Jun 08 21:13:47.730375 ip-10-0-135-79 systemd[1]: Starting Kubernetes Kubelet... Jun 08 21:13:48.175383 ip-10-0-135-79 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 21:13:48.175383 ip-10-0-135-79 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 21:13:48.175383 ip-10-0-135-79 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 21:13:48.175383 ip-10-0-135-79 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 21:13:48.175383 ip-10-0-135-79 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 21:13:48.177446 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.177355 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 21:13:48.184138 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184115 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 21:13:48.184138 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184132 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 21:13:48.184138 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184137 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 21:13:48.184138 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184140 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 21:13:48.184138 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184143 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 08 21:13:48.184138 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184146 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 21:13:48.184360 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184151 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 21:13:48.184360 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184155 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 21:13:48.184360 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184158 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 21:13:48.184360 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184160 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 21:13:48.184360 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184163 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 21:13:48.184360 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184165 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 21:13:48.184360 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184168 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 21:13:48.184360 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184170 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 21:13:48.184360 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184173 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 21:13:48.184360 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184176 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 21:13:48.184360 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184178 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 21:13:48.184360 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184181 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 21:13:48.184360 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184184 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 21:13:48.184360 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184187 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 21:13:48.184360 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184189 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 21:13:48.184360 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184192 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 21:13:48.184360 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184194 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 21:13:48.184360 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184196 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 21:13:48.184360 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184199 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 21:13:48.184821 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184203 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 21:13:48.184821 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184207 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 21:13:48.184821 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184210 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 21:13:48.184821 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184213 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 21:13:48.184821 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184215 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 21:13:48.184821 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184218 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 21:13:48.184821 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184220 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 21:13:48.184821 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184223 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 21:13:48.184821 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184226 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 21:13:48.184821 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184229 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 21:13:48.184821 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184232 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 21:13:48.184821 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184234 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 21:13:48.184821 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184237 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 21:13:48.184821 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184239 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 21:13:48.184821 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184243 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 21:13:48.184821 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184246 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 21:13:48.184821 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184249 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 21:13:48.184821 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184252 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 21:13:48.184821 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184255 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 21:13:48.185320 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184257 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 21:13:48.185320 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184260 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 21:13:48.185320 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184263 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 21:13:48.185320 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184265 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 21:13:48.185320 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184268 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 21:13:48.185320 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184270 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 21:13:48.185320 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184273 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 21:13:48.185320 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184276 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 21:13:48.185320 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184279 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 21:13:48.185320 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184281 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 21:13:48.185320 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184283 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 21:13:48.185320 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184286 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 21:13:48.185320 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184288 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 21:13:48.185320 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184292 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 21:13:48.185320 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184296 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 21:13:48.185320 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184299 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 21:13:48.185320 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184301 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 21:13:48.185320 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184304 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 21:13:48.185320 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184307 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 21:13:48.185320 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184309 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 21:13:48.185817 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184312 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 21:13:48.185817 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184314 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 21:13:48.185817 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184317 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 21:13:48.185817 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184319 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 21:13:48.185817 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184323 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 21:13:48.185817 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184325 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 21:13:48.185817 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184328 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 21:13:48.185817 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184331 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 21:13:48.185817 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184334 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 21:13:48.185817 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184337 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 21:13:48.185817 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184339 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 21:13:48.185817 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184342 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 21:13:48.185817 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184345 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 21:13:48.185817 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184347 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 21:13:48.185817 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184350 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 21:13:48.185817 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184353 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 21:13:48.185817 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184355 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 21:13:48.185817 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184358 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 21:13:48.185817 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184360 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 21:13:48.185817 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184363 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 21:13:48.186352 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184366 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 21:13:48.186352 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184369 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 21:13:48.186352 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184371 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 21:13:48.186352 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184374 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 21:13:48.186352 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184377 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 21:13:48.186352 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184379 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 21:13:48.186352 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184382 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 21:13:48.186352 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184384 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 21:13:48.186352 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184387 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 21:13:48.186352 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184389 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 21:13:48.186352 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184392 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 21:13:48.186352 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184394 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 21:13:48.186352 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184397 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 21:13:48.186352 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184399 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 21:13:48.186352 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.184402 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 21:13:48.186352 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185136 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 21:13:48.186352 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185144 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 21:13:48.186352 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185148 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 21:13:48.186352 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185151 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 21:13:48.186352 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185155 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 21:13:48.186871 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185158 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 21:13:48.186871 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185161 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 21:13:48.186871 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185164 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 21:13:48.186871 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185167 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 21:13:48.186871 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185169 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 21:13:48.186871 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185172 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 21:13:48.186871 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185175 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 21:13:48.186871 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185177 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 21:13:48.186871 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185179 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 21:13:48.186871 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185182 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 21:13:48.186871 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185184 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 21:13:48.186871 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185187 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 21:13:48.186871 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185190 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 21:13:48.186871 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185194 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 21:13:48.186871 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185196 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 21:13:48.186871 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185199 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 21:13:48.186871 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185201 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 21:13:48.186871 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185204 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 21:13:48.186871 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185206 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 21:13:48.186871 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185209 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 21:13:48.187386 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185211 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 21:13:48.187386 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185214 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 21:13:48.187386 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185216 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 21:13:48.187386 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185219 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 21:13:48.187386 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185221 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 21:13:48.187386 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185224 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 21:13:48.187386 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185227 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 21:13:48.187386 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185230 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 21:13:48.187386 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185232 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 21:13:48.187386 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185235 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 21:13:48.187386 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185238 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 21:13:48.187386 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185241 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 21:13:48.187386 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185243 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 21:13:48.187386 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185248 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 21:13:48.187386 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185252 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 21:13:48.187386 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185255 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 21:13:48.187386 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185257 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 21:13:48.187386 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185260 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 21:13:48.187386 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185263 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 21:13:48.187888 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185266 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 21:13:48.187888 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185268 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 21:13:48.187888 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185271 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 21:13:48.187888 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185274 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 21:13:48.187888 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185277 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 21:13:48.187888 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185279 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 21:13:48.187888 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185282 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 21:13:48.187888 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185285 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 21:13:48.187888 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185287 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 21:13:48.187888 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185290 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 21:13:48.187888 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185293 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 21:13:48.187888 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185296 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 21:13:48.187888 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185298 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 21:13:48.187888 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185301 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 21:13:48.187888 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185303 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 21:13:48.187888 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185306 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 21:13:48.187888 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185308 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 21:13:48.187888 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185310 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 21:13:48.187888 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185313 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 08 21:13:48.187888 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185315 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 21:13:48.188424 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185317 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 21:13:48.188424 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185320 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 21:13:48.188424 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185324 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 21:13:48.188424 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185327 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 21:13:48.188424 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185330 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 21:13:48.188424 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185333 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 21:13:48.188424 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185335 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 21:13:48.188424 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185338 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 21:13:48.188424 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185341 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 21:13:48.188424 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185343 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 21:13:48.188424 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185346 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 21:13:48.188424 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185348 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 21:13:48.188424 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185350 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 21:13:48.188424 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185354 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 21:13:48.188424 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185357 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 21:13:48.188424 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185360 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 21:13:48.188424 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185362 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 21:13:48.188424 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185365 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 21:13:48.188424 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185367 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 21:13:48.188424 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185370 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 21:13:48.188914 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185373 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 21:13:48.188914 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185375 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 21:13:48.188914 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185377 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 21:13:48.188914 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185382 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 21:13:48.188914 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185385 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 21:13:48.188914 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185388 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 21:13:48.188914 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185391 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 21:13:48.188914 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185394 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 21:13:48.188914 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185397 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 21:13:48.188914 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185400 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 21:13:48.188914 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185402 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 21:13:48.188914 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185405 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 21:13:48.188914 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185407 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 21:13:48.188914 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185410 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 21:13:48.188914 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185412 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 21:13:48.188914 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185783 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 21:13:48.188914 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185788 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 21:13:48.188914 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185791 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 21:13:48.188914 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185794 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 21:13:48.189390 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185796 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 21:13:48.189390 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185799 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 21:13:48.189390 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185801 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 21:13:48.189390 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185804 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 21:13:48.189390 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185807 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 21:13:48.189390 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185809 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 21:13:48.189390 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185811 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 21:13:48.189390 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185814 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 21:13:48.189390 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185819 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 21:13:48.189390 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185822 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 21:13:48.189390 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185825 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 21:13:48.189390 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185829 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 21:13:48.189390 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185834 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 21:13:48.189390 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185839 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 21:13:48.189390 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185843 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 21:13:48.189390 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185845 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 21:13:48.189390 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185848 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 21:13:48.189390 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185850 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 21:13:48.189390 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185853 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 21:13:48.189874 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185856 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 21:13:48.189874 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185858 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 21:13:48.189874 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185861 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 21:13:48.189874 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185863 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 21:13:48.189874 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185866 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 21:13:48.189874 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185868 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 21:13:48.189874 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185871 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 21:13:48.189874 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185874 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 21:13:48.189874 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185876 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 21:13:48.189874 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185879 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 21:13:48.189874 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185882 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 21:13:48.189874 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185885 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 21:13:48.189874 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185887 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 21:13:48.189874 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185889 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 21:13:48.189874 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185892 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 21:13:48.189874 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185894 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 21:13:48.189874 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185908 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 21:13:48.189874 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185912 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 21:13:48.189874 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185915 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 21:13:48.190350 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185918 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 21:13:48.190350 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185921 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 21:13:48.190350 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185924 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 21:13:48.190350 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185927 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 21:13:48.190350 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185930 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 21:13:48.190350 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185932 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 21:13:48.190350 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185935 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 21:13:48.190350 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185938 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 21:13:48.190350 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185941 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 21:13:48.190350 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185943 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 21:13:48.190350 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185945 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 21:13:48.190350 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185949 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 21:13:48.190350 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185952 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 21:13:48.190350 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185955 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 21:13:48.190350 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185957 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 21:13:48.190350 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185960 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 21:13:48.190350 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185962 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 21:13:48.190350 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185964 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 21:13:48.190350 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185967 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 21:13:48.190350 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185969 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 21:13:48.190832 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185972 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 21:13:48.190832 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185974 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 21:13:48.190832 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185976 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 21:13:48.190832 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185979 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 21:13:48.190832 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185982 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 21:13:48.190832 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185984 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 21:13:48.190832 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185987 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 21:13:48.190832 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185989 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 21:13:48.190832 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185992 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 21:13:48.190832 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185995 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 21:13:48.190832 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.185997 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 21:13:48.190832 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186000 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 21:13:48.190832 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186002 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 21:13:48.190832 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186004 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 21:13:48.190832 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186007 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 21:13:48.190832 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186010 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 21:13:48.190832 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186012 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 21:13:48.190832 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186015 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 21:13:48.190832 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186017 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 21:13:48.190832 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186020 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 21:13:48.191374 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186023 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 21:13:48.191374 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186025 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 21:13:48.191374 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186028 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 21:13:48.191374 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186030 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 21:13:48.191374 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186033 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 21:13:48.191374 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186035 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 21:13:48.191374 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186038 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 21:13:48.191374 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186041 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 21:13:48.191374 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186043 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 21:13:48.191374 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186046 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 21:13:48.191374 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186048 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 21:13:48.191374 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186050 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 08 21:13:48.191374 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186053 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 21:13:48.191374 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186055 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 21:13:48.191374 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186058 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 21:13:48.191374 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186060 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 21:13:48.191374 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186078 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 21:13:48.191374 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186154 2564 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 21:13:48.191374 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186161 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 21:13:48.191374 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186168 2564 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 21:13:48.191860 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186173 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 21:13:48.191860 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186176 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 21:13:48.191860 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186180 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 21:13:48.191860 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186184 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 21:13:48.191860 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186188 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 21:13:48.191860 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186191 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 21:13:48.191860 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186194 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 21:13:48.191860 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186198 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 21:13:48.191860 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186201 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 21:13:48.191860 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186204 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 21:13:48.191860 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186207 2564 flags.go:64] FLAG: --cgroup-root="" Jun 08 21:13:48.191860 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186210 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 21:13:48.191860 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186213 2564 flags.go:64] FLAG: --client-ca-file="" Jun 08 21:13:48.191860 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186219 2564 flags.go:64] FLAG: --cloud-provider="external" Jun 08 21:13:48.191860 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186222 2564 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 21:13:48.191860 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186226 2564 flags.go:64] FLAG: --cluster-domain="" Jun 08 21:13:48.191860 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186229 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 21:13:48.191860 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186232 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 21:13:48.191860 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186235 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 21:13:48.191860 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186238 2564 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 21:13:48.191860 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186242 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 21:13:48.191860 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186244 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 21:13:48.191860 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186247 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 21:13:48.192437 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186251 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 21:13:48.192437 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186253 2564 flags.go:64] FLAG: --contention-profiling="false" Jun 08 21:13:48.192437 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186256 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 21:13:48.192437 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186259 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 21:13:48.192437 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186262 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 21:13:48.192437 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186265 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 21:13:48.192437 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186270 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 21:13:48.192437 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186272 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 21:13:48.192437 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186275 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 21:13:48.192437 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186278 2564 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 21:13:48.192437 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186281 2564 flags.go:64] FLAG: --enable-server="true" Jun 08 21:13:48.192437 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186283 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 21:13:48.192437 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186288 2564 flags.go:64] FLAG: --event-burst="100" Jun 08 21:13:48.192437 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186291 2564 flags.go:64] FLAG: --event-qps="50" Jun 08 21:13:48.192437 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186294 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 21:13:48.192437 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186297 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 21:13:48.192437 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186300 2564 flags.go:64] FLAG: --eviction-hard="" Jun 08 21:13:48.192437 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186307 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 21:13:48.192437 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186310 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 21:13:48.192437 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186313 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 21:13:48.192437 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186317 2564 flags.go:64] FLAG: --eviction-soft="" Jun 08 21:13:48.192437 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186319 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 21:13:48.192437 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186322 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 21:13:48.192437 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186325 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 21:13:48.192437 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186328 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 21:13:48.193162 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186331 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 21:13:48.193162 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186334 2564 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 21:13:48.193162 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186337 2564 flags.go:64] FLAG: --feature-gates="" Jun 08 21:13:48.193162 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186340 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 21:13:48.193162 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186343 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 21:13:48.193162 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186346 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 21:13:48.193162 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186349 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 21:13:48.193162 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186351 2564 flags.go:64] FLAG: --healthz-port="10248" Jun 08 21:13:48.193162 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186354 2564 flags.go:64] FLAG: --help="false" Jun 08 21:13:48.193162 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186357 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-135-79.ec2.internal" Jun 08 21:13:48.193162 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186360 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 21:13:48.193162 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186366 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 21:13:48.193162 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186369 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 21:13:48.193162 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186372 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 21:13:48.193162 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186375 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 21:13:48.193162 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186378 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 21:13:48.193162 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186381 2564 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 21:13:48.193162 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186383 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 21:13:48.193162 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186386 2564 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 21:13:48.193162 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186389 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 21:13:48.193162 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186392 2564 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 21:13:48.193162 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186395 2564 flags.go:64] FLAG: --kube-reserved="" Jun 08 21:13:48.193162 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186399 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 21:13:48.193162 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186401 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 21:13:48.193741 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186404 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 21:13:48.193741 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186407 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 21:13:48.193741 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186410 2564 flags.go:64] FLAG: --lock-file="" Jun 08 21:13:48.193741 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186413 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 21:13:48.193741 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186416 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 21:13:48.193741 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186418 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 21:13:48.193741 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186423 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 21:13:48.193741 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186427 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 21:13:48.193741 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186430 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 21:13:48.193741 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186432 2564 flags.go:64] FLAG: --logging-format="text" Jun 08 21:13:48.193741 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186435 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 21:13:48.193741 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186438 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 21:13:48.193741 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186441 2564 flags.go:64] FLAG: --manifest-url="" Jun 08 21:13:48.193741 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186444 2564 flags.go:64] FLAG: --manifest-url-header="" Jun 08 21:13:48.193741 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186447 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 21:13:48.193741 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186450 2564 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 21:13:48.193741 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186454 2564 flags.go:64] FLAG: --max-pods="110" Jun 08 21:13:48.193741 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186457 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 21:13:48.193741 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186460 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 21:13:48.193741 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186464 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 21:13:48.193741 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186467 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 21:13:48.193741 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186470 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 21:13:48.193741 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186473 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 21:13:48.193741 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186476 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 21:13:48.193741 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186482 2564 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 21:13:48.194428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186485 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 21:13:48.194428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186488 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 21:13:48.194428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186491 2564 flags.go:64] FLAG: --pod-cidr="" Jun 08 21:13:48.194428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186494 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 21:13:48.194428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186499 2564 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 21:13:48.194428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186503 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 21:13:48.194428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186509 2564 flags.go:64] FLAG: --pods-per-core="0" Jun 08 21:13:48.194428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186512 2564 flags.go:64] FLAG: --port="10250" Jun 08 21:13:48.194428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186515 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 21:13:48.194428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186517 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-002f39ba10d5be2af" Jun 08 21:13:48.194428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186520 2564 flags.go:64] FLAG: --qos-reserved="" Jun 08 21:13:48.194428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186523 2564 flags.go:64] FLAG: --read-only-port="10255" Jun 08 21:13:48.194428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186526 2564 flags.go:64] FLAG: --register-node="true" Jun 08 21:13:48.194428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186529 2564 flags.go:64] FLAG: --register-with-taints="" Jun 08 21:13:48.194428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186532 2564 flags.go:64] FLAG: --registry-burst="10" Jun 08 21:13:48.194428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186535 2564 flags.go:64] FLAG: --registry-qps="5" Jun 08 21:13:48.194428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186538 2564 flags.go:64] FLAG: --reserved-cpus="" Jun 08 21:13:48.194428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186541 2564 flags.go:64] FLAG: --reserved-memory="" Jun 08 21:13:48.194428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186544 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 21:13:48.194428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186547 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 21:13:48.194428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186550 2564 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 21:13:48.194428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186553 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 21:13:48.194428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186555 2564 flags.go:64] FLAG: --runonce="false" Jun 08 21:13:48.194428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186558 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 21:13:48.194428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186561 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 21:13:48.195096 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186564 2564 flags.go:64] FLAG: --seccomp-default="false" Jun 08 21:13:48.195096 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186568 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 21:13:48.195096 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186571 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 21:13:48.195096 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186573 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 21:13:48.195096 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186576 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 21:13:48.195096 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186579 2564 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 21:13:48.195096 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186582 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 21:13:48.195096 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186585 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 21:13:48.195096 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186587 2564 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 21:13:48.195096 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186590 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 21:13:48.195096 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186593 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 21:13:48.195096 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186595 2564 flags.go:64] FLAG: --system-cgroups="" Jun 08 21:13:48.195096 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186598 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 21:13:48.195096 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186606 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 21:13:48.195096 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186609 2564 flags.go:64] FLAG: --tls-cert-file="" Jun 08 21:13:48.195096 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186612 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 21:13:48.195096 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186616 2564 flags.go:64] FLAG: --tls-min-version="" Jun 08 21:13:48.195096 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186619 2564 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 21:13:48.195096 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186621 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 21:13:48.195096 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186624 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 21:13:48.195096 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186627 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 21:13:48.195096 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186630 2564 flags.go:64] FLAG: --v="2" Jun 08 21:13:48.195096 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186634 2564 flags.go:64] FLAG: --version="false" Jun 08 21:13:48.195096 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186639 2564 flags.go:64] FLAG: --vmodule="" Jun 08 21:13:48.195096 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186642 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 21:13:48.195725 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.186646 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 21:13:48.195725 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186759 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 21:13:48.195725 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186763 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 21:13:48.195725 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186766 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 21:13:48.195725 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186769 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 21:13:48.195725 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186771 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 21:13:48.195725 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186774 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 21:13:48.195725 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186777 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 21:13:48.195725 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186781 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 21:13:48.195725 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186783 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 21:13:48.195725 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186787 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 21:13:48.195725 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186791 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 21:13:48.195725 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186795 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 21:13:48.195725 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186798 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 21:13:48.195725 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186800 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 21:13:48.195725 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186804 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 21:13:48.195725 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186806 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 21:13:48.195725 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186809 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 21:13:48.195725 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186812 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 21:13:48.196252 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186816 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 21:13:48.196252 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186820 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 21:13:48.196252 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186822 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 21:13:48.196252 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186825 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 21:13:48.196252 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186827 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 21:13:48.196252 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186830 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 21:13:48.196252 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186832 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 21:13:48.196252 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186835 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 21:13:48.196252 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186838 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 21:13:48.196252 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186840 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 21:13:48.196252 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186843 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 21:13:48.196252 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186845 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 21:13:48.196252 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186848 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 21:13:48.196252 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186851 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 21:13:48.196252 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186854 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 21:13:48.196252 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186856 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 21:13:48.196252 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186858 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 21:13:48.196252 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186861 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 21:13:48.196252 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186863 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 21:13:48.196252 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186865 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 21:13:48.196746 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186868 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 21:13:48.196746 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186871 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 21:13:48.196746 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186874 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 21:13:48.196746 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186877 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 21:13:48.196746 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186880 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 21:13:48.196746 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186883 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 21:13:48.196746 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186886 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 21:13:48.196746 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186888 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 21:13:48.196746 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186890 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 21:13:48.196746 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186893 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 21:13:48.196746 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186895 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 21:13:48.196746 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186897 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 21:13:48.196746 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186900 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 21:13:48.196746 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186904 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 21:13:48.196746 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186906 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 21:13:48.196746 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186908 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 21:13:48.196746 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186911 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 21:13:48.196746 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186913 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 21:13:48.196746 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186916 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 21:13:48.197306 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186920 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 21:13:48.197306 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186923 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 21:13:48.197306 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186926 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 21:13:48.197306 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186929 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 21:13:48.197306 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186931 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 21:13:48.197306 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186934 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 21:13:48.197306 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186937 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 21:13:48.197306 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186940 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 21:13:48.197306 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186942 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 21:13:48.197306 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186945 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 21:13:48.197306 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186947 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 21:13:48.197306 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186949 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 21:13:48.197306 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186952 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 21:13:48.197306 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186954 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 21:13:48.197306 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186958 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 21:13:48.197306 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186960 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 21:13:48.197306 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186963 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 21:13:48.197306 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186965 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 21:13:48.197306 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186968 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 21:13:48.197796 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186970 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 21:13:48.197796 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186972 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 21:13:48.197796 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186975 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 21:13:48.197796 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186977 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 21:13:48.197796 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186980 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 21:13:48.197796 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186982 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 21:13:48.197796 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186985 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 21:13:48.197796 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186988 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 21:13:48.197796 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186991 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 21:13:48.197796 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186993 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 21:13:48.197796 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186996 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 21:13:48.197796 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.186998 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 21:13:48.197796 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.187001 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 08 21:13:48.197796 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.187003 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 21:13:48.197796 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.187006 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 21:13:48.197796 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.187008 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 21:13:48.197796 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.187011 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 21:13:48.197796 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.187013 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 21:13:48.197796 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.187016 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 21:13:48.197796 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.187018 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 21:13:48.198312 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.187021 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 21:13:48.198312 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.187024 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 21:13:48.198312 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.187027 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 21:13:48.198312 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.187035 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 21:13:48.198312 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.194374 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 21:13:48.198312 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.194389 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 21:13:48.198312 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.194404 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 21:13:48.198312 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.194414 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 21:13:48.198312 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194470 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 21:13:48.198312 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194476 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 21:13:48.198312 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194479 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 21:13:48.198312 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194482 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 21:13:48.198312 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194486 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 21:13:48.198312 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194489 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 21:13:48.198664 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194491 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 21:13:48.198664 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194494 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 21:13:48.198664 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194496 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 21:13:48.198664 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194499 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 21:13:48.198664 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194502 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 21:13:48.198664 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194504 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 21:13:48.198664 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194507 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 08 21:13:48.198664 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194509 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 21:13:48.198664 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194512 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 21:13:48.198664 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194514 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 21:13:48.198664 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194517 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 21:13:48.198664 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194520 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 21:13:48.198664 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194522 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 21:13:48.198664 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194525 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 21:13:48.198664 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194527 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 21:13:48.198664 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194530 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 21:13:48.198664 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194533 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 21:13:48.198664 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194535 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 21:13:48.198664 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194537 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 21:13:48.198664 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194540 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 21:13:48.199169 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194543 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 21:13:48.199169 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194546 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 21:13:48.199169 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194548 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 21:13:48.199169 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194552 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 21:13:48.199169 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194554 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 21:13:48.199169 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194557 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 21:13:48.199169 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194559 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 21:13:48.199169 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194562 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 21:13:48.199169 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194564 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 21:13:48.199169 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194567 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 21:13:48.199169 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194569 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 21:13:48.199169 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194572 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 21:13:48.199169 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194574 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 21:13:48.199169 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194577 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 21:13:48.199169 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194579 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 21:13:48.199169 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194582 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 21:13:48.199169 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194584 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 21:13:48.199169 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194587 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 21:13:48.199169 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194589 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 21:13:48.199169 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194592 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 21:13:48.199679 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194595 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 21:13:48.199679 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194597 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 21:13:48.199679 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194600 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 21:13:48.199679 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194603 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 21:13:48.199679 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194605 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 21:13:48.199679 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194608 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 21:13:48.199679 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194610 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 21:13:48.199679 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194613 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 21:13:48.199679 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194617 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 21:13:48.199679 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194620 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 21:13:48.199679 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194623 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 21:13:48.199679 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194627 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 21:13:48.199679 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194630 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 21:13:48.199679 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194633 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 21:13:48.199679 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194636 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 21:13:48.199679 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194640 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 21:13:48.199679 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194643 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 21:13:48.199679 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194645 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 21:13:48.199679 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194648 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 21:13:48.200186 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194651 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 21:13:48.200186 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194653 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 21:13:48.200186 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194655 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 21:13:48.200186 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194658 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 21:13:48.200186 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194660 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 21:13:48.200186 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194663 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 21:13:48.200186 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194665 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 21:13:48.200186 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194668 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 21:13:48.200186 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194670 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 21:13:48.200186 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194672 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 21:13:48.200186 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194675 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 21:13:48.200186 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194677 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 21:13:48.200186 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194680 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 21:13:48.200186 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194682 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 21:13:48.200186 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194685 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 21:13:48.200186 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194688 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 21:13:48.200186 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194691 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 21:13:48.200186 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194694 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 21:13:48.200186 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194696 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 21:13:48.200186 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194699 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 21:13:48.200695 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194702 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 21:13:48.200695 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194704 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 21:13:48.200695 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194706 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 21:13:48.200695 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194709 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 21:13:48.200695 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194711 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 21:13:48.200695 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194714 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 21:13:48.200695 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194716 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 21:13:48.200695 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194719 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 21:13:48.200695 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194721 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 21:13:48.200695 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194724 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 21:13:48.200695 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194727 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 21:13:48.200695 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194730 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 21:13:48.200695 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194732 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 21:13:48.200695 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194736 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 21:13:48.200695 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.194741 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 21:13:48.201151 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194856 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 21:13:48.201151 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194861 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 21:13:48.201151 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194863 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 21:13:48.201151 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194866 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 21:13:48.201151 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194869 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 21:13:48.201151 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194872 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 21:13:48.201151 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194874 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 21:13:48.201151 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194877 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 21:13:48.201151 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194879 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 21:13:48.201151 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194881 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 21:13:48.201151 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194884 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 21:13:48.201151 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194887 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 21:13:48.201151 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194889 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 21:13:48.201151 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194893 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 21:13:48.201151 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194895 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 21:13:48.201151 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194898 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 21:13:48.201151 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194900 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 21:13:48.201151 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194902 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 21:13:48.201151 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194905 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 21:13:48.201151 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194907 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 21:13:48.201151 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194910 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 21:13:48.201651 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194912 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 21:13:48.201651 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194915 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 21:13:48.201651 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194917 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 21:13:48.201651 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194920 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 21:13:48.201651 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194923 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 21:13:48.201651 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194925 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 21:13:48.201651 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194928 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 21:13:48.201651 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194932 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 21:13:48.201651 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194935 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 21:13:48.201651 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194938 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 08 21:13:48.201651 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194940 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 21:13:48.201651 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194943 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 21:13:48.201651 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194945 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 21:13:48.201651 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194947 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 21:13:48.201651 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194949 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 21:13:48.201651 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194952 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 21:13:48.201651 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194954 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 21:13:48.201651 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194957 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 21:13:48.201651 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194959 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 21:13:48.202150 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194961 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 21:13:48.202150 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194964 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 21:13:48.202150 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194967 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 21:13:48.202150 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194969 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 21:13:48.202150 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194971 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 21:13:48.202150 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194974 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 21:13:48.202150 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194977 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 21:13:48.202150 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194980 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 21:13:48.202150 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194982 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 21:13:48.202150 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194984 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 21:13:48.202150 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194987 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 21:13:48.202150 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194989 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 21:13:48.202150 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194991 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 21:13:48.202150 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194994 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 21:13:48.202150 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194996 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 21:13:48.202150 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.194999 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 21:13:48.202150 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195001 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 21:13:48.202150 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195004 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 21:13:48.202150 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195006 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 21:13:48.202603 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195009 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 21:13:48.202603 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195011 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 21:13:48.202603 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195014 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 21:13:48.202603 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195017 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 21:13:48.202603 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195020 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 21:13:48.202603 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195023 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 21:13:48.202603 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195026 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 21:13:48.202603 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195029 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 21:13:48.202603 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195031 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 21:13:48.202603 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195034 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 21:13:48.202603 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195037 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 21:13:48.202603 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195040 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 21:13:48.202603 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195043 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 21:13:48.202603 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195045 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 21:13:48.202603 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195048 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 21:13:48.202603 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195050 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 21:13:48.202603 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195052 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 21:13:48.202603 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195055 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 21:13:48.202603 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195058 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 21:13:48.203083 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195061 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 21:13:48.203083 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195077 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 21:13:48.203083 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195080 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 21:13:48.203083 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195083 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 21:13:48.203083 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195085 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 21:13:48.203083 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195088 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 21:13:48.203083 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195090 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 21:13:48.203083 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195093 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 21:13:48.203083 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195095 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 21:13:48.203083 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195098 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 21:13:48.203083 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195100 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 21:13:48.203083 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195103 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 21:13:48.203083 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195106 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 21:13:48.203083 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195108 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 21:13:48.203083 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195111 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 21:13:48.203083 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195113 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 21:13:48.203083 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195116 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 21:13:48.203083 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195119 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 21:13:48.203083 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195122 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 21:13:48.203083 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195124 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 21:13:48.203576 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:48.195127 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 21:13:48.203576 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.195132 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 21:13:48.203576 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.195236 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 21:13:48.203576 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.197716 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 21:13:48.203576 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.200751 2564 server.go:1019] "Starting client certificate rotation" Jun 08 21:13:48.203576 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.200852 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 21:13:48.203576 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.201820 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 21:13:48.204179 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.204161 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 21:13:48.209721 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.209696 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 21:13:48.219764 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.219744 2564 log.go:25] "Validated CRI v1 runtime API" Jun 08 21:13:48.223148 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.223124 2564 log.go:25] "Validated CRI v1 image API" Jun 08 21:13:48.224907 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.224885 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 21:13:48.227646 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.227624 2564 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 82068b18-98eb-40af-858f-97ac6cb58c86:/dev/nvme0n1p3 9b849e78-d12a-4859-9585-eb5120db9803:/dev/nvme0n1p4] Jun 08 21:13:48.227743 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.227645 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 21:13:48.231885 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.231774 2564 manager.go:216] Machine: {Timestamp:2026-06-08 21:13:48.231314041 +0000 UTC m=+0.371356913 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096440 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a48a5c0d2bb885a940838518f76a8 SystemUUID:ec2a48a5-c0d2-bb88-5a94-0838518f76a8 BootID:b178158e-07e8-43fe-a017-330b5fc14cca Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d6:8b:1a:59:61 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d6:8b:1a:59:61 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:92:83:c6:c0:52 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 21:13:48.231885 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.231882 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 21:13:48.231996 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.231987 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 21:13:48.232998 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.232982 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 21:13:48.235590 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.235566 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 21:13:48.235728 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.235592 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-79.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 21:13:48.236424 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.236413 2564 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 21:13:48.236460 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.236426 2564 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 21:13:48.236460 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.236438 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 21:13:48.236460 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.236453 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 21:13:48.237701 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.237692 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 21:13:48.242021 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.242005 2564 state_mem.go:36] "Initialized new in-memory state store" Jun 08 21:13:48.242169 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.242159 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 21:13:48.242204 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.242189 2564 kubelet.go:486] "Attempting to sync node with API server" Jun 08 21:13:48.242232 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.242206 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 21:13:48.242232 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.242225 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 21:13:48.242298 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.242236 2564 kubelet.go:398] "Adding apiserver pod source" Jun 08 21:13:48.242298 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.242250 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 21:13:48.242684 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.242671 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 21:13:48.242721 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.242690 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 21:13:48.247968 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.247951 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 21:13:48.249661 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.249648 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 21:13:48.249727 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.249678 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 21:13:48.251567 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.251553 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 21:13:48.251616 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.251572 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 21:13:48.251616 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.251578 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 21:13:48.251616 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.251584 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 21:13:48.251616 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.251593 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 21:13:48.251616 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.251598 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 21:13:48.251616 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.251607 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 21:13:48.251616 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.251613 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 21:13:48.251798 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.251620 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 21:13:48.251798 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.251637 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 21:13:48.251798 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.251649 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 21:13:48.251798 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.251658 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 21:13:48.251798 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.251684 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 21:13:48.251798 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.251690 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 21:13:48.255259 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.255227 2564 server.go:1268] "Started kubelet" Jun 08 21:13:48.255904 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.255856 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 21:13:48.256223 ip-10-0-135-79 systemd[1]: Started Kubernetes Kubelet. Jun 08 21:13:48.256842 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.256327 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 21:13:48.256842 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.256397 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 21:13:48.258660 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.258489 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 21:13:48.259352 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.259335 2564 server.go:310] "Adding debug handlers to kubelet server" Jun 08 21:13:48.260558 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:48.260526 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 21:13:48.260652 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:48.260598 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-79.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 21:13:48.260701 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.260685 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-79.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 21:13:48.263756 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:48.263720 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 21:13:48.267342 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.267324 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 21:13:48.267441 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.267339 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 21:13:48.267501 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:48.267461 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-79.ec2.internal\" not found" Jun 08 21:13:48.268187 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.268107 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 21:13:48.268187 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.268128 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 21:13:48.268429 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.268245 2564 reconstruct.go:97] "Volume reconstruction finished" Jun 08 21:13:48.268429 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.268256 2564 reconciler.go:29] "Reconciler: start to sync state" Jun 08 21:13:48.268429 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.268328 2564 factory.go:153] Registering CRI-O factory Jun 08 21:13:48.268429 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.268339 2564 factory.go:223] Registration of the crio container factory successfully Jun 08 21:13:48.268429 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.268419 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 21:13:48.268429 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.268426 2564 factory.go:55] Registering systemd factory Jun 08 21:13:48.268429 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.268434 2564 factory.go:223] Registration of the systemd container factory successfully Jun 08 21:13:48.268722 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.268450 2564 factory.go:103] Registering Raw factory Jun 08 21:13:48.268722 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.268459 2564 manager.go:1196] Started watching for new ooms in manager Jun 08 21:13:48.268820 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.268753 2564 manager.go:349] Starting recovery of all containers Jun 08 21:13:48.272104 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.271591 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 21:13:48.277449 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.277432 2564 manager.go:354] Recovery completed Jun 08 21:13:48.277909 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:48.277875 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 08 21:13:48.278142 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:48.278114 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-79.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 08 21:13:48.279233 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:48.277947 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-79.ec2.internal.18b7378673bc6f72 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-79.ec2.internal,UID:ip-10-0-135-79.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-79.ec2.internal,},FirstTimestamp:2026-06-08 21:13:48.255194994 +0000 UTC m=+0.395237867,LastTimestamp:2026-06-08 21:13:48.255194994 +0000 UTC m=+0.395237867,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-79.ec2.internal,}" Jun 08 21:13:48.280850 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.280829 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-42f2d" Jun 08 21:13:48.281651 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.281635 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:13:48.283713 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.283698 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-79.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:13:48.283794 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.283724 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-79.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:13:48.283794 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.283736 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-79.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:13:48.284278 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.284262 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 21:13:48.284278 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.284276 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 21:13:48.284417 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.284286 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:13:48.284417 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.284292 2564 state_mem.go:36] "Initialized new in-memory state store" Jun 08 21:13:48.284929 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.284914 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-79.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:13:48.284984 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.284941 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-79.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:13:48.284984 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.284951 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-79.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:13:48.286295 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.286281 2564 policy_none.go:49] "None policy: Start" Jun 08 21:13:48.286352 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.286299 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 21:13:48.286352 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.286309 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 21:13:48.287804 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.287787 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-42f2d" Jun 08 21:13:48.287867 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.287857 2564 policy_none.go:47] "Start" Jun 08 21:13:48.325685 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.325668 2564 manager.go:337] "Starting Device Plugin manager" Jun 08 21:13:48.350453 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:48.325739 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 21:13:48.350453 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.325749 2564 server.go:87] "Starting device plugin registration server" Jun 08 21:13:48.350453 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.325957 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 21:13:48.350453 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.325966 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 21:13:48.350453 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.326082 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 21:13:48.350453 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.326176 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 21:13:48.350453 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.326183 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 21:13:48.350453 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:48.326663 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 21:13:48.350453 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:48.326705 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-79.ec2.internal\" not found" Jun 08 21:13:48.350453 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.339317 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 21:13:48.350453 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.340642 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 21:13:48.350453 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.340672 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 21:13:48.350453 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.340690 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 21:13:48.350453 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:48.340721 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 08 21:13:48.350453 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.342969 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 21:13:48.426382 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.426299 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:13:48.427338 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.427319 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-79.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:13:48.427423 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.427353 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-79.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:13:48.427423 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.427363 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-79.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:13:48.427423 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.427390 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-79.ec2.internal" Jun 08 21:13:48.439330 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.439310 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-79.ec2.internal" Jun 08 21:13:48.439430 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:48.439339 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-79.ec2.internal\": node \"ip-10-0-135-79.ec2.internal\" not found" Jun 08 21:13:48.441458 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.441440 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-79.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-79.ec2.internal"] Jun 08 21:13:48.441514 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.441505 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:13:48.442353 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.442335 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-79.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:13:48.442420 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.442365 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-79.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:13:48.442420 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.442381 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-79.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:13:48.445013 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.445000 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:13:48.445139 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.445126 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-79.ec2.internal" Jun 08 21:13:48.445185 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.445161 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:13:48.445677 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.445660 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-79.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:13:48.445754 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.445688 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-79.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:13:48.445754 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.445703 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-79.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:13:48.445754 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.445687 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-79.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:13:48.445754 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.445743 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-79.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:13:48.445931 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.445758 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-79.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:13:48.448581 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.448565 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-79.ec2.internal" Jun 08 21:13:48.448664 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.448595 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:13:48.449289 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.449275 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-79.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:13:48.449355 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.449305 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-79.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:13:48.449355 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.449320 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-79.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:13:48.466407 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:48.466381 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-79.ec2.internal\" not found" Jun 08 21:13:48.471677 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:48.471664 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-79.ec2.internal\" not found" node="ip-10-0-135-79.ec2.internal" Jun 08 21:13:48.476046 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:48.476030 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-79.ec2.internal\" not found" node="ip-10-0-135-79.ec2.internal" Jun 08 21:13:48.566901 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:48.566865 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-79.ec2.internal\" not found" Jun 08 21:13:48.570194 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.570175 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8d2f4ab0296ea13816c307edf2a2d2c0-config\") pod \"kube-apiserver-proxy-ip-10-0-135-79.ec2.internal\" (UID: \"8d2f4ab0296ea13816c307edf2a2d2c0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-79.ec2.internal" Jun 08 21:13:48.570265 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.570203 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e761856f3e5ce01ff1b2fb776f5e563c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-79.ec2.internal\" (UID: \"e761856f3e5ce01ff1b2fb776f5e563c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-79.ec2.internal" Jun 08 21:13:48.570265 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.570220 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e761856f3e5ce01ff1b2fb776f5e563c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-79.ec2.internal\" (UID: \"e761856f3e5ce01ff1b2fb776f5e563c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-79.ec2.internal" Jun 08 21:13:48.667499 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:48.667468 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-79.ec2.internal\" not found" Jun 08 21:13:48.670665 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.670643 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e761856f3e5ce01ff1b2fb776f5e563c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-79.ec2.internal\" (UID: \"e761856f3e5ce01ff1b2fb776f5e563c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-79.ec2.internal" Jun 08 21:13:48.670746 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.670684 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8d2f4ab0296ea13816c307edf2a2d2c0-config\") pod \"kube-apiserver-proxy-ip-10-0-135-79.ec2.internal\" (UID: \"8d2f4ab0296ea13816c307edf2a2d2c0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-79.ec2.internal" Jun 08 21:13:48.670746 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.670712 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e761856f3e5ce01ff1b2fb776f5e563c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-79.ec2.internal\" (UID: \"e761856f3e5ce01ff1b2fb776f5e563c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-79.ec2.internal" Jun 08 21:13:48.670837 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.670747 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e761856f3e5ce01ff1b2fb776f5e563c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-79.ec2.internal\" (UID: \"e761856f3e5ce01ff1b2fb776f5e563c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-79.ec2.internal" Jun 08 21:13:48.670837 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.670756 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8d2f4ab0296ea13816c307edf2a2d2c0-config\") pod \"kube-apiserver-proxy-ip-10-0-135-79.ec2.internal\" (UID: \"8d2f4ab0296ea13816c307edf2a2d2c0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-79.ec2.internal" Jun 08 21:13:48.670837 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.670764 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e761856f3e5ce01ff1b2fb776f5e563c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-79.ec2.internal\" (UID: \"e761856f3e5ce01ff1b2fb776f5e563c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-79.ec2.internal" Jun 08 21:13:48.768215 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:48.768136 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-79.ec2.internal\" not found" Jun 08 21:13:48.778560 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.778539 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-79.ec2.internal" Jun 08 21:13:48.783319 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:48.783135 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-79.ec2.internal" Jun 08 21:13:48.868905 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:48.868871 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-79.ec2.internal\" not found" Jun 08 21:13:48.969348 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:48.969319 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-79.ec2.internal\" not found" Jun 08 21:13:49.069835 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:49.069809 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-79.ec2.internal\" not found" Jun 08 21:13:49.170361 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:49.170330 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-79.ec2.internal\" not found" Jun 08 21:13:49.199710 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:49.199684 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 21:13:49.200282 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:49.199823 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 21:13:49.270757 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:49.270708 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-79.ec2.internal\" not found" Jun 08 21:13:49.291286 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:49.291242 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 21:08:48 +0000 UTC" deadline="2028-01-15 01:27:12.478680788 +0000 UTC" Jun 08 21:13:49.291286 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:49.291278 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14044h13m23.187406306s" Jun 08 21:13:49.357427 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:49.357397 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d2f4ab0296ea13816c307edf2a2d2c0.slice/crio-b027c7b3ce6977d867b91206bf7431a36b75176445e36575af844de587febdb2 WatchSource:0}: Error finding container b027c7b3ce6977d867b91206bf7431a36b75176445e36575af844de587febdb2: Status 404 returned error can't find the container with id b027c7b3ce6977d867b91206bf7431a36b75176445e36575af844de587febdb2 Jun 08 21:13:49.357842 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:49.357824 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode761856f3e5ce01ff1b2fb776f5e563c.slice/crio-49767a6c529bd18b6a469e379d7d0d2e8cb086a9fdd6b43f577f008ca70061b8 WatchSource:0}: Error finding container 49767a6c529bd18b6a469e379d7d0d2e8cb086a9fdd6b43f577f008ca70061b8: Status 404 returned error can't find the container with id 49767a6c529bd18b6a469e379d7d0d2e8cb086a9fdd6b43f577f008ca70061b8 Jun 08 21:13:49.358814 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:49.358796 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 21:13:49.363271 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:49.363256 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 21:13:49.371194 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:49.371168 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-79.ec2.internal\" not found" Jun 08 21:13:49.437499 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:49.436259 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 21:13:49.468012 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:49.467978 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-79.ec2.internal" Jun 08 21:13:49.480751 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:49.480727 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 21:13:49.481900 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:49.481886 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-79.ec2.internal" Jun 08 21:13:49.490256 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:49.490236 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 21:13:49.544267 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:49.544237 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 21:13:50.243246 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.243210 2564 apiserver.go:52] "Watching apiserver" Jun 08 21:13:50.250558 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.250533 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 21:13:50.252019 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.251988 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-swvjh","openshift-network-operator/iptables-alerter-9fjnh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvzqj","openshift-image-registry/node-ca-zmr52","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-79.ec2.internal","openshift-multus/multus-additional-cni-plugins-mlh7b","openshift-multus/network-metrics-daemon-9jghf","openshift-ovn-kubernetes/ovnkube-node-pbt69","kube-system/global-pull-secret-syncer-qgmqb","kube-system/konnectivity-agent-km8nj","kube-system/kube-apiserver-proxy-ip-10-0-135-79.ec2.internal","openshift-cluster-node-tuning-operator/tuned-kf8t9","openshift-dns/node-resolver-bx6xk","openshift-multus/multus-8rdm2"] Jun 08 21:13:50.255004 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.254979 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:13:50.255153 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:50.255087 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9jghf" podUID="69e600b7-7393-4b2c-8e83-3b5fd3e07b31" Jun 08 21:13:50.257263 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.257240 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.260042 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.259416 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvzqj" Jun 08 21:13:50.261181 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.260340 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 21:13:50.261181 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.260600 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 21:13:50.261181 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.260893 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7gw9j\"" Jun 08 21:13:50.261343 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.261220 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 21:13:50.261751 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.261419 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 21:13:50.261751 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.261482 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 21:13:50.261751 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.261548 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 21:13:50.261751 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.261626 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 21:13:50.261994 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.261803 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zmr52" Jun 08 21:13:50.262255 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.262237 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jp8r5\"" Jun 08 21:13:50.262358 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.262278 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 21:13:50.262421 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.262408 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 21:13:50.263786 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.263769 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swvjh" Jun 08 21:13:50.263870 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:50.263831 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swvjh" podUID="54e29e23-7c54-491b-886c-cf0c300aefe7" Jun 08 21:13:50.264325 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.264282 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 21:13:50.264630 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.264612 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 21:13:50.264693 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.264676 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 21:13:50.265941 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.264881 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-n82kx\"" Jun 08 21:13:50.267023 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.266120 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mlh7b" Jun 08 21:13:50.269297 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.268489 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 21:13:50.269832 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.269811 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:13:50.269927 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:50.269876 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgmqb" podUID="30982bae-7fbf-49b2-a16a-2b01df5d6a30" Jun 08 21:13:50.270206 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.270167 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 21:13:50.270206 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.270198 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 21:13:50.270423 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.270199 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-c9g56\"" Jun 08 21:13:50.270423 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.270382 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 21:13:50.270606 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.270494 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 21:13:50.270606 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.270568 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 21:13:50.272254 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.272224 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bx6xk" Jun 08 21:13:50.274743 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.274720 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9fjnh" Jun 08 21:13:50.276766 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.276743 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 21:13:50.276878 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.276863 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7lzs4\"" Jun 08 21:13:50.276926 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.276912 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 21:13:50.277462 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.277439 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-km8nj" Jun 08 21:13:50.277987 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.277592 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 21:13:50.278489 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.278249 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 21:13:50.278489 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.278285 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zqxbb\"" Jun 08 21:13:50.278856 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.278835 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-log-socket\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.278947 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.278876 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-ovnkube-config\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.279008 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.278908 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-ovnkube-script-lib\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.279008 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.278993 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/63d534e1-4383-4105-8106-4024249357e9-socket-dir\") pod \"aws-ebs-csi-driver-node-xvzqj\" (UID: \"63d534e1-4383-4105-8106-4024249357e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvzqj" Jun 08 21:13:50.279154 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.279025 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7nl4\" (UniqueName: \"kubernetes.io/projected/54e29e23-7c54-491b-886c-cf0c300aefe7-kube-api-access-k7nl4\") pod \"network-check-target-swvjh\" (UID: \"54e29e23-7c54-491b-886c-cf0c300aefe7\") " pod="openshift-network-diagnostics/network-check-target-swvjh" Jun 08 21:13:50.279154 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.279056 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/68070959-71b5-45c6-828d-0a404231b097-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mlh7b\" (UID: \"68070959-71b5-45c6-828d-0a404231b097\") " pod="openshift-multus/multus-additional-cni-plugins-mlh7b" Jun 08 21:13:50.279154 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.279118 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmd25\" (UniqueName: \"kubernetes.io/projected/63d534e1-4383-4105-8106-4024249357e9-kube-api-access-qmd25\") pod \"aws-ebs-csi-driver-node-xvzqj\" (UID: \"63d534e1-4383-4105-8106-4024249357e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvzqj" Jun 08 21:13:50.279300 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.279187 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/68070959-71b5-45c6-828d-0a404231b097-cni-binary-copy\") pod \"multus-additional-cni-plugins-mlh7b\" (UID: \"68070959-71b5-45c6-828d-0a404231b097\") " pod="openshift-multus/multus-additional-cni-plugins-mlh7b" Jun 08 21:13:50.279786 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.279694 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 21:13:50.279786 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.279706 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/68070959-71b5-45c6-828d-0a404231b097-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mlh7b\" (UID: \"68070959-71b5-45c6-828d-0a404231b097\") " pod="openshift-multus/multus-additional-cni-plugins-mlh7b" Jun 08 21:13:50.279786 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.279738 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/30982bae-7fbf-49b2-a16a-2b01df5d6a30-kubelet-config\") pod \"global-pull-secret-syncer-qgmqb\" (UID: \"30982bae-7fbf-49b2-a16a-2b01df5d6a30\") " pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:13:50.279786 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.279771 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-run-systemd\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.279960 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.279800 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-etc-openvswitch\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.279960 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.279825 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.279960 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.279851 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/63d534e1-4383-4105-8106-4024249357e9-device-dir\") pod \"aws-ebs-csi-driver-node-xvzqj\" (UID: \"63d534e1-4383-4105-8106-4024249357e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvzqj" Jun 08 21:13:50.279960 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.279873 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/63d534e1-4383-4105-8106-4024249357e9-sys-fs\") pod \"aws-ebs-csi-driver-node-xvzqj\" (UID: \"63d534e1-4383-4105-8106-4024249357e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvzqj" Jun 08 21:13:50.279960 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.279895 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jxzl\" (UniqueName: \"kubernetes.io/projected/69e600b7-7393-4b2c-8e83-3b5fd3e07b31-kube-api-access-6jxzl\") pod \"network-metrics-daemon-9jghf\" (UID: \"69e600b7-7393-4b2c-8e83-3b5fd3e07b31\") " pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:13:50.279960 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.279931 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-run-openvswitch\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.279960 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.279954 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-run-ovn\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.280332 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.279975 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-node-log\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.280332 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.279998 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-env-overrides\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.280332 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.280024 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/63d534e1-4383-4105-8106-4024249357e9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xvzqj\" (UID: \"63d534e1-4383-4105-8106-4024249357e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvzqj" Jun 08 21:13:50.280332 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.280052 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/68070959-71b5-45c6-828d-0a404231b097-system-cni-dir\") pod \"multus-additional-cni-plugins-mlh7b\" (UID: \"68070959-71b5-45c6-828d-0a404231b097\") " pod="openshift-multus/multus-additional-cni-plugins-mlh7b" Jun 08 21:13:50.280332 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.280093 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j786\" (UniqueName: \"kubernetes.io/projected/68070959-71b5-45c6-828d-0a404231b097-kube-api-access-2j786\") pod \"multus-additional-cni-plugins-mlh7b\" (UID: \"68070959-71b5-45c6-828d-0a404231b097\") " pod="openshift-multus/multus-additional-cni-plugins-mlh7b" Jun 08 21:13:50.280332 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.280146 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d0fecdbc-84b7-45d5-bbb1-efdd9ccf83ca-iptables-alerter-script\") pod \"iptables-alerter-9fjnh\" (UID: \"d0fecdbc-84b7-45d5-bbb1-efdd9ccf83ca\") " pod="openshift-network-operator/iptables-alerter-9fjnh" Jun 08 21:13:50.280332 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.280169 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-host-kubelet\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.280332 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.280193 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-host-slash\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.280332 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.280221 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-var-lib-openvswitch\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.280332 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.280245 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/63d534e1-4383-4105-8106-4024249357e9-etc-selinux\") pod \"aws-ebs-csi-driver-node-xvzqj\" (UID: \"63d534e1-4383-4105-8106-4024249357e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvzqj" Jun 08 21:13:50.280332 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.280267 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/30982bae-7fbf-49b2-a16a-2b01df5d6a30-dbus\") pod \"global-pull-secret-syncer-qgmqb\" (UID: \"30982bae-7fbf-49b2-a16a-2b01df5d6a30\") " pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:13:50.280332 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.280288 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d0fecdbc-84b7-45d5-bbb1-efdd9ccf83ca-host-slash\") pod \"iptables-alerter-9fjnh\" (UID: \"d0fecdbc-84b7-45d5-bbb1-efdd9ccf83ca\") " pod="openshift-network-operator/iptables-alerter-9fjnh" Jun 08 21:13:50.280332 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.280312 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69e600b7-7393-4b2c-8e83-3b5fd3e07b31-metrics-certs\") pod \"network-metrics-daemon-9jghf\" (UID: \"69e600b7-7393-4b2c-8e83-3b5fd3e07b31\") " pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:13:50.280332 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.280333 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8ee88a26-ad92-4bad-91b5-612089504d71-serviceca\") pod \"node-ca-zmr52\" (UID: \"8ee88a26-ad92-4bad-91b5-612089504d71\") " pod="openshift-image-registry/node-ca-zmr52" Jun 08 21:13:50.281127 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.280360 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-host-cni-netd\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.281127 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.280385 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-ovn-node-metrics-cert\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.281127 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.280408 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chsmg\" (UniqueName: \"kubernetes.io/projected/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-kube-api-access-chsmg\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.281127 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.280432 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/68070959-71b5-45c6-828d-0a404231b097-cnibin\") pod \"multus-additional-cni-plugins-mlh7b\" (UID: \"68070959-71b5-45c6-828d-0a404231b097\") " pod="openshift-multus/multus-additional-cni-plugins-mlh7b" Jun 08 21:13:50.281127 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.280454 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/68070959-71b5-45c6-828d-0a404231b097-os-release\") pod \"multus-additional-cni-plugins-mlh7b\" (UID: \"68070959-71b5-45c6-828d-0a404231b097\") " pod="openshift-multus/multus-additional-cni-plugins-mlh7b" Jun 08 21:13:50.281127 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.280477 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/68070959-71b5-45c6-828d-0a404231b097-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mlh7b\" (UID: \"68070959-71b5-45c6-828d-0a404231b097\") " pod="openshift-multus/multus-additional-cni-plugins-mlh7b" Jun 08 21:13:50.281127 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.280500 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-host-run-ovn-kubernetes\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.281127 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.280523 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-host-cni-bin\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.281127 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.280545 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30982bae-7fbf-49b2-a16a-2b01df5d6a30-original-pull-secret\") pod \"global-pull-secret-syncer-qgmqb\" (UID: \"30982bae-7fbf-49b2-a16a-2b01df5d6a30\") " pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:13:50.281127 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.280576 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ee88a26-ad92-4bad-91b5-612089504d71-host\") pod \"node-ca-zmr52\" (UID: \"8ee88a26-ad92-4bad-91b5-612089504d71\") " pod="openshift-image-registry/node-ca-zmr52" Jun 08 21:13:50.281127 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.280612 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-systemd-units\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.281127 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.280637 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/63d534e1-4383-4105-8106-4024249357e9-registration-dir\") pod \"aws-ebs-csi-driver-node-xvzqj\" (UID: \"63d534e1-4383-4105-8106-4024249357e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvzqj" Jun 08 21:13:50.281127 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.280660 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8lpz\" (UniqueName: \"kubernetes.io/projected/d0fecdbc-84b7-45d5-bbb1-efdd9ccf83ca-kube-api-access-g8lpz\") pod \"iptables-alerter-9fjnh\" (UID: \"d0fecdbc-84b7-45d5-bbb1-efdd9ccf83ca\") " pod="openshift-network-operator/iptables-alerter-9fjnh" Jun 08 21:13:50.281127 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.280683 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6kfg\" (UniqueName: \"kubernetes.io/projected/8ee88a26-ad92-4bad-91b5-612089504d71-kube-api-access-x6kfg\") pod \"node-ca-zmr52\" (UID: \"8ee88a26-ad92-4bad-91b5-612089504d71\") " pod="openshift-image-registry/node-ca-zmr52" Jun 08 21:13:50.281127 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.280705 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c1390673-1d07-4f52-b5cd-da6da7cdbdf6-hosts-file\") pod \"node-resolver-bx6xk\" (UID: \"c1390673-1d07-4f52-b5cd-da6da7cdbdf6\") " pod="openshift-dns/node-resolver-bx6xk" Jun 08 21:13:50.281127 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.280760 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1390673-1d07-4f52-b5cd-da6da7cdbdf6-tmp-dir\") pod \"node-resolver-bx6xk\" (UID: \"c1390673-1d07-4f52-b5cd-da6da7cdbdf6\") " pod="openshift-dns/node-resolver-bx6xk" Jun 08 21:13:50.281956 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.280783 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmpjq\" (UniqueName: \"kubernetes.io/projected/c1390673-1d07-4f52-b5cd-da6da7cdbdf6-kube-api-access-wmpjq\") pod \"node-resolver-bx6xk\" (UID: \"c1390673-1d07-4f52-b5cd-da6da7cdbdf6\") " pod="openshift-dns/node-resolver-bx6xk" Jun 08 21:13:50.281956 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.280810 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-host-run-netns\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.282050 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.281965 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.282370 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.282349 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 21:13:50.282460 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.282429 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nkbh4\"" Jun 08 21:13:50.282520 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.282487 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 21:13:50.284401 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.284204 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 21:13:50.284827 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.284519 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 21:13:50.284827 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.284591 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.284827 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.284716 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sf5fp\"" Jun 08 21:13:50.287303 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.287112 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 21:13:50.287303 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.287154 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 21:13:50.287303 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.287210 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j6m5d\"" Jun 08 21:13:50.301397 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.301377 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-284br" Jun 08 21:13:50.316943 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.316916 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-284br" Jun 08 21:13:50.346011 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.345958 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-79.ec2.internal" event={"ID":"e761856f3e5ce01ff1b2fb776f5e563c","Type":"ContainerStarted","Data":"49767a6c529bd18b6a469e379d7d0d2e8cb086a9fdd6b43f577f008ca70061b8"} Jun 08 21:13:50.348105 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.348060 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-79.ec2.internal" event={"ID":"8d2f4ab0296ea13816c307edf2a2d2c0","Type":"ContainerStarted","Data":"b027c7b3ce6977d867b91206bf7431a36b75176445e36575af844de587febdb2"} Jun 08 21:13:50.372407 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.372379 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 21:13:50.381675 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.381638 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-run-systemd\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.381829 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.381685 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-etc-openvswitch\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.381829 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.381712 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/63d534e1-4383-4105-8106-4024249357e9-device-dir\") pod \"aws-ebs-csi-driver-node-xvzqj\" (UID: \"63d534e1-4383-4105-8106-4024249357e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvzqj" Jun 08 21:13:50.381829 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.381757 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-run-systemd\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.381829 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.381779 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/63d534e1-4383-4105-8106-4024249357e9-device-dir\") pod \"aws-ebs-csi-driver-node-xvzqj\" (UID: \"63d534e1-4383-4105-8106-4024249357e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvzqj" Jun 08 21:13:50.381829 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.381779 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-etc-openvswitch\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.381829 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.381807 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jxzl\" (UniqueName: \"kubernetes.io/projected/69e600b7-7393-4b2c-8e83-3b5fd3e07b31-kube-api-access-6jxzl\") pod \"network-metrics-daemon-9jghf\" (UID: \"69e600b7-7393-4b2c-8e83-3b5fd3e07b31\") " pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:13:50.382141 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.381846 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-host-var-lib-cni-multus\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.382141 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.381870 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/68addd18-18e2-4d23-a9ff-c2c488ec7219-etc-tuned\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.382141 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.381895 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-run-openvswitch\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.382141 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.381916 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-run-ovn\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.382141 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.381943 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-node-log\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.382141 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.381966 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/63d534e1-4383-4105-8106-4024249357e9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xvzqj\" (UID: \"63d534e1-4383-4105-8106-4024249357e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvzqj" Jun 08 21:13:50.382141 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.381967 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-run-openvswitch\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.382141 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.381989 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d0fecdbc-84b7-45d5-bbb1-efdd9ccf83ca-iptables-alerter-script\") pod \"iptables-alerter-9fjnh\" (UID: \"d0fecdbc-84b7-45d5-bbb1-efdd9ccf83ca\") " pod="openshift-network-operator/iptables-alerter-9fjnh" Jun 08 21:13:50.382141 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.381998 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-run-ovn\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.382141 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382013 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-cnibin\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.382141 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382034 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-node-log\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.382141 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382039 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/63d534e1-4383-4105-8106-4024249357e9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xvzqj\" (UID: \"63d534e1-4383-4105-8106-4024249357e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvzqj" Jun 08 21:13:50.382141 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382085 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-host-var-lib-cni-bin\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.382141 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382117 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/68addd18-18e2-4d23-a9ff-c2c488ec7219-etc-sysconfig\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.382875 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382195 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmpjq\" (UniqueName: \"kubernetes.io/projected/c1390673-1d07-4f52-b5cd-da6da7cdbdf6-kube-api-access-wmpjq\") pod \"node-resolver-bx6xk\" (UID: \"c1390673-1d07-4f52-b5cd-da6da7cdbdf6\") " pod="openshift-dns/node-resolver-bx6xk" Jun 08 21:13:50.382875 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382233 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-host-kubelet\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.382875 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382258 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/30982bae-7fbf-49b2-a16a-2b01df5d6a30-dbus\") pod \"global-pull-secret-syncer-qgmqb\" (UID: \"30982bae-7fbf-49b2-a16a-2b01df5d6a30\") " pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:13:50.382875 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382281 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8ee88a26-ad92-4bad-91b5-612089504d71-serviceca\") pod \"node-ca-zmr52\" (UID: \"8ee88a26-ad92-4bad-91b5-612089504d71\") " pod="openshift-image-registry/node-ca-zmr52" Jun 08 21:13:50.382875 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382307 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/68addd18-18e2-4d23-a9ff-c2c488ec7219-etc-systemd\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.382875 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382331 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68addd18-18e2-4d23-a9ff-c2c488ec7219-lib-modules\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.382875 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382357 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3ccf1861-eb1f-494e-87b4-1508123ccfd6-agent-certs\") pod \"konnectivity-agent-km8nj\" (UID: \"3ccf1861-eb1f-494e-87b4-1508123ccfd6\") " pod="kube-system/konnectivity-agent-km8nj" Jun 08 21:13:50.382875 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382384 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-host-cni-netd\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.382875 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382409 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-ovn-node-metrics-cert\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.382875 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382434 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chsmg\" (UniqueName: \"kubernetes.io/projected/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-kube-api-access-chsmg\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.382875 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382458 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/68070959-71b5-45c6-828d-0a404231b097-os-release\") pod \"multus-additional-cni-plugins-mlh7b\" (UID: \"68070959-71b5-45c6-828d-0a404231b097\") " pod="openshift-multus/multus-additional-cni-plugins-mlh7b" Jun 08 21:13:50.382875 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382466 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-host-kubelet\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.382875 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382484 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/68070959-71b5-45c6-828d-0a404231b097-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mlh7b\" (UID: \"68070959-71b5-45c6-828d-0a404231b097\") " pod="openshift-multus/multus-additional-cni-plugins-mlh7b" Jun 08 21:13:50.382875 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382433 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/30982bae-7fbf-49b2-a16a-2b01df5d6a30-dbus\") pod \"global-pull-secret-syncer-qgmqb\" (UID: \"30982bae-7fbf-49b2-a16a-2b01df5d6a30\") " pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:13:50.382875 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382507 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ee88a26-ad92-4bad-91b5-612089504d71-host\") pod \"node-ca-zmr52\" (UID: \"8ee88a26-ad92-4bad-91b5-612089504d71\") " pod="openshift-image-registry/node-ca-zmr52" Jun 08 21:13:50.382875 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382538 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-host-cni-netd\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.382875 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382531 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-host-cni-bin\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.383671 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382580 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pz4t\" (UniqueName: \"kubernetes.io/projected/d152d239-9949-4c45-ae86-7975965aeaa1-kube-api-access-7pz4t\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.383671 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382595 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-host-cni-bin\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.383671 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382598 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68addd18-18e2-4d23-a9ff-c2c488ec7219-sys\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.383671 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382623 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68addd18-18e2-4d23-a9ff-c2c488ec7219-tmp\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.383671 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382643 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-systemd-units\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.383671 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382660 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/63d534e1-4383-4105-8106-4024249357e9-registration-dir\") pod \"aws-ebs-csi-driver-node-xvzqj\" (UID: \"63d534e1-4383-4105-8106-4024249357e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvzqj" Jun 08 21:13:50.383671 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382681 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6kfg\" (UniqueName: \"kubernetes.io/projected/8ee88a26-ad92-4bad-91b5-612089504d71-kube-api-access-x6kfg\") pod \"node-ca-zmr52\" (UID: \"8ee88a26-ad92-4bad-91b5-612089504d71\") " pod="openshift-image-registry/node-ca-zmr52" Jun 08 21:13:50.383671 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382695 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c1390673-1d07-4f52-b5cd-da6da7cdbdf6-hosts-file\") pod \"node-resolver-bx6xk\" (UID: \"c1390673-1d07-4f52-b5cd-da6da7cdbdf6\") " pod="openshift-dns/node-resolver-bx6xk" Jun 08 21:13:50.383671 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382711 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68addd18-18e2-4d23-a9ff-c2c488ec7219-etc-kubernetes\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.383671 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382726 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-host-run-netns\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.383671 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382747 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-ovnkube-script-lib\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.383671 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382762 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/63d534e1-4383-4105-8106-4024249357e9-socket-dir\") pod \"aws-ebs-csi-driver-node-xvzqj\" (UID: \"63d534e1-4383-4105-8106-4024249357e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvzqj" Jun 08 21:13:50.383671 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382770 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/68070959-71b5-45c6-828d-0a404231b097-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mlh7b\" (UID: \"68070959-71b5-45c6-828d-0a404231b097\") " pod="openshift-multus/multus-additional-cni-plugins-mlh7b" Jun 08 21:13:50.383671 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382777 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7nl4\" (UniqueName: \"kubernetes.io/projected/54e29e23-7c54-491b-886c-cf0c300aefe7-kube-api-access-k7nl4\") pod \"network-check-target-swvjh\" (UID: \"54e29e23-7c54-491b-886c-cf0c300aefe7\") " pod="openshift-network-diagnostics/network-check-target-swvjh" Jun 08 21:13:50.383671 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382793 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-multus-cni-dir\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.383671 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382809 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-multus-conf-dir\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.383671 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382824 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/68addd18-18e2-4d23-a9ff-c2c488ec7219-etc-modprobe-d\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.384428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382835 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/68070959-71b5-45c6-828d-0a404231b097-os-release\") pod \"multus-additional-cni-plugins-mlh7b\" (UID: \"68070959-71b5-45c6-828d-0a404231b097\") " pod="openshift-multus/multus-additional-cni-plugins-mlh7b" Jun 08 21:13:50.384428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382909 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 21:13:50.384428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.383035 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d0fecdbc-84b7-45d5-bbb1-efdd9ccf83ca-iptables-alerter-script\") pod \"iptables-alerter-9fjnh\" (UID: \"d0fecdbc-84b7-45d5-bbb1-efdd9ccf83ca\") " pod="openshift-network-operator/iptables-alerter-9fjnh" Jun 08 21:13:50.384428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.382839 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/68070959-71b5-45c6-828d-0a404231b097-cni-binary-copy\") pod \"multus-additional-cni-plugins-mlh7b\" (UID: \"68070959-71b5-45c6-828d-0a404231b097\") " pod="openshift-multus/multus-additional-cni-plugins-mlh7b" Jun 08 21:13:50.384428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.383135 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ee88a26-ad92-4bad-91b5-612089504d71-host\") pod \"node-ca-zmr52\" (UID: \"8ee88a26-ad92-4bad-91b5-612089504d71\") " pod="openshift-image-registry/node-ca-zmr52" Jun 08 21:13:50.384428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.383158 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/68070959-71b5-45c6-828d-0a404231b097-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mlh7b\" (UID: \"68070959-71b5-45c6-828d-0a404231b097\") " pod="openshift-multus/multus-additional-cni-plugins-mlh7b" Jun 08 21:13:50.384428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.383175 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-host-run-netns\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.384428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.383204 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-systemd-units\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.384428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.383203 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/30982bae-7fbf-49b2-a16a-2b01df5d6a30-kubelet-config\") pod \"global-pull-secret-syncer-qgmqb\" (UID: \"30982bae-7fbf-49b2-a16a-2b01df5d6a30\") " pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:13:50.384428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.383244 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d152d239-9949-4c45-ae86-7975965aeaa1-cni-binary-copy\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.384428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.383254 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/30982bae-7fbf-49b2-a16a-2b01df5d6a30-kubelet-config\") pod \"global-pull-secret-syncer-qgmqb\" (UID: \"30982bae-7fbf-49b2-a16a-2b01df5d6a30\") " pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:13:50.384428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.383260 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-host-run-multus-certs\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.384428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.383265 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8ee88a26-ad92-4bad-91b5-612089504d71-serviceca\") pod \"node-ca-zmr52\" (UID: \"8ee88a26-ad92-4bad-91b5-612089504d71\") " pod="openshift-image-registry/node-ca-zmr52" Jun 08 21:13:50.384428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.383297 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.384428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.383316 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/63d534e1-4383-4105-8106-4024249357e9-registration-dir\") pod \"aws-ebs-csi-driver-node-xvzqj\" (UID: \"63d534e1-4383-4105-8106-4024249357e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvzqj" Jun 08 21:13:50.384428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.383320 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c1390673-1d07-4f52-b5cd-da6da7cdbdf6-hosts-file\") pod \"node-resolver-bx6xk\" (UID: \"c1390673-1d07-4f52-b5cd-da6da7cdbdf6\") " pod="openshift-dns/node-resolver-bx6xk" Jun 08 21:13:50.384428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.383324 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/63d534e1-4383-4105-8106-4024249357e9-sys-fs\") pod \"aws-ebs-csi-driver-node-xvzqj\" (UID: \"63d534e1-4383-4105-8106-4024249357e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvzqj" Jun 08 21:13:50.385169 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.383368 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-os-release\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.385169 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.383393 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-host-run-netns\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.385169 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.383419 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-hostroot\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.385169 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.383431 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/63d534e1-4383-4105-8106-4024249357e9-socket-dir\") pod \"aws-ebs-csi-driver-node-xvzqj\" (UID: \"63d534e1-4383-4105-8106-4024249357e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvzqj" Jun 08 21:13:50.385169 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.383443 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-etc-kubernetes\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.385169 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.383486 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-env-overrides\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.385169 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.383511 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/68070959-71b5-45c6-828d-0a404231b097-system-cni-dir\") pod \"multus-additional-cni-plugins-mlh7b\" (UID: \"68070959-71b5-45c6-828d-0a404231b097\") " pod="openshift-multus/multus-additional-cni-plugins-mlh7b" Jun 08 21:13:50.385169 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.383564 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/63d534e1-4383-4105-8106-4024249357e9-sys-fs\") pod \"aws-ebs-csi-driver-node-xvzqj\" (UID: \"63d534e1-4383-4105-8106-4024249357e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvzqj" Jun 08 21:13:50.385169 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.383579 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/68070959-71b5-45c6-828d-0a404231b097-cni-binary-copy\") pod \"multus-additional-cni-plugins-mlh7b\" (UID: \"68070959-71b5-45c6-828d-0a404231b097\") " pod="openshift-multus/multus-additional-cni-plugins-mlh7b" Jun 08 21:13:50.385169 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.383647 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/68070959-71b5-45c6-828d-0a404231b097-system-cni-dir\") pod \"multus-additional-cni-plugins-mlh7b\" (UID: \"68070959-71b5-45c6-828d-0a404231b097\") " pod="openshift-multus/multus-additional-cni-plugins-mlh7b" Jun 08 21:13:50.385169 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.383684 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.385169 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.383801 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/68070959-71b5-45c6-828d-0a404231b097-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mlh7b\" (UID: \"68070959-71b5-45c6-828d-0a404231b097\") " pod="openshift-multus/multus-additional-cni-plugins-mlh7b" Jun 08 21:13:50.385169 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.383937 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j786\" (UniqueName: \"kubernetes.io/projected/68070959-71b5-45c6-828d-0a404231b097-kube-api-access-2j786\") pod \"multus-additional-cni-plugins-mlh7b\" (UID: \"68070959-71b5-45c6-828d-0a404231b097\") " pod="openshift-multus/multus-additional-cni-plugins-mlh7b" Jun 08 21:13:50.385169 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.384485 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69e600b7-7393-4b2c-8e83-3b5fd3e07b31-metrics-certs\") pod \"network-metrics-daemon-9jghf\" (UID: \"69e600b7-7393-4b2c-8e83-3b5fd3e07b31\") " pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:13:50.385169 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.384500 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-env-overrides\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.385169 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.384512 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-host-var-lib-kubelet\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.385169 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.384535 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d152d239-9949-4c45-ae86-7975965aeaa1-multus-daemon-config\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.385899 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.384552 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4twz\" (UniqueName: \"kubernetes.io/projected/68addd18-18e2-4d23-a9ff-c2c488ec7219-kube-api-access-z4twz\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.385899 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.384578 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-host-slash\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.385899 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.384614 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-var-lib-openvswitch\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.385899 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.384646 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/63d534e1-4383-4105-8106-4024249357e9-etc-selinux\") pod \"aws-ebs-csi-driver-node-xvzqj\" (UID: \"63d534e1-4383-4105-8106-4024249357e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvzqj" Jun 08 21:13:50.385899 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.384667 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d0fecdbc-84b7-45d5-bbb1-efdd9ccf83ca-host-slash\") pod \"iptables-alerter-9fjnh\" (UID: \"d0fecdbc-84b7-45d5-bbb1-efdd9ccf83ca\") " pod="openshift-network-operator/iptables-alerter-9fjnh" Jun 08 21:13:50.385899 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.384695 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/68addd18-18e2-4d23-a9ff-c2c488ec7219-etc-sysctl-d\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.385899 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.384715 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/68070959-71b5-45c6-828d-0a404231b097-cnibin\") pod \"multus-additional-cni-plugins-mlh7b\" (UID: \"68070959-71b5-45c6-828d-0a404231b097\") " pod="openshift-multus/multus-additional-cni-plugins-mlh7b" Jun 08 21:13:50.385899 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.384734 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/68addd18-18e2-4d23-a9ff-c2c488ec7219-etc-sysctl-conf\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.385899 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.384417 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-ovnkube-script-lib\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.385899 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:50.384931 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:13:50.385899 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:50.385039 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e600b7-7393-4b2c-8e83-3b5fd3e07b31-metrics-certs podName:69e600b7-7393-4b2c-8e83-3b5fd3e07b31 nodeName:}" failed. No retries permitted until 2026-06-08 21:13:50.884995947 +0000 UTC m=+3.025038830 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69e600b7-7393-4b2c-8e83-3b5fd3e07b31-metrics-certs") pod "network-metrics-daemon-9jghf" (UID: "69e600b7-7393-4b2c-8e83-3b5fd3e07b31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:13:50.385899 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.385356 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-host-slash\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.385899 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.385416 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-var-lib-openvswitch\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.385899 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.385464 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/63d534e1-4383-4105-8106-4024249357e9-etc-selinux\") pod \"aws-ebs-csi-driver-node-xvzqj\" (UID: \"63d534e1-4383-4105-8106-4024249357e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvzqj" Jun 08 21:13:50.385899 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.385499 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d0fecdbc-84b7-45d5-bbb1-efdd9ccf83ca-host-slash\") pod \"iptables-alerter-9fjnh\" (UID: \"d0fecdbc-84b7-45d5-bbb1-efdd9ccf83ca\") " pod="openshift-network-operator/iptables-alerter-9fjnh" Jun 08 21:13:50.385899 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.385567 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/68070959-71b5-45c6-828d-0a404231b097-cnibin\") pod \"multus-additional-cni-plugins-mlh7b\" (UID: \"68070959-71b5-45c6-828d-0a404231b097\") " pod="openshift-multus/multus-additional-cni-plugins-mlh7b" Jun 08 21:13:50.386604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.385907 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68addd18-18e2-4d23-a9ff-c2c488ec7219-host\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.386604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.385955 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-host-run-ovn-kubernetes\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.386604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.385990 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30982bae-7fbf-49b2-a16a-2b01df5d6a30-original-pull-secret\") pod \"global-pull-secret-syncer-qgmqb\" (UID: \"30982bae-7fbf-49b2-a16a-2b01df5d6a30\") " pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:13:50.386604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.386019 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-system-cni-dir\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.386604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.386053 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-multus-socket-dir-parent\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.386604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.386098 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68addd18-18e2-4d23-a9ff-c2c488ec7219-var-lib-kubelet\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.386604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.386127 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3ccf1861-eb1f-494e-87b4-1508123ccfd6-konnectivity-ca\") pod \"konnectivity-agent-km8nj\" (UID: \"3ccf1861-eb1f-494e-87b4-1508123ccfd6\") " pod="kube-system/konnectivity-agent-km8nj" Jun 08 21:13:50.386604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.386138 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-host-run-ovn-kubernetes\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.386604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.386155 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8lpz\" (UniqueName: \"kubernetes.io/projected/d0fecdbc-84b7-45d5-bbb1-efdd9ccf83ca-kube-api-access-g8lpz\") pod \"iptables-alerter-9fjnh\" (UID: \"d0fecdbc-84b7-45d5-bbb1-efdd9ccf83ca\") " pod="openshift-network-operator/iptables-alerter-9fjnh" Jun 08 21:13:50.386604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.386179 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1390673-1d07-4f52-b5cd-da6da7cdbdf6-tmp-dir\") pod \"node-resolver-bx6xk\" (UID: \"c1390673-1d07-4f52-b5cd-da6da7cdbdf6\") " pod="openshift-dns/node-resolver-bx6xk" Jun 08 21:13:50.386604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.386205 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-host-run-k8s-cni-cncf-io\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.386604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.386234 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-log-socket\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.386604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.386265 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-ovnkube-config\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.386604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.386292 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/68070959-71b5-45c6-828d-0a404231b097-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mlh7b\" (UID: \"68070959-71b5-45c6-828d-0a404231b097\") " pod="openshift-multus/multus-additional-cni-plugins-mlh7b" Jun 08 21:13:50.386604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.386324 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/68addd18-18e2-4d23-a9ff-c2c488ec7219-run\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.386604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.386359 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmd25\" (UniqueName: \"kubernetes.io/projected/63d534e1-4383-4105-8106-4024249357e9-kube-api-access-qmd25\") pod \"aws-ebs-csi-driver-node-xvzqj\" (UID: \"63d534e1-4383-4105-8106-4024249357e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvzqj" Jun 08 21:13:50.386604 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:50.386369 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:13:50.387362 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:50.386438 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30982bae-7fbf-49b2-a16a-2b01df5d6a30-original-pull-secret podName:30982bae-7fbf-49b2-a16a-2b01df5d6a30 nodeName:}" failed. No retries permitted until 2026-06-08 21:13:50.886420971 +0000 UTC m=+3.026463836 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30982bae-7fbf-49b2-a16a-2b01df5d6a30-original-pull-secret") pod "global-pull-secret-syncer-qgmqb" (UID: "30982bae-7fbf-49b2-a16a-2b01df5d6a30") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:13:50.387362 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.386715 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-log-socket\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.387362 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.386738 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1390673-1d07-4f52-b5cd-da6da7cdbdf6-tmp-dir\") pod \"node-resolver-bx6xk\" (UID: \"c1390673-1d07-4f52-b5cd-da6da7cdbdf6\") " pod="openshift-dns/node-resolver-bx6xk" Jun 08 21:13:50.387362 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.387212 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-ovn-node-metrics-cert\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.387362 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.387265 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-ovnkube-config\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.390142 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.387665 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/68070959-71b5-45c6-828d-0a404231b097-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mlh7b\" (UID: \"68070959-71b5-45c6-828d-0a404231b097\") " pod="openshift-multus/multus-additional-cni-plugins-mlh7b" Jun 08 21:13:50.390142 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:50.389190 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:13:50.390142 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:50.389211 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:13:50.390142 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:50.389233 2564 projected.go:196] Error preparing data for projected volume kube-api-access-k7nl4 for pod openshift-network-diagnostics/network-check-target-swvjh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:13:50.390142 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:50.389355 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54e29e23-7c54-491b-886c-cf0c300aefe7-kube-api-access-k7nl4 podName:54e29e23-7c54-491b-886c-cf0c300aefe7 nodeName:}" failed. No retries permitted until 2026-06-08 21:13:50.88932945 +0000 UTC m=+3.029372309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-k7nl4" (UniqueName: "kubernetes.io/projected/54e29e23-7c54-491b-886c-cf0c300aefe7-kube-api-access-k7nl4") pod "network-check-target-swvjh" (UID: "54e29e23-7c54-491b-886c-cf0c300aefe7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:13:50.393261 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.393240 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chsmg\" (UniqueName: \"kubernetes.io/projected/9eb3105f-0406-4c64-b8c3-38b78c40d6d0-kube-api-access-chsmg\") pod \"ovnkube-node-pbt69\" (UID: \"9eb3105f-0406-4c64-b8c3-38b78c40d6d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.393869 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.393841 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jxzl\" (UniqueName: \"kubernetes.io/projected/69e600b7-7393-4b2c-8e83-3b5fd3e07b31-kube-api-access-6jxzl\") pod \"network-metrics-daemon-9jghf\" (UID: \"69e600b7-7393-4b2c-8e83-3b5fd3e07b31\") " pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:13:50.395870 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.395847 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmd25\" (UniqueName: \"kubernetes.io/projected/63d534e1-4383-4105-8106-4024249357e9-kube-api-access-qmd25\") pod \"aws-ebs-csi-driver-node-xvzqj\" (UID: \"63d534e1-4383-4105-8106-4024249357e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvzqj" Jun 08 21:13:50.396342 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.396315 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmpjq\" (UniqueName: \"kubernetes.io/projected/c1390673-1d07-4f52-b5cd-da6da7cdbdf6-kube-api-access-wmpjq\") pod \"node-resolver-bx6xk\" (UID: \"c1390673-1d07-4f52-b5cd-da6da7cdbdf6\") " pod="openshift-dns/node-resolver-bx6xk" Jun 08 21:13:50.396663 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.396642 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6kfg\" (UniqueName: \"kubernetes.io/projected/8ee88a26-ad92-4bad-91b5-612089504d71-kube-api-access-x6kfg\") pod \"node-ca-zmr52\" (UID: \"8ee88a26-ad92-4bad-91b5-612089504d71\") " pod="openshift-image-registry/node-ca-zmr52" Jun 08 21:13:50.396970 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.396936 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j786\" (UniqueName: \"kubernetes.io/projected/68070959-71b5-45c6-828d-0a404231b097-kube-api-access-2j786\") pod \"multus-additional-cni-plugins-mlh7b\" (UID: \"68070959-71b5-45c6-828d-0a404231b097\") " pod="openshift-multus/multus-additional-cni-plugins-mlh7b" Jun 08 21:13:50.398707 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.398686 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8lpz\" (UniqueName: \"kubernetes.io/projected/d0fecdbc-84b7-45d5-bbb1-efdd9ccf83ca-kube-api-access-g8lpz\") pod \"iptables-alerter-9fjnh\" (UID: \"d0fecdbc-84b7-45d5-bbb1-efdd9ccf83ca\") " pod="openshift-network-operator/iptables-alerter-9fjnh" Jun 08 21:13:50.487459 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.487422 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/68addd18-18e2-4d23-a9ff-c2c488ec7219-etc-sysctl-conf\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.487653 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.487469 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68addd18-18e2-4d23-a9ff-c2c488ec7219-host\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.487653 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.487504 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-system-cni-dir\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.487653 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.487577 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68addd18-18e2-4d23-a9ff-c2c488ec7219-host\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.487653 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.487584 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-system-cni-dir\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.487653 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.487607 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-multus-socket-dir-parent\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.487653 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.487644 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/68addd18-18e2-4d23-a9ff-c2c488ec7219-etc-sysctl-conf\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.487941 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.487645 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68addd18-18e2-4d23-a9ff-c2c488ec7219-var-lib-kubelet\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.487941 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.487685 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68addd18-18e2-4d23-a9ff-c2c488ec7219-var-lib-kubelet\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.487941 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.487649 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-multus-socket-dir-parent\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.487941 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.487702 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3ccf1861-eb1f-494e-87b4-1508123ccfd6-konnectivity-ca\") pod \"konnectivity-agent-km8nj\" (UID: \"3ccf1861-eb1f-494e-87b4-1508123ccfd6\") " pod="kube-system/konnectivity-agent-km8nj" Jun 08 21:13:50.487941 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.487740 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-host-run-k8s-cni-cncf-io\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.487941 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.487764 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/68addd18-18e2-4d23-a9ff-c2c488ec7219-run\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.487941 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.487787 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-host-var-lib-cni-multus\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.487941 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.487800 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/68addd18-18e2-4d23-a9ff-c2c488ec7219-etc-tuned\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.487941 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.487835 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/68addd18-18e2-4d23-a9ff-c2c488ec7219-run\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.487941 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.487827 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-cnibin\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.487941 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.487848 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-host-run-k8s-cni-cncf-io\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.487941 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.487867 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-host-var-lib-cni-bin\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.487941 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.487878 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-cnibin\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.487941 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.487891 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/68addd18-18e2-4d23-a9ff-c2c488ec7219-etc-sysconfig\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.487941 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.487905 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-host-var-lib-cni-bin\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.487941 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.487880 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-host-var-lib-cni-multus\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.487941 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.487920 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/68addd18-18e2-4d23-a9ff-c2c488ec7219-etc-systemd\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.487941 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.487944 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68addd18-18e2-4d23-a9ff-c2c488ec7219-lib-modules\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.488911 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.487965 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3ccf1861-eb1f-494e-87b4-1508123ccfd6-agent-certs\") pod \"konnectivity-agent-km8nj\" (UID: \"3ccf1861-eb1f-494e-87b4-1508123ccfd6\") " pod="kube-system/konnectivity-agent-km8nj" Jun 08 21:13:50.488911 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.487968 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/68addd18-18e2-4d23-a9ff-c2c488ec7219-etc-sysconfig\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.488911 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.487969 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/68addd18-18e2-4d23-a9ff-c2c488ec7219-etc-systemd\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.488911 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.487998 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pz4t\" (UniqueName: \"kubernetes.io/projected/d152d239-9949-4c45-ae86-7975965aeaa1-kube-api-access-7pz4t\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.488911 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.488021 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68addd18-18e2-4d23-a9ff-c2c488ec7219-sys\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.488911 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.488043 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68addd18-18e2-4d23-a9ff-c2c488ec7219-tmp\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.488911 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.488085 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68addd18-18e2-4d23-a9ff-c2c488ec7219-etc-kubernetes\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.488911 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.488106 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68addd18-18e2-4d23-a9ff-c2c488ec7219-lib-modules\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.488911 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.488111 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68addd18-18e2-4d23-a9ff-c2c488ec7219-sys\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.488911 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.488172 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-multus-cni-dir\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.488911 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.488199 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-multus-conf-dir\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.488911 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.488223 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/68addd18-18e2-4d23-a9ff-c2c488ec7219-etc-modprobe-d\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.488911 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.488250 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d152d239-9949-4c45-ae86-7975965aeaa1-cni-binary-copy\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.488911 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.488272 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-multus-conf-dir\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.488911 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.488279 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-host-run-multus-certs\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.488911 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.488305 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-os-release\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.488911 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.488327 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-host-run-netns\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.488911 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.488342 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3ccf1861-eb1f-494e-87b4-1508123ccfd6-konnectivity-ca\") pod \"konnectivity-agent-km8nj\" (UID: \"3ccf1861-eb1f-494e-87b4-1508123ccfd6\") " pod="kube-system/konnectivity-agent-km8nj" Jun 08 21:13:50.489604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.488355 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-hostroot\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.489604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.488374 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-host-run-multus-certs\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.489604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.488377 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-etc-kubernetes\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.489604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.488420 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-etc-kubernetes\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.489604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.488427 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-host-var-lib-kubelet\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.489604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.488452 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d152d239-9949-4c45-ae86-7975965aeaa1-multus-daemon-config\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.489604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.488466 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-host-run-netns\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.489604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.488468 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/68addd18-18e2-4d23-a9ff-c2c488ec7219-etc-modprobe-d\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.489604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.488334 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-multus-cni-dir\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.489604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.488479 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4twz\" (UniqueName: \"kubernetes.io/projected/68addd18-18e2-4d23-a9ff-c2c488ec7219-kube-api-access-z4twz\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.489604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.488534 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-os-release\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.489604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.488576 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-host-var-lib-kubelet\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.489604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.488610 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d152d239-9949-4c45-ae86-7975965aeaa1-hostroot\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.489604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.488224 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68addd18-18e2-4d23-a9ff-c2c488ec7219-etc-kubernetes\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.489604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.488713 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/68addd18-18e2-4d23-a9ff-c2c488ec7219-etc-sysctl-d\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.489604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.488846 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/68addd18-18e2-4d23-a9ff-c2c488ec7219-etc-sysctl-d\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.489604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.488865 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d152d239-9949-4c45-ae86-7975965aeaa1-cni-binary-copy\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.489604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.489012 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d152d239-9949-4c45-ae86-7975965aeaa1-multus-daemon-config\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.490435 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.490411 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/68addd18-18e2-4d23-a9ff-c2c488ec7219-etc-tuned\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.490747 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.490720 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3ccf1861-eb1f-494e-87b4-1508123ccfd6-agent-certs\") pod \"konnectivity-agent-km8nj\" (UID: \"3ccf1861-eb1f-494e-87b4-1508123ccfd6\") " pod="kube-system/konnectivity-agent-km8nj" Jun 08 21:13:50.490845 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.490824 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68addd18-18e2-4d23-a9ff-c2c488ec7219-tmp\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.499959 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.499899 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4twz\" (UniqueName: \"kubernetes.io/projected/68addd18-18e2-4d23-a9ff-c2c488ec7219-kube-api-access-z4twz\") pod \"tuned-kf8t9\" (UID: \"68addd18-18e2-4d23-a9ff-c2c488ec7219\") " pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.500249 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.500227 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pz4t\" (UniqueName: \"kubernetes.io/projected/d152d239-9949-4c45-ae86-7975965aeaa1-kube-api-access-7pz4t\") pod \"multus-8rdm2\" (UID: \"d152d239-9949-4c45-ae86-7975965aeaa1\") " pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.573545 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.573512 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:13:50.583580 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.583555 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvzqj" Jun 08 21:13:50.596356 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.596334 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9fjnh" Jun 08 21:13:50.601921 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.601893 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zmr52" Jun 08 21:13:50.609591 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.609568 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mlh7b" Jun 08 21:13:50.618228 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.618209 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bx6xk" Jun 08 21:13:50.625864 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.625841 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-km8nj" Jun 08 21:13:50.634565 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.634544 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8rdm2" Jun 08 21:13:50.638274 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.638254 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" Jun 08 21:13:50.640655 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.640630 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 21:13:50.891495 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.891452 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7nl4\" (UniqueName: \"kubernetes.io/projected/54e29e23-7c54-491b-886c-cf0c300aefe7-kube-api-access-k7nl4\") pod \"network-check-target-swvjh\" (UID: \"54e29e23-7c54-491b-886c-cf0c300aefe7\") " pod="openshift-network-diagnostics/network-check-target-swvjh" Jun 08 21:13:50.891682 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.891504 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69e600b7-7393-4b2c-8e83-3b5fd3e07b31-metrics-certs\") pod \"network-metrics-daemon-9jghf\" (UID: \"69e600b7-7393-4b2c-8e83-3b5fd3e07b31\") " pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:13:50.891682 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:50.891614 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:13:50.891682 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:50.891630 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:13:50.891682 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:50.891652 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:13:50.891682 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:50.891663 2564 projected.go:196] Error preparing data for projected volume kube-api-access-k7nl4 for pod openshift-network-diagnostics/network-check-target-swvjh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:13:50.891682 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:50.891674 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e600b7-7393-4b2c-8e83-3b5fd3e07b31-metrics-certs podName:69e600b7-7393-4b2c-8e83-3b5fd3e07b31 nodeName:}" failed. No retries permitted until 2026-06-08 21:13:51.891657641 +0000 UTC m=+4.031700503 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69e600b7-7393-4b2c-8e83-3b5fd3e07b31-metrics-certs") pod "network-metrics-daemon-9jghf" (UID: "69e600b7-7393-4b2c-8e83-3b5fd3e07b31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:13:50.891968 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:50.891699 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:13:50.891968 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:50.891635 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30982bae-7fbf-49b2-a16a-2b01df5d6a30-original-pull-secret\") pod \"global-pull-secret-syncer-qgmqb\" (UID: \"30982bae-7fbf-49b2-a16a-2b01df5d6a30\") " pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:13:50.891968 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:50.891702 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54e29e23-7c54-491b-886c-cf0c300aefe7-kube-api-access-k7nl4 podName:54e29e23-7c54-491b-886c-cf0c300aefe7 nodeName:}" failed. No retries permitted until 2026-06-08 21:13:51.891690321 +0000 UTC m=+4.031733185 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-k7nl4" (UniqueName: "kubernetes.io/projected/54e29e23-7c54-491b-886c-cf0c300aefe7-kube-api-access-k7nl4") pod "network-check-target-swvjh" (UID: "54e29e23-7c54-491b-886c-cf0c300aefe7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:13:50.891968 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:50.891783 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30982bae-7fbf-49b2-a16a-2b01df5d6a30-original-pull-secret podName:30982bae-7fbf-49b2-a16a-2b01df5d6a30 nodeName:}" failed. No retries permitted until 2026-06-08 21:13:51.891769209 +0000 UTC m=+4.031812069 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30982bae-7fbf-49b2-a16a-2b01df5d6a30-original-pull-secret") pod "global-pull-secret-syncer-qgmqb" (UID: "30982bae-7fbf-49b2-a16a-2b01df5d6a30") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:13:51.250209 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:51.250027 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68addd18_18e2_4d23_a9ff_c2c488ec7219.slice/crio-ffd97c1eda961c5cec125d721e540fe84b660888d844637d9aab6413f64d76a1 WatchSource:0}: Error finding container ffd97c1eda961c5cec125d721e540fe84b660888d844637d9aab6413f64d76a1: Status 404 returned error can't find the container with id ffd97c1eda961c5cec125d721e540fe84b660888d844637d9aab6413f64d76a1 Jun 08 21:13:51.251158 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:51.251129 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eb3105f_0406_4c64_b8c3_38b78c40d6d0.slice/crio-2311262dc70ecd2185f853d1b59bd8edc026a36799f3ae29e8ab16942f663e58 WatchSource:0}: Error finding container 2311262dc70ecd2185f853d1b59bd8edc026a36799f3ae29e8ab16942f663e58: Status 404 returned error can't find the container with id 2311262dc70ecd2185f853d1b59bd8edc026a36799f3ae29e8ab16942f663e58 Jun 08 21:13:51.253640 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:51.253620 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ee88a26_ad92_4bad_91b5_612089504d71.slice/crio-93f52a5fe62faf523f153584146cba830b0ffd05ac06e062a062cc3a99366abb WatchSource:0}: Error finding container 93f52a5fe62faf523f153584146cba830b0ffd05ac06e062a062cc3a99366abb: Status 404 returned error can't find the container with id 93f52a5fe62faf523f153584146cba830b0ffd05ac06e062a062cc3a99366abb Jun 08 21:13:51.256858 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:51.256837 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1390673_1d07_4f52_b5cd_da6da7cdbdf6.slice/crio-ed342ccab3390d964b1072f174c3d1969a2dd6dd202a8e4f228c96c149f2fa7f WatchSource:0}: Error finding container ed342ccab3390d964b1072f174c3d1969a2dd6dd202a8e4f228c96c149f2fa7f: Status 404 returned error can't find the container with id ed342ccab3390d964b1072f174c3d1969a2dd6dd202a8e4f228c96c149f2fa7f Jun 08 21:13:51.279299 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:51.279261 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0fecdbc_84b7_45d5_bbb1_efdd9ccf83ca.slice/crio-2405b6132f48445430be09e52a5915ddf0a09103169371d11da5f12659f6d6ae WatchSource:0}: Error finding container 2405b6132f48445430be09e52a5915ddf0a09103169371d11da5f12659f6d6ae: Status 404 returned error can't find the container with id 2405b6132f48445430be09e52a5915ddf0a09103169371d11da5f12659f6d6ae Jun 08 21:13:51.281669 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:51.281644 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ccf1861_eb1f_494e_87b4_1508123ccfd6.slice/crio-f209d09d124711a3352603e9f16989d8dfe4ee3dbf03f4d7ba5217befb099ffa WatchSource:0}: Error finding container f209d09d124711a3352603e9f16989d8dfe4ee3dbf03f4d7ba5217befb099ffa: Status 404 returned error can't find the container with id f209d09d124711a3352603e9f16989d8dfe4ee3dbf03f4d7ba5217befb099ffa Jun 08 21:13:51.282470 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:51.282445 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63d534e1_4383_4105_8106_4024249357e9.slice/crio-e7591aeb918aedda40e6a99c5f18fa35b4564c12013981fdc12a1ec4406fd058 WatchSource:0}: Error finding container e7591aeb918aedda40e6a99c5f18fa35b4564c12013981fdc12a1ec4406fd058: Status 404 returned error can't find the container with id e7591aeb918aedda40e6a99c5f18fa35b4564c12013981fdc12a1ec4406fd058 Jun 08 21:13:51.284295 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:51.284269 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd152d239_9949_4c45_ae86_7975965aeaa1.slice/crio-026aa549572b571ee362e35e255f673db679b3ea2113aafb7203bf4213d4e59d WatchSource:0}: Error finding container 026aa549572b571ee362e35e255f673db679b3ea2113aafb7203bf4213d4e59d: Status 404 returned error can't find the container with id 026aa549572b571ee362e35e255f673db679b3ea2113aafb7203bf4213d4e59d Jun 08 21:13:51.285125 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:13:51.285103 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68070959_71b5_45c6_828d_0a404231b097.slice/crio-0b1c83f4e57a80ab03843adf28e8b8296efd3323cea7b580252355e7d2ce6403 WatchSource:0}: Error finding container 0b1c83f4e57a80ab03843adf28e8b8296efd3323cea7b580252355e7d2ce6403: Status 404 returned error can't find the container with id 0b1c83f4e57a80ab03843adf28e8b8296efd3323cea7b580252355e7d2ce6403 Jun 08 21:13:51.320819 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:51.320774 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 21:08:50 +0000 UTC" deadline="2028-02-10 06:25:11.316967072 +0000 UTC" Jun 08 21:13:51.320819 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:51.320818 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14673h11m19.996153019s" Jun 08 21:13:51.340873 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:51.340849 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:13:51.340987 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:51.340962 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgmqb" podUID="30982bae-7fbf-49b2-a16a-2b01df5d6a30" Jun 08 21:13:51.350792 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:51.350764 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvzqj" event={"ID":"63d534e1-4383-4105-8106-4024249357e9","Type":"ContainerStarted","Data":"e7591aeb918aedda40e6a99c5f18fa35b4564c12013981fdc12a1ec4406fd058"} Jun 08 21:13:51.351751 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:51.351730 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9fjnh" event={"ID":"d0fecdbc-84b7-45d5-bbb1-efdd9ccf83ca","Type":"ContainerStarted","Data":"2405b6132f48445430be09e52a5915ddf0a09103169371d11da5f12659f6d6ae"} Jun 08 21:13:51.352648 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:51.352626 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bx6xk" event={"ID":"c1390673-1d07-4f52-b5cd-da6da7cdbdf6","Type":"ContainerStarted","Data":"ed342ccab3390d964b1072f174c3d1969a2dd6dd202a8e4f228c96c149f2fa7f"} Jun 08 21:13:51.353654 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:51.353633 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zmr52" event={"ID":"8ee88a26-ad92-4bad-91b5-612089504d71","Type":"ContainerStarted","Data":"93f52a5fe62faf523f153584146cba830b0ffd05ac06e062a062cc3a99366abb"} Jun 08 21:13:51.354674 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:51.354649 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" event={"ID":"68addd18-18e2-4d23-a9ff-c2c488ec7219","Type":"ContainerStarted","Data":"ffd97c1eda961c5cec125d721e540fe84b660888d844637d9aab6413f64d76a1"} Jun 08 21:13:51.356079 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:51.356046 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mlh7b" event={"ID":"68070959-71b5-45c6-828d-0a404231b097","Type":"ContainerStarted","Data":"0b1c83f4e57a80ab03843adf28e8b8296efd3323cea7b580252355e7d2ce6403"} Jun 08 21:13:51.357114 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:51.357092 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-km8nj" event={"ID":"3ccf1861-eb1f-494e-87b4-1508123ccfd6","Type":"ContainerStarted","Data":"f209d09d124711a3352603e9f16989d8dfe4ee3dbf03f4d7ba5217befb099ffa"} Jun 08 21:13:51.358214 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:51.358197 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" event={"ID":"9eb3105f-0406-4c64-b8c3-38b78c40d6d0","Type":"ContainerStarted","Data":"2311262dc70ecd2185f853d1b59bd8edc026a36799f3ae29e8ab16942f663e58"} Jun 08 21:13:51.359188 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:51.359166 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8rdm2" event={"ID":"d152d239-9949-4c45-ae86-7975965aeaa1","Type":"ContainerStarted","Data":"026aa549572b571ee362e35e255f673db679b3ea2113aafb7203bf4213d4e59d"} Jun 08 21:13:51.900120 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:51.899179 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30982bae-7fbf-49b2-a16a-2b01df5d6a30-original-pull-secret\") pod \"global-pull-secret-syncer-qgmqb\" (UID: \"30982bae-7fbf-49b2-a16a-2b01df5d6a30\") " pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:13:51.900120 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:51.899262 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7nl4\" (UniqueName: \"kubernetes.io/projected/54e29e23-7c54-491b-886c-cf0c300aefe7-kube-api-access-k7nl4\") pod \"network-check-target-swvjh\" (UID: \"54e29e23-7c54-491b-886c-cf0c300aefe7\") " pod="openshift-network-diagnostics/network-check-target-swvjh" Jun 08 21:13:51.900120 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:51.899298 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69e600b7-7393-4b2c-8e83-3b5fd3e07b31-metrics-certs\") pod \"network-metrics-daemon-9jghf\" (UID: \"69e600b7-7393-4b2c-8e83-3b5fd3e07b31\") " pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:13:51.900120 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:51.899418 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:13:51.900120 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:51.899482 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e600b7-7393-4b2c-8e83-3b5fd3e07b31-metrics-certs podName:69e600b7-7393-4b2c-8e83-3b5fd3e07b31 nodeName:}" failed. No retries permitted until 2026-06-08 21:13:53.899461846 +0000 UTC m=+6.039504708 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69e600b7-7393-4b2c-8e83-3b5fd3e07b31-metrics-certs") pod "network-metrics-daemon-9jghf" (UID: "69e600b7-7393-4b2c-8e83-3b5fd3e07b31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:13:51.900120 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:51.899544 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:13:51.900120 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:51.899574 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30982bae-7fbf-49b2-a16a-2b01df5d6a30-original-pull-secret podName:30982bae-7fbf-49b2-a16a-2b01df5d6a30 nodeName:}" failed. No retries permitted until 2026-06-08 21:13:53.899563504 +0000 UTC m=+6.039606366 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30982bae-7fbf-49b2-a16a-2b01df5d6a30-original-pull-secret") pod "global-pull-secret-syncer-qgmqb" (UID: "30982bae-7fbf-49b2-a16a-2b01df5d6a30") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:13:51.900120 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:51.899657 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:13:51.900120 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:51.899671 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:13:51.900120 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:51.899683 2564 projected.go:196] Error preparing data for projected volume kube-api-access-k7nl4 for pod openshift-network-diagnostics/network-check-target-swvjh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:13:51.900120 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:51.899713 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54e29e23-7c54-491b-886c-cf0c300aefe7-kube-api-access-k7nl4 podName:54e29e23-7c54-491b-886c-cf0c300aefe7 nodeName:}" failed. No retries permitted until 2026-06-08 21:13:53.899703433 +0000 UTC m=+6.039746294 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-k7nl4" (UniqueName: "kubernetes.io/projected/54e29e23-7c54-491b-886c-cf0c300aefe7-kube-api-access-k7nl4") pod "network-check-target-swvjh" (UID: "54e29e23-7c54-491b-886c-cf0c300aefe7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:13:52.322087 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:52.322031 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 21:08:50 +0000 UTC" deadline="2027-11-15 12:00:01.667611617 +0000 UTC" Jun 08 21:13:52.322546 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:52.322087 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12590h46m9.345529365s" Jun 08 21:13:52.343456 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:52.343418 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swvjh" Jun 08 21:13:52.343642 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:52.343554 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swvjh" podUID="54e29e23-7c54-491b-886c-cf0c300aefe7" Jun 08 21:13:52.344141 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:52.344118 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:13:52.344294 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:52.344271 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9jghf" podUID="69e600b7-7393-4b2c-8e83-3b5fd3e07b31" Jun 08 21:13:52.380101 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:52.379595 2564 generic.go:356] "Generic (PLEG): container finished" podID="e761856f3e5ce01ff1b2fb776f5e563c" containerID="ff449c6fd9734c255ba38e431f9ed9d549ba1c03b408147c473f00ecf95ede87" exitCode=0 Jun 08 21:13:52.380101 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:52.379691 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-79.ec2.internal" event={"ID":"e761856f3e5ce01ff1b2fb776f5e563c","Type":"ContainerDied","Data":"ff449c6fd9734c255ba38e431f9ed9d549ba1c03b408147c473f00ecf95ede87"} Jun 08 21:13:52.395862 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:52.395760 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-79.ec2.internal" event={"ID":"8d2f4ab0296ea13816c307edf2a2d2c0","Type":"ContainerStarted","Data":"7cea6f837acab93946ad9438e9074916576c226994d59e27fcd7e4324c8f8a5a"} Jun 08 21:13:53.341100 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:53.341042 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:13:53.341634 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:53.341266 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgmqb" podUID="30982bae-7fbf-49b2-a16a-2b01df5d6a30" Jun 08 21:13:53.414175 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:53.414136 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-79.ec2.internal" event={"ID":"e761856f3e5ce01ff1b2fb776f5e563c","Type":"ContainerStarted","Data":"045b104c12f7130cbb4c6c0b5a3df9898aacd3a8198f60d18a6df5961eef49a7"} Jun 08 21:13:53.430438 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:53.429428 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-79.ec2.internal" podStartSLOduration=4.429407086 podStartE2EDuration="4.429407086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:13:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:13:52.411361157 +0000 UTC m=+4.551404040" watchObservedRunningTime="2026-06-08 21:13:53.429407086 +0000 UTC m=+5.569449965" Jun 08 21:13:53.917150 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:53.915753 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7nl4\" (UniqueName: \"kubernetes.io/projected/54e29e23-7c54-491b-886c-cf0c300aefe7-kube-api-access-k7nl4\") pod \"network-check-target-swvjh\" (UID: \"54e29e23-7c54-491b-886c-cf0c300aefe7\") " pod="openshift-network-diagnostics/network-check-target-swvjh" Jun 08 21:13:53.917150 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:53.915825 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69e600b7-7393-4b2c-8e83-3b5fd3e07b31-metrics-certs\") pod \"network-metrics-daemon-9jghf\" (UID: \"69e600b7-7393-4b2c-8e83-3b5fd3e07b31\") " pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:13:53.917150 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:53.915860 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30982bae-7fbf-49b2-a16a-2b01df5d6a30-original-pull-secret\") pod \"global-pull-secret-syncer-qgmqb\" (UID: \"30982bae-7fbf-49b2-a16a-2b01df5d6a30\") " pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:13:53.917150 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:53.916019 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:13:53.917150 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:53.916107 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30982bae-7fbf-49b2-a16a-2b01df5d6a30-original-pull-secret podName:30982bae-7fbf-49b2-a16a-2b01df5d6a30 nodeName:}" failed. No retries permitted until 2026-06-08 21:13:57.916086522 +0000 UTC m=+10.056129396 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30982bae-7fbf-49b2-a16a-2b01df5d6a30-original-pull-secret") pod "global-pull-secret-syncer-qgmqb" (UID: "30982bae-7fbf-49b2-a16a-2b01df5d6a30") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:13:53.917150 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:53.916746 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:13:53.917150 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:53.916768 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:13:53.917150 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:53.916780 2564 projected.go:196] Error preparing data for projected volume kube-api-access-k7nl4 for pod openshift-network-diagnostics/network-check-target-swvjh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:13:53.917150 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:53.916829 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54e29e23-7c54-491b-886c-cf0c300aefe7-kube-api-access-k7nl4 podName:54e29e23-7c54-491b-886c-cf0c300aefe7 nodeName:}" failed. No retries permitted until 2026-06-08 21:13:57.916814786 +0000 UTC m=+10.056857666 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-k7nl4" (UniqueName: "kubernetes.io/projected/54e29e23-7c54-491b-886c-cf0c300aefe7-kube-api-access-k7nl4") pod "network-check-target-swvjh" (UID: "54e29e23-7c54-491b-886c-cf0c300aefe7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:13:53.917150 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:53.916897 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:13:53.917150 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:53.916930 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e600b7-7393-4b2c-8e83-3b5fd3e07b31-metrics-certs podName:69e600b7-7393-4b2c-8e83-3b5fd3e07b31 nodeName:}" failed. No retries permitted until 2026-06-08 21:13:57.916918595 +0000 UTC m=+10.056961460 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69e600b7-7393-4b2c-8e83-3b5fd3e07b31-metrics-certs") pod "network-metrics-daemon-9jghf" (UID: "69e600b7-7393-4b2c-8e83-3b5fd3e07b31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:13:54.341234 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:54.341201 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swvjh" Jun 08 21:13:54.341689 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:54.341201 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:13:54.341689 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:54.341339 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swvjh" podUID="54e29e23-7c54-491b-886c-cf0c300aefe7" Jun 08 21:13:54.341689 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:54.341419 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9jghf" podUID="69e600b7-7393-4b2c-8e83-3b5fd3e07b31" Jun 08 21:13:55.342430 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:55.341909 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:13:55.342430 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:55.342047 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgmqb" podUID="30982bae-7fbf-49b2-a16a-2b01df5d6a30" Jun 08 21:13:56.341862 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:56.341383 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:13:56.341862 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:56.341424 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swvjh" Jun 08 21:13:56.341862 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:56.341518 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9jghf" podUID="69e600b7-7393-4b2c-8e83-3b5fd3e07b31" Jun 08 21:13:56.341862 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:56.341627 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swvjh" podUID="54e29e23-7c54-491b-886c-cf0c300aefe7" Jun 08 21:13:57.341883 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:57.341411 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:13:57.341883 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:57.341544 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgmqb" podUID="30982bae-7fbf-49b2-a16a-2b01df5d6a30" Jun 08 21:13:57.947949 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:57.947907 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69e600b7-7393-4b2c-8e83-3b5fd3e07b31-metrics-certs\") pod \"network-metrics-daemon-9jghf\" (UID: \"69e600b7-7393-4b2c-8e83-3b5fd3e07b31\") " pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:13:57.948126 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:57.947972 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30982bae-7fbf-49b2-a16a-2b01df5d6a30-original-pull-secret\") pod \"global-pull-secret-syncer-qgmqb\" (UID: \"30982bae-7fbf-49b2-a16a-2b01df5d6a30\") " pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:13:57.948126 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:57.948044 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7nl4\" (UniqueName: \"kubernetes.io/projected/54e29e23-7c54-491b-886c-cf0c300aefe7-kube-api-access-k7nl4\") pod \"network-check-target-swvjh\" (UID: \"54e29e23-7c54-491b-886c-cf0c300aefe7\") " pod="openshift-network-diagnostics/network-check-target-swvjh" Jun 08 21:13:57.948126 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:57.948081 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:13:57.948315 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:57.948154 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e600b7-7393-4b2c-8e83-3b5fd3e07b31-metrics-certs podName:69e600b7-7393-4b2c-8e83-3b5fd3e07b31 nodeName:}" failed. No retries permitted until 2026-06-08 21:14:05.94813261 +0000 UTC m=+18.088175471 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69e600b7-7393-4b2c-8e83-3b5fd3e07b31-metrics-certs") pod "network-metrics-daemon-9jghf" (UID: "69e600b7-7393-4b2c-8e83-3b5fd3e07b31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:13:57.948315 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:57.948152 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:13:57.948315 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:57.948185 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:13:57.948315 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:57.948206 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:13:57.948315 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:57.948216 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30982bae-7fbf-49b2-a16a-2b01df5d6a30-original-pull-secret podName:30982bae-7fbf-49b2-a16a-2b01df5d6a30 nodeName:}" failed. No retries permitted until 2026-06-08 21:14:05.948196849 +0000 UTC m=+18.088239712 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30982bae-7fbf-49b2-a16a-2b01df5d6a30-original-pull-secret") pod "global-pull-secret-syncer-qgmqb" (UID: "30982bae-7fbf-49b2-a16a-2b01df5d6a30") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:13:57.948315 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:57.948219 2564 projected.go:196] Error preparing data for projected volume kube-api-access-k7nl4 for pod openshift-network-diagnostics/network-check-target-swvjh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:13:57.948315 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:57.948277 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54e29e23-7c54-491b-886c-cf0c300aefe7-kube-api-access-k7nl4 podName:54e29e23-7c54-491b-886c-cf0c300aefe7 nodeName:}" failed. No retries permitted until 2026-06-08 21:14:05.948261868 +0000 UTC m=+18.088304728 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-k7nl4" (UniqueName: "kubernetes.io/projected/54e29e23-7c54-491b-886c-cf0c300aefe7-kube-api-access-k7nl4") pod "network-check-target-swvjh" (UID: "54e29e23-7c54-491b-886c-cf0c300aefe7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:13:58.341899 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:58.341860 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swvjh" Jun 08 21:13:58.342363 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:58.341978 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swvjh" podUID="54e29e23-7c54-491b-886c-cf0c300aefe7" Jun 08 21:13:58.342458 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:58.342432 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:13:58.342585 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:58.342554 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9jghf" podUID="69e600b7-7393-4b2c-8e83-3b5fd3e07b31" Jun 08 21:13:59.341312 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:13:59.341278 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:13:59.341497 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:13:59.341394 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgmqb" podUID="30982bae-7fbf-49b2-a16a-2b01df5d6a30" Jun 08 21:14:00.341373 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:00.341334 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swvjh" Jun 08 21:14:00.341373 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:00.341363 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:14:00.341869 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:00.341463 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swvjh" podUID="54e29e23-7c54-491b-886c-cf0c300aefe7" Jun 08 21:14:00.341869 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:00.341534 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9jghf" podUID="69e600b7-7393-4b2c-8e83-3b5fd3e07b31" Jun 08 21:14:01.341446 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:01.341413 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:14:01.341917 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:01.341542 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgmqb" podUID="30982bae-7fbf-49b2-a16a-2b01df5d6a30" Jun 08 21:14:02.341230 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:02.341185 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:14:02.341391 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:02.341191 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swvjh" Jun 08 21:14:02.341391 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:02.341319 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9jghf" podUID="69e600b7-7393-4b2c-8e83-3b5fd3e07b31" Jun 08 21:14:02.341492 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:02.341401 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swvjh" podUID="54e29e23-7c54-491b-886c-cf0c300aefe7" Jun 08 21:14:03.341872 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:03.341841 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:14:03.342296 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:03.341978 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgmqb" podUID="30982bae-7fbf-49b2-a16a-2b01df5d6a30" Jun 08 21:14:04.343683 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:04.343643 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swvjh" Jun 08 21:14:04.344205 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:04.343770 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swvjh" podUID="54e29e23-7c54-491b-886c-cf0c300aefe7" Jun 08 21:14:04.344205 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:04.344118 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:14:04.344304 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:04.344219 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9jghf" podUID="69e600b7-7393-4b2c-8e83-3b5fd3e07b31" Jun 08 21:14:05.341638 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:05.341594 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:14:05.341841 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:05.341742 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgmqb" podUID="30982bae-7fbf-49b2-a16a-2b01df5d6a30" Jun 08 21:14:06.015193 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:06.015150 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7nl4\" (UniqueName: \"kubernetes.io/projected/54e29e23-7c54-491b-886c-cf0c300aefe7-kube-api-access-k7nl4\") pod \"network-check-target-swvjh\" (UID: \"54e29e23-7c54-491b-886c-cf0c300aefe7\") " pod="openshift-network-diagnostics/network-check-target-swvjh" Jun 08 21:14:06.015193 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:06.015205 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69e600b7-7393-4b2c-8e83-3b5fd3e07b31-metrics-certs\") pod \"network-metrics-daemon-9jghf\" (UID: \"69e600b7-7393-4b2c-8e83-3b5fd3e07b31\") " pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:14:06.015649 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:06.015325 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:14:06.015649 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:06.015341 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:14:06.015649 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:06.015369 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:14:06.015649 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:06.015380 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e600b7-7393-4b2c-8e83-3b5fd3e07b31-metrics-certs podName:69e600b7-7393-4b2c-8e83-3b5fd3e07b31 nodeName:}" failed. No retries permitted until 2026-06-08 21:14:22.015365227 +0000 UTC m=+34.155408087 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69e600b7-7393-4b2c-8e83-3b5fd3e07b31-metrics-certs") pod "network-metrics-daemon-9jghf" (UID: "69e600b7-7393-4b2c-8e83-3b5fd3e07b31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:14:06.015649 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:06.015382 2564 projected.go:196] Error preparing data for projected volume kube-api-access-k7nl4 for pod openshift-network-diagnostics/network-check-target-swvjh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:14:06.015649 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:06.015396 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30982bae-7fbf-49b2-a16a-2b01df5d6a30-original-pull-secret\") pod \"global-pull-secret-syncer-qgmqb\" (UID: \"30982bae-7fbf-49b2-a16a-2b01df5d6a30\") " pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:14:06.015649 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:06.015425 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54e29e23-7c54-491b-886c-cf0c300aefe7-kube-api-access-k7nl4 podName:54e29e23-7c54-491b-886c-cf0c300aefe7 nodeName:}" failed. No retries permitted until 2026-06-08 21:14:22.015414448 +0000 UTC m=+34.155457306 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-k7nl4" (UniqueName: "kubernetes.io/projected/54e29e23-7c54-491b-886c-cf0c300aefe7-kube-api-access-k7nl4") pod "network-check-target-swvjh" (UID: "54e29e23-7c54-491b-886c-cf0c300aefe7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:14:06.015649 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:06.015445 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:14:06.015649 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:06.015468 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30982bae-7fbf-49b2-a16a-2b01df5d6a30-original-pull-secret podName:30982bae-7fbf-49b2-a16a-2b01df5d6a30 nodeName:}" failed. No retries permitted until 2026-06-08 21:14:22.01545954 +0000 UTC m=+34.155502398 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30982bae-7fbf-49b2-a16a-2b01df5d6a30-original-pull-secret") pod "global-pull-secret-syncer-qgmqb" (UID: "30982bae-7fbf-49b2-a16a-2b01df5d6a30") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:14:06.341741 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:06.341696 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:14:06.341915 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:06.341750 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swvjh" Jun 08 21:14:06.341915 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:06.341855 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9jghf" podUID="69e600b7-7393-4b2c-8e83-3b5fd3e07b31" Jun 08 21:14:06.342038 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:06.341974 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swvjh" podUID="54e29e23-7c54-491b-886c-cf0c300aefe7" Jun 08 21:14:07.341643 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:07.341603 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:14:07.342035 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:07.341742 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgmqb" podUID="30982bae-7fbf-49b2-a16a-2b01df5d6a30" Jun 08 21:14:08.342446 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:08.342399 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swvjh" Jun 08 21:14:08.342897 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:08.342507 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swvjh" podUID="54e29e23-7c54-491b-886c-cf0c300aefe7" Jun 08 21:14:08.342897 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:08.342887 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:14:08.343012 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:08.342990 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9jghf" podUID="69e600b7-7393-4b2c-8e83-3b5fd3e07b31" Jun 08 21:14:09.341791 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:09.341752 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:14:09.341986 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:09.341861 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgmqb" podUID="30982bae-7fbf-49b2-a16a-2b01df5d6a30" Jun 08 21:14:10.343316 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:10.343294 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swvjh" Jun 08 21:14:10.343606 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:10.343410 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swvjh" podUID="54e29e23-7c54-491b-886c-cf0c300aefe7" Jun 08 21:14:10.343806 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:10.343784 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:14:10.343907 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:10.343890 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9jghf" podUID="69e600b7-7393-4b2c-8e83-3b5fd3e07b31" Jun 08 21:14:10.452356 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:10.452313 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-km8nj" event={"ID":"3ccf1861-eb1f-494e-87b4-1508123ccfd6","Type":"ContainerStarted","Data":"bd7d8b93101587d39d627e783ec48c280affe5fbddaa476aec2832b3aeb7f335"} Jun 08 21:14:10.454825 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:10.454791 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvzqj" event={"ID":"63d534e1-4383-4105-8106-4024249357e9","Type":"ContainerStarted","Data":"72c091a7952376fdd6bdff3fa964ba964cb488b9475e5271726fc79bc1fd1507"} Jun 08 21:14:10.456844 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:10.456814 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bx6xk" event={"ID":"c1390673-1d07-4f52-b5cd-da6da7cdbdf6","Type":"ContainerStarted","Data":"196fc714009696ab12f9231176f607c88b088433a011eef275c6e8654fb9abb5"} Jun 08 21:14:10.474526 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:10.474469 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-79.ec2.internal" podStartSLOduration=21.474449533 podStartE2EDuration="21.474449533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:13:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:13:53.430666339 +0000 UTC m=+5.570709220" watchObservedRunningTime="2026-06-08 21:14:10.474449533 +0000 UTC m=+22.614492415" Jun 08 21:14:10.475001 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:10.474963 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-km8nj" podStartSLOduration=12.180733627 podStartE2EDuration="22.474951546s" totalImagesPullingTime="10.294217919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:13:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:14:10.474376233 +0000 UTC m=+22.614419387" watchObservedRunningTime="2026-06-08 21:14:10.474951546 +0000 UTC m=+22.614994428" Jun 08 21:14:11.341491 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:11.341291 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:14:11.341658 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:11.341574 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgmqb" podUID="30982bae-7fbf-49b2-a16a-2b01df5d6a30" Jun 08 21:14:11.460409 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:11.460373 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8rdm2" event={"ID":"d152d239-9949-4c45-ae86-7975965aeaa1","Type":"ContainerStarted","Data":"542af3028ae148b2e247d20d8f8da6ce62c946315a61b00563df45a97253336a"} Jun 08 21:14:11.464117 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:11.464094 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zmr52" event={"ID":"8ee88a26-ad92-4bad-91b5-612089504d71","Type":"ContainerStarted","Data":"41e8ae986f983cde51c1a52bafb8c4e5048fc147a41b88d7a38598640b95e5f1"} Jun 08 21:14:11.466020 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:11.465994 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" event={"ID":"68addd18-18e2-4d23-a9ff-c2c488ec7219","Type":"ContainerStarted","Data":"5ceb786ffe9307709d1dff2384f40207da762996b2f56292e2d5ba9d2a2fd344"} Jun 08 21:14:11.467558 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:11.467542 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 21:14:11.467840 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:11.467822 2564 generic.go:356] "Generic (PLEG): container finished" podID="68070959-71b5-45c6-828d-0a404231b097" containerID="44737579fbe94da0da0b456fb0f91736ca8fce847c3b4d91634b8021792a3a04" exitCode=0 Jun 08 21:14:11.467900 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:11.467888 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mlh7b" event={"ID":"68070959-71b5-45c6-828d-0a404231b097","Type":"ContainerDied","Data":"44737579fbe94da0da0b456fb0f91736ca8fce847c3b4d91634b8021792a3a04"} Jun 08 21:14:11.473371 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:11.473347 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" event={"ID":"9eb3105f-0406-4c64-b8c3-38b78c40d6d0","Type":"ContainerStarted","Data":"8e5d9a8afcd16c1b89c750a0729d150fa9cc9b25cbd72efe5dcbc5aa1c2fffd3"} Jun 08 21:14:11.473458 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:11.473409 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" event={"ID":"9eb3105f-0406-4c64-b8c3-38b78c40d6d0","Type":"ContainerStarted","Data":"4076e36a99e5f4d509bfcbf8b8d67c3337295cf570e85fd9c7610b0c3dac6e28"} Jun 08 21:14:11.473458 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:11.473444 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" event={"ID":"9eb3105f-0406-4c64-b8c3-38b78c40d6d0","Type":"ContainerStarted","Data":"1942658dbb36602cd50a53b982ff14e10a96ecc0a7f4aa4172c32fea379f80c1"} Jun 08 21:14:11.473558 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:11.473487 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" event={"ID":"9eb3105f-0406-4c64-b8c3-38b78c40d6d0","Type":"ContainerStarted","Data":"1f8db47dfca82be70170770bb176d2b8c8e1ef065a6363fb1a452a19fc6fb7f8"} Jun 08 21:14:11.473558 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:11.473524 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" event={"ID":"9eb3105f-0406-4c64-b8c3-38b78c40d6d0","Type":"ContainerStarted","Data":"2a85efe74a5608a0cb857811aaeb118fd891a034429927183e9c9cf670a59cd6"} Jun 08 21:14:11.473657 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:11.473564 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" event={"ID":"9eb3105f-0406-4c64-b8c3-38b78c40d6d0","Type":"ContainerStarted","Data":"96fafcc15ddac42965758c32211544a409f679851612fe3e4427379659522560"} Jun 08 21:14:11.477059 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:11.477023 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8rdm2" podStartSLOduration=4.449753585 podStartE2EDuration="23.477011513s" totalImagesPullingTime="19.027257928s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:13:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:14:11.476271423 +0000 UTC m=+23.616314304" watchObservedRunningTime="2026-06-08 21:14:11.477011513 +0000 UTC m=+23.617054393" Jun 08 21:14:11.492614 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:11.492569 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kf8t9" podStartSLOduration=4.457905486 podStartE2EDuration="23.492559185s" totalImagesPullingTime="19.034653699s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:13:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:14:11.491949767 +0000 UTC m=+23.631992647" watchObservedRunningTime="2026-06-08 21:14:11.492559185 +0000 UTC m=+23.632602090" Jun 08 21:14:11.505743 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:11.505700 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zmr52" podStartSLOduration=4.493237124 podStartE2EDuration="23.505686868s" totalImagesPullingTime="19.012449744s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:13:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:14:11.505584127 +0000 UTC m=+23.645627007" watchObservedRunningTime="2026-06-08 21:14:11.505686868 +0000 UTC m=+23.645729748" Jun 08 21:14:11.556316 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:11.556262 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bx6xk" podStartSLOduration=4.833058005 podStartE2EDuration="23.556248115s" totalImagesPullingTime="18.72319011s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:13:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:14:11.556172591 +0000 UTC m=+23.696215471" watchObservedRunningTime="2026-06-08 21:14:11.556248115 +0000 UTC m=+23.696290996" Jun 08 21:14:12.341014 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:12.340975 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swvjh" Jun 08 21:14:12.341237 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:12.340999 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:14:12.341237 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:12.341160 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swvjh" podUID="54e29e23-7c54-491b-886c-cf0c300aefe7" Jun 08 21:14:12.341237 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:12.341222 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9jghf" podUID="69e600b7-7393-4b2c-8e83-3b5fd3e07b31" Jun 08 21:14:12.345444 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:12.345335 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T21:14:11.467555619Z","UUID":"7e2f3811-d5fd-4070-887c-610f1f0ec67f","Handler":null,"Name":"","Endpoint":""} Jun 08 21:14:12.347757 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:12.347733 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 21:14:12.347896 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:12.347879 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 21:14:12.477758 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:12.477724 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvzqj" event={"ID":"63d534e1-4383-4105-8106-4024249357e9","Type":"ContainerStarted","Data":"3b6db6eb781e8bae57f6f28e29f8b25ce88af395b2305bc3cde21551d02497a3"} Jun 08 21:14:12.479428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:12.479400 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9fjnh" event={"ID":"d0fecdbc-84b7-45d5-bbb1-efdd9ccf83ca","Type":"ContainerStarted","Data":"a202a7c1b48f1c9599541deb3d23a756e262c69134ed37cec04859d0e5d3b80c"} Jun 08 21:14:12.494355 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:12.494296 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9fjnh" podStartSLOduration=5.528232735 podStartE2EDuration="24.494275457s" totalImagesPullingTime="18.966042722s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:13:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:14:12.493822797 +0000 UTC m=+24.633865679" watchObservedRunningTime="2026-06-08 21:14:12.494275457 +0000 UTC m=+24.634318340" Jun 08 21:14:13.208154 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:13.208055 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-km8nj" Jun 08 21:14:13.341285 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:13.341259 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:14:13.341428 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:13.341363 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgmqb" podUID="30982bae-7fbf-49b2-a16a-2b01df5d6a30" Jun 08 21:14:13.487035 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:13.487002 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" event={"ID":"9eb3105f-0406-4c64-b8c3-38b78c40d6d0","Type":"ContainerStarted","Data":"f65165f3ecf356add83a25c3c222d18729c53cd516b9abfbaf732be840ba3b8a"} Jun 08 21:14:13.489542 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:13.489507 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvzqj" event={"ID":"63d534e1-4383-4105-8106-4024249357e9","Type":"ContainerStarted","Data":"7c3596f2ffd9e4f316a3900da26dad8e6c5ef43f8dc42b2724b19bfe476bb735"} Jun 08 21:14:13.505941 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:13.505884 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvzqj" podStartSLOduration=3.714245203 podStartE2EDuration="25.505862837s" totalImagesPullingTime="21.791617634s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:13:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:14:13.505722828 +0000 UTC m=+25.645765708" watchObservedRunningTime="2026-06-08 21:14:13.505862837 +0000 UTC m=+25.645905719" Jun 08 21:14:14.341661 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:14.341622 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swvjh" Jun 08 21:14:14.341894 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:14.341750 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swvjh" podUID="54e29e23-7c54-491b-886c-cf0c300aefe7" Jun 08 21:14:14.341894 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:14.341790 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:14:14.341894 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:14.341879 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9jghf" podUID="69e600b7-7393-4b2c-8e83-3b5fd3e07b31" Jun 08 21:14:14.412139 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:14.412099 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-km8nj" Jun 08 21:14:14.412734 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:14.412715 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-km8nj" Jun 08 21:14:14.492229 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:14.492203 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-km8nj" Jun 08 21:14:15.341976 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:15.341707 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:14:15.342206 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:15.342094 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgmqb" podUID="30982bae-7fbf-49b2-a16a-2b01df5d6a30" Jun 08 21:14:15.497537 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:15.497507 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" event={"ID":"9eb3105f-0406-4c64-b8c3-38b78c40d6d0","Type":"ContainerStarted","Data":"b095d912e2d58e75cb64579fba95961311097378a1870047dd2ade7500cab98d"} Jun 08 21:14:15.524138 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:15.524060 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" podStartSLOduration=8.420591805 podStartE2EDuration="27.524043155s" totalImagesPullingTime="19.10345135s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:13:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:14:15.522196359 +0000 UTC m=+27.662239239" watchObservedRunningTime="2026-06-08 21:14:15.524043155 +0000 UTC m=+27.664086038" Jun 08 21:14:16.344499 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:16.344462 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:14:16.344679 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:16.344608 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9jghf" podUID="69e600b7-7393-4b2c-8e83-3b5fd3e07b31" Jun 08 21:14:16.345624 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:16.344978 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swvjh" Jun 08 21:14:16.346248 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:16.346208 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swvjh" podUID="54e29e23-7c54-491b-886c-cf0c300aefe7" Jun 08 21:14:16.500132 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:16.500102 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:14:16.500575 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:16.500180 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:14:16.500575 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:16.500210 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:14:16.516361 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:16.516336 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:14:16.516526 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:16.516472 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:14:17.017806 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:17.017759 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-swvjh"] Jun 08 21:14:17.017984 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:17.017947 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swvjh" Jun 08 21:14:17.018100 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:17.018054 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swvjh" podUID="54e29e23-7c54-491b-886c-cf0c300aefe7" Jun 08 21:14:17.020011 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:17.019980 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9jghf"] Jun 08 21:14:17.020169 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:17.020128 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:14:17.020285 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:17.020247 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9jghf" podUID="69e600b7-7393-4b2c-8e83-3b5fd3e07b31" Jun 08 21:14:17.020874 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:17.020851 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qgmqb"] Jun 08 21:14:17.020970 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:17.020949 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:14:17.021113 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:17.021046 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgmqb" podUID="30982bae-7fbf-49b2-a16a-2b01df5d6a30" Jun 08 21:14:18.341801 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:18.341769 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:14:18.342363 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:18.341902 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9jghf" podUID="69e600b7-7393-4b2c-8e83-3b5fd3e07b31" Jun 08 21:14:18.342363 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:18.341981 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swvjh" Jun 08 21:14:18.342363 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:18.342104 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:14:18.342363 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:18.342125 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swvjh" podUID="54e29e23-7c54-491b-886c-cf0c300aefe7" Jun 08 21:14:18.342363 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:18.342163 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgmqb" podUID="30982bae-7fbf-49b2-a16a-2b01df5d6a30" Jun 08 21:14:19.509306 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:19.509062 2564 generic.go:356] "Generic (PLEG): container finished" podID="68070959-71b5-45c6-828d-0a404231b097" containerID="02f320345c9a2b1fbafd7416dc12457ca12844fdf1111917da4a00e02fcf4ce5" exitCode=0 Jun 08 21:14:19.509306 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:19.509108 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mlh7b" event={"ID":"68070959-71b5-45c6-828d-0a404231b097","Type":"ContainerDied","Data":"02f320345c9a2b1fbafd7416dc12457ca12844fdf1111917da4a00e02fcf4ce5"} Jun 08 21:14:20.341086 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:20.341042 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:14:20.341256 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:20.341042 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swvjh" Jun 08 21:14:20.341256 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:20.341191 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:14:20.341256 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:20.341193 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgmqb" podUID="30982bae-7fbf-49b2-a16a-2b01df5d6a30" Jun 08 21:14:20.341420 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:20.341297 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swvjh" podUID="54e29e23-7c54-491b-886c-cf0c300aefe7" Jun 08 21:14:20.341420 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:20.341396 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9jghf" podUID="69e600b7-7393-4b2c-8e83-3b5fd3e07b31" Jun 08 21:14:21.515125 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:21.515090 2564 generic.go:356] "Generic (PLEG): container finished" podID="68070959-71b5-45c6-828d-0a404231b097" containerID="cf80b977b52962dc721dc4963726b7cfd6c3023714bdc7da624da74f73933726" exitCode=0 Jun 08 21:14:21.515765 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:21.515143 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mlh7b" event={"ID":"68070959-71b5-45c6-828d-0a404231b097","Type":"ContainerDied","Data":"cf80b977b52962dc721dc4963726b7cfd6c3023714bdc7da624da74f73933726"} Jun 08 21:14:22.036234 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:22.036193 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69e600b7-7393-4b2c-8e83-3b5fd3e07b31-metrics-certs\") pod \"network-metrics-daemon-9jghf\" (UID: \"69e600b7-7393-4b2c-8e83-3b5fd3e07b31\") " pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:14:22.036400 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:22.036242 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30982bae-7fbf-49b2-a16a-2b01df5d6a30-original-pull-secret\") pod \"global-pull-secret-syncer-qgmqb\" (UID: \"30982bae-7fbf-49b2-a16a-2b01df5d6a30\") " pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:14:22.036400 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:22.036301 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7nl4\" (UniqueName: \"kubernetes.io/projected/54e29e23-7c54-491b-886c-cf0c300aefe7-kube-api-access-k7nl4\") pod \"network-check-target-swvjh\" (UID: \"54e29e23-7c54-491b-886c-cf0c300aefe7\") " pod="openshift-network-diagnostics/network-check-target-swvjh" Jun 08 21:14:22.036400 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:22.036377 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:14:22.036499 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:22.036401 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:14:22.036499 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:22.036417 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:14:22.036499 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:22.036422 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:14:22.036499 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:22.036448 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e600b7-7393-4b2c-8e83-3b5fd3e07b31-metrics-certs podName:69e600b7-7393-4b2c-8e83-3b5fd3e07b31 nodeName:}" failed. No retries permitted until 2026-06-08 21:14:54.036428086 +0000 UTC m=+66.176470964 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69e600b7-7393-4b2c-8e83-3b5fd3e07b31-metrics-certs") pod "network-metrics-daemon-9jghf" (UID: "69e600b7-7393-4b2c-8e83-3b5fd3e07b31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:14:22.036499 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:22.036476 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30982bae-7fbf-49b2-a16a-2b01df5d6a30-original-pull-secret podName:30982bae-7fbf-49b2-a16a-2b01df5d6a30 nodeName:}" failed. No retries permitted until 2026-06-08 21:14:54.036462933 +0000 UTC m=+66.176505792 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30982bae-7fbf-49b2-a16a-2b01df5d6a30-original-pull-secret") pod "global-pull-secret-syncer-qgmqb" (UID: "30982bae-7fbf-49b2-a16a-2b01df5d6a30") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:14:22.036499 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:22.036430 2564 projected.go:196] Error preparing data for projected volume kube-api-access-k7nl4 for pod openshift-network-diagnostics/network-check-target-swvjh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:14:22.036679 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:22.036507 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54e29e23-7c54-491b-886c-cf0c300aefe7-kube-api-access-k7nl4 podName:54e29e23-7c54-491b-886c-cf0c300aefe7 nodeName:}" failed. No retries permitted until 2026-06-08 21:14:54.036501455 +0000 UTC m=+66.176544313 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-k7nl4" (UniqueName: "kubernetes.io/projected/54e29e23-7c54-491b-886c-cf0c300aefe7-kube-api-access-k7nl4") pod "network-check-target-swvjh" (UID: "54e29e23-7c54-491b-886c-cf0c300aefe7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:14:22.341237 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:22.341152 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:14:22.341388 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:22.341156 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swvjh" Jun 08 21:14:22.341388 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:22.341286 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9jghf" podUID="69e600b7-7393-4b2c-8e83-3b5fd3e07b31" Jun 08 21:14:22.341388 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:22.341168 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:14:22.341507 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:22.341379 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swvjh" podUID="54e29e23-7c54-491b-886c-cf0c300aefe7" Jun 08 21:14:22.341507 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:22.341470 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qgmqb" podUID="30982bae-7fbf-49b2-a16a-2b01df5d6a30" Jun 08 21:14:23.190130 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.190048 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-79.ec2.internal" event="NodeReady" Jun 08 21:14:23.190555 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.190208 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 21:14:23.225036 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.224999 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78b77f675-grvwb"] Jun 08 21:14:23.244728 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.244698 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-84b76"] Jun 08 21:14:23.244906 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.244819 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:14:23.247371 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.247335 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 08 21:14:23.247646 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.247629 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 08 21:14:23.248108 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.247856 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-x6djq\"" Jun 08 21:14:23.248108 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.247948 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 08 21:14:23.257464 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.255568 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 08 21:14:23.262054 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.262020 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ms72g"] Jun 08 21:14:23.262218 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.262143 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-84b76" Jun 08 21:14:23.264917 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.264895 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 21:14:23.265237 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.265220 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 21:14:23.265301 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.265268 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6vb88\"" Jun 08 21:14:23.286168 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.286138 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78b77f675-grvwb"] Jun 08 21:14:23.286168 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.286174 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ms72g"] Jun 08 21:14:23.286353 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.286188 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-84b76"] Jun 08 21:14:23.286353 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.286264 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ms72g" Jun 08 21:14:23.289312 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.289283 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 21:14:23.289312 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.289284 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fr2mn\"" Jun 08 21:14:23.289485 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.289338 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 21:14:23.289611 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.289597 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 21:14:23.345740 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.345696 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a49114d7-546a-48fe-b312-10f9c9e04f34-image-registry-private-configuration\") pod \"image-registry-78b77f675-grvwb\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:14:23.345740 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.345736 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-tmp-dir\") pod \"dns-default-84b76\" (UID: \"32c5f89b-dbcb-4c62-b411-d5ce3b45ee03\") " pod="openshift-dns/dns-default-84b76" Jun 08 21:14:23.346009 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.345760 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl5l6\" (UniqueName: \"kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-kube-api-access-gl5l6\") pod \"image-registry-78b77f675-grvwb\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:14:23.346009 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.345850 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-bound-sa-token\") pod \"image-registry-78b77f675-grvwb\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:14:23.346009 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.345908 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a49114d7-546a-48fe-b312-10f9c9e04f34-installation-pull-secrets\") pod \"image-registry-78b77f675-grvwb\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:14:23.346009 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.345943 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-tls\") pod \"image-registry-78b77f675-grvwb\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:14:23.346009 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.345968 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a49114d7-546a-48fe-b312-10f9c9e04f34-ca-trust-extracted\") pod \"image-registry-78b77f675-grvwb\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:14:23.346009 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.345993 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-config-volume\") pod \"dns-default-84b76\" (UID: \"32c5f89b-dbcb-4c62-b411-d5ce3b45ee03\") " pod="openshift-dns/dns-default-84b76" Jun 08 21:14:23.346292 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.346022 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-certificates\") pod \"image-registry-78b77f675-grvwb\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:14:23.346292 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.346047 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-metrics-tls\") pod \"dns-default-84b76\" (UID: \"32c5f89b-dbcb-4c62-b411-d5ce3b45ee03\") " pod="openshift-dns/dns-default-84b76" Jun 08 21:14:23.346292 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.346116 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvvm7\" (UniqueName: \"kubernetes.io/projected/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-kube-api-access-gvvm7\") pod \"dns-default-84b76\" (UID: \"32c5f89b-dbcb-4c62-b411-d5ce3b45ee03\") " pod="openshift-dns/dns-default-84b76" Jun 08 21:14:23.346292 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.346145 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a49114d7-546a-48fe-b312-10f9c9e04f34-trusted-ca\") pod \"image-registry-78b77f675-grvwb\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:14:23.447256 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.447173 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a49114d7-546a-48fe-b312-10f9c9e04f34-installation-pull-secrets\") pod \"image-registry-78b77f675-grvwb\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:14:23.447256 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.447217 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-tls\") pod \"image-registry-78b77f675-grvwb\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:14:23.447256 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.447233 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a49114d7-546a-48fe-b312-10f9c9e04f34-ca-trust-extracted\") pod \"image-registry-78b77f675-grvwb\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:14:23.447522 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:23.447350 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 21:14:23.447522 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:23.447375 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b77f675-grvwb: secret "image-registry-tls" not found Jun 08 21:14:23.447522 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.447371 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-config-volume\") pod \"dns-default-84b76\" (UID: \"32c5f89b-dbcb-4c62-b411-d5ce3b45ee03\") " pod="openshift-dns/dns-default-84b76" Jun 08 21:14:23.447522 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:23.447455 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-tls podName:a49114d7-546a-48fe-b312-10f9c9e04f34 nodeName:}" failed. No retries permitted until 2026-06-08 21:14:23.947433123 +0000 UTC m=+36.087476004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-tls") pod "image-registry-78b77f675-grvwb" (UID: "a49114d7-546a-48fe-b312-10f9c9e04f34") : secret "image-registry-tls" not found Jun 08 21:14:23.447522 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.447494 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-certificates\") pod \"image-registry-78b77f675-grvwb\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:14:23.447522 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.447522 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-metrics-tls\") pod \"dns-default-84b76\" (UID: \"32c5f89b-dbcb-4c62-b411-d5ce3b45ee03\") " pod="openshift-dns/dns-default-84b76" Jun 08 21:14:23.447903 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.447584 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a49114d7-546a-48fe-b312-10f9c9e04f34-ca-trust-extracted\") pod \"image-registry-78b77f675-grvwb\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:14:23.447903 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:23.447603 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:14:23.447903 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.447638 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvvm7\" (UniqueName: \"kubernetes.io/projected/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-kube-api-access-gvvm7\") pod \"dns-default-84b76\" (UID: \"32c5f89b-dbcb-4c62-b411-d5ce3b45ee03\") " pod="openshift-dns/dns-default-84b76" Jun 08 21:14:23.447903 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:23.447650 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-metrics-tls podName:32c5f89b-dbcb-4c62-b411-d5ce3b45ee03 nodeName:}" failed. No retries permitted until 2026-06-08 21:14:23.947636221 +0000 UTC m=+36.087679093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-metrics-tls") pod "dns-default-84b76" (UID: "32c5f89b-dbcb-4c62-b411-d5ce3b45ee03") : secret "dns-default-metrics-tls" not found Jun 08 21:14:23.447903 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.447683 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a49114d7-546a-48fe-b312-10f9c9e04f34-trusted-ca\") pod \"image-registry-78b77f675-grvwb\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:14:23.447903 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.447731 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a49114d7-546a-48fe-b312-10f9c9e04f34-image-registry-private-configuration\") pod \"image-registry-78b77f675-grvwb\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:14:23.447903 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.447759 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-tmp-dir\") pod \"dns-default-84b76\" (UID: \"32c5f89b-dbcb-4c62-b411-d5ce3b45ee03\") " pod="openshift-dns/dns-default-84b76" Jun 08 21:14:23.447903 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.447786 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d9e9533-81fc-454f-83ae-7482b70c189a-cert\") pod \"ingress-canary-ms72g\" (UID: \"5d9e9533-81fc-454f-83ae-7482b70c189a\") " pod="openshift-ingress-canary/ingress-canary-ms72g" Jun 08 21:14:23.447903 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.447813 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl5l6\" (UniqueName: \"kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-kube-api-access-gl5l6\") pod \"image-registry-78b77f675-grvwb\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:14:23.447903 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.447841 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b44cc\" (UniqueName: \"kubernetes.io/projected/5d9e9533-81fc-454f-83ae-7482b70c189a-kube-api-access-b44cc\") pod \"ingress-canary-ms72g\" (UID: \"5d9e9533-81fc-454f-83ae-7482b70c189a\") " pod="openshift-ingress-canary/ingress-canary-ms72g" Jun 08 21:14:23.447903 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.447886 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-bound-sa-token\") pod \"image-registry-78b77f675-grvwb\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:14:23.448398 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.447912 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-config-volume\") pod \"dns-default-84b76\" (UID: \"32c5f89b-dbcb-4c62-b411-d5ce3b45ee03\") " pod="openshift-dns/dns-default-84b76" Jun 08 21:14:23.448398 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.448016 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-certificates\") pod \"image-registry-78b77f675-grvwb\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:14:23.448398 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.448027 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-tmp-dir\") pod \"dns-default-84b76\" (UID: \"32c5f89b-dbcb-4c62-b411-d5ce3b45ee03\") " pod="openshift-dns/dns-default-84b76" Jun 08 21:14:23.448822 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.448801 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a49114d7-546a-48fe-b312-10f9c9e04f34-trusted-ca\") pod \"image-registry-78b77f675-grvwb\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:14:23.452956 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.452931 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a49114d7-546a-48fe-b312-10f9c9e04f34-image-registry-private-configuration\") pod \"image-registry-78b77f675-grvwb\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:14:23.453042 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.452995 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a49114d7-546a-48fe-b312-10f9c9e04f34-installation-pull-secrets\") pod \"image-registry-78b77f675-grvwb\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:14:23.456676 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.456653 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-bound-sa-token\") pod \"image-registry-78b77f675-grvwb\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:14:23.457123 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.457106 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl5l6\" (UniqueName: \"kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-kube-api-access-gl5l6\") pod \"image-registry-78b77f675-grvwb\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:14:23.477177 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.477139 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvvm7\" (UniqueName: \"kubernetes.io/projected/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-kube-api-access-gvvm7\") pod \"dns-default-84b76\" (UID: \"32c5f89b-dbcb-4c62-b411-d5ce3b45ee03\") " pod="openshift-dns/dns-default-84b76" Jun 08 21:14:23.523388 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.523341 2564 generic.go:356] "Generic (PLEG): container finished" podID="68070959-71b5-45c6-828d-0a404231b097" containerID="c9eed7f74c72846569ec9ea35c47d4fa5d65963c6833c21626e2c1e99ed79fa2" exitCode=0 Jun 08 21:14:23.523564 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.523393 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mlh7b" event={"ID":"68070959-71b5-45c6-828d-0a404231b097","Type":"ContainerDied","Data":"c9eed7f74c72846569ec9ea35c47d4fa5d65963c6833c21626e2c1e99ed79fa2"} Jun 08 21:14:23.548374 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.548338 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d9e9533-81fc-454f-83ae-7482b70c189a-cert\") pod \"ingress-canary-ms72g\" (UID: \"5d9e9533-81fc-454f-83ae-7482b70c189a\") " pod="openshift-ingress-canary/ingress-canary-ms72g" Jun 08 21:14:23.548374 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.548372 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b44cc\" (UniqueName: \"kubernetes.io/projected/5d9e9533-81fc-454f-83ae-7482b70c189a-kube-api-access-b44cc\") pod \"ingress-canary-ms72g\" (UID: \"5d9e9533-81fc-454f-83ae-7482b70c189a\") " pod="openshift-ingress-canary/ingress-canary-ms72g" Jun 08 21:14:23.550930 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.550899 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d9e9533-81fc-454f-83ae-7482b70c189a-cert\") pod \"ingress-canary-ms72g\" (UID: \"5d9e9533-81fc-454f-83ae-7482b70c189a\") " pod="openshift-ingress-canary/ingress-canary-ms72g" Jun 08 21:14:23.556816 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.556784 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b44cc\" (UniqueName: \"kubernetes.io/projected/5d9e9533-81fc-454f-83ae-7482b70c189a-kube-api-access-b44cc\") pod \"ingress-canary-ms72g\" (UID: \"5d9e9533-81fc-454f-83ae-7482b70c189a\") " pod="openshift-ingress-canary/ingress-canary-ms72g" Jun 08 21:14:23.594907 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.594871 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ms72g" Jun 08 21:14:23.768807 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.768775 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ms72g"] Jun 08 21:14:23.772702 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:14:23.772670 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d9e9533_81fc_454f_83ae_7482b70c189a.slice/crio-0411db9d1a622cca5bafefefdafb7884e66aff9b202b74b09a348be92824a667 WatchSource:0}: Error finding container 0411db9d1a622cca5bafefefdafb7884e66aff9b202b74b09a348be92824a667: Status 404 returned error can't find the container with id 0411db9d1a622cca5bafefefdafb7884e66aff9b202b74b09a348be92824a667 Jun 08 21:14:23.953428 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.953389 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-metrics-tls\") pod \"dns-default-84b76\" (UID: \"32c5f89b-dbcb-4c62-b411-d5ce3b45ee03\") " pod="openshift-dns/dns-default-84b76" Jun 08 21:14:23.953643 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:23.953505 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-tls\") pod \"image-registry-78b77f675-grvwb\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:14:23.953643 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:23.953533 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:14:23.953643 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:23.953613 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 21:14:23.953643 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:23.953627 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b77f675-grvwb: secret "image-registry-tls" not found Jun 08 21:14:23.953863 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:23.953617 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-metrics-tls podName:32c5f89b-dbcb-4c62-b411-d5ce3b45ee03 nodeName:}" failed. No retries permitted until 2026-06-08 21:14:24.95359632 +0000 UTC m=+37.093639183 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-metrics-tls") pod "dns-default-84b76" (UID: "32c5f89b-dbcb-4c62-b411-d5ce3b45ee03") : secret "dns-default-metrics-tls" not found Jun 08 21:14:23.953863 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:23.953680 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-tls podName:a49114d7-546a-48fe-b312-10f9c9e04f34 nodeName:}" failed. No retries permitted until 2026-06-08 21:14:24.953664631 +0000 UTC m=+37.093707498 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-tls") pod "image-registry-78b77f675-grvwb" (UID: "a49114d7-546a-48fe-b312-10f9c9e04f34") : secret "image-registry-tls" not found Jun 08 21:14:24.341780 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:24.341738 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:14:24.341780 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:24.341775 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swvjh" Jun 08 21:14:24.342486 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:24.341775 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:14:24.344709 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:24.344688 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dsw77\"" Jun 08 21:14:24.346086 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:24.346051 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 21:14:24.346086 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:24.346060 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 21:14:24.346285 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:24.346125 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 21:14:24.346285 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:24.346177 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 21:14:24.346285 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:24.346126 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zf2sl\"" Jun 08 21:14:24.528243 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:24.528197 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ms72g" event={"ID":"5d9e9533-81fc-454f-83ae-7482b70c189a","Type":"ContainerStarted","Data":"0411db9d1a622cca5bafefefdafb7884e66aff9b202b74b09a348be92824a667"} Jun 08 21:14:24.960531 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:24.960493 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-tls\") pod \"image-registry-78b77f675-grvwb\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:14:24.960531 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:24.960545 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-metrics-tls\") pod \"dns-default-84b76\" (UID: \"32c5f89b-dbcb-4c62-b411-d5ce3b45ee03\") " pod="openshift-dns/dns-default-84b76" Jun 08 21:14:24.960838 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:24.960690 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 21:14:24.960838 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:24.960704 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:14:24.960838 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:24.960713 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b77f675-grvwb: secret "image-registry-tls" not found Jun 08 21:14:24.960838 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:24.960764 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-metrics-tls podName:32c5f89b-dbcb-4c62-b411-d5ce3b45ee03 nodeName:}" failed. No retries permitted until 2026-06-08 21:14:26.960746794 +0000 UTC m=+39.100789653 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-metrics-tls") pod "dns-default-84b76" (UID: "32c5f89b-dbcb-4c62-b411-d5ce3b45ee03") : secret "dns-default-metrics-tls" not found Jun 08 21:14:24.960838 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:24.960783 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-tls podName:a49114d7-546a-48fe-b312-10f9c9e04f34 nodeName:}" failed. No retries permitted until 2026-06-08 21:14:26.960773889 +0000 UTC m=+39.100816748 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-tls") pod "image-registry-78b77f675-grvwb" (UID: "a49114d7-546a-48fe-b312-10f9c9e04f34") : secret "image-registry-tls" not found Jun 08 21:14:26.977881 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:26.977790 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-tls\") pod \"image-registry-78b77f675-grvwb\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:14:26.977881 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:26.977843 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-metrics-tls\") pod \"dns-default-84b76\" (UID: \"32c5f89b-dbcb-4c62-b411-d5ce3b45ee03\") " pod="openshift-dns/dns-default-84b76" Jun 08 21:14:26.978353 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:26.977994 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 21:14:26.978353 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:26.978019 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b77f675-grvwb: secret "image-registry-tls" not found Jun 08 21:14:26.978353 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:26.978028 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:14:26.978353 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:26.978108 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-tls podName:a49114d7-546a-48fe-b312-10f9c9e04f34 nodeName:}" failed. No retries permitted until 2026-06-08 21:14:30.978086474 +0000 UTC m=+43.118129346 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-tls") pod "image-registry-78b77f675-grvwb" (UID: "a49114d7-546a-48fe-b312-10f9c9e04f34") : secret "image-registry-tls" not found Jun 08 21:14:26.978353 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:26.978128 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-metrics-tls podName:32c5f89b-dbcb-4c62-b411-d5ce3b45ee03 nodeName:}" failed. No retries permitted until 2026-06-08 21:14:30.978118985 +0000 UTC m=+43.118161849 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-metrics-tls") pod "dns-default-84b76" (UID: "32c5f89b-dbcb-4c62-b411-d5ce3b45ee03") : secret "dns-default-metrics-tls" not found Jun 08 21:14:29.541767 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:29.541727 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ms72g" event={"ID":"5d9e9533-81fc-454f-83ae-7482b70c189a","Type":"ContainerStarted","Data":"6c8a35f88155859ef96b8536cc9265db935c4c1b6e438fb85e69e7bdea4e55f4"} Jun 08 21:14:29.544396 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:29.544370 2564 generic.go:356] "Generic (PLEG): container finished" podID="68070959-71b5-45c6-828d-0a404231b097" containerID="1ed92bda26f833f6e830cdea22b37e6d754ffea23687d65efee0e604816616ae" exitCode=0 Jun 08 21:14:29.544557 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:29.544406 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mlh7b" event={"ID":"68070959-71b5-45c6-828d-0a404231b097","Type":"ContainerDied","Data":"1ed92bda26f833f6e830cdea22b37e6d754ffea23687d65efee0e604816616ae"} Jun 08 21:14:29.557472 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:29.557417 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ms72g" podStartSLOduration=1.897923528 podStartE2EDuration="6.557380612s" totalImagesPullingTime="4.659457084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:14:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:14:29.55700003 +0000 UTC m=+41.697042911" watchObservedRunningTime="2026-06-08 21:14:29.557380612 +0000 UTC m=+41.697423486" Jun 08 21:14:30.549810 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:30.549767 2564 generic.go:356] "Generic (PLEG): container finished" podID="68070959-71b5-45c6-828d-0a404231b097" containerID="6caa90a70c93e07d7471f1ce30b0456117ec6c7123f1c177c2ccac445d0eca5c" exitCode=0 Jun 08 21:14:30.550211 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:30.549836 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mlh7b" event={"ID":"68070959-71b5-45c6-828d-0a404231b097","Type":"ContainerDied","Data":"6caa90a70c93e07d7471f1ce30b0456117ec6c7123f1c177c2ccac445d0eca5c"} Jun 08 21:14:31.011627 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:31.011536 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-tls\") pod \"image-registry-78b77f675-grvwb\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:14:31.011627 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:31.011579 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-metrics-tls\") pod \"dns-default-84b76\" (UID: \"32c5f89b-dbcb-4c62-b411-d5ce3b45ee03\") " pod="openshift-dns/dns-default-84b76" Jun 08 21:14:31.011817 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:31.011680 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:14:31.011817 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:31.011691 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 21:14:31.011817 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:31.011714 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b77f675-grvwb: secret "image-registry-tls" not found Jun 08 21:14:31.011817 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:31.011735 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-metrics-tls podName:32c5f89b-dbcb-4c62-b411-d5ce3b45ee03 nodeName:}" failed. No retries permitted until 2026-06-08 21:14:39.011722189 +0000 UTC m=+51.151765047 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-metrics-tls") pod "dns-default-84b76" (UID: "32c5f89b-dbcb-4c62-b411-d5ce3b45ee03") : secret "dns-default-metrics-tls" not found Jun 08 21:14:31.011817 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:31.011758 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-tls podName:a49114d7-546a-48fe-b312-10f9c9e04f34 nodeName:}" failed. No retries permitted until 2026-06-08 21:14:39.011745356 +0000 UTC m=+51.151788219 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-tls") pod "image-registry-78b77f675-grvwb" (UID: "a49114d7-546a-48fe-b312-10f9c9e04f34") : secret "image-registry-tls" not found Jun 08 21:14:31.554996 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:31.554963 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mlh7b" event={"ID":"68070959-71b5-45c6-828d-0a404231b097","Type":"ContainerStarted","Data":"ba30569765b734a4ab17fa46ed812c246be0a53ac07085648ed9dff3320c8d7e"} Jun 08 21:14:31.579230 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:31.579175 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mlh7b" podStartSLOduration=10.227711295 podStartE2EDuration="43.5791581s" totalImagesPullingTime="33.351446805s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:13:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:14:31.577584051 +0000 UTC m=+43.717626932" watchObservedRunningTime="2026-06-08 21:14:31.5791581 +0000 UTC m=+43.719200980" Jun 08 21:14:39.073479 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:39.073436 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-tls\") pod \"image-registry-78b77f675-grvwb\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:14:39.073479 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:39.073486 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-metrics-tls\") pod \"dns-default-84b76\" (UID: \"32c5f89b-dbcb-4c62-b411-d5ce3b45ee03\") " pod="openshift-dns/dns-default-84b76" Jun 08 21:14:39.073965 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:39.073603 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:14:39.073965 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:39.073603 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 21:14:39.073965 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:39.073631 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b77f675-grvwb: secret "image-registry-tls" not found Jun 08 21:14:39.073965 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:39.073667 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-metrics-tls podName:32c5f89b-dbcb-4c62-b411-d5ce3b45ee03 nodeName:}" failed. No retries permitted until 2026-06-08 21:14:55.073652683 +0000 UTC m=+67.213695541 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-metrics-tls") pod "dns-default-84b76" (UID: "32c5f89b-dbcb-4c62-b411-d5ce3b45ee03") : secret "dns-default-metrics-tls" not found Jun 08 21:14:39.073965 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:39.073690 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-tls podName:a49114d7-546a-48fe-b312-10f9c9e04f34 nodeName:}" failed. No retries permitted until 2026-06-08 21:14:55.073675571 +0000 UTC m=+67.213718430 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-tls") pod "image-registry-78b77f675-grvwb" (UID: "a49114d7-546a-48fe-b312-10f9c9e04f34") : secret "image-registry-tls" not found Jun 08 21:14:48.516583 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:48.516554 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pbt69" Jun 08 21:14:54.088908 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:54.088871 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7nl4\" (UniqueName: \"kubernetes.io/projected/54e29e23-7c54-491b-886c-cf0c300aefe7-kube-api-access-k7nl4\") pod \"network-check-target-swvjh\" (UID: \"54e29e23-7c54-491b-886c-cf0c300aefe7\") " pod="openshift-network-diagnostics/network-check-target-swvjh" Jun 08 21:14:54.088908 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:54.088918 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69e600b7-7393-4b2c-8e83-3b5fd3e07b31-metrics-certs\") pod \"network-metrics-daemon-9jghf\" (UID: \"69e600b7-7393-4b2c-8e83-3b5fd3e07b31\") " pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:14:54.089388 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:54.088944 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30982bae-7fbf-49b2-a16a-2b01df5d6a30-original-pull-secret\") pod \"global-pull-secret-syncer-qgmqb\" (UID: \"30982bae-7fbf-49b2-a16a-2b01df5d6a30\") " pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:14:54.092318 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:54.092292 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 21:14:54.092411 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:54.092296 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 21:14:54.092411 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:54.092299 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 21:14:54.099782 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:54.099752 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 21:14:54.099863 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:54.099827 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e600b7-7393-4b2c-8e83-3b5fd3e07b31-metrics-certs podName:69e600b7-7393-4b2c-8e83-3b5fd3e07b31 nodeName:}" failed. No retries permitted until 2026-06-08 21:15:58.099809843 +0000 UTC m=+130.239852701 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69e600b7-7393-4b2c-8e83-3b5fd3e07b31-metrics-certs") pod "network-metrics-daemon-9jghf" (UID: "69e600b7-7393-4b2c-8e83-3b5fd3e07b31") : secret "metrics-daemon-secret" not found Jun 08 21:14:54.102042 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:54.102029 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 21:14:54.103586 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:54.103562 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30982bae-7fbf-49b2-a16a-2b01df5d6a30-original-pull-secret\") pod \"global-pull-secret-syncer-qgmqb\" (UID: \"30982bae-7fbf-49b2-a16a-2b01df5d6a30\") " pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:14:54.112589 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:54.112567 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7nl4\" (UniqueName: \"kubernetes.io/projected/54e29e23-7c54-491b-886c-cf0c300aefe7-kube-api-access-k7nl4\") pod \"network-check-target-swvjh\" (UID: \"54e29e23-7c54-491b-886c-cf0c300aefe7\") " pod="openshift-network-diagnostics/network-check-target-swvjh" Jun 08 21:14:54.354134 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:54.354041 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qgmqb" Jun 08 21:14:54.364017 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:54.363991 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dsw77\"" Jun 08 21:14:54.371840 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:54.371818 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swvjh" Jun 08 21:14:54.486366 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:54.486334 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qgmqb"] Jun 08 21:14:54.489574 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:14:54.489537 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30982bae_7fbf_49b2_a16a_2b01df5d6a30.slice/crio-b01ae9e1862a3f287c1267fad088e2553bf2213bbaeb49617a1eff02fb65cb39 WatchSource:0}: Error finding container b01ae9e1862a3f287c1267fad088e2553bf2213bbaeb49617a1eff02fb65cb39: Status 404 returned error can't find the container with id b01ae9e1862a3f287c1267fad088e2553bf2213bbaeb49617a1eff02fb65cb39 Jun 08 21:14:54.505535 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:54.505464 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-swvjh"] Jun 08 21:14:54.508002 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:14:54.507962 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54e29e23_7c54_491b_886c_cf0c300aefe7.slice/crio-3d9993b8df0e2fc0afe0a08c5c049480695b2c2e614bfaf17a19dceb4516bf8c WatchSource:0}: Error finding container 3d9993b8df0e2fc0afe0a08c5c049480695b2c2e614bfaf17a19dceb4516bf8c: Status 404 returned error can't find the container with id 3d9993b8df0e2fc0afe0a08c5c049480695b2c2e614bfaf17a19dceb4516bf8c Jun 08 21:14:54.607092 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:54.606966 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qgmqb" event={"ID":"30982bae-7fbf-49b2-a16a-2b01df5d6a30","Type":"ContainerStarted","Data":"b01ae9e1862a3f287c1267fad088e2553bf2213bbaeb49617a1eff02fb65cb39"} Jun 08 21:14:54.608042 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:54.608018 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-swvjh" event={"ID":"54e29e23-7c54-491b-886c-cf0c300aefe7","Type":"ContainerStarted","Data":"3d9993b8df0e2fc0afe0a08c5c049480695b2c2e614bfaf17a19dceb4516bf8c"} Jun 08 21:14:55.095454 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:55.095408 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-tls\") pod \"image-registry-78b77f675-grvwb\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:14:55.095867 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:55.095470 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-metrics-tls\") pod \"dns-default-84b76\" (UID: \"32c5f89b-dbcb-4c62-b411-d5ce3b45ee03\") " pod="openshift-dns/dns-default-84b76" Jun 08 21:14:55.095867 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:55.095606 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:14:55.095867 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:55.095687 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-metrics-tls podName:32c5f89b-dbcb-4c62-b411-d5ce3b45ee03 nodeName:}" failed. No retries permitted until 2026-06-08 21:15:27.095666641 +0000 UTC m=+99.235709502 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-metrics-tls") pod "dns-default-84b76" (UID: "32c5f89b-dbcb-4c62-b411-d5ce3b45ee03") : secret "dns-default-metrics-tls" not found Jun 08 21:14:55.095867 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:55.095605 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 21:14:55.095867 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:55.095723 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b77f675-grvwb: secret "image-registry-tls" not found Jun 08 21:14:55.095867 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:14:55.095796 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-tls podName:a49114d7-546a-48fe-b312-10f9c9e04f34 nodeName:}" failed. No retries permitted until 2026-06-08 21:15:27.095778564 +0000 UTC m=+99.235821427 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-tls") pod "image-registry-78b77f675-grvwb" (UID: "a49114d7-546a-48fe-b312-10f9c9e04f34") : secret "image-registry-tls" not found Jun 08 21:14:59.624900 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:59.624865 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-swvjh" event={"ID":"54e29e23-7c54-491b-886c-cf0c300aefe7","Type":"ContainerStarted","Data":"166ab38155c374deb24a7251f4243c63b0a99cec33cc9fc8ae88957651504461"} Jun 08 21:14:59.625385 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:59.624972 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-swvjh" Jun 08 21:14:59.626574 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:59.626551 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qgmqb" event={"ID":"30982bae-7fbf-49b2-a16a-2b01df5d6a30","Type":"ContainerStarted","Data":"cb917c2afa5a96e89f45d12a663a7f2fd3b7fb63753262190254b2f7812018bb"} Jun 08 21:14:59.661423 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:59.661366 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-swvjh" podStartSLOduration=67.219392524 podStartE2EDuration="1m11.661351198s" totalImagesPullingTime="4.441958674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:13:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:14:59.660029216 +0000 UTC m=+71.800072096" watchObservedRunningTime="2026-06-08 21:14:59.661351198 +0000 UTC m=+71.801394109" Jun 08 21:14:59.681639 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:14:59.681579 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qgmqb" podStartSLOduration=67.210287338 podStartE2EDuration="1m11.681566782s" totalImagesPullingTime="4.471279444s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:13:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:14:59.681277218 +0000 UTC m=+71.821320099" watchObservedRunningTime="2026-06-08 21:14:59.681566782 +0000 UTC m=+71.821609655" Jun 08 21:15:27.125600 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:15:27.125552 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-tls\") pod \"image-registry-78b77f675-grvwb\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:15:27.125600 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:15:27.125609 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-metrics-tls\") pod \"dns-default-84b76\" (UID: \"32c5f89b-dbcb-4c62-b411-d5ce3b45ee03\") " pod="openshift-dns/dns-default-84b76" Jun 08 21:15:27.126063 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:15:27.125704 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:15:27.126063 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:15:27.125709 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 21:15:27.126063 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:15:27.125729 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b77f675-grvwb: secret "image-registry-tls" not found Jun 08 21:15:27.126063 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:15:27.125761 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-metrics-tls podName:32c5f89b-dbcb-4c62-b411-d5ce3b45ee03 nodeName:}" failed. No retries permitted until 2026-06-08 21:16:31.125745458 +0000 UTC m=+163.265788316 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-metrics-tls") pod "dns-default-84b76" (UID: "32c5f89b-dbcb-4c62-b411-d5ce3b45ee03") : secret "dns-default-metrics-tls" not found Jun 08 21:15:27.126063 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:15:27.125827 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-tls podName:a49114d7-546a-48fe-b312-10f9c9e04f34 nodeName:}" failed. No retries permitted until 2026-06-08 21:16:31.125813034 +0000 UTC m=+163.265855893 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-tls") pod "image-registry-78b77f675-grvwb" (UID: "a49114d7-546a-48fe-b312-10f9c9e04f34") : secret "image-registry-tls" not found Jun 08 21:15:30.631941 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:15:30.631904 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-swvjh" Jun 08 21:15:58.154401 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:15:58.154353 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69e600b7-7393-4b2c-8e83-3b5fd3e07b31-metrics-certs\") pod \"network-metrics-daemon-9jghf\" (UID: \"69e600b7-7393-4b2c-8e83-3b5fd3e07b31\") " pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:15:58.154868 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:15:58.154482 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 21:15:58.154868 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:15:58.154538 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e600b7-7393-4b2c-8e83-3b5fd3e07b31-metrics-certs podName:69e600b7-7393-4b2c-8e83-3b5fd3e07b31 nodeName:}" failed. No retries permitted until 2026-06-08 21:18:00.154523904 +0000 UTC m=+252.294566763 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69e600b7-7393-4b2c-8e83-3b5fd3e07b31-metrics-certs") pod "network-metrics-daemon-9jghf" (UID: "69e600b7-7393-4b2c-8e83-3b5fd3e07b31") : secret "metrics-daemon-secret" not found Jun 08 21:16:26.260580 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:16:26.260481 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-78b77f675-grvwb" podUID="a49114d7-546a-48fe-b312-10f9c9e04f34" Jun 08 21:16:26.270668 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:16:26.270639 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-84b76" podUID="32c5f89b-dbcb-4c62-b411-d5ce3b45ee03" Jun 08 21:16:26.835462 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:16:26.835384 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-84b76" Jun 08 21:16:26.835598 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:16:26.835384 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:16:27.368700 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:16:27.368657 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9jghf" podUID="69e600b7-7393-4b2c-8e83-3b5fd3e07b31" Jun 08 21:16:31.185408 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:16:31.185362 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-metrics-tls\") pod \"dns-default-84b76\" (UID: \"32c5f89b-dbcb-4c62-b411-d5ce3b45ee03\") " pod="openshift-dns/dns-default-84b76" Jun 08 21:16:31.185806 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:16:31.185439 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-tls\") pod \"image-registry-78b77f675-grvwb\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:16:31.185806 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:16:31.185523 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:16:31.185806 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:16:31.185598 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-metrics-tls podName:32c5f89b-dbcb-4c62-b411-d5ce3b45ee03 nodeName:}" failed. No retries permitted until 2026-06-08 21:18:33.185582438 +0000 UTC m=+285.325625297 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-metrics-tls") pod "dns-default-84b76" (UID: "32c5f89b-dbcb-4c62-b411-d5ce3b45ee03") : secret "dns-default-metrics-tls" not found Jun 08 21:16:31.185806 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:16:31.185526 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 21:16:31.185806 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:16:31.185626 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b77f675-grvwb: secret "image-registry-tls" not found Jun 08 21:16:31.185806 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:16:31.185679 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-tls podName:a49114d7-546a-48fe-b312-10f9c9e04f34 nodeName:}" failed. No retries permitted until 2026-06-08 21:18:33.185666434 +0000 UTC m=+285.325709294 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-tls") pod "image-registry-78b77f675-grvwb" (UID: "a49114d7-546a-48fe-b312-10f9c9e04f34") : secret "image-registry-tls" not found Jun 08 21:16:43.341896 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:16:43.341860 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:17:09.207678 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.207640 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cvwhd"] Jun 08 21:17:09.210340 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.210324 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lcxm8"] Jun 08 21:17:09.210466 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.210445 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cvwhd" Jun 08 21:17:09.212916 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.212898 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-pp7gc"] Jun 08 21:17:09.213094 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.213056 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lcxm8" Jun 08 21:17:09.213247 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.213230 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 08 21:17:09.213317 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.213244 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 08 21:17:09.213317 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.213259 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 08 21:17:09.215167 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.215144 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lcw2r\"" Jun 08 21:17:09.215267 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.215161 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 08 21:17:09.215705 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.215687 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-pp7gc" Jun 08 21:17:09.216419 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.216307 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 08 21:17:09.216419 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.216346 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 08 21:17:09.216419 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.216374 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 08 21:17:09.216626 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.216429 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-tmk2c\"" Jun 08 21:17:09.216626 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.216502 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 08 21:17:09.218445 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.218416 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 08 21:17:09.218565 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.218546 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-wpn7l\"" Jun 08 21:17:09.218750 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.218602 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 08 21:17:09.218909 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.218640 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 08 21:17:09.219162 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.218860 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 08 21:17:09.223023 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.223003 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lcxm8"] Jun 08 21:17:09.225721 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.225705 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-pp7gc"] Jun 08 21:17:09.227146 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.227125 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cvwhd"] Jun 08 21:17:09.229009 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.228985 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 08 21:17:09.303820 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.303791 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mjtb6"] Jun 08 21:17:09.306811 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.306781 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mjtb6" Jun 08 21:17:09.307256 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.307235 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-666f6c5b9c-ssbtn"] Jun 08 21:17:09.309654 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.309636 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ncst9\"" Jun 08 21:17:09.309993 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.309973 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 08 21:17:09.310188 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.310165 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 08 21:17:09.310271 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.310026 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" Jun 08 21:17:09.310271 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.310119 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 08 21:17:09.312621 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.312602 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 08 21:17:09.312818 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.312799 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 08 21:17:09.312911 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.312892 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 08 21:17:09.313032 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.313016 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 08 21:17:09.313110 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.313013 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 08 21:17:09.313395 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.313363 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mfqfn\"" Jun 08 21:17:09.313520 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.313458 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 08 21:17:09.321021 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.321002 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mjtb6"] Jun 08 21:17:09.326681 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.326662 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-666f6c5b9c-ssbtn"] Jun 08 21:17:09.360055 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.360033 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/63764930-22a1-469f-8747-a7b72a3c224d-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-lcxm8\" (UID: \"63764930-22a1-469f-8747-a7b72a3c224d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lcxm8" Jun 08 21:17:09.360055 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.360061 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5afccbef-c7e7-4921-8292-381bf51a0dda-snapshots\") pod \"insights-operator-896549976-pp7gc\" (UID: \"5afccbef-c7e7-4921-8292-381bf51a0dda\") " pod="openshift-insights/insights-operator-896549976-pp7gc" Jun 08 21:17:09.360244 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.360094 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4624h\" (UniqueName: \"kubernetes.io/projected/5afccbef-c7e7-4921-8292-381bf51a0dda-kube-api-access-4624h\") pod \"insights-operator-896549976-pp7gc\" (UID: \"5afccbef-c7e7-4921-8292-381bf51a0dda\") " pod="openshift-insights/insights-operator-896549976-pp7gc" Jun 08 21:17:09.360244 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.360112 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1bd23943-c430-434a-b125-d5957fd6c8ee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-cvwhd\" (UID: \"1bd23943-c430-434a-b125-d5957fd6c8ee\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cvwhd" Jun 08 21:17:09.360244 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.360190 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5afccbef-c7e7-4921-8292-381bf51a0dda-service-ca-bundle\") pod \"insights-operator-896549976-pp7gc\" (UID: \"5afccbef-c7e7-4921-8292-381bf51a0dda\") " pod="openshift-insights/insights-operator-896549976-pp7gc" Jun 08 21:17:09.360371 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.360245 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l69kc\" (UniqueName: \"kubernetes.io/projected/1bd23943-c430-434a-b125-d5957fd6c8ee-kube-api-access-l69kc\") pod \"cluster-monitoring-operator-74bbf69bbb-cvwhd\" (UID: \"1bd23943-c430-434a-b125-d5957fd6c8ee\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cvwhd" Jun 08 21:17:09.360371 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.360269 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5afccbef-c7e7-4921-8292-381bf51a0dda-serving-cert\") pod \"insights-operator-896549976-pp7gc\" (UID: \"5afccbef-c7e7-4921-8292-381bf51a0dda\") " pod="openshift-insights/insights-operator-896549976-pp7gc" Jun 08 21:17:09.360371 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.360295 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2mwb\" (UniqueName: \"kubernetes.io/projected/63764930-22a1-469f-8747-a7b72a3c224d-kube-api-access-s2mwb\") pod \"service-ca-operator-6bc5ff68f5-lcxm8\" (UID: \"63764930-22a1-469f-8747-a7b72a3c224d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lcxm8" Jun 08 21:17:09.360371 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.360310 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5afccbef-c7e7-4921-8292-381bf51a0dda-tmp\") pod \"insights-operator-896549976-pp7gc\" (UID: \"5afccbef-c7e7-4921-8292-381bf51a0dda\") " pod="openshift-insights/insights-operator-896549976-pp7gc" Jun 08 21:17:09.360371 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.360325 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1bd23943-c430-434a-b125-d5957fd6c8ee-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-cvwhd\" (UID: \"1bd23943-c430-434a-b125-d5957fd6c8ee\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cvwhd" Jun 08 21:17:09.360371 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.360340 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/63764930-22a1-469f-8747-a7b72a3c224d-config\") pod \"service-ca-operator-6bc5ff68f5-lcxm8\" (UID: \"63764930-22a1-469f-8747-a7b72a3c224d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lcxm8" Jun 08 21:17:09.360371 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.360354 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5afccbef-c7e7-4921-8292-381bf51a0dda-trusted-ca-bundle\") pod \"insights-operator-896549976-pp7gc\" (UID: \"5afccbef-c7e7-4921-8292-381bf51a0dda\") " pod="openshift-insights/insights-operator-896549976-pp7gc" Jun 08 21:17:09.461367 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.461274 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5rfg\" (UniqueName: \"kubernetes.io/projected/2dd6f813-4e22-48f1-8d97-02a438d0552a-kube-api-access-f5rfg\") pod \"cluster-samples-operator-854f8b96b6-mjtb6\" (UID: \"2dd6f813-4e22-48f1-8d97-02a438d0552a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mjtb6" Jun 08 21:17:09.461367 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.461317 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1bd23943-c430-434a-b125-d5957fd6c8ee-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-cvwhd\" (UID: \"1bd23943-c430-434a-b125-d5957fd6c8ee\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cvwhd" Jun 08 21:17:09.461367 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.461342 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5afccbef-c7e7-4921-8292-381bf51a0dda-trusted-ca-bundle\") pod \"insights-operator-896549976-pp7gc\" (UID: \"5afccbef-c7e7-4921-8292-381bf51a0dda\") " pod="openshift-insights/insights-operator-896549976-pp7gc" Jun 08 21:17:09.461648 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.461426 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5afccbef-c7e7-4921-8292-381bf51a0dda-snapshots\") pod \"insights-operator-896549976-pp7gc\" (UID: \"5afccbef-c7e7-4921-8292-381bf51a0dda\") " pod="openshift-insights/insights-operator-896549976-pp7gc" Jun 08 21:17:09.461648 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.461466 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4624h\" (UniqueName: \"kubernetes.io/projected/5afccbef-c7e7-4921-8292-381bf51a0dda-kube-api-access-4624h\") pod \"insights-operator-896549976-pp7gc\" (UID: \"5afccbef-c7e7-4921-8292-381bf51a0dda\") " pod="openshift-insights/insights-operator-896549976-pp7gc" Jun 08 21:17:09.461648 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.461505 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-default-certificate\") pod \"router-default-666f6c5b9c-ssbtn\" (UID: \"7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3\") " pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" Jun 08 21:17:09.461648 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.461534 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2mwb\" (UniqueName: \"kubernetes.io/projected/63764930-22a1-469f-8747-a7b72a3c224d-kube-api-access-s2mwb\") pod \"service-ca-operator-6bc5ff68f5-lcxm8\" (UID: \"63764930-22a1-469f-8747-a7b72a3c224d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lcxm8" Jun 08 21:17:09.461648 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.461558 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5afccbef-c7e7-4921-8292-381bf51a0dda-tmp\") pod \"insights-operator-896549976-pp7gc\" (UID: \"5afccbef-c7e7-4921-8292-381bf51a0dda\") " pod="openshift-insights/insights-operator-896549976-pp7gc" Jun 08 21:17:09.461648 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.461581 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2dd6f813-4e22-48f1-8d97-02a438d0552a-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-mjtb6\" (UID: \"2dd6f813-4e22-48f1-8d97-02a438d0552a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mjtb6" Jun 08 21:17:09.461648 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.461604 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-stats-auth\") pod \"router-default-666f6c5b9c-ssbtn\" (UID: \"7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3\") " pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" Jun 08 21:17:09.461648 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.461632 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/63764930-22a1-469f-8747-a7b72a3c224d-config\") pod \"service-ca-operator-6bc5ff68f5-lcxm8\" (UID: \"63764930-22a1-469f-8747-a7b72a3c224d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lcxm8" Jun 08 21:17:09.462058 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.461657 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-service-ca-bundle\") pod \"router-default-666f6c5b9c-ssbtn\" (UID: \"7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3\") " pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" Jun 08 21:17:09.462058 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.461688 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h7qt\" (UniqueName: \"kubernetes.io/projected/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-kube-api-access-2h7qt\") pod \"router-default-666f6c5b9c-ssbtn\" (UID: \"7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3\") " pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" Jun 08 21:17:09.462058 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.461715 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/63764930-22a1-469f-8747-a7b72a3c224d-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-lcxm8\" (UID: \"63764930-22a1-469f-8747-a7b72a3c224d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lcxm8" Jun 08 21:17:09.462058 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.461737 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5afccbef-c7e7-4921-8292-381bf51a0dda-serving-cert\") pod \"insights-operator-896549976-pp7gc\" (UID: \"5afccbef-c7e7-4921-8292-381bf51a0dda\") " pod="openshift-insights/insights-operator-896549976-pp7gc" Jun 08 21:17:09.462058 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.461778 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1bd23943-c430-434a-b125-d5957fd6c8ee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-cvwhd\" (UID: \"1bd23943-c430-434a-b125-d5957fd6c8ee\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cvwhd" Jun 08 21:17:09.462058 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.461813 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l69kc\" (UniqueName: \"kubernetes.io/projected/1bd23943-c430-434a-b125-d5957fd6c8ee-kube-api-access-l69kc\") pod \"cluster-monitoring-operator-74bbf69bbb-cvwhd\" (UID: \"1bd23943-c430-434a-b125-d5957fd6c8ee\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cvwhd" Jun 08 21:17:09.462058 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.461863 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5afccbef-c7e7-4921-8292-381bf51a0dda-service-ca-bundle\") pod \"insights-operator-896549976-pp7gc\" (UID: \"5afccbef-c7e7-4921-8292-381bf51a0dda\") " pod="openshift-insights/insights-operator-896549976-pp7gc" Jun 08 21:17:09.462058 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.461889 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-metrics-certs\") pod \"router-default-666f6c5b9c-ssbtn\" (UID: \"7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3\") " pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" Jun 08 21:17:09.462505 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.462105 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5afccbef-c7e7-4921-8292-381bf51a0dda-tmp\") pod \"insights-operator-896549976-pp7gc\" (UID: \"5afccbef-c7e7-4921-8292-381bf51a0dda\") " pod="openshift-insights/insights-operator-896549976-pp7gc" Jun 08 21:17:09.462505 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.462201 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5afccbef-c7e7-4921-8292-381bf51a0dda-snapshots\") pod \"insights-operator-896549976-pp7gc\" (UID: \"5afccbef-c7e7-4921-8292-381bf51a0dda\") " pod="openshift-insights/insights-operator-896549976-pp7gc" Jun 08 21:17:09.462505 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.462221 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1bd23943-c430-434a-b125-d5957fd6c8ee-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-cvwhd\" (UID: \"1bd23943-c430-434a-b125-d5957fd6c8ee\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cvwhd" Jun 08 21:17:09.462505 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.462310 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/63764930-22a1-469f-8747-a7b72a3c224d-config\") pod \"service-ca-operator-6bc5ff68f5-lcxm8\" (UID: \"63764930-22a1-469f-8747-a7b72a3c224d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lcxm8" Jun 08 21:17:09.462505 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:09.462325 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 21:17:09.462505 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:09.462401 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bd23943-c430-434a-b125-d5957fd6c8ee-cluster-monitoring-operator-tls podName:1bd23943-c430-434a-b125-d5957fd6c8ee nodeName:}" failed. No retries permitted until 2026-06-08 21:17:09.962380975 +0000 UTC m=+202.102423846 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1bd23943-c430-434a-b125-d5957fd6c8ee-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-cvwhd" (UID: "1bd23943-c430-434a-b125-d5957fd6c8ee") : secret "cluster-monitoring-operator-tls" not found Jun 08 21:17:09.462505 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.462465 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5afccbef-c7e7-4921-8292-381bf51a0dda-trusted-ca-bundle\") pod \"insights-operator-896549976-pp7gc\" (UID: \"5afccbef-c7e7-4921-8292-381bf51a0dda\") " pod="openshift-insights/insights-operator-896549976-pp7gc" Jun 08 21:17:09.462946 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.462920 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5afccbef-c7e7-4921-8292-381bf51a0dda-service-ca-bundle\") pod \"insights-operator-896549976-pp7gc\" (UID: \"5afccbef-c7e7-4921-8292-381bf51a0dda\") " pod="openshift-insights/insights-operator-896549976-pp7gc" Jun 08 21:17:09.464330 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.464312 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/63764930-22a1-469f-8747-a7b72a3c224d-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-lcxm8\" (UID: \"63764930-22a1-469f-8747-a7b72a3c224d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lcxm8" Jun 08 21:17:09.464439 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.464334 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5afccbef-c7e7-4921-8292-381bf51a0dda-serving-cert\") pod \"insights-operator-896549976-pp7gc\" (UID: \"5afccbef-c7e7-4921-8292-381bf51a0dda\") " pod="openshift-insights/insights-operator-896549976-pp7gc" Jun 08 21:17:09.473833 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.473805 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2mwb\" (UniqueName: \"kubernetes.io/projected/63764930-22a1-469f-8747-a7b72a3c224d-kube-api-access-s2mwb\") pod \"service-ca-operator-6bc5ff68f5-lcxm8\" (UID: \"63764930-22a1-469f-8747-a7b72a3c224d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lcxm8" Jun 08 21:17:09.474313 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.474293 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4624h\" (UniqueName: \"kubernetes.io/projected/5afccbef-c7e7-4921-8292-381bf51a0dda-kube-api-access-4624h\") pod \"insights-operator-896549976-pp7gc\" (UID: \"5afccbef-c7e7-4921-8292-381bf51a0dda\") " pod="openshift-insights/insights-operator-896549976-pp7gc" Jun 08 21:17:09.475135 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.475115 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l69kc\" (UniqueName: \"kubernetes.io/projected/1bd23943-c430-434a-b125-d5957fd6c8ee-kube-api-access-l69kc\") pod \"cluster-monitoring-operator-74bbf69bbb-cvwhd\" (UID: \"1bd23943-c430-434a-b125-d5957fd6c8ee\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cvwhd" Jun 08 21:17:09.530175 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.530127 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lcxm8" Jun 08 21:17:09.536663 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.536643 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-pp7gc" Jun 08 21:17:09.562745 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.562714 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-default-certificate\") pod \"router-default-666f6c5b9c-ssbtn\" (UID: \"7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3\") " pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" Jun 08 21:17:09.562905 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.562758 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2dd6f813-4e22-48f1-8d97-02a438d0552a-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-mjtb6\" (UID: \"2dd6f813-4e22-48f1-8d97-02a438d0552a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mjtb6" Jun 08 21:17:09.562905 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.562785 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-stats-auth\") pod \"router-default-666f6c5b9c-ssbtn\" (UID: \"7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3\") " pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" Jun 08 21:17:09.562905 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.562807 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-service-ca-bundle\") pod \"router-default-666f6c5b9c-ssbtn\" (UID: \"7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3\") " pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" Jun 08 21:17:09.562905 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.562835 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h7qt\" (UniqueName: \"kubernetes.io/projected/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-kube-api-access-2h7qt\") pod \"router-default-666f6c5b9c-ssbtn\" (UID: \"7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3\") " pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" Jun 08 21:17:09.562905 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:09.562889 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 21:17:09.563172 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.562916 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-metrics-certs\") pod \"router-default-666f6c5b9c-ssbtn\" (UID: \"7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3\") " pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" Jun 08 21:17:09.563172 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.562943 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5rfg\" (UniqueName: \"kubernetes.io/projected/2dd6f813-4e22-48f1-8d97-02a438d0552a-kube-api-access-f5rfg\") pod \"cluster-samples-operator-854f8b96b6-mjtb6\" (UID: \"2dd6f813-4e22-48f1-8d97-02a438d0552a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mjtb6" Jun 08 21:17:09.563172 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:09.562972 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dd6f813-4e22-48f1-8d97-02a438d0552a-samples-operator-tls podName:2dd6f813-4e22-48f1-8d97-02a438d0552a nodeName:}" failed. No retries permitted until 2026-06-08 21:17:10.062949689 +0000 UTC m=+202.202992551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2dd6f813-4e22-48f1-8d97-02a438d0552a-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-mjtb6" (UID: "2dd6f813-4e22-48f1-8d97-02a438d0552a") : secret "samples-operator-tls" not found Jun 08 21:17:09.563172 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:09.563023 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-service-ca-bundle podName:7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3 nodeName:}" failed. No retries permitted until 2026-06-08 21:17:10.063004943 +0000 UTC m=+202.203047817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-service-ca-bundle") pod "router-default-666f6c5b9c-ssbtn" (UID: "7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3") : configmap references non-existent config key: service-ca.crt Jun 08 21:17:09.563386 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:09.563234 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 21:17:09.563386 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:09.563294 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-metrics-certs podName:7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3 nodeName:}" failed. No retries permitted until 2026-06-08 21:17:10.063283526 +0000 UTC m=+202.203326385 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-metrics-certs") pod "router-default-666f6c5b9c-ssbtn" (UID: "7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3") : secret "router-metrics-certs-default" not found Jun 08 21:17:09.565596 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.565571 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-stats-auth\") pod \"router-default-666f6c5b9c-ssbtn\" (UID: \"7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3\") " pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" Jun 08 21:17:09.565953 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.565932 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-default-certificate\") pod \"router-default-666f6c5b9c-ssbtn\" (UID: \"7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3\") " pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" Jun 08 21:17:09.572376 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.572346 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5rfg\" (UniqueName: \"kubernetes.io/projected/2dd6f813-4e22-48f1-8d97-02a438d0552a-kube-api-access-f5rfg\") pod \"cluster-samples-operator-854f8b96b6-mjtb6\" (UID: \"2dd6f813-4e22-48f1-8d97-02a438d0552a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mjtb6" Jun 08 21:17:09.573187 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.573167 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h7qt\" (UniqueName: \"kubernetes.io/projected/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-kube-api-access-2h7qt\") pod \"router-default-666f6c5b9c-ssbtn\" (UID: \"7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3\") " pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" Jun 08 21:17:09.668272 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.668239 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lcxm8"] Jun 08 21:17:09.671410 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:17:09.671372 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63764930_22a1_469f_8747_a7b72a3c224d.slice/crio-8f37fe19cad867a5b87e51c20264c1908ed8f9e0c294f792ac51dd8da53e3a9c WatchSource:0}: Error finding container 8f37fe19cad867a5b87e51c20264c1908ed8f9e0c294f792ac51dd8da53e3a9c: Status 404 returned error can't find the container with id 8f37fe19cad867a5b87e51c20264c1908ed8f9e0c294f792ac51dd8da53e3a9c Jun 08 21:17:09.687258 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.687234 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-pp7gc"] Jun 08 21:17:09.689402 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:17:09.689369 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5afccbef_c7e7_4921_8292_381bf51a0dda.slice/crio-87a5a9ac6a5ba0dfb0fb1811d9ec24bfb40d57460edd73066b03f8428fded346 WatchSource:0}: Error finding container 87a5a9ac6a5ba0dfb0fb1811d9ec24bfb40d57460edd73066b03f8428fded346: Status 404 returned error can't find the container with id 87a5a9ac6a5ba0dfb0fb1811d9ec24bfb40d57460edd73066b03f8428fded346 Jun 08 21:17:09.936000 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.935962 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-pp7gc" event={"ID":"5afccbef-c7e7-4921-8292-381bf51a0dda","Type":"ContainerStarted","Data":"87a5a9ac6a5ba0dfb0fb1811d9ec24bfb40d57460edd73066b03f8428fded346"} Jun 08 21:17:09.936998 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.936976 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lcxm8" event={"ID":"63764930-22a1-469f-8747-a7b72a3c224d","Type":"ContainerStarted","Data":"8f37fe19cad867a5b87e51c20264c1908ed8f9e0c294f792ac51dd8da53e3a9c"} Jun 08 21:17:09.967487 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:09.967459 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1bd23943-c430-434a-b125-d5957fd6c8ee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-cvwhd\" (UID: \"1bd23943-c430-434a-b125-d5957fd6c8ee\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cvwhd" Jun 08 21:17:09.967580 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:09.967559 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 21:17:09.967626 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:09.967617 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bd23943-c430-434a-b125-d5957fd6c8ee-cluster-monitoring-operator-tls podName:1bd23943-c430-434a-b125-d5957fd6c8ee nodeName:}" failed. No retries permitted until 2026-06-08 21:17:10.967603288 +0000 UTC m=+203.107646147 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1bd23943-c430-434a-b125-d5957fd6c8ee-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-cvwhd" (UID: "1bd23943-c430-434a-b125-d5957fd6c8ee") : secret "cluster-monitoring-operator-tls" not found Jun 08 21:17:10.068084 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:10.068029 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2dd6f813-4e22-48f1-8d97-02a438d0552a-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-mjtb6\" (UID: \"2dd6f813-4e22-48f1-8d97-02a438d0552a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mjtb6" Jun 08 21:17:10.068084 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:10.068085 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-service-ca-bundle\") pod \"router-default-666f6c5b9c-ssbtn\" (UID: \"7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3\") " pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" Jun 08 21:17:10.068290 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:10.068158 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-metrics-certs\") pod \"router-default-666f6c5b9c-ssbtn\" (UID: \"7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3\") " pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" Jun 08 21:17:10.068290 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:10.068195 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 21:17:10.068290 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:10.068252 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 21:17:10.068290 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:10.068259 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dd6f813-4e22-48f1-8d97-02a438d0552a-samples-operator-tls podName:2dd6f813-4e22-48f1-8d97-02a438d0552a nodeName:}" failed. No retries permitted until 2026-06-08 21:17:11.068242482 +0000 UTC m=+203.208285340 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2dd6f813-4e22-48f1-8d97-02a438d0552a-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-mjtb6" (UID: "2dd6f813-4e22-48f1-8d97-02a438d0552a") : secret "samples-operator-tls" not found Jun 08 21:17:10.068290 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:10.068291 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-metrics-certs podName:7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3 nodeName:}" failed. No retries permitted until 2026-06-08 21:17:11.068278822 +0000 UTC m=+203.208321680 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-metrics-certs") pod "router-default-666f6c5b9c-ssbtn" (UID: "7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3") : secret "router-metrics-certs-default" not found Jun 08 21:17:10.068457 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:10.068373 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-service-ca-bundle podName:7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3 nodeName:}" failed. No retries permitted until 2026-06-08 21:17:11.068361111 +0000 UTC m=+203.208403973 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-service-ca-bundle") pod "router-default-666f6c5b9c-ssbtn" (UID: "7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3") : configmap references non-existent config key: service-ca.crt Jun 08 21:17:10.976683 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:10.976646 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1bd23943-c430-434a-b125-d5957fd6c8ee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-cvwhd\" (UID: \"1bd23943-c430-434a-b125-d5957fd6c8ee\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cvwhd" Jun 08 21:17:10.977181 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:10.976824 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 21:17:10.977181 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:10.976888 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bd23943-c430-434a-b125-d5957fd6c8ee-cluster-monitoring-operator-tls podName:1bd23943-c430-434a-b125-d5957fd6c8ee nodeName:}" failed. No retries permitted until 2026-06-08 21:17:12.976868135 +0000 UTC m=+205.116910999 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1bd23943-c430-434a-b125-d5957fd6c8ee-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-cvwhd" (UID: "1bd23943-c430-434a-b125-d5957fd6c8ee") : secret "cluster-monitoring-operator-tls" not found Jun 08 21:17:11.077974 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:11.077934 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2dd6f813-4e22-48f1-8d97-02a438d0552a-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-mjtb6\" (UID: \"2dd6f813-4e22-48f1-8d97-02a438d0552a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mjtb6" Jun 08 21:17:11.077974 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:11.077977 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-service-ca-bundle\") pod \"router-default-666f6c5b9c-ssbtn\" (UID: \"7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3\") " pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" Jun 08 21:17:11.078298 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:11.078025 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-metrics-certs\") pod \"router-default-666f6c5b9c-ssbtn\" (UID: \"7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3\") " pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" Jun 08 21:17:11.078298 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:11.078119 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 21:17:11.078298 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:11.078124 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 21:17:11.078298 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:11.078179 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dd6f813-4e22-48f1-8d97-02a438d0552a-samples-operator-tls podName:2dd6f813-4e22-48f1-8d97-02a438d0552a nodeName:}" failed. No retries permitted until 2026-06-08 21:17:13.078164211 +0000 UTC m=+205.218207070 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2dd6f813-4e22-48f1-8d97-02a438d0552a-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-mjtb6" (UID: "2dd6f813-4e22-48f1-8d97-02a438d0552a") : secret "samples-operator-tls" not found Jun 08 21:17:11.078298 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:11.078233 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-service-ca-bundle podName:7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3 nodeName:}" failed. No retries permitted until 2026-06-08 21:17:13.078212099 +0000 UTC m=+205.218254966 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-service-ca-bundle") pod "router-default-666f6c5b9c-ssbtn" (UID: "7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3") : configmap references non-existent config key: service-ca.crt Jun 08 21:17:11.078298 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:11.078254 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-metrics-certs podName:7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3 nodeName:}" failed. No retries permitted until 2026-06-08 21:17:13.078245882 +0000 UTC m=+205.218288743 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-metrics-certs") pod "router-default-666f6c5b9c-ssbtn" (UID: "7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3") : secret "router-metrics-certs-default" not found Jun 08 21:17:12.945382 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:12.945279 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lcxm8" event={"ID":"63764930-22a1-469f-8747-a7b72a3c224d","Type":"ContainerStarted","Data":"6bac1eb52c611d6436f5d86ce166a9b7ecb6f9151dd811cf207480276e9775bb"} Jun 08 21:17:12.946731 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:12.946709 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-pp7gc" event={"ID":"5afccbef-c7e7-4921-8292-381bf51a0dda","Type":"ContainerStarted","Data":"fb888006e5e5749b65fed182c8e91f8996acb97daea4d5a29e2120c4e3740fac"} Jun 08 21:17:12.961540 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:12.961497 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lcxm8" podStartSLOduration=1.058422563 podStartE2EDuration="3.961483276s" totalImagesPullingTime="2.903060713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:17:12.960769664 +0000 UTC m=+205.100812549" watchObservedRunningTime="2026-06-08 21:17:12.961483276 +0000 UTC m=+205.101526157" Jun 08 21:17:12.980544 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:12.980483 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-pp7gc" podStartSLOduration=1.6799271089999999 podStartE2EDuration="3.980463161s" totalImagesPullingTime="2.300536052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:17:12.977822548 +0000 UTC m=+205.117865429" watchObservedRunningTime="2026-06-08 21:17:12.980463161 +0000 UTC m=+205.120506041" Jun 08 21:17:12.993899 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:12.993871 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1bd23943-c430-434a-b125-d5957fd6c8ee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-cvwhd\" (UID: \"1bd23943-c430-434a-b125-d5957fd6c8ee\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cvwhd" Jun 08 21:17:12.994056 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:12.994034 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 21:17:12.994146 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:12.994134 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bd23943-c430-434a-b125-d5957fd6c8ee-cluster-monitoring-operator-tls podName:1bd23943-c430-434a-b125-d5957fd6c8ee nodeName:}" failed. No retries permitted until 2026-06-08 21:17:16.994113055 +0000 UTC m=+209.134155939 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1bd23943-c430-434a-b125-d5957fd6c8ee-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-cvwhd" (UID: "1bd23943-c430-434a-b125-d5957fd6c8ee") : secret "cluster-monitoring-operator-tls" not found Jun 08 21:17:13.094608 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:13.094572 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-service-ca-bundle\") pod \"router-default-666f6c5b9c-ssbtn\" (UID: \"7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3\") " pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" Jun 08 21:17:13.094811 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:13.094706 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-metrics-certs\") pod \"router-default-666f6c5b9c-ssbtn\" (UID: \"7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3\") " pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" Jun 08 21:17:13.094876 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:13.094821 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2dd6f813-4e22-48f1-8d97-02a438d0552a-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-mjtb6\" (UID: \"2dd6f813-4e22-48f1-8d97-02a438d0552a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mjtb6" Jun 08 21:17:13.094955 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:13.094921 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 21:17:13.095127 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:13.094991 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dd6f813-4e22-48f1-8d97-02a438d0552a-samples-operator-tls podName:2dd6f813-4e22-48f1-8d97-02a438d0552a nodeName:}" failed. No retries permitted until 2026-06-08 21:17:17.094974597 +0000 UTC m=+209.235017458 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2dd6f813-4e22-48f1-8d97-02a438d0552a-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-mjtb6" (UID: "2dd6f813-4e22-48f1-8d97-02a438d0552a") : secret "samples-operator-tls" not found Jun 08 21:17:13.095127 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:13.095014 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-service-ca-bundle podName:7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3 nodeName:}" failed. No retries permitted until 2026-06-08 21:17:17.095004615 +0000 UTC m=+209.235047478 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-service-ca-bundle") pod "router-default-666f6c5b9c-ssbtn" (UID: "7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3") : configmap references non-existent config key: service-ca.crt Jun 08 21:17:13.095127 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:13.095091 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 21:17:13.095315 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:13.095158 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-metrics-certs podName:7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3 nodeName:}" failed. No retries permitted until 2026-06-08 21:17:17.095140199 +0000 UTC m=+209.235183058 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-metrics-certs") pod "router-default-666f6c5b9c-ssbtn" (UID: "7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3") : secret "router-metrics-certs-default" not found Jun 08 21:17:13.576744 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:13.576706 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-h2l72"] Jun 08 21:17:13.579928 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:13.579909 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-h2l72" Jun 08 21:17:13.583603 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:13.583579 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 08 21:17:13.583739 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:13.583610 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 08 21:17:13.583739 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:13.583629 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-k4l8v\"" Jun 08 21:17:13.590660 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:13.590635 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-h2l72"] Jun 08 21:17:13.699713 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:13.699669 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7dpc\" (UniqueName: \"kubernetes.io/projected/d77374d1-a814-43ff-8298-aaa87f0c3c33-kube-api-access-s7dpc\") pod \"migrator-955ffdf5f-h2l72\" (UID: \"d77374d1-a814-43ff-8298-aaa87f0c3c33\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-h2l72" Jun 08 21:17:13.800341 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:13.800308 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7dpc\" (UniqueName: \"kubernetes.io/projected/d77374d1-a814-43ff-8298-aaa87f0c3c33-kube-api-access-s7dpc\") pod \"migrator-955ffdf5f-h2l72\" (UID: \"d77374d1-a814-43ff-8298-aaa87f0c3c33\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-h2l72" Jun 08 21:17:13.808660 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:13.808633 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7dpc\" (UniqueName: \"kubernetes.io/projected/d77374d1-a814-43ff-8298-aaa87f0c3c33-kube-api-access-s7dpc\") pod \"migrator-955ffdf5f-h2l72\" (UID: \"d77374d1-a814-43ff-8298-aaa87f0c3c33\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-h2l72" Jun 08 21:17:13.889053 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:13.888946 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-h2l72" Jun 08 21:17:14.024235 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:14.024199 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-h2l72"] Jun 08 21:17:14.027867 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:17:14.027833 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd77374d1_a814_43ff_8298_aaa87f0c3c33.slice/crio-b5a1dd5996ab76873b77f0a27fd89b26d820b3faae96f52d8f9636ea4c71c1c6 WatchSource:0}: Error finding container b5a1dd5996ab76873b77f0a27fd89b26d820b3faae96f52d8f9636ea4c71c1c6: Status 404 returned error can't find the container with id b5a1dd5996ab76873b77f0a27fd89b26d820b3faae96f52d8f9636ea4c71c1c6 Jun 08 21:17:14.953840 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:14.953799 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-h2l72" event={"ID":"d77374d1-a814-43ff-8298-aaa87f0c3c33","Type":"ContainerStarted","Data":"b5a1dd5996ab76873b77f0a27fd89b26d820b3faae96f52d8f9636ea4c71c1c6"} Jun 08 21:17:15.200720 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:15.200694 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bx6xk_c1390673-1d07-4f52-b5cd-da6da7cdbdf6/dns-node-resolver/0.log" Jun 08 21:17:15.957838 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:15.957802 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-h2l72" event={"ID":"d77374d1-a814-43ff-8298-aaa87f0c3c33","Type":"ContainerStarted","Data":"a11348323069764eac18329f9806377915b20f1c826386d8202a37a8ef8480cb"} Jun 08 21:17:15.958020 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:15.957853 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-h2l72" event={"ID":"d77374d1-a814-43ff-8298-aaa87f0c3c33","Type":"ContainerStarted","Data":"68255ac219cb4bda4135237801984337d7e6a1c86b00018b78e060d99a048b9c"} Jun 08 21:17:15.973450 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:15.973362 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-h2l72" podStartSLOduration=1.5303076340000001 podStartE2EDuration="2.973345509s" totalImagesPullingTime="1.443037875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:17:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:17:15.973156656 +0000 UTC m=+208.113199537" watchObservedRunningTime="2026-06-08 21:17:15.973345509 +0000 UTC m=+208.113388395" Jun 08 21:17:16.401132 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:16.401092 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zmr52_8ee88a26-ad92-4bad-91b5-612089504d71/node-ca/0.log" Jun 08 21:17:17.030453 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:17.030420 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1bd23943-c430-434a-b125-d5957fd6c8ee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-cvwhd\" (UID: \"1bd23943-c430-434a-b125-d5957fd6c8ee\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cvwhd" Jun 08 21:17:17.030635 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:17.030578 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 21:17:17.030676 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:17.030638 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bd23943-c430-434a-b125-d5957fd6c8ee-cluster-monitoring-operator-tls podName:1bd23943-c430-434a-b125-d5957fd6c8ee nodeName:}" failed. No retries permitted until 2026-06-08 21:17:25.030619842 +0000 UTC m=+217.170662703 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1bd23943-c430-434a-b125-d5957fd6c8ee-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-cvwhd" (UID: "1bd23943-c430-434a-b125-d5957fd6c8ee") : secret "cluster-monitoring-operator-tls" not found Jun 08 21:17:17.131125 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:17.131085 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-metrics-certs\") pod \"router-default-666f6c5b9c-ssbtn\" (UID: \"7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3\") " pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" Jun 08 21:17:17.131306 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:17.131182 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2dd6f813-4e22-48f1-8d97-02a438d0552a-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-mjtb6\" (UID: \"2dd6f813-4e22-48f1-8d97-02a438d0552a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mjtb6" Jun 08 21:17:17.131306 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:17.131210 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-service-ca-bundle\") pod \"router-default-666f6c5b9c-ssbtn\" (UID: \"7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3\") " pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" Jun 08 21:17:17.131306 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:17.131261 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 21:17:17.131306 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:17.131296 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 21:17:17.131441 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:17.131327 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-metrics-certs podName:7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3 nodeName:}" failed. No retries permitted until 2026-06-08 21:17:25.131308824 +0000 UTC m=+217.271351699 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-metrics-certs") pod "router-default-666f6c5b9c-ssbtn" (UID: "7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3") : secret "router-metrics-certs-default" not found Jun 08 21:17:17.131441 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:17.131352 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dd6f813-4e22-48f1-8d97-02a438d0552a-samples-operator-tls podName:2dd6f813-4e22-48f1-8d97-02a438d0552a nodeName:}" failed. No retries permitted until 2026-06-08 21:17:25.131336427 +0000 UTC m=+217.271379285 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2dd6f813-4e22-48f1-8d97-02a438d0552a-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-mjtb6" (UID: "2dd6f813-4e22-48f1-8d97-02a438d0552a") : secret "samples-operator-tls" not found Jun 08 21:17:17.131441 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:17.131421 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-service-ca-bundle podName:7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3 nodeName:}" failed. No retries permitted until 2026-06-08 21:17:25.131402094 +0000 UTC m=+217.271444953 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-service-ca-bundle") pod "router-default-666f6c5b9c-ssbtn" (UID: "7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3") : configmap references non-existent config key: service-ca.crt Jun 08 21:17:17.201494 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:17.201465 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ms72g_5d9e9533-81fc-454f-83ae-7482b70c189a/serve-healthcheck-canary/0.log" Jun 08 21:17:25.094711 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:25.094669 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1bd23943-c430-434a-b125-d5957fd6c8ee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-cvwhd\" (UID: \"1bd23943-c430-434a-b125-d5957fd6c8ee\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cvwhd" Jun 08 21:17:25.095110 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:25.094810 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 21:17:25.095110 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:25.094884 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bd23943-c430-434a-b125-d5957fd6c8ee-cluster-monitoring-operator-tls podName:1bd23943-c430-434a-b125-d5957fd6c8ee nodeName:}" failed. No retries permitted until 2026-06-08 21:17:41.094866808 +0000 UTC m=+233.234909669 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1bd23943-c430-434a-b125-d5957fd6c8ee-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-cvwhd" (UID: "1bd23943-c430-434a-b125-d5957fd6c8ee") : secret "cluster-monitoring-operator-tls" not found Jun 08 21:17:25.195388 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:25.195347 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2dd6f813-4e22-48f1-8d97-02a438d0552a-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-mjtb6\" (UID: \"2dd6f813-4e22-48f1-8d97-02a438d0552a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mjtb6" Jun 08 21:17:25.195388 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:25.195391 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-service-ca-bundle\") pod \"router-default-666f6c5b9c-ssbtn\" (UID: \"7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3\") " pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" Jun 08 21:17:25.195638 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:25.195455 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-metrics-certs\") pod \"router-default-666f6c5b9c-ssbtn\" (UID: \"7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3\") " pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" Jun 08 21:17:25.195638 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:25.195585 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-service-ca-bundle podName:7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3 nodeName:}" failed. No retries permitted until 2026-06-08 21:17:41.195566158 +0000 UTC m=+233.335609017 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-service-ca-bundle") pod "router-default-666f6c5b9c-ssbtn" (UID: "7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3") : configmap references non-existent config key: service-ca.crt Jun 08 21:17:25.198101 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:25.198032 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-metrics-certs\") pod \"router-default-666f6c5b9c-ssbtn\" (UID: \"7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3\") " pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" Jun 08 21:17:25.198101 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:25.198032 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2dd6f813-4e22-48f1-8d97-02a438d0552a-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-mjtb6\" (UID: \"2dd6f813-4e22-48f1-8d97-02a438d0552a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mjtb6" Jun 08 21:17:25.216843 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:25.216812 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mjtb6" Jun 08 21:17:25.341745 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:25.341713 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mjtb6"] Jun 08 21:17:25.989488 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:25.989445 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mjtb6" event={"ID":"2dd6f813-4e22-48f1-8d97-02a438d0552a","Type":"ContainerStarted","Data":"f251fb3d8c899856786ed1115d68559cc591f66842dd87a9fcf9844bd313db4b"} Jun 08 21:17:27.996400 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:27.996367 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mjtb6" event={"ID":"2dd6f813-4e22-48f1-8d97-02a438d0552a","Type":"ContainerStarted","Data":"1378f7c9e3cfc6866e60290294b0135c91924f75a767342925e73fbb15fe3fe9"} Jun 08 21:17:27.996774 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:27.996416 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mjtb6" event={"ID":"2dd6f813-4e22-48f1-8d97-02a438d0552a","Type":"ContainerStarted","Data":"43bcbb05f7592eaefe1551c5b4d3d1eea8ce0854383c8f7744c579edaa096cb4"} Jun 08 21:17:28.013175 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:28.013123 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mjtb6" podStartSLOduration=17.001545498 podStartE2EDuration="19.013108377s" totalImagesPullingTime="2.011562879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:17:28.012165002 +0000 UTC m=+220.152207886" watchObservedRunningTime="2026-06-08 21:17:28.013108377 +0000 UTC m=+220.153151258" Jun 08 21:17:38.974790 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:38.974741 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-tkkdm"] Jun 08 21:17:38.981109 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:38.981087 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-tkkdm" Jun 08 21:17:38.989903 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:38.989880 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 08 21:17:38.990010 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:38.989905 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 08 21:17:38.990010 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:38.989945 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-2wg8q\"" Jun 08 21:17:38.998531 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:38.998511 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-s78h5"] Jun 08 21:17:39.002725 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:39.002707 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s78h5" Jun 08 21:17:39.010054 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:39.010038 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 08 21:17:39.010329 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:39.010313 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7t8tv\"" Jun 08 21:17:39.010623 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:39.010608 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 08 21:17:39.039321 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:39.039294 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s78h5"] Jun 08 21:17:39.087630 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:39.087596 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-tkkdm"] Jun 08 21:17:39.102366 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:39.102341 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f785d5c-de8c-45ea-b361-0026649bd952-data-volume\") pod \"insights-runtime-extractor-s78h5\" (UID: \"9f785d5c-de8c-45ea-b361-0026649bd952\") " pod="openshift-insights/insights-runtime-extractor-s78h5" Jun 08 21:17:39.102537 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:39.102371 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqpbd\" (UniqueName: \"kubernetes.io/projected/ce7d9d0d-9af9-49df-ab21-c514fe47c28f-kube-api-access-rqpbd\") pod \"downloads-6657875f97-tkkdm\" (UID: \"ce7d9d0d-9af9-49df-ab21-c514fe47c28f\") " pod="openshift-console/downloads-6657875f97-tkkdm" Jun 08 21:17:39.102537 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:39.102426 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f785d5c-de8c-45ea-b361-0026649bd952-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s78h5\" (UID: \"9f785d5c-de8c-45ea-b361-0026649bd952\") " pod="openshift-insights/insights-runtime-extractor-s78h5" Jun 08 21:17:39.102537 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:39.102528 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9f785d5c-de8c-45ea-b361-0026649bd952-crio-socket\") pod \"insights-runtime-extractor-s78h5\" (UID: \"9f785d5c-de8c-45ea-b361-0026649bd952\") " pod="openshift-insights/insights-runtime-extractor-s78h5" Jun 08 21:17:39.102698 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:39.102581 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rdqt\" (UniqueName: \"kubernetes.io/projected/9f785d5c-de8c-45ea-b361-0026649bd952-kube-api-access-6rdqt\") pod \"insights-runtime-extractor-s78h5\" (UID: \"9f785d5c-de8c-45ea-b361-0026649bd952\") " pod="openshift-insights/insights-runtime-extractor-s78h5" Jun 08 21:17:39.102698 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:39.102645 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f785d5c-de8c-45ea-b361-0026649bd952-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s78h5\" (UID: \"9f785d5c-de8c-45ea-b361-0026649bd952\") " pod="openshift-insights/insights-runtime-extractor-s78h5" Jun 08 21:17:39.203602 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:39.203568 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f785d5c-de8c-45ea-b361-0026649bd952-data-volume\") pod \"insights-runtime-extractor-s78h5\" (UID: \"9f785d5c-de8c-45ea-b361-0026649bd952\") " pod="openshift-insights/insights-runtime-extractor-s78h5" Jun 08 21:17:39.203602 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:39.203601 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqpbd\" (UniqueName: \"kubernetes.io/projected/ce7d9d0d-9af9-49df-ab21-c514fe47c28f-kube-api-access-rqpbd\") pod \"downloads-6657875f97-tkkdm\" (UID: \"ce7d9d0d-9af9-49df-ab21-c514fe47c28f\") " pod="openshift-console/downloads-6657875f97-tkkdm" Jun 08 21:17:39.203847 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:39.203645 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f785d5c-de8c-45ea-b361-0026649bd952-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s78h5\" (UID: \"9f785d5c-de8c-45ea-b361-0026649bd952\") " pod="openshift-insights/insights-runtime-extractor-s78h5" Jun 08 21:17:39.203847 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:39.203697 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9f785d5c-de8c-45ea-b361-0026649bd952-crio-socket\") pod \"insights-runtime-extractor-s78h5\" (UID: \"9f785d5c-de8c-45ea-b361-0026649bd952\") " pod="openshift-insights/insights-runtime-extractor-s78h5" Jun 08 21:17:39.203847 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:39.203719 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rdqt\" (UniqueName: \"kubernetes.io/projected/9f785d5c-de8c-45ea-b361-0026649bd952-kube-api-access-6rdqt\") pod \"insights-runtime-extractor-s78h5\" (UID: \"9f785d5c-de8c-45ea-b361-0026649bd952\") " pod="openshift-insights/insights-runtime-extractor-s78h5" Jun 08 21:17:39.203847 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:39.203769 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f785d5c-de8c-45ea-b361-0026649bd952-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s78h5\" (UID: \"9f785d5c-de8c-45ea-b361-0026649bd952\") " pod="openshift-insights/insights-runtime-extractor-s78h5" Jun 08 21:17:39.203847 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:39.203834 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9f785d5c-de8c-45ea-b361-0026649bd952-crio-socket\") pod \"insights-runtime-extractor-s78h5\" (UID: \"9f785d5c-de8c-45ea-b361-0026649bd952\") " pod="openshift-insights/insights-runtime-extractor-s78h5" Jun 08 21:17:39.204118 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:39.204037 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f785d5c-de8c-45ea-b361-0026649bd952-data-volume\") pod \"insights-runtime-extractor-s78h5\" (UID: \"9f785d5c-de8c-45ea-b361-0026649bd952\") " pod="openshift-insights/insights-runtime-extractor-s78h5" Jun 08 21:17:39.204330 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:39.204311 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f785d5c-de8c-45ea-b361-0026649bd952-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s78h5\" (UID: \"9f785d5c-de8c-45ea-b361-0026649bd952\") " pod="openshift-insights/insights-runtime-extractor-s78h5" Jun 08 21:17:39.206195 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:39.206173 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f785d5c-de8c-45ea-b361-0026649bd952-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s78h5\" (UID: \"9f785d5c-de8c-45ea-b361-0026649bd952\") " pod="openshift-insights/insights-runtime-extractor-s78h5" Jun 08 21:17:39.213241 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:39.213213 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqpbd\" (UniqueName: \"kubernetes.io/projected/ce7d9d0d-9af9-49df-ab21-c514fe47c28f-kube-api-access-rqpbd\") pod \"downloads-6657875f97-tkkdm\" (UID: \"ce7d9d0d-9af9-49df-ab21-c514fe47c28f\") " pod="openshift-console/downloads-6657875f97-tkkdm" Jun 08 21:17:39.213661 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:39.213637 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rdqt\" (UniqueName: \"kubernetes.io/projected/9f785d5c-de8c-45ea-b361-0026649bd952-kube-api-access-6rdqt\") pod \"insights-runtime-extractor-s78h5\" (UID: \"9f785d5c-de8c-45ea-b361-0026649bd952\") " pod="openshift-insights/insights-runtime-extractor-s78h5" Jun 08 21:17:39.289909 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:39.289870 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-tkkdm" Jun 08 21:17:39.310676 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:39.310646 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s78h5" Jun 08 21:17:39.434247 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:39.434215 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-tkkdm"] Jun 08 21:17:39.437738 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:17:39.437700 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce7d9d0d_9af9_49df_ab21_c514fe47c28f.slice/crio-93c0922b93f624bd6a5fa6c95756a060562108a87fe9abaf72e5860719e590ea WatchSource:0}: Error finding container 93c0922b93f624bd6a5fa6c95756a060562108a87fe9abaf72e5860719e590ea: Status 404 returned error can't find the container with id 93c0922b93f624bd6a5fa6c95756a060562108a87fe9abaf72e5860719e590ea Jun 08 21:17:39.454154 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:39.454127 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s78h5"] Jun 08 21:17:39.456879 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:17:39.456853 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f785d5c_de8c_45ea_b361_0026649bd952.slice/crio-4b3bfe600f5712e0548307c600b6e29367306550d3d38a3db5b92dd491eaa61c WatchSource:0}: Error finding container 4b3bfe600f5712e0548307c600b6e29367306550d3d38a3db5b92dd491eaa61c: Status 404 returned error can't find the container with id 4b3bfe600f5712e0548307c600b6e29367306550d3d38a3db5b92dd491eaa61c Jun 08 21:17:40.032505 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:40.032464 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-tkkdm" event={"ID":"ce7d9d0d-9af9-49df-ab21-c514fe47c28f","Type":"ContainerStarted","Data":"93c0922b93f624bd6a5fa6c95756a060562108a87fe9abaf72e5860719e590ea"} Jun 08 21:17:40.034056 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:40.034029 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s78h5" event={"ID":"9f785d5c-de8c-45ea-b361-0026649bd952","Type":"ContainerStarted","Data":"93222f1f2fe4332ac2d7486b548a035f9b4e22ee360645f46a24f01528d7c3c5"} Jun 08 21:17:40.034186 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:40.034100 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s78h5" event={"ID":"9f785d5c-de8c-45ea-b361-0026649bd952","Type":"ContainerStarted","Data":"4b3bfe600f5712e0548307c600b6e29367306550d3d38a3db5b92dd491eaa61c"} Jun 08 21:17:41.039867 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:41.039833 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s78h5" event={"ID":"9f785d5c-de8c-45ea-b361-0026649bd952","Type":"ContainerStarted","Data":"6e292688605225cc610a595ce927797163b6d196e937317bd3ea27fd320cf6a9"} Jun 08 21:17:41.122307 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:41.122263 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1bd23943-c430-434a-b125-d5957fd6c8ee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-cvwhd\" (UID: \"1bd23943-c430-434a-b125-d5957fd6c8ee\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cvwhd" Jun 08 21:17:41.125243 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:41.125211 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1bd23943-c430-434a-b125-d5957fd6c8ee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-cvwhd\" (UID: \"1bd23943-c430-434a-b125-d5957fd6c8ee\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cvwhd" Jun 08 21:17:41.223617 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:41.223575 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-service-ca-bundle\") pod \"router-default-666f6c5b9c-ssbtn\" (UID: \"7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3\") " pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" Jun 08 21:17:41.224406 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:41.224354 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3-service-ca-bundle\") pod \"router-default-666f6c5b9c-ssbtn\" (UID: \"7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3\") " pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" Jun 08 21:17:41.320978 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:41.320732 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cvwhd" Jun 08 21:17:41.422062 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:41.422005 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" Jun 08 21:17:41.482544 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:41.482501 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cvwhd"] Jun 08 21:17:42.062953 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:17:42.062923 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bd23943_c430_434a_b125_d5957fd6c8ee.slice/crio-90cc135a28befabd05f22c29893e49ca3cf7f6ddf8af8d4e071a2fab9e19afd2 WatchSource:0}: Error finding container 90cc135a28befabd05f22c29893e49ca3cf7f6ddf8af8d4e071a2fab9e19afd2: Status 404 returned error can't find the container with id 90cc135a28befabd05f22c29893e49ca3cf7f6ddf8af8d4e071a2fab9e19afd2 Jun 08 21:17:42.216631 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:42.216589 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-666f6c5b9c-ssbtn"] Jun 08 21:17:42.220315 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:17:42.220283 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b92e7ad_862c_4b47_9c9f_4d73ca2e55d3.slice/crio-925f51f8eb73b48ec488af10f43a9b259e059e23a9670ea010e39a41c9fd20ba WatchSource:0}: Error finding container 925f51f8eb73b48ec488af10f43a9b259e059e23a9670ea010e39a41c9fd20ba: Status 404 returned error can't find the container with id 925f51f8eb73b48ec488af10f43a9b259e059e23a9670ea010e39a41c9fd20ba Jun 08 21:17:43.049290 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:43.049249 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" event={"ID":"7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3","Type":"ContainerStarted","Data":"f9c77eb73436f6c0176c812aa59dce4e874dcf8105a9f17b613d68b6f97f4b73"} Jun 08 21:17:43.049480 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:43.049303 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" event={"ID":"7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3","Type":"ContainerStarted","Data":"925f51f8eb73b48ec488af10f43a9b259e059e23a9670ea010e39a41c9fd20ba"} Jun 08 21:17:43.050473 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:43.050438 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cvwhd" event={"ID":"1bd23943-c430-434a-b125-d5957fd6c8ee","Type":"ContainerStarted","Data":"90cc135a28befabd05f22c29893e49ca3cf7f6ddf8af8d4e071a2fab9e19afd2"} Jun 08 21:17:43.053708 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:43.053624 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s78h5" event={"ID":"9f785d5c-de8c-45ea-b361-0026649bd952","Type":"ContainerStarted","Data":"7cdc8566e526d4541f5f7d628fed48393ac28b5de1077093ed3449cd24b5d47c"} Jun 08 21:17:43.070315 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:43.070264 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" podStartSLOduration=34.070249459 podStartE2EDuration="34.070249459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:17:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:17:43.06852425 +0000 UTC m=+235.208567131" watchObservedRunningTime="2026-06-08 21:17:43.070249459 +0000 UTC m=+235.210292341" Jun 08 21:17:43.085885 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:43.085829 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-s78h5" podStartSLOduration=2.263124431 podStartE2EDuration="5.085810125s" totalImagesPullingTime="2.822685694s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:17:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:17:43.085760786 +0000 UTC m=+235.225803700" watchObservedRunningTime="2026-06-08 21:17:43.085810125 +0000 UTC m=+235.225853010" Jun 08 21:17:43.422534 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:43.422450 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" Jun 08 21:17:43.425191 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:43.425168 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" Jun 08 21:17:44.061505 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:44.060689 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" Jun 08 21:17:44.062610 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:44.061989 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-666f6c5b9c-ssbtn" Jun 08 21:17:44.949168 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:44.949130 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-w2bbf"] Jun 08 21:17:44.952223 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:44.952205 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-w2bbf" Jun 08 21:17:44.955282 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:44.955260 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 08 21:17:44.955414 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:44.955372 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-zg8sw\"" Jun 08 21:17:44.962726 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:44.962703 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-w2bbf"] Jun 08 21:17:45.058495 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:45.058456 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e453a443-47fe-4d29-aa22-a7ba786d1976-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-w2bbf\" (UID: \"e453a443-47fe-4d29-aa22-a7ba786d1976\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-w2bbf" Jun 08 21:17:45.065321 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:45.065285 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cvwhd" event={"ID":"1bd23943-c430-434a-b125-d5957fd6c8ee","Type":"ContainerStarted","Data":"a163d51326127d8dfdc7889e6014dcc094003db72ec306d79eba1ece5270ff1d"} Jun 08 21:17:45.083041 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:45.082808 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cvwhd" podStartSLOduration=33.707475501 podStartE2EDuration="36.082786301s" totalImagesPullingTime="2.3753108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:17:45.082787478 +0000 UTC m=+237.222830359" watchObservedRunningTime="2026-06-08 21:17:45.082786301 +0000 UTC m=+237.222829184" Jun 08 21:17:45.159517 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:45.159480 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e453a443-47fe-4d29-aa22-a7ba786d1976-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-w2bbf\" (UID: \"e453a443-47fe-4d29-aa22-a7ba786d1976\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-w2bbf" Jun 08 21:17:45.161989 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:45.161964 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e453a443-47fe-4d29-aa22-a7ba786d1976-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-w2bbf\" (UID: \"e453a443-47fe-4d29-aa22-a7ba786d1976\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-w2bbf" Jun 08 21:17:45.260837 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:45.260752 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-w2bbf" Jun 08 21:17:45.415405 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:45.415355 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-w2bbf"] Jun 08 21:17:45.418765 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:17:45.418733 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode453a443_47fe_4d29_aa22_a7ba786d1976.slice/crio-45fdd8a198666e12bdb7b612010edf75bbad32a3572602442e7aec5378c4ff6c WatchSource:0}: Error finding container 45fdd8a198666e12bdb7b612010edf75bbad32a3572602442e7aec5378c4ff6c: Status 404 returned error can't find the container with id 45fdd8a198666e12bdb7b612010edf75bbad32a3572602442e7aec5378c4ff6c Jun 08 21:17:46.071751 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:46.071314 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-w2bbf" event={"ID":"e453a443-47fe-4d29-aa22-a7ba786d1976","Type":"ContainerStarted","Data":"45fdd8a198666e12bdb7b612010edf75bbad32a3572602442e7aec5378c4ff6c"} Jun 08 21:17:47.076280 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:47.076248 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-w2bbf" event={"ID":"e453a443-47fe-4d29-aa22-a7ba786d1976","Type":"ContainerStarted","Data":"ae37fed409617e7aae2acd367df590c182e1b4dc7b6acdc7a5d8a41f00c84721"} Jun 08 21:17:47.076695 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:47.076436 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-w2bbf" Jun 08 21:17:47.081049 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:47.081027 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-w2bbf" Jun 08 21:17:47.092765 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:47.092717 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-w2bbf" podStartSLOduration=1.868011247 podStartE2EDuration="3.092703278s" totalImagesPullingTime="1.224692031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:17:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:17:47.091916443 +0000 UTC m=+239.231959318" watchObservedRunningTime="2026-06-08 21:17:47.092703278 +0000 UTC m=+239.232746196" Jun 08 21:17:48.019328 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:48.019293 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-x5lsk"] Jun 08 21:17:48.022726 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:48.022707 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-x5lsk" Jun 08 21:17:48.025728 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:48.025687 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 08 21:17:48.025868 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:48.025725 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 08 21:17:48.026684 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:48.026659 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 08 21:17:48.026797 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:48.026698 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-gppn9\"" Jun 08 21:17:48.037699 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:48.035261 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-x5lsk"] Jun 08 21:17:48.085120 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:48.085090 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cb4d3c5-5f41-475c-b2ed-09835366e940-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-x5lsk\" (UID: \"7cb4d3c5-5f41-475c-b2ed-09835366e940\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-x5lsk" Jun 08 21:17:48.085468 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:48.085166 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7cb4d3c5-5f41-475c-b2ed-09835366e940-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-x5lsk\" (UID: \"7cb4d3c5-5f41-475c-b2ed-09835366e940\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-x5lsk" Jun 08 21:17:48.085468 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:48.085197 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7cb4d3c5-5f41-475c-b2ed-09835366e940-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-x5lsk\" (UID: \"7cb4d3c5-5f41-475c-b2ed-09835366e940\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-x5lsk" Jun 08 21:17:48.085468 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:48.085224 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crkxl\" (UniqueName: \"kubernetes.io/projected/7cb4d3c5-5f41-475c-b2ed-09835366e940-kube-api-access-crkxl\") pod \"prometheus-operator-7f7d445d84-x5lsk\" (UID: \"7cb4d3c5-5f41-475c-b2ed-09835366e940\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-x5lsk" Jun 08 21:17:48.186444 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:48.186408 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crkxl\" (UniqueName: \"kubernetes.io/projected/7cb4d3c5-5f41-475c-b2ed-09835366e940-kube-api-access-crkxl\") pod \"prometheus-operator-7f7d445d84-x5lsk\" (UID: \"7cb4d3c5-5f41-475c-b2ed-09835366e940\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-x5lsk" Jun 08 21:17:48.186637 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:48.186480 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cb4d3c5-5f41-475c-b2ed-09835366e940-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-x5lsk\" (UID: \"7cb4d3c5-5f41-475c-b2ed-09835366e940\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-x5lsk" Jun 08 21:17:48.186637 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:48.186531 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7cb4d3c5-5f41-475c-b2ed-09835366e940-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-x5lsk\" (UID: \"7cb4d3c5-5f41-475c-b2ed-09835366e940\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-x5lsk" Jun 08 21:17:48.186637 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:48.186558 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7cb4d3c5-5f41-475c-b2ed-09835366e940-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-x5lsk\" (UID: \"7cb4d3c5-5f41-475c-b2ed-09835366e940\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-x5lsk" Jun 08 21:17:48.186798 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:48.186659 2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 08 21:17:48.186798 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:17:48.186743 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cb4d3c5-5f41-475c-b2ed-09835366e940-prometheus-operator-tls podName:7cb4d3c5-5f41-475c-b2ed-09835366e940 nodeName:}" failed. No retries permitted until 2026-06-08 21:17:48.686725518 +0000 UTC m=+240.826768377 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/7cb4d3c5-5f41-475c-b2ed-09835366e940-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-x5lsk" (UID: "7cb4d3c5-5f41-475c-b2ed-09835366e940") : secret "prometheus-operator-tls" not found Jun 08 21:17:48.187253 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:48.187224 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cb4d3c5-5f41-475c-b2ed-09835366e940-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-x5lsk\" (UID: \"7cb4d3c5-5f41-475c-b2ed-09835366e940\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-x5lsk" Jun 08 21:17:48.189186 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:48.189160 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7cb4d3c5-5f41-475c-b2ed-09835366e940-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-x5lsk\" (UID: \"7cb4d3c5-5f41-475c-b2ed-09835366e940\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-x5lsk" Jun 08 21:17:48.195282 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:48.195261 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crkxl\" (UniqueName: \"kubernetes.io/projected/7cb4d3c5-5f41-475c-b2ed-09835366e940-kube-api-access-crkxl\") pod \"prometheus-operator-7f7d445d84-x5lsk\" (UID: \"7cb4d3c5-5f41-475c-b2ed-09835366e940\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-x5lsk" Jun 08 21:17:48.690364 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:48.690327 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7cb4d3c5-5f41-475c-b2ed-09835366e940-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-x5lsk\" (UID: \"7cb4d3c5-5f41-475c-b2ed-09835366e940\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-x5lsk" Jun 08 21:17:48.692904 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:48.692868 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7cb4d3c5-5f41-475c-b2ed-09835366e940-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-x5lsk\" (UID: \"7cb4d3c5-5f41-475c-b2ed-09835366e940\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-x5lsk" Jun 08 21:17:48.939140 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:48.939106 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-gppn9\"" Jun 08 21:17:48.946438 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:48.946390 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-x5lsk" Jun 08 21:17:49.084644 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:49.084611 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-x5lsk"] Jun 08 21:17:49.087675 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:17:49.087650 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cb4d3c5_5f41_475c_b2ed_09835366e940.slice/crio-32307c48a35dc0014e481e26b3d35267897e01c3416e31bff3a92102ec50c3d3 WatchSource:0}: Error finding container 32307c48a35dc0014e481e26b3d35267897e01c3416e31bff3a92102ec50c3d3: Status 404 returned error can't find the container with id 32307c48a35dc0014e481e26b3d35267897e01c3416e31bff3a92102ec50c3d3 Jun 08 21:17:50.091001 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:50.090962 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-x5lsk" event={"ID":"7cb4d3c5-5f41-475c-b2ed-09835366e940","Type":"ContainerStarted","Data":"32307c48a35dc0014e481e26b3d35267897e01c3416e31bff3a92102ec50c3d3"} Jun 08 21:17:51.095570 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:51.095535 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-x5lsk" event={"ID":"7cb4d3c5-5f41-475c-b2ed-09835366e940","Type":"ContainerStarted","Data":"b6c6b35f3d00776cb8b484861878da864467f9529b9323fa4c76bd46f1f86d61"} Jun 08 21:17:51.095950 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:51.095588 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-x5lsk" event={"ID":"7cb4d3c5-5f41-475c-b2ed-09835366e940","Type":"ContainerStarted","Data":"0397e12a507cf5f986b6fe08e2c9148a65cf5040334a12279a5cfbd7a190b295"} Jun 08 21:17:51.116850 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:51.116800 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-x5lsk" podStartSLOduration=2.716765274 podStartE2EDuration="4.116783361s" totalImagesPullingTime="1.400018087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:17:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:17:51.115024237 +0000 UTC m=+243.255067109" watchObservedRunningTime="2026-06-08 21:17:51.116783361 +0000 UTC m=+243.256826234" Jun 08 21:17:53.389599 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.389565 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-69gk5"] Jun 08 21:17:53.393269 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.393243 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-69gk5" Jun 08 21:17:53.401926 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.401864 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 08 21:17:53.402341 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.402321 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 08 21:17:53.402644 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.402615 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-cztfw\"" Jun 08 21:17:53.407596 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.407575 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-69gk5"] Jun 08 21:17:53.430935 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.430909 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xphsd"] Jun 08 21:17:53.434223 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.434192 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xphsd" Jun 08 21:17:53.438552 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.438526 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 08 21:17:53.438682 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.438571 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 08 21:17:53.438799 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.438772 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 08 21:17:53.438912 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.438870 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fwhrd\"" Jun 08 21:17:53.529645 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.529609 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cpvc\" (UniqueName: \"kubernetes.io/projected/d84c3bbe-7f8e-4d22-9135-ab07ec3229fc-kube-api-access-6cpvc\") pod \"node-exporter-xphsd\" (UID: \"d84c3bbe-7f8e-4d22-9135-ab07ec3229fc\") " pod="openshift-monitoring/node-exporter-xphsd" Jun 08 21:17:53.529645 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.529641 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d84c3bbe-7f8e-4d22-9135-ab07ec3229fc-node-exporter-wtmp\") pod \"node-exporter-xphsd\" (UID: \"d84c3bbe-7f8e-4d22-9135-ab07ec3229fc\") " pod="openshift-monitoring/node-exporter-xphsd" Jun 08 21:17:53.529871 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.529660 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d84c3bbe-7f8e-4d22-9135-ab07ec3229fc-metrics-client-ca\") pod \"node-exporter-xphsd\" (UID: \"d84c3bbe-7f8e-4d22-9135-ab07ec3229fc\") " pod="openshift-monitoring/node-exporter-xphsd" Jun 08 21:17:53.529871 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.529676 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d84c3bbe-7f8e-4d22-9135-ab07ec3229fc-sys\") pod \"node-exporter-xphsd\" (UID: \"d84c3bbe-7f8e-4d22-9135-ab07ec3229fc\") " pod="openshift-monitoring/node-exporter-xphsd" Jun 08 21:17:53.529871 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.529757 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9344bf3f-c069-46ae-a9ba-725376e7ecc7-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-69gk5\" (UID: \"9344bf3f-c069-46ae-a9ba-725376e7ecc7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-69gk5" Jun 08 21:17:53.529871 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.529815 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9344bf3f-c069-46ae-a9ba-725376e7ecc7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-69gk5\" (UID: \"9344bf3f-c069-46ae-a9ba-725376e7ecc7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-69gk5" Jun 08 21:17:53.529871 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.529840 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8sxw\" (UniqueName: \"kubernetes.io/projected/9344bf3f-c069-46ae-a9ba-725376e7ecc7-kube-api-access-d8sxw\") pod \"openshift-state-metrics-65f78d5c66-69gk5\" (UID: \"9344bf3f-c069-46ae-a9ba-725376e7ecc7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-69gk5" Jun 08 21:17:53.530143 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.529928 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d84c3bbe-7f8e-4d22-9135-ab07ec3229fc-root\") pod \"node-exporter-xphsd\" (UID: \"d84c3bbe-7f8e-4d22-9135-ab07ec3229fc\") " pod="openshift-monitoring/node-exporter-xphsd" Jun 08 21:17:53.530143 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.529960 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d84c3bbe-7f8e-4d22-9135-ab07ec3229fc-node-exporter-textfile\") pod \"node-exporter-xphsd\" (UID: \"d84c3bbe-7f8e-4d22-9135-ab07ec3229fc\") " pod="openshift-monitoring/node-exporter-xphsd" Jun 08 21:17:53.530143 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.529985 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d84c3bbe-7f8e-4d22-9135-ab07ec3229fc-node-exporter-tls\") pod \"node-exporter-xphsd\" (UID: \"d84c3bbe-7f8e-4d22-9135-ab07ec3229fc\") " pod="openshift-monitoring/node-exporter-xphsd" Jun 08 21:17:53.530143 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.530033 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9344bf3f-c069-46ae-a9ba-725376e7ecc7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-69gk5\" (UID: \"9344bf3f-c069-46ae-a9ba-725376e7ecc7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-69gk5" Jun 08 21:17:53.530143 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.530119 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d84c3bbe-7f8e-4d22-9135-ab07ec3229fc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xphsd\" (UID: \"d84c3bbe-7f8e-4d22-9135-ab07ec3229fc\") " pod="openshift-monitoring/node-exporter-xphsd" Jun 08 21:17:53.530299 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.530164 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d84c3bbe-7f8e-4d22-9135-ab07ec3229fc-node-exporter-accelerators-collector-config\") pod \"node-exporter-xphsd\" (UID: \"d84c3bbe-7f8e-4d22-9135-ab07ec3229fc\") " pod="openshift-monitoring/node-exporter-xphsd" Jun 08 21:17:53.630878 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.630840 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d84c3bbe-7f8e-4d22-9135-ab07ec3229fc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xphsd\" (UID: \"d84c3bbe-7f8e-4d22-9135-ab07ec3229fc\") " pod="openshift-monitoring/node-exporter-xphsd" Jun 08 21:17:53.631090 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.630900 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d84c3bbe-7f8e-4d22-9135-ab07ec3229fc-node-exporter-accelerators-collector-config\") pod \"node-exporter-xphsd\" (UID: \"d84c3bbe-7f8e-4d22-9135-ab07ec3229fc\") " pod="openshift-monitoring/node-exporter-xphsd" Jun 08 21:17:53.631090 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.630933 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cpvc\" (UniqueName: \"kubernetes.io/projected/d84c3bbe-7f8e-4d22-9135-ab07ec3229fc-kube-api-access-6cpvc\") pod \"node-exporter-xphsd\" (UID: \"d84c3bbe-7f8e-4d22-9135-ab07ec3229fc\") " pod="openshift-monitoring/node-exporter-xphsd" Jun 08 21:17:53.631090 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.630960 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d84c3bbe-7f8e-4d22-9135-ab07ec3229fc-node-exporter-wtmp\") pod \"node-exporter-xphsd\" (UID: \"d84c3bbe-7f8e-4d22-9135-ab07ec3229fc\") " pod="openshift-monitoring/node-exporter-xphsd" Jun 08 21:17:53.631090 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.630985 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d84c3bbe-7f8e-4d22-9135-ab07ec3229fc-metrics-client-ca\") pod \"node-exporter-xphsd\" (UID: \"d84c3bbe-7f8e-4d22-9135-ab07ec3229fc\") " pod="openshift-monitoring/node-exporter-xphsd" Jun 08 21:17:53.631315 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.631152 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d84c3bbe-7f8e-4d22-9135-ab07ec3229fc-node-exporter-wtmp\") pod \"node-exporter-xphsd\" (UID: \"d84c3bbe-7f8e-4d22-9135-ab07ec3229fc\") " pod="openshift-monitoring/node-exporter-xphsd" Jun 08 21:17:53.631315 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.631203 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d84c3bbe-7f8e-4d22-9135-ab07ec3229fc-sys\") pod \"node-exporter-xphsd\" (UID: \"d84c3bbe-7f8e-4d22-9135-ab07ec3229fc\") " pod="openshift-monitoring/node-exporter-xphsd" Jun 08 21:17:53.631315 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.631284 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9344bf3f-c069-46ae-a9ba-725376e7ecc7-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-69gk5\" (UID: \"9344bf3f-c069-46ae-a9ba-725376e7ecc7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-69gk5" Jun 08 21:17:53.631476 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.631328 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9344bf3f-c069-46ae-a9ba-725376e7ecc7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-69gk5\" (UID: \"9344bf3f-c069-46ae-a9ba-725376e7ecc7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-69gk5" Jun 08 21:17:53.631476 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.631357 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d84c3bbe-7f8e-4d22-9135-ab07ec3229fc-sys\") pod \"node-exporter-xphsd\" (UID: \"d84c3bbe-7f8e-4d22-9135-ab07ec3229fc\") " pod="openshift-monitoring/node-exporter-xphsd" Jun 08 21:17:53.631476 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.631415 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8sxw\" (UniqueName: \"kubernetes.io/projected/9344bf3f-c069-46ae-a9ba-725376e7ecc7-kube-api-access-d8sxw\") pod \"openshift-state-metrics-65f78d5c66-69gk5\" (UID: \"9344bf3f-c069-46ae-a9ba-725376e7ecc7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-69gk5" Jun 08 21:17:53.631476 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.631466 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d84c3bbe-7f8e-4d22-9135-ab07ec3229fc-root\") pod \"node-exporter-xphsd\" (UID: \"d84c3bbe-7f8e-4d22-9135-ab07ec3229fc\") " pod="openshift-monitoring/node-exporter-xphsd" Jun 08 21:17:53.631672 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.631486 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d84c3bbe-7f8e-4d22-9135-ab07ec3229fc-node-exporter-textfile\") pod \"node-exporter-xphsd\" (UID: \"d84c3bbe-7f8e-4d22-9135-ab07ec3229fc\") " pod="openshift-monitoring/node-exporter-xphsd" Jun 08 21:17:53.631672 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.631512 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d84c3bbe-7f8e-4d22-9135-ab07ec3229fc-node-exporter-tls\") pod \"node-exporter-xphsd\" (UID: \"d84c3bbe-7f8e-4d22-9135-ab07ec3229fc\") " pod="openshift-monitoring/node-exporter-xphsd" Jun 08 21:17:53.631672 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.631544 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9344bf3f-c069-46ae-a9ba-725376e7ecc7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-69gk5\" (UID: \"9344bf3f-c069-46ae-a9ba-725376e7ecc7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-69gk5" Jun 08 21:17:53.631672 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.631608 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d84c3bbe-7f8e-4d22-9135-ab07ec3229fc-metrics-client-ca\") pod \"node-exporter-xphsd\" (UID: \"d84c3bbe-7f8e-4d22-9135-ab07ec3229fc\") " pod="openshift-monitoring/node-exporter-xphsd" Jun 08 21:17:53.631672 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.631608 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d84c3bbe-7f8e-4d22-9135-ab07ec3229fc-node-exporter-accelerators-collector-config\") pod \"node-exporter-xphsd\" (UID: \"d84c3bbe-7f8e-4d22-9135-ab07ec3229fc\") " pod="openshift-monitoring/node-exporter-xphsd" Jun 08 21:17:53.631905 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.631853 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d84c3bbe-7f8e-4d22-9135-ab07ec3229fc-root\") pod \"node-exporter-xphsd\" (UID: \"d84c3bbe-7f8e-4d22-9135-ab07ec3229fc\") " pod="openshift-monitoring/node-exporter-xphsd" Jun 08 21:17:53.632167 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.632143 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d84c3bbe-7f8e-4d22-9135-ab07ec3229fc-node-exporter-textfile\") pod \"node-exporter-xphsd\" (UID: \"d84c3bbe-7f8e-4d22-9135-ab07ec3229fc\") " pod="openshift-monitoring/node-exporter-xphsd" Jun 08 21:17:53.632243 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.632214 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9344bf3f-c069-46ae-a9ba-725376e7ecc7-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-69gk5\" (UID: \"9344bf3f-c069-46ae-a9ba-725376e7ecc7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-69gk5" Jun 08 21:17:53.634184 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.634157 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d84c3bbe-7f8e-4d22-9135-ab07ec3229fc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xphsd\" (UID: \"d84c3bbe-7f8e-4d22-9135-ab07ec3229fc\") " pod="openshift-monitoring/node-exporter-xphsd" Jun 08 21:17:53.634802 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.634776 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d84c3bbe-7f8e-4d22-9135-ab07ec3229fc-node-exporter-tls\") pod \"node-exporter-xphsd\" (UID: \"d84c3bbe-7f8e-4d22-9135-ab07ec3229fc\") " pod="openshift-monitoring/node-exporter-xphsd" Jun 08 21:17:53.634960 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.634936 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9344bf3f-c069-46ae-a9ba-725376e7ecc7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-69gk5\" (UID: \"9344bf3f-c069-46ae-a9ba-725376e7ecc7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-69gk5" Jun 08 21:17:53.635120 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.634978 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9344bf3f-c069-46ae-a9ba-725376e7ecc7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-69gk5\" (UID: \"9344bf3f-c069-46ae-a9ba-725376e7ecc7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-69gk5" Jun 08 21:17:53.646577 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.646507 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cpvc\" (UniqueName: \"kubernetes.io/projected/d84c3bbe-7f8e-4d22-9135-ab07ec3229fc-kube-api-access-6cpvc\") pod \"node-exporter-xphsd\" (UID: \"d84c3bbe-7f8e-4d22-9135-ab07ec3229fc\") " pod="openshift-monitoring/node-exporter-xphsd" Jun 08 21:17:53.649644 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.649523 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8sxw\" (UniqueName: \"kubernetes.io/projected/9344bf3f-c069-46ae-a9ba-725376e7ecc7-kube-api-access-d8sxw\") pod \"openshift-state-metrics-65f78d5c66-69gk5\" (UID: \"9344bf3f-c069-46ae-a9ba-725376e7ecc7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-69gk5" Jun 08 21:17:53.704300 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.704263 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-69gk5" Jun 08 21:17:53.744923 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.744883 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xphsd" Jun 08 21:17:53.758716 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:17:53.758017 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd84c3bbe_7f8e_4d22_9135_ab07ec3229fc.slice/crio-7d82aa105e612e1e1c9c89fc961715b61ef09acdb7fb92a323be22965a590134 WatchSource:0}: Error finding container 7d82aa105e612e1e1c9c89fc961715b61ef09acdb7fb92a323be22965a590134: Status 404 returned error can't find the container with id 7d82aa105e612e1e1c9c89fc961715b61ef09acdb7fb92a323be22965a590134 Jun 08 21:17:53.851233 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:53.851207 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-69gk5"] Jun 08 21:17:53.854083 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:17:53.854044 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9344bf3f_c069_46ae_a9ba_725376e7ecc7.slice/crio-aaba7f5a2459264e4e040efd5a9cbb007ca7d26d6213ebe327d11ba3b6f92c75 WatchSource:0}: Error finding container aaba7f5a2459264e4e040efd5a9cbb007ca7d26d6213ebe327d11ba3b6f92c75: Status 404 returned error can't find the container with id aaba7f5a2459264e4e040efd5a9cbb007ca7d26d6213ebe327d11ba3b6f92c75 Jun 08 21:17:54.110131 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:54.110093 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-69gk5" event={"ID":"9344bf3f-c069-46ae-a9ba-725376e7ecc7","Type":"ContainerStarted","Data":"6b3968952d1a195faae6290bd649c8061d16493b0d7258ed2d267a688227f944"} Jun 08 21:17:54.110337 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:54.110165 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-69gk5" event={"ID":"9344bf3f-c069-46ae-a9ba-725376e7ecc7","Type":"ContainerStarted","Data":"5a67457df03743447dccb0304734be1d210cfcb86ad1747775dc61a87ac5a28f"} Jun 08 21:17:54.110337 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:54.110197 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-69gk5" event={"ID":"9344bf3f-c069-46ae-a9ba-725376e7ecc7","Type":"ContainerStarted","Data":"aaba7f5a2459264e4e040efd5a9cbb007ca7d26d6213ebe327d11ba3b6f92c75"} Jun 08 21:17:54.111541 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:54.111513 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xphsd" event={"ID":"d84c3bbe-7f8e-4d22-9135-ab07ec3229fc","Type":"ContainerStarted","Data":"7d82aa105e612e1e1c9c89fc961715b61ef09acdb7fb92a323be22965a590134"} Jun 08 21:17:56.122401 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:56.122300 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-69gk5" event={"ID":"9344bf3f-c069-46ae-a9ba-725376e7ecc7","Type":"ContainerStarted","Data":"020c889553ef88959cf2c743f1e0419d8ba9fe75a26e3b2b5814ca3dc9cce8ac"} Jun 08 21:17:56.124331 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:56.124298 2564 generic.go:356] "Generic (PLEG): container finished" podID="d84c3bbe-7f8e-4d22-9135-ab07ec3229fc" containerID="66c01ca5f3572390d2507911f0f231866602ac758710c58f21f89b75474a85aa" exitCode=0 Jun 08 21:17:56.124445 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:56.124345 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xphsd" event={"ID":"d84c3bbe-7f8e-4d22-9135-ab07ec3229fc","Type":"ContainerDied","Data":"66c01ca5f3572390d2507911f0f231866602ac758710c58f21f89b75474a85aa"} Jun 08 21:17:56.139728 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:17:56.139649 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-69gk5" podStartSLOduration=1.9738391549999998 podStartE2EDuration="3.13962938s" totalImagesPullingTime="1.165790225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:17:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:17:56.139034536 +0000 UTC m=+248.279077419" watchObservedRunningTime="2026-06-08 21:17:56.13962938 +0000 UTC m=+248.279672261" Jun 08 21:18:00.193648 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:00.193605 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69e600b7-7393-4b2c-8e83-3b5fd3e07b31-metrics-certs\") pod \"network-metrics-daemon-9jghf\" (UID: \"69e600b7-7393-4b2c-8e83-3b5fd3e07b31\") " pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:18:00.196599 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:00.196566 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69e600b7-7393-4b2c-8e83-3b5fd3e07b31-metrics-certs\") pod \"network-metrics-daemon-9jghf\" (UID: \"69e600b7-7393-4b2c-8e83-3b5fd3e07b31\") " pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:18:00.445447 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:00.445364 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zf2sl\"" Jun 08 21:18:00.453701 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:00.453678 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9jghf" Jun 08 21:18:02.826571 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:02.826542 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9jghf"] Jun 08 21:18:02.829691 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:18:02.829661 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69e600b7_7393_4b2c_8e83_3b5fd3e07b31.slice/crio-f8df4925225d26c475914addb66a6c1adab77a19327f6b6059bfc3b16718f839 WatchSource:0}: Error finding container f8df4925225d26c475914addb66a6c1adab77a19327f6b6059bfc3b16718f839: Status 404 returned error can't find the container with id f8df4925225d26c475914addb66a6c1adab77a19327f6b6059bfc3b16718f839 Jun 08 21:18:03.154683 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:03.154642 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-tkkdm" event={"ID":"ce7d9d0d-9af9-49df-ab21-c514fe47c28f","Type":"ContainerStarted","Data":"136bcffe02fe5ba5a0047840bc76d19b5faa4b7655b30b8793a11829a4673a89"} Jun 08 21:18:03.155007 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:03.154984 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-tkkdm" Jun 08 21:18:03.157475 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:03.157442 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xphsd" event={"ID":"d84c3bbe-7f8e-4d22-9135-ab07ec3229fc","Type":"ContainerStarted","Data":"a3c00b5f8d6d383f65d757e8e20801e33b090ff9592eaeb1b7711788f5cb652d"} Jun 08 21:18:03.157596 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:03.157504 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xphsd" event={"ID":"d84c3bbe-7f8e-4d22-9135-ab07ec3229fc","Type":"ContainerStarted","Data":"c8669c6f4c5b2fe3515a6d1af63241f190e86c39df20e2020a939ac003d64263"} Jun 08 21:18:03.158731 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:03.158711 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9jghf" event={"ID":"69e600b7-7393-4b2c-8e83-3b5fd3e07b31","Type":"ContainerStarted","Data":"f8df4925225d26c475914addb66a6c1adab77a19327f6b6059bfc3b16718f839"} Jun 08 21:18:03.170136 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:03.170093 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-tkkdm" Jun 08 21:18:03.174622 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:03.174562 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-tkkdm" podStartSLOduration=1.833938187 podStartE2EDuration="25.174545326s" totalImagesPullingTime="23.340607139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:17:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:18:03.174464975 +0000 UTC m=+255.314507856" watchObservedRunningTime="2026-06-08 21:18:03.174545326 +0000 UTC m=+255.314588207" Jun 08 21:18:03.210730 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:03.210664 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xphsd" podStartSLOduration=8.739321817 podStartE2EDuration="10.210642405s" totalImagesPullingTime="1.38978207s" totalInitContainerRuntime="81.538518ms" isStatefulPod=true podCreationTimestamp="2026-06-08 21:17:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:18:03.2098396 +0000 UTC m=+255.349882483" watchObservedRunningTime="2026-06-08 21:18:03.210642405 +0000 UTC m=+255.350685286" Jun 08 21:18:04.166016 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:04.165833 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9jghf" event={"ID":"69e600b7-7393-4b2c-8e83-3b5fd3e07b31","Type":"ContainerStarted","Data":"10c240bbcf53bd059b781801c191c8543d36e56127ba11182232b2d78a4ec989"} Jun 08 21:18:04.166016 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:04.165919 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9jghf" event={"ID":"69e600b7-7393-4b2c-8e83-3b5fd3e07b31","Type":"ContainerStarted","Data":"a60aa8c33ace4c80a943d32daa22f2b20c507868f7f163dc7d037a7d49727d5f"} Jun 08 21:18:04.183109 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:04.183042 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9jghf" podStartSLOduration=255.222130024 podStartE2EDuration="4m16.183027177s" totalImagesPullingTime="960.897153ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:13:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:18:04.18121637 +0000 UTC m=+256.321259291" watchObservedRunningTime="2026-06-08 21:18:04.183027177 +0000 UTC m=+256.323070059" Jun 08 21:18:19.226394 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:19.226362 2564 generic.go:356] "Generic (PLEG): container finished" podID="63764930-22a1-469f-8747-a7b72a3c224d" containerID="6bac1eb52c611d6436f5d86ce166a9b7ecb6f9151dd811cf207480276e9775bb" exitCode=0 Jun 08 21:18:19.226867 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:19.226423 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lcxm8" event={"ID":"63764930-22a1-469f-8747-a7b72a3c224d","Type":"ContainerDied","Data":"6bac1eb52c611d6436f5d86ce166a9b7ecb6f9151dd811cf207480276e9775bb"} Jun 08 21:18:19.226867 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:19.226726 2564 scope.go:117] "RemoveContainer" containerID="6bac1eb52c611d6436f5d86ce166a9b7ecb6f9151dd811cf207480276e9775bb" Jun 08 21:18:20.232019 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:20.231984 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-lcxm8" event={"ID":"63764930-22a1-469f-8747-a7b72a3c224d","Type":"ContainerStarted","Data":"9980fb8e501f324649b4b108cd8c0f29a8f1af197d9ff14467ea47cdc536f22b"} Jun 08 21:18:23.245294 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:23.245258 2564 generic.go:356] "Generic (PLEG): container finished" podID="5afccbef-c7e7-4921-8292-381bf51a0dda" containerID="fb888006e5e5749b65fed182c8e91f8996acb97daea4d5a29e2120c4e3740fac" exitCode=0 Jun 08 21:18:23.245670 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:23.245336 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-pp7gc" event={"ID":"5afccbef-c7e7-4921-8292-381bf51a0dda","Type":"ContainerDied","Data":"fb888006e5e5749b65fed182c8e91f8996acb97daea4d5a29e2120c4e3740fac"} Jun 08 21:18:23.245712 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:23.245683 2564 scope.go:117] "RemoveContainer" containerID="fb888006e5e5749b65fed182c8e91f8996acb97daea4d5a29e2120c4e3740fac" Jun 08 21:18:24.251793 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:24.251758 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-pp7gc" event={"ID":"5afccbef-c7e7-4921-8292-381bf51a0dda","Type":"ContainerStarted","Data":"1aeaf4b9a0377dc684432566921f7582680a87da85d650ce813999b264c7eab7"} Jun 08 21:18:29.836267 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:18:29.836218 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-84b76" podUID="32c5f89b-dbcb-4c62-b411-d5ce3b45ee03" Jun 08 21:18:29.836267 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:18:29.836232 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-78b77f675-grvwb" podUID="a49114d7-546a-48fe-b312-10f9c9e04f34" Jun 08 21:18:30.273705 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:30.273608 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:18:30.273705 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:30.273615 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-84b76" Jun 08 21:18:33.281605 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:33.281569 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-tls\") pod \"image-registry-78b77f675-grvwb\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:18:33.282015 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:33.281627 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-metrics-tls\") pod \"dns-default-84b76\" (UID: \"32c5f89b-dbcb-4c62-b411-d5ce3b45ee03\") " pod="openshift-dns/dns-default-84b76" Jun 08 21:18:33.284207 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:33.284183 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32c5f89b-dbcb-4c62-b411-d5ce3b45ee03-metrics-tls\") pod \"dns-default-84b76\" (UID: \"32c5f89b-dbcb-4c62-b411-d5ce3b45ee03\") " pod="openshift-dns/dns-default-84b76" Jun 08 21:18:33.284324 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:33.284305 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-tls\") pod \"image-registry-78b77f675-grvwb\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:18:33.578928 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:33.578878 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6vb88\"" Jun 08 21:18:33.578928 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:33.578879 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-x6djq\"" Jun 08 21:18:33.585713 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:33.585698 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-84b76" Jun 08 21:18:33.585802 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:33.585725 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:18:33.757092 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:33.757040 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-84b76"] Jun 08 21:18:33.759038 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:18:33.759011 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32c5f89b_dbcb_4c62_b411_d5ce3b45ee03.slice/crio-9ae4aa2969130517f756986b0958acb209e5a8fb0e3f09e31c7d8c6b60ede769 WatchSource:0}: Error finding container 9ae4aa2969130517f756986b0958acb209e5a8fb0e3f09e31c7d8c6b60ede769: Status 404 returned error can't find the container with id 9ae4aa2969130517f756986b0958acb209e5a8fb0e3f09e31c7d8c6b60ede769 Jun 08 21:18:33.780764 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:33.780737 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78b77f675-grvwb"] Jun 08 21:18:33.783010 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:18:33.782989 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda49114d7_546a_48fe_b312_10f9c9e04f34.slice/crio-05b9ad9971e5127047d50a634d5fc5b2ccc28f987775d707c29cf0af05e0c9ed WatchSource:0}: Error finding container 05b9ad9971e5127047d50a634d5fc5b2ccc28f987775d707c29cf0af05e0c9ed: Status 404 returned error can't find the container with id 05b9ad9971e5127047d50a634d5fc5b2ccc28f987775d707c29cf0af05e0c9ed Jun 08 21:18:34.290194 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:34.290152 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-84b76" event={"ID":"32c5f89b-dbcb-4c62-b411-d5ce3b45ee03","Type":"ContainerStarted","Data":"9ae4aa2969130517f756986b0958acb209e5a8fb0e3f09e31c7d8c6b60ede769"} Jun 08 21:18:34.291709 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:34.291684 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78b77f675-grvwb" event={"ID":"a49114d7-546a-48fe-b312-10f9c9e04f34","Type":"ContainerStarted","Data":"c318218914b6fd32538a5b6963fa3d82999c00b3bb3aa711030e4b8fcae4a21e"} Jun 08 21:18:34.291859 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:34.291722 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78b77f675-grvwb" event={"ID":"a49114d7-546a-48fe-b312-10f9c9e04f34","Type":"ContainerStarted","Data":"05b9ad9971e5127047d50a634d5fc5b2ccc28f987775d707c29cf0af05e0c9ed"} Jun 08 21:18:34.291859 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:34.291809 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:18:34.315975 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:34.315920 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-78b77f675-grvwb" podStartSLOduration=285.315903017 podStartE2EDuration="4m45.315903017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:13:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:18:34.314696205 +0000 UTC m=+286.454739086" watchObservedRunningTime="2026-06-08 21:18:34.315903017 +0000 UTC m=+286.455945928" Jun 08 21:18:37.305680 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:37.305648 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-84b76" event={"ID":"32c5f89b-dbcb-4c62-b411-d5ce3b45ee03","Type":"ContainerStarted","Data":"721c37f63ec8e4a8560c15e630bfce5a67a2e161baf6422796674a25c9a827aa"} Jun 08 21:18:37.306063 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:37.305700 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-84b76" event={"ID":"32c5f89b-dbcb-4c62-b411-d5ce3b45ee03","Type":"ContainerStarted","Data":"c7ff5c9b85d7a2c9ccb035184dc368578610d4a203d27e7088a99efd724c3c03"} Jun 08 21:18:37.306063 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:37.305738 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-84b76" Jun 08 21:18:37.327817 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:37.327773 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-84b76" podStartSLOduration=251.643256874 podStartE2EDuration="4m14.327758256s" totalImagesPullingTime="2.684501382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:14:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:18:37.32524409 +0000 UTC m=+289.465286984" watchObservedRunningTime="2026-06-08 21:18:37.327758256 +0000 UTC m=+289.467801137" Jun 08 21:18:47.310988 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:47.310953 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-84b76" Jun 08 21:18:48.289449 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:48.289423 2564 kubelet.go:1648] "Image garbage collection succeeded" Jun 08 21:18:53.589894 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:53.589854 2564 patch_prober.go:28] interesting pod/image-registry-78b77f675-grvwb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 21:18:53.592285 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:53.589931 2564 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-78b77f675-grvwb" podUID="a49114d7-546a-48fe-b312-10f9c9e04f34" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 21:18:55.300208 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:18:55.300180 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:19:07.489594 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:07.489558 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78b77f675-grvwb"] Jun 08 21:19:32.510033 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:32.509986 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-78b77f675-grvwb" podUID="a49114d7-546a-48fe-b312-10f9c9e04f34" containerName="registry" containerID="cri-o://c318218914b6fd32538a5b6963fa3d82999c00b3bb3aa711030e4b8fcae4a21e" gracePeriod=30 Jun 08 21:19:33.748176 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:33.748147 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:19:33.858985 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:33.858878 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-tls\") pod \"a49114d7-546a-48fe-b312-10f9c9e04f34\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " Jun 08 21:19:33.858985 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:33.858943 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a49114d7-546a-48fe-b312-10f9c9e04f34-image-registry-private-configuration\") pod \"a49114d7-546a-48fe-b312-10f9c9e04f34\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " Jun 08 21:19:33.858985 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:33.858969 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-certificates\") pod \"a49114d7-546a-48fe-b312-10f9c9e04f34\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " Jun 08 21:19:33.858985 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:33.858991 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl5l6\" (UniqueName: \"kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-kube-api-access-gl5l6\") pod \"a49114d7-546a-48fe-b312-10f9c9e04f34\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " Jun 08 21:19:33.859353 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:33.859015 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-bound-sa-token\") pod \"a49114d7-546a-48fe-b312-10f9c9e04f34\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " Jun 08 21:19:33.859353 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:33.859031 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a49114d7-546a-48fe-b312-10f9c9e04f34-installation-pull-secrets\") pod \"a49114d7-546a-48fe-b312-10f9c9e04f34\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " Jun 08 21:19:33.859353 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:33.859054 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a49114d7-546a-48fe-b312-10f9c9e04f34-trusted-ca\") pod \"a49114d7-546a-48fe-b312-10f9c9e04f34\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " Jun 08 21:19:33.859353 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:33.859110 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a49114d7-546a-48fe-b312-10f9c9e04f34-ca-trust-extracted\") pod \"a49114d7-546a-48fe-b312-10f9c9e04f34\" (UID: \"a49114d7-546a-48fe-b312-10f9c9e04f34\") " Jun 08 21:19:33.859666 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:33.859596 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a49114d7-546a-48fe-b312-10f9c9e04f34" (UID: "a49114d7-546a-48fe-b312-10f9c9e04f34"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 21:19:33.859666 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:33.859607 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a49114d7-546a-48fe-b312-10f9c9e04f34-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a49114d7-546a-48fe-b312-10f9c9e04f34" (UID: "a49114d7-546a-48fe-b312-10f9c9e04f34"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 21:19:33.861911 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:33.861880 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-kube-api-access-gl5l6" (OuterVolumeSpecName: "kube-api-access-gl5l6") pod "a49114d7-546a-48fe-b312-10f9c9e04f34" (UID: "a49114d7-546a-48fe-b312-10f9c9e04f34"). InnerVolumeSpecName "kube-api-access-gl5l6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:19:33.862043 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:33.861985 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a49114d7-546a-48fe-b312-10f9c9e04f34" (UID: "a49114d7-546a-48fe-b312-10f9c9e04f34"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:19:33.862117 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:33.862017 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a49114d7-546a-48fe-b312-10f9c9e04f34" (UID: "a49114d7-546a-48fe-b312-10f9c9e04f34"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:19:33.862173 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:33.862123 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a49114d7-546a-48fe-b312-10f9c9e04f34-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a49114d7-546a-48fe-b312-10f9c9e04f34" (UID: "a49114d7-546a-48fe-b312-10f9c9e04f34"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 21:19:33.862264 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:33.862243 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a49114d7-546a-48fe-b312-10f9c9e04f34-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a49114d7-546a-48fe-b312-10f9c9e04f34" (UID: "a49114d7-546a-48fe-b312-10f9c9e04f34"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 21:19:33.867784 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:33.867758 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a49114d7-546a-48fe-b312-10f9c9e04f34-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a49114d7-546a-48fe-b312-10f9c9e04f34" (UID: "a49114d7-546a-48fe-b312-10f9c9e04f34"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:19:33.959764 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:33.959717 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-tls\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:19:33.959764 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:33.959757 2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a49114d7-546a-48fe-b312-10f9c9e04f34-image-registry-private-configuration\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:19:33.959764 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:33.959768 2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a49114d7-546a-48fe-b312-10f9c9e04f34-registry-certificates\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:19:33.960010 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:33.959778 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl5l6\" (UniqueName: \"kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-kube-api-access-gl5l6\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:19:33.960010 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:33.959786 2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a49114d7-546a-48fe-b312-10f9c9e04f34-bound-sa-token\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:19:33.960010 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:33.959794 2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a49114d7-546a-48fe-b312-10f9c9e04f34-installation-pull-secrets\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:19:33.960010 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:33.959802 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a49114d7-546a-48fe-b312-10f9c9e04f34-trusted-ca\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:19:33.960010 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:33.959810 2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a49114d7-546a-48fe-b312-10f9c9e04f34-ca-trust-extracted\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:19:34.527689 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:34.527654 2564 generic.go:356] "Generic (PLEG): container finished" podID="a49114d7-546a-48fe-b312-10f9c9e04f34" containerID="c318218914b6fd32538a5b6963fa3d82999c00b3bb3aa711030e4b8fcae4a21e" exitCode=0 Jun 08 21:19:34.527847 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:34.527697 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78b77f675-grvwb" Jun 08 21:19:34.527847 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:34.527742 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78b77f675-grvwb" event={"ID":"a49114d7-546a-48fe-b312-10f9c9e04f34","Type":"ContainerDied","Data":"c318218914b6fd32538a5b6963fa3d82999c00b3bb3aa711030e4b8fcae4a21e"} Jun 08 21:19:34.527847 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:34.527796 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78b77f675-grvwb" event={"ID":"a49114d7-546a-48fe-b312-10f9c9e04f34","Type":"ContainerDied","Data":"05b9ad9971e5127047d50a634d5fc5b2ccc28f987775d707c29cf0af05e0c9ed"} Jun 08 21:19:34.527847 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:34.527828 2564 scope.go:117] "RemoveContainer" containerID="c318218914b6fd32538a5b6963fa3d82999c00b3bb3aa711030e4b8fcae4a21e" Jun 08 21:19:34.537621 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:34.537601 2564 scope.go:117] "RemoveContainer" containerID="c318218914b6fd32538a5b6963fa3d82999c00b3bb3aa711030e4b8fcae4a21e" Jun 08 21:19:34.537909 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:19:34.537887 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c318218914b6fd32538a5b6963fa3d82999c00b3bb3aa711030e4b8fcae4a21e\": container with ID starting with c318218914b6fd32538a5b6963fa3d82999c00b3bb3aa711030e4b8fcae4a21e not found: ID does not exist" containerID="c318218914b6fd32538a5b6963fa3d82999c00b3bb3aa711030e4b8fcae4a21e" Jun 08 21:19:34.537980 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:34.537922 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c318218914b6fd32538a5b6963fa3d82999c00b3bb3aa711030e4b8fcae4a21e"} err="failed to get container status \"c318218914b6fd32538a5b6963fa3d82999c00b3bb3aa711030e4b8fcae4a21e\": rpc error: code = NotFound desc = could not find container \"c318218914b6fd32538a5b6963fa3d82999c00b3bb3aa711030e4b8fcae4a21e\": container with ID starting with c318218914b6fd32538a5b6963fa3d82999c00b3bb3aa711030e4b8fcae4a21e not found: ID does not exist" Jun 08 21:19:34.545446 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:34.545420 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78b77f675-grvwb"] Jun 08 21:19:34.549391 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:34.549363 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-78b77f675-grvwb"] Jun 08 21:19:36.346369 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:19:36.346339 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a49114d7-546a-48fe-b312-10f9c9e04f34" path="/var/lib/kubelet/pods/a49114d7-546a-48fe-b312-10f9c9e04f34/volumes" Jun 08 21:20:23.038202 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:23.038160 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgfcq"] Jun 08 21:20:23.038808 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:23.038632 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a49114d7-546a-48fe-b312-10f9c9e04f34" containerName="registry" Jun 08 21:20:23.038808 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:23.038655 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a49114d7-546a-48fe-b312-10f9c9e04f34" containerName="registry" Jun 08 21:20:23.038808 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:23.038727 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a49114d7-546a-48fe-b312-10f9c9e04f34" containerName="registry" Jun 08 21:20:23.041874 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:23.041851 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgfcq" Jun 08 21:20:23.044612 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:23.044587 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 21:20:23.044612 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:23.044590 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9466d\"" Jun 08 21:20:23.045816 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:23.045791 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 21:20:23.049517 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:23.049493 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgfcq"] Jun 08 21:20:23.131879 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:23.131837 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb29f6cc-9824-4fcb-88fe-d4742e7525e3-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgfcq\" (UID: \"fb29f6cc-9824-4fcb-88fe-d4742e7525e3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgfcq" Jun 08 21:20:23.132094 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:23.131896 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb29f6cc-9824-4fcb-88fe-d4742e7525e3-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgfcq\" (UID: \"fb29f6cc-9824-4fcb-88fe-d4742e7525e3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgfcq" Jun 08 21:20:23.132094 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:23.131914 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht7gb\" (UniqueName: \"kubernetes.io/projected/fb29f6cc-9824-4fcb-88fe-d4742e7525e3-kube-api-access-ht7gb\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgfcq\" (UID: \"fb29f6cc-9824-4fcb-88fe-d4742e7525e3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgfcq" Jun 08 21:20:23.233148 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:23.233115 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb29f6cc-9824-4fcb-88fe-d4742e7525e3-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgfcq\" (UID: \"fb29f6cc-9824-4fcb-88fe-d4742e7525e3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgfcq" Jun 08 21:20:23.233317 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:23.233176 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb29f6cc-9824-4fcb-88fe-d4742e7525e3-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgfcq\" (UID: \"fb29f6cc-9824-4fcb-88fe-d4742e7525e3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgfcq" Jun 08 21:20:23.233317 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:23.233205 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht7gb\" (UniqueName: \"kubernetes.io/projected/fb29f6cc-9824-4fcb-88fe-d4742e7525e3-kube-api-access-ht7gb\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgfcq\" (UID: \"fb29f6cc-9824-4fcb-88fe-d4742e7525e3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgfcq" Jun 08 21:20:23.233582 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:23.233561 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb29f6cc-9824-4fcb-88fe-d4742e7525e3-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgfcq\" (UID: \"fb29f6cc-9824-4fcb-88fe-d4742e7525e3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgfcq" Jun 08 21:20:23.233617 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:23.233580 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb29f6cc-9824-4fcb-88fe-d4742e7525e3-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgfcq\" (UID: \"fb29f6cc-9824-4fcb-88fe-d4742e7525e3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgfcq" Jun 08 21:20:23.241851 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:23.241811 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht7gb\" (UniqueName: \"kubernetes.io/projected/fb29f6cc-9824-4fcb-88fe-d4742e7525e3-kube-api-access-ht7gb\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgfcq\" (UID: \"fb29f6cc-9824-4fcb-88fe-d4742e7525e3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgfcq" Jun 08 21:20:23.351897 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:23.351801 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgfcq" Jun 08 21:20:23.487234 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:23.487206 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgfcq"] Jun 08 21:20:23.489444 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:20:23.489415 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb29f6cc_9824_4fcb_88fe_d4742e7525e3.slice/crio-f63a9dbe39ff3e2ac1ba559e8047cd985b1d1d63d47d7ba8af5a0cd5f1cc5223 WatchSource:0}: Error finding container f63a9dbe39ff3e2ac1ba559e8047cd985b1d1d63d47d7ba8af5a0cd5f1cc5223: Status 404 returned error can't find the container with id f63a9dbe39ff3e2ac1ba559e8047cd985b1d1d63d47d7ba8af5a0cd5f1cc5223 Jun 08 21:20:23.491297 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:23.491278 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 21:20:23.709111 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:23.708993 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgfcq" event={"ID":"fb29f6cc-9824-4fcb-88fe-d4742e7525e3","Type":"ContainerStarted","Data":"f63a9dbe39ff3e2ac1ba559e8047cd985b1d1d63d47d7ba8af5a0cd5f1cc5223"} Jun 08 21:20:31.739464 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:31.739424 2564 generic.go:356] "Generic (PLEG): container finished" podID="fb29f6cc-9824-4fcb-88fe-d4742e7525e3" containerID="831c1122bc061d972d140747111851056bdf315313ddbd73a2ef495877ad72dd" exitCode=0 Jun 08 21:20:31.739862 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:31.739478 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgfcq" event={"ID":"fb29f6cc-9824-4fcb-88fe-d4742e7525e3","Type":"ContainerDied","Data":"831c1122bc061d972d140747111851056bdf315313ddbd73a2ef495877ad72dd"} Jun 08 21:20:34.753045 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:34.753006 2564 generic.go:356] "Generic (PLEG): container finished" podID="fb29f6cc-9824-4fcb-88fe-d4742e7525e3" containerID="cec55e15c1ff7c77864f8abda396273cffeeb1dd516dde2ee7c451c76e348c76" exitCode=0 Jun 08 21:20:34.753045 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:34.753044 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgfcq" event={"ID":"fb29f6cc-9824-4fcb-88fe-d4742e7525e3","Type":"ContainerDied","Data":"cec55e15c1ff7c77864f8abda396273cffeeb1dd516dde2ee7c451c76e348c76"} Jun 08 21:20:43.793034 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:43.793000 2564 generic.go:356] "Generic (PLEG): container finished" podID="fb29f6cc-9824-4fcb-88fe-d4742e7525e3" containerID="515d43c8db49789d68ccea6f165d0e12ffb5e1c4292a1eceaa4b1e66d99d2161" exitCode=0 Jun 08 21:20:43.793442 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:43.793060 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgfcq" event={"ID":"fb29f6cc-9824-4fcb-88fe-d4742e7525e3","Type":"ContainerDied","Data":"515d43c8db49789d68ccea6f165d0e12ffb5e1c4292a1eceaa4b1e66d99d2161"} Jun 08 21:20:44.970358 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:44.970321 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgfcq" Jun 08 21:20:45.015087 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:45.015034 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb29f6cc-9824-4fcb-88fe-d4742e7525e3-util\") pod \"fb29f6cc-9824-4fcb-88fe-d4742e7525e3\" (UID: \"fb29f6cc-9824-4fcb-88fe-d4742e7525e3\") " Jun 08 21:20:45.015229 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:45.015113 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ht7gb\" (UniqueName: \"kubernetes.io/projected/fb29f6cc-9824-4fcb-88fe-d4742e7525e3-kube-api-access-ht7gb\") pod \"fb29f6cc-9824-4fcb-88fe-d4742e7525e3\" (UID: \"fb29f6cc-9824-4fcb-88fe-d4742e7525e3\") " Jun 08 21:20:45.015229 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:45.015151 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb29f6cc-9824-4fcb-88fe-d4742e7525e3-bundle\") pod \"fb29f6cc-9824-4fcb-88fe-d4742e7525e3\" (UID: \"fb29f6cc-9824-4fcb-88fe-d4742e7525e3\") " Jun 08 21:20:45.015851 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:45.015772 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb29f6cc-9824-4fcb-88fe-d4742e7525e3-bundle" (OuterVolumeSpecName: "bundle") pod "fb29f6cc-9824-4fcb-88fe-d4742e7525e3" (UID: "fb29f6cc-9824-4fcb-88fe-d4742e7525e3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:20:45.017436 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:45.017413 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb29f6cc-9824-4fcb-88fe-d4742e7525e3-kube-api-access-ht7gb" (OuterVolumeSpecName: "kube-api-access-ht7gb") pod "fb29f6cc-9824-4fcb-88fe-d4742e7525e3" (UID: "fb29f6cc-9824-4fcb-88fe-d4742e7525e3"). InnerVolumeSpecName "kube-api-access-ht7gb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:20:45.019942 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:45.019915 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb29f6cc-9824-4fcb-88fe-d4742e7525e3-util" (OuterVolumeSpecName: "util") pod "fb29f6cc-9824-4fcb-88fe-d4742e7525e3" (UID: "fb29f6cc-9824-4fcb-88fe-d4742e7525e3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:20:45.115985 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:45.115905 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb29f6cc-9824-4fcb-88fe-d4742e7525e3-bundle\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:20:45.115985 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:45.115937 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb29f6cc-9824-4fcb-88fe-d4742e7525e3-util\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:20:45.115985 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:45.115949 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ht7gb\" (UniqueName: \"kubernetes.io/projected/fb29f6cc-9824-4fcb-88fe-d4742e7525e3-kube-api-access-ht7gb\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:20:45.803233 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:45.803198 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgfcq" event={"ID":"fb29f6cc-9824-4fcb-88fe-d4742e7525e3","Type":"ContainerDied","Data":"f63a9dbe39ff3e2ac1ba559e8047cd985b1d1d63d47d7ba8af5a0cd5f1cc5223"} Jun 08 21:20:45.803233 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:45.803228 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgfcq" Jun 08 21:20:45.803461 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:45.803246 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f63a9dbe39ff3e2ac1ba559e8047cd985b1d1d63d47d7ba8af5a0cd5f1cc5223" Jun 08 21:20:50.765317 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:50.765278 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-f2ggr"] Jun 08 21:20:50.765861 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:50.765555 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb29f6cc-9824-4fcb-88fe-d4742e7525e3" containerName="extract" Jun 08 21:20:50.765861 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:50.765566 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb29f6cc-9824-4fcb-88fe-d4742e7525e3" containerName="extract" Jun 08 21:20:50.765861 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:50.765577 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb29f6cc-9824-4fcb-88fe-d4742e7525e3" containerName="pull" Jun 08 21:20:50.765861 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:50.765582 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb29f6cc-9824-4fcb-88fe-d4742e7525e3" containerName="pull" Jun 08 21:20:50.765861 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:50.765589 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb29f6cc-9824-4fcb-88fe-d4742e7525e3" containerName="util" Jun 08 21:20:50.765861 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:50.765595 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb29f6cc-9824-4fcb-88fe-d4742e7525e3" containerName="util" Jun 08 21:20:50.765861 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:50.765646 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb29f6cc-9824-4fcb-88fe-d4742e7525e3" containerName="extract" Jun 08 21:20:50.770016 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:50.769996 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-f2ggr" Jun 08 21:20:50.773005 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:50.772972 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-q8x4q\"" Jun 08 21:20:50.773144 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:50.773014 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 08 21:20:50.773144 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:50.773108 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 08 21:20:50.782170 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:50.782139 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-f2ggr"] Jun 08 21:20:50.863432 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:50.863377 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c357cde-1593-4bdc-8930-4b4dece53a69-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-f2ggr\" (UID: \"8c357cde-1593-4bdc-8930-4b4dece53a69\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-f2ggr" Jun 08 21:20:50.863628 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:50.863504 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h67lx\" (UniqueName: \"kubernetes.io/projected/8c357cde-1593-4bdc-8930-4b4dece53a69-kube-api-access-h67lx\") pod \"cert-manager-operator-controller-manager-57757f7cfc-f2ggr\" (UID: \"8c357cde-1593-4bdc-8930-4b4dece53a69\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-f2ggr" Jun 08 21:20:50.964425 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:50.964381 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h67lx\" (UniqueName: \"kubernetes.io/projected/8c357cde-1593-4bdc-8930-4b4dece53a69-kube-api-access-h67lx\") pod \"cert-manager-operator-controller-manager-57757f7cfc-f2ggr\" (UID: \"8c357cde-1593-4bdc-8930-4b4dece53a69\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-f2ggr" Jun 08 21:20:50.964626 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:50.964448 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c357cde-1593-4bdc-8930-4b4dece53a69-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-f2ggr\" (UID: \"8c357cde-1593-4bdc-8930-4b4dece53a69\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-f2ggr" Jun 08 21:20:50.964861 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:50.964837 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c357cde-1593-4bdc-8930-4b4dece53a69-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-f2ggr\" (UID: \"8c357cde-1593-4bdc-8930-4b4dece53a69\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-f2ggr" Jun 08 21:20:50.977605 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:50.977567 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h67lx\" (UniqueName: \"kubernetes.io/projected/8c357cde-1593-4bdc-8930-4b4dece53a69-kube-api-access-h67lx\") pod \"cert-manager-operator-controller-manager-57757f7cfc-f2ggr\" (UID: \"8c357cde-1593-4bdc-8930-4b4dece53a69\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-f2ggr" Jun 08 21:20:51.079119 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:51.079052 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-f2ggr" Jun 08 21:20:51.216461 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:51.216432 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-f2ggr"] Jun 08 21:20:51.219261 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:20:51.219228 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c357cde_1593_4bdc_8930_4b4dece53a69.slice/crio-c6f35737ce6bc63366b4a8f5210e9001bde19f14b9ed559c4b401d517efa0e75 WatchSource:0}: Error finding container c6f35737ce6bc63366b4a8f5210e9001bde19f14b9ed559c4b401d517efa0e75: Status 404 returned error can't find the container with id c6f35737ce6bc63366b4a8f5210e9001bde19f14b9ed559c4b401d517efa0e75 Jun 08 21:20:51.828542 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:51.828507 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-f2ggr" event={"ID":"8c357cde-1593-4bdc-8930-4b4dece53a69","Type":"ContainerStarted","Data":"c6f35737ce6bc63366b4a8f5210e9001bde19f14b9ed559c4b401d517efa0e75"} Jun 08 21:20:53.838311 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:53.838268 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-f2ggr" event={"ID":"8c357cde-1593-4bdc-8930-4b4dece53a69","Type":"ContainerStarted","Data":"dd4a400935c7052f01d1001349a6e9943cc9d4f33429cf43cfcf9aa7922a82cb"} Jun 08 21:20:53.910982 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:53.910924 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-f2ggr" podStartSLOduration=2.190624779 podStartE2EDuration="3.910907747s" totalImagesPullingTime="1.720282968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:20:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:20:53.909998866 +0000 UTC m=+426.050041748" watchObservedRunningTime="2026-06-08 21:20:53.910907747 +0000 UTC m=+426.050950628" Jun 08 21:20:55.429922 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:55.429886 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn62bj"] Jun 08 21:20:55.433411 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:55.433393 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn62bj" Jun 08 21:20:55.436468 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:55.436442 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9466d\"" Jun 08 21:20:55.436607 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:55.436482 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 21:20:55.441099 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:55.441046 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 21:20:55.442909 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:55.442886 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn62bj"] Jun 08 21:20:55.504917 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:55.504877 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/349dedf1-575b-46f2-9d1f-f8d2473552ae-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn62bj\" (UID: \"349dedf1-575b-46f2-9d1f-f8d2473552ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn62bj" Jun 08 21:20:55.504917 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:55.504919 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/349dedf1-575b-46f2-9d1f-f8d2473552ae-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn62bj\" (UID: \"349dedf1-575b-46f2-9d1f-f8d2473552ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn62bj" Jun 08 21:20:55.505175 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:55.504944 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcmtc\" (UniqueName: \"kubernetes.io/projected/349dedf1-575b-46f2-9d1f-f8d2473552ae-kube-api-access-wcmtc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn62bj\" (UID: \"349dedf1-575b-46f2-9d1f-f8d2473552ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn62bj" Jun 08 21:20:55.605545 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:55.605460 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/349dedf1-575b-46f2-9d1f-f8d2473552ae-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn62bj\" (UID: \"349dedf1-575b-46f2-9d1f-f8d2473552ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn62bj" Jun 08 21:20:55.605545 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:55.605500 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/349dedf1-575b-46f2-9d1f-f8d2473552ae-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn62bj\" (UID: \"349dedf1-575b-46f2-9d1f-f8d2473552ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn62bj" Jun 08 21:20:55.605545 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:55.605528 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcmtc\" (UniqueName: \"kubernetes.io/projected/349dedf1-575b-46f2-9d1f-f8d2473552ae-kube-api-access-wcmtc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn62bj\" (UID: \"349dedf1-575b-46f2-9d1f-f8d2473552ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn62bj" Jun 08 21:20:55.605991 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:55.605964 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/349dedf1-575b-46f2-9d1f-f8d2473552ae-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn62bj\" (UID: \"349dedf1-575b-46f2-9d1f-f8d2473552ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn62bj" Jun 08 21:20:55.605991 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:55.605983 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/349dedf1-575b-46f2-9d1f-f8d2473552ae-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn62bj\" (UID: \"349dedf1-575b-46f2-9d1f-f8d2473552ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn62bj" Jun 08 21:20:55.614106 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:55.614054 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcmtc\" (UniqueName: \"kubernetes.io/projected/349dedf1-575b-46f2-9d1f-f8d2473552ae-kube-api-access-wcmtc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn62bj\" (UID: \"349dedf1-575b-46f2-9d1f-f8d2473552ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn62bj" Jun 08 21:20:55.743423 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:55.743319 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn62bj" Jun 08 21:20:55.885243 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:55.885215 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn62bj"] Jun 08 21:20:55.887294 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:20:55.887265 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod349dedf1_575b_46f2_9d1f_f8d2473552ae.slice/crio-dd77b81137970fada1affea1a54061e2a13451b37727a454eae787e98b5e4098 WatchSource:0}: Error finding container dd77b81137970fada1affea1a54061e2a13451b37727a454eae787e98b5e4098: Status 404 returned error can't find the container with id dd77b81137970fada1affea1a54061e2a13451b37727a454eae787e98b5e4098 Jun 08 21:20:56.295770 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:56.295734 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-p5cpg"] Jun 08 21:20:56.298870 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:56.298851 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-p5cpg" Jun 08 21:20:56.301609 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:56.301586 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 08 21:20:56.302714 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:56.302691 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 08 21:20:56.302822 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:56.302692 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-vqds8\"" Jun 08 21:20:56.306601 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:56.306574 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-p5cpg"] Jun 08 21:20:56.410859 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:56.410817 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c04391e-3d46-4f77-82ba-10c63ca114b1-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-p5cpg\" (UID: \"3c04391e-3d46-4f77-82ba-10c63ca114b1\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-p5cpg" Jun 08 21:20:56.411056 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:56.410870 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wm5q\" (UniqueName: \"kubernetes.io/projected/3c04391e-3d46-4f77-82ba-10c63ca114b1-kube-api-access-5wm5q\") pod \"cert-manager-webhook-7dc76cbb94-p5cpg\" (UID: \"3c04391e-3d46-4f77-82ba-10c63ca114b1\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-p5cpg" Jun 08 21:20:56.511312 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:56.511264 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c04391e-3d46-4f77-82ba-10c63ca114b1-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-p5cpg\" (UID: \"3c04391e-3d46-4f77-82ba-10c63ca114b1\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-p5cpg" Jun 08 21:20:56.511312 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:56.511319 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wm5q\" (UniqueName: \"kubernetes.io/projected/3c04391e-3d46-4f77-82ba-10c63ca114b1-kube-api-access-5wm5q\") pod \"cert-manager-webhook-7dc76cbb94-p5cpg\" (UID: \"3c04391e-3d46-4f77-82ba-10c63ca114b1\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-p5cpg" Jun 08 21:20:56.519834 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:56.519804 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c04391e-3d46-4f77-82ba-10c63ca114b1-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-p5cpg\" (UID: \"3c04391e-3d46-4f77-82ba-10c63ca114b1\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-p5cpg" Jun 08 21:20:56.519983 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:56.519868 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wm5q\" (UniqueName: \"kubernetes.io/projected/3c04391e-3d46-4f77-82ba-10c63ca114b1-kube-api-access-5wm5q\") pod \"cert-manager-webhook-7dc76cbb94-p5cpg\" (UID: \"3c04391e-3d46-4f77-82ba-10c63ca114b1\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-p5cpg" Jun 08 21:20:56.618711 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:56.618624 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-p5cpg" Jun 08 21:20:56.748027 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:56.747996 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-p5cpg"] Jun 08 21:20:56.750997 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:20:56.750968 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c04391e_3d46_4f77_82ba_10c63ca114b1.slice/crio-fce9b59e1024dcd2e4c96f82bc3c12b6443d4d1291e1a1174ea78a05e17a5e6e WatchSource:0}: Error finding container fce9b59e1024dcd2e4c96f82bc3c12b6443d4d1291e1a1174ea78a05e17a5e6e: Status 404 returned error can't find the container with id fce9b59e1024dcd2e4c96f82bc3c12b6443d4d1291e1a1174ea78a05e17a5e6e Jun 08 21:20:56.854397 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:56.854362 2564 generic.go:356] "Generic (PLEG): container finished" podID="349dedf1-575b-46f2-9d1f-f8d2473552ae" containerID="705e67b9651db6609659364f4a7785d0a9bee5cfd18fd2caaeaff7127e53a0dc" exitCode=0 Jun 08 21:20:56.854586 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:56.854448 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn62bj" event={"ID":"349dedf1-575b-46f2-9d1f-f8d2473552ae","Type":"ContainerDied","Data":"705e67b9651db6609659364f4a7785d0a9bee5cfd18fd2caaeaff7127e53a0dc"} Jun 08 21:20:56.854586 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:56.854497 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn62bj" event={"ID":"349dedf1-575b-46f2-9d1f-f8d2473552ae","Type":"ContainerStarted","Data":"dd77b81137970fada1affea1a54061e2a13451b37727a454eae787e98b5e4098"} Jun 08 21:20:56.855671 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:56.855648 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-p5cpg" event={"ID":"3c04391e-3d46-4f77-82ba-10c63ca114b1","Type":"ContainerStarted","Data":"fce9b59e1024dcd2e4c96f82bc3c12b6443d4d1291e1a1174ea78a05e17a5e6e"} Jun 08 21:20:59.114504 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:59.114464 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-jx55z"] Jun 08 21:20:59.124903 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:59.124785 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-jx55z" Jun 08 21:20:59.126617 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:59.126566 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-jx55z"] Jun 08 21:20:59.127425 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:59.127398 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-4gmb5\"" Jun 08 21:20:59.233889 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:59.233850 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f18602c9-9a7a-4b7d-a2c7-e63e49627574-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-jx55z\" (UID: \"f18602c9-9a7a-4b7d-a2c7-e63e49627574\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-jx55z" Jun 08 21:20:59.234102 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:59.233947 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xttwb\" (UniqueName: \"kubernetes.io/projected/f18602c9-9a7a-4b7d-a2c7-e63e49627574-kube-api-access-xttwb\") pod \"cert-manager-cainjector-5d99449ffd-jx55z\" (UID: \"f18602c9-9a7a-4b7d-a2c7-e63e49627574\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-jx55z" Jun 08 21:20:59.335242 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:59.335207 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f18602c9-9a7a-4b7d-a2c7-e63e49627574-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-jx55z\" (UID: \"f18602c9-9a7a-4b7d-a2c7-e63e49627574\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-jx55z" Jun 08 21:20:59.335453 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:59.335259 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xttwb\" (UniqueName: \"kubernetes.io/projected/f18602c9-9a7a-4b7d-a2c7-e63e49627574-kube-api-access-xttwb\") pod \"cert-manager-cainjector-5d99449ffd-jx55z\" (UID: \"f18602c9-9a7a-4b7d-a2c7-e63e49627574\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-jx55z" Jun 08 21:20:59.350543 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:59.350511 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f18602c9-9a7a-4b7d-a2c7-e63e49627574-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-jx55z\" (UID: \"f18602c9-9a7a-4b7d-a2c7-e63e49627574\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-jx55z" Jun 08 21:20:59.351084 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:59.351042 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xttwb\" (UniqueName: \"kubernetes.io/projected/f18602c9-9a7a-4b7d-a2c7-e63e49627574-kube-api-access-xttwb\") pod \"cert-manager-cainjector-5d99449ffd-jx55z\" (UID: \"f18602c9-9a7a-4b7d-a2c7-e63e49627574\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-jx55z" Jun 08 21:20:59.437212 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:20:59.437116 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-jx55z" Jun 08 21:21:00.395914 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:00.395883 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-jx55z"] Jun 08 21:21:00.397642 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:21:00.397610 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf18602c9_9a7a_4b7d_a2c7_e63e49627574.slice/crio-1d8331a897a9565b8d2baefcfab57193e3ee2b2ae8e4112138c15b8a5776ab05 WatchSource:0}: Error finding container 1d8331a897a9565b8d2baefcfab57193e3ee2b2ae8e4112138c15b8a5776ab05: Status 404 returned error can't find the container with id 1d8331a897a9565b8d2baefcfab57193e3ee2b2ae8e4112138c15b8a5776ab05 Jun 08 21:21:00.878288 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:00.878255 2564 generic.go:356] "Generic (PLEG): container finished" podID="349dedf1-575b-46f2-9d1f-f8d2473552ae" containerID="e56bea20e235cabc664ac1b4a9620bda3ccfc318e8a20174e2dba10d6377583c" exitCode=0 Jun 08 21:21:00.878481 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:00.878333 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn62bj" event={"ID":"349dedf1-575b-46f2-9d1f-f8d2473552ae","Type":"ContainerDied","Data":"e56bea20e235cabc664ac1b4a9620bda3ccfc318e8a20174e2dba10d6377583c"} Jun 08 21:21:00.880223 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:00.880190 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-jx55z" event={"ID":"f18602c9-9a7a-4b7d-a2c7-e63e49627574","Type":"ContainerStarted","Data":"6e223b4a97ed852ee7af3eed17cffecb430bafa32b71ef4e5fae88d60ae149cb"} Jun 08 21:21:00.880329 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:00.880235 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-jx55z" event={"ID":"f18602c9-9a7a-4b7d-a2c7-e63e49627574","Type":"ContainerStarted","Data":"1d8331a897a9565b8d2baefcfab57193e3ee2b2ae8e4112138c15b8a5776ab05"} Jun 08 21:21:00.881799 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:00.881777 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-p5cpg" event={"ID":"3c04391e-3d46-4f77-82ba-10c63ca114b1","Type":"ContainerStarted","Data":"ea1010f68d3dde634f94580693a9852725de86197137ebafcefc87424faeaefc"} Jun 08 21:21:00.883344 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:00.883246 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-p5cpg" Jun 08 21:21:00.914135 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:00.914030 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-jx55z" podStartSLOduration=1.914012799 podStartE2EDuration="1.914012799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:20:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:21:00.913172813 +0000 UTC m=+433.053215695" watchObservedRunningTime="2026-06-08 21:21:00.914012799 +0000 UTC m=+433.054055680" Jun 08 21:21:00.933007 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:00.932955 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-p5cpg" podStartSLOduration=1.457469914 podStartE2EDuration="4.932940506s" totalImagesPullingTime="3.475470592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:20:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:21:00.93161417 +0000 UTC m=+433.071657044" watchObservedRunningTime="2026-06-08 21:21:00.932940506 +0000 UTC m=+433.072983386" Jun 08 21:21:01.887989 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:01.887950 2564 generic.go:356] "Generic (PLEG): container finished" podID="349dedf1-575b-46f2-9d1f-f8d2473552ae" containerID="5b6f7f13bca10799d3d0c5ea37cf201b2fdd58dfcf2e1bfe2524be45035d44dc" exitCode=0 Jun 08 21:21:01.888405 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:01.887990 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn62bj" event={"ID":"349dedf1-575b-46f2-9d1f-f8d2473552ae","Type":"ContainerDied","Data":"5b6f7f13bca10799d3d0c5ea37cf201b2fdd58dfcf2e1bfe2524be45035d44dc"} Jun 08 21:21:03.017126 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:03.017099 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn62bj" Jun 08 21:21:03.169309 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:03.169223 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/349dedf1-575b-46f2-9d1f-f8d2473552ae-util\") pod \"349dedf1-575b-46f2-9d1f-f8d2473552ae\" (UID: \"349dedf1-575b-46f2-9d1f-f8d2473552ae\") " Jun 08 21:21:03.169309 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:03.169288 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/349dedf1-575b-46f2-9d1f-f8d2473552ae-bundle\") pod \"349dedf1-575b-46f2-9d1f-f8d2473552ae\" (UID: \"349dedf1-575b-46f2-9d1f-f8d2473552ae\") " Jun 08 21:21:03.169503 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:03.169317 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcmtc\" (UniqueName: \"kubernetes.io/projected/349dedf1-575b-46f2-9d1f-f8d2473552ae-kube-api-access-wcmtc\") pod \"349dedf1-575b-46f2-9d1f-f8d2473552ae\" (UID: \"349dedf1-575b-46f2-9d1f-f8d2473552ae\") " Jun 08 21:21:03.169666 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:03.169641 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/349dedf1-575b-46f2-9d1f-f8d2473552ae-bundle" (OuterVolumeSpecName: "bundle") pod "349dedf1-575b-46f2-9d1f-f8d2473552ae" (UID: "349dedf1-575b-46f2-9d1f-f8d2473552ae"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:21:03.171614 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:03.171589 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/349dedf1-575b-46f2-9d1f-f8d2473552ae-kube-api-access-wcmtc" (OuterVolumeSpecName: "kube-api-access-wcmtc") pod "349dedf1-575b-46f2-9d1f-f8d2473552ae" (UID: "349dedf1-575b-46f2-9d1f-f8d2473552ae"). InnerVolumeSpecName "kube-api-access-wcmtc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:21:03.173989 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:03.173960 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/349dedf1-575b-46f2-9d1f-f8d2473552ae-util" (OuterVolumeSpecName: "util") pod "349dedf1-575b-46f2-9d1f-f8d2473552ae" (UID: "349dedf1-575b-46f2-9d1f-f8d2473552ae"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:21:03.270149 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:03.270114 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/349dedf1-575b-46f2-9d1f-f8d2473552ae-bundle\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:21:03.270149 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:03.270144 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcmtc\" (UniqueName: \"kubernetes.io/projected/349dedf1-575b-46f2-9d1f-f8d2473552ae-kube-api-access-wcmtc\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:21:03.270149 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:03.270155 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/349dedf1-575b-46f2-9d1f-f8d2473552ae-util\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:21:03.898082 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:03.898048 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn62bj" Jun 08 21:21:03.898273 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:03.898048 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn62bj" event={"ID":"349dedf1-575b-46f2-9d1f-f8d2473552ae","Type":"ContainerDied","Data":"dd77b81137970fada1affea1a54061e2a13451b37727a454eae787e98b5e4098"} Jun 08 21:21:03.898273 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:03.898189 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd77b81137970fada1affea1a54061e2a13451b37727a454eae787e98b5e4098" Jun 08 21:21:06.890961 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:06.890926 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-p5cpg" Jun 08 21:21:07.764273 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:07.764235 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-cbh9r"] Jun 08 21:21:07.764574 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:07.764560 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="349dedf1-575b-46f2-9d1f-f8d2473552ae" containerName="extract" Jun 08 21:21:07.764574 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:07.764575 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="349dedf1-575b-46f2-9d1f-f8d2473552ae" containerName="extract" Jun 08 21:21:07.764666 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:07.764585 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="349dedf1-575b-46f2-9d1f-f8d2473552ae" containerName="pull" Jun 08 21:21:07.764666 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:07.764591 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="349dedf1-575b-46f2-9d1f-f8d2473552ae" containerName="pull" Jun 08 21:21:07.764666 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:07.764599 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="349dedf1-575b-46f2-9d1f-f8d2473552ae" containerName="util" Jun 08 21:21:07.764666 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:07.764604 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="349dedf1-575b-46f2-9d1f-f8d2473552ae" containerName="util" Jun 08 21:21:07.764666 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:07.764652 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="349dedf1-575b-46f2-9d1f-f8d2473552ae" containerName="extract" Jun 08 21:21:07.768633 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:07.768617 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-cbh9r" Jun 08 21:21:07.771096 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:07.771053 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-nz4wl\"" Jun 08 21:21:07.777855 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:07.777828 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-cbh9r"] Jun 08 21:21:07.906269 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:07.906237 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr59w\" (UniqueName: \"kubernetes.io/projected/3ee39cc6-b4f9-4c75-bc72-75def55a8608-kube-api-access-fr59w\") pod \"cert-manager-59c77684cc-cbh9r\" (UID: \"3ee39cc6-b4f9-4c75-bc72-75def55a8608\") " pod="cert-manager/cert-manager-59c77684cc-cbh9r" Jun 08 21:21:07.906660 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:07.906295 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ee39cc6-b4f9-4c75-bc72-75def55a8608-bound-sa-token\") pod \"cert-manager-59c77684cc-cbh9r\" (UID: \"3ee39cc6-b4f9-4c75-bc72-75def55a8608\") " pod="cert-manager/cert-manager-59c77684cc-cbh9r" Jun 08 21:21:08.007477 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:08.007424 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr59w\" (UniqueName: \"kubernetes.io/projected/3ee39cc6-b4f9-4c75-bc72-75def55a8608-kube-api-access-fr59w\") pod \"cert-manager-59c77684cc-cbh9r\" (UID: \"3ee39cc6-b4f9-4c75-bc72-75def55a8608\") " pod="cert-manager/cert-manager-59c77684cc-cbh9r" Jun 08 21:21:08.007625 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:08.007516 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ee39cc6-b4f9-4c75-bc72-75def55a8608-bound-sa-token\") pod \"cert-manager-59c77684cc-cbh9r\" (UID: \"3ee39cc6-b4f9-4c75-bc72-75def55a8608\") " pod="cert-manager/cert-manager-59c77684cc-cbh9r" Jun 08 21:21:08.016115 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:08.016016 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ee39cc6-b4f9-4c75-bc72-75def55a8608-bound-sa-token\") pod \"cert-manager-59c77684cc-cbh9r\" (UID: \"3ee39cc6-b4f9-4c75-bc72-75def55a8608\") " pod="cert-manager/cert-manager-59c77684cc-cbh9r" Jun 08 21:21:08.016238 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:08.016143 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr59w\" (UniqueName: \"kubernetes.io/projected/3ee39cc6-b4f9-4c75-bc72-75def55a8608-kube-api-access-fr59w\") pod \"cert-manager-59c77684cc-cbh9r\" (UID: \"3ee39cc6-b4f9-4c75-bc72-75def55a8608\") " pod="cert-manager/cert-manager-59c77684cc-cbh9r" Jun 08 21:21:08.079103 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:08.079054 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-cbh9r" Jun 08 21:21:08.211380 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:08.211356 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-cbh9r"] Jun 08 21:21:08.213934 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:21:08.213905 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ee39cc6_b4f9_4c75_bc72_75def55a8608.slice/crio-5a78a7bc483a42699a43684427afb862da578aece3d9ef7e0653305511fb388f WatchSource:0}: Error finding container 5a78a7bc483a42699a43684427afb862da578aece3d9ef7e0653305511fb388f: Status 404 returned error can't find the container with id 5a78a7bc483a42699a43684427afb862da578aece3d9ef7e0653305511fb388f Jun 08 21:21:08.922654 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:08.922616 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-cbh9r" event={"ID":"3ee39cc6-b4f9-4c75-bc72-75def55a8608","Type":"ContainerStarted","Data":"a636b3515a46ad08467ce84fa6bb8b710e95bc8d7b0cb076a6fbb342a98b48f3"} Jun 08 21:21:08.922654 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:08.922655 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-cbh9r" event={"ID":"3ee39cc6-b4f9-4c75-bc72-75def55a8608","Type":"ContainerStarted","Data":"5a78a7bc483a42699a43684427afb862da578aece3d9ef7e0653305511fb388f"} Jun 08 21:21:08.938482 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:08.938433 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-cbh9r" podStartSLOduration=1.9384177980000001 podStartE2EDuration="1.938417798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:21:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:21:08.937633028 +0000 UTC m=+441.077675909" watchObservedRunningTime="2026-06-08 21:21:08.938417798 +0000 UTC m=+441.078460678" Jun 08 21:21:16.279549 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:16.279511 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdv4m6w"] Jun 08 21:21:16.285617 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:16.285597 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdv4m6w" Jun 08 21:21:16.288496 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:16.288461 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 21:21:16.289752 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:16.289682 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 21:21:16.289991 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:16.289975 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9466d\"" Jun 08 21:21:16.290527 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:16.290491 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdv4m6w"] Jun 08 21:21:16.376847 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:16.376813 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhv5v\" (UniqueName: \"kubernetes.io/projected/702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9-kube-api-access-vhv5v\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdv4m6w\" (UID: \"702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdv4m6w" Jun 08 21:21:16.376999 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:16.376863 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdv4m6w\" (UID: \"702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdv4m6w" Jun 08 21:21:16.376999 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:16.376966 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdv4m6w\" (UID: \"702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdv4m6w" Jun 08 21:21:16.477929 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:16.477894 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhv5v\" (UniqueName: \"kubernetes.io/projected/702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9-kube-api-access-vhv5v\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdv4m6w\" (UID: \"702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdv4m6w" Jun 08 21:21:16.478134 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:16.477942 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdv4m6w\" (UID: \"702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdv4m6w" Jun 08 21:21:16.478134 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:16.477981 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdv4m6w\" (UID: \"702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdv4m6w" Jun 08 21:21:16.478351 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:16.478328 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdv4m6w\" (UID: \"702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdv4m6w" Jun 08 21:21:16.478408 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:16.478358 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdv4m6w\" (UID: \"702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdv4m6w" Jun 08 21:21:16.489454 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:16.489433 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhv5v\" (UniqueName: \"kubernetes.io/projected/702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9-kube-api-access-vhv5v\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdv4m6w\" (UID: \"702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdv4m6w" Jun 08 21:21:16.596748 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:16.596716 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdv4m6w" Jun 08 21:21:16.731920 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:16.731884 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdv4m6w"] Jun 08 21:21:16.736403 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:21:16.736376 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod702b2bc5_f9cb_484f_9df7_bd6eb8b2e1b9.slice/crio-cc6d0f33daa8e2362dab3444c28e878817f1d5bcddef419d4a8d46ee4841eb7c WatchSource:0}: Error finding container cc6d0f33daa8e2362dab3444c28e878817f1d5bcddef419d4a8d46ee4841eb7c: Status 404 returned error can't find the container with id cc6d0f33daa8e2362dab3444c28e878817f1d5bcddef419d4a8d46ee4841eb7c Jun 08 21:21:16.960776 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:16.960683 2564 generic.go:356] "Generic (PLEG): container finished" podID="702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9" containerID="dddfcefd1fc67eb3e28ec33a6b243382b4b7e6ba247ab09a33eb7fbe16889f6c" exitCode=0 Jun 08 21:21:16.960934 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:16.960775 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdv4m6w" event={"ID":"702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9","Type":"ContainerDied","Data":"dddfcefd1fc67eb3e28ec33a6b243382b4b7e6ba247ab09a33eb7fbe16889f6c"} Jun 08 21:21:16.960934 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:16.960836 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdv4m6w" event={"ID":"702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9","Type":"ContainerStarted","Data":"cc6d0f33daa8e2362dab3444c28e878817f1d5bcddef419d4a8d46ee4841eb7c"} Jun 08 21:21:17.966782 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:17.966750 2564 generic.go:356] "Generic (PLEG): container finished" podID="702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9" containerID="3e3ce5c6b5e0dde2d28382a6af7f39e471fb40261e8ce8e7b612ad5e95dcf0c6" exitCode=0 Jun 08 21:21:17.967283 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:17.966826 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdv4m6w" event={"ID":"702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9","Type":"ContainerDied","Data":"3e3ce5c6b5e0dde2d28382a6af7f39e471fb40261e8ce8e7b612ad5e95dcf0c6"} Jun 08 21:21:18.973488 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:18.973447 2564 generic.go:356] "Generic (PLEG): container finished" podID="702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9" containerID="bec03fda21e3ba41d1da9002af9d82419f0819c6bae4a9e697856138acd6656c" exitCode=0 Jun 08 21:21:18.973884 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:18.973540 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdv4m6w" event={"ID":"702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9","Type":"ContainerDied","Data":"bec03fda21e3ba41d1da9002af9d82419f0819c6bae4a9e697856138acd6656c"} Jun 08 21:21:20.110885 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:20.110861 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdv4m6w" Jun 08 21:21:20.208443 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:20.208404 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9-util\") pod \"702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9\" (UID: \"702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9\") " Jun 08 21:21:20.208606 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:20.208484 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9-bundle\") pod \"702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9\" (UID: \"702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9\") " Jun 08 21:21:20.208606 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:20.208548 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhv5v\" (UniqueName: \"kubernetes.io/projected/702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9-kube-api-access-vhv5v\") pod \"702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9\" (UID: \"702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9\") " Jun 08 21:21:20.209187 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:20.209152 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9-bundle" (OuterVolumeSpecName: "bundle") pod "702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9" (UID: "702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:21:20.210744 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:20.210716 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9-kube-api-access-vhv5v" (OuterVolumeSpecName: "kube-api-access-vhv5v") pod "702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9" (UID: "702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9"). InnerVolumeSpecName "kube-api-access-vhv5v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:21:20.214161 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:20.214142 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9-util" (OuterVolumeSpecName: "util") pod "702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9" (UID: "702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:21:20.309248 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:20.309218 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9-bundle\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:21:20.309248 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:20.309243 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhv5v\" (UniqueName: \"kubernetes.io/projected/702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9-kube-api-access-vhv5v\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:21:20.309248 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:20.309253 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9-util\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:21:20.983551 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:20.983510 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdv4m6w" event={"ID":"702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9","Type":"ContainerDied","Data":"cc6d0f33daa8e2362dab3444c28e878817f1d5bcddef419d4a8d46ee4841eb7c"} Jun 08 21:21:20.983551 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:20.983543 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdv4m6w" Jun 08 21:21:20.983790 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:20.983564 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc6d0f33daa8e2362dab3444c28e878817f1d5bcddef419d4a8d46ee4841eb7c" Jun 08 21:21:30.971114 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:30.971079 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-697d6d88bf-s8qrd"] Jun 08 21:21:30.971492 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:30.971379 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9" containerName="extract" Jun 08 21:21:30.971492 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:30.971390 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9" containerName="extract" Jun 08 21:21:30.971492 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:30.971401 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9" containerName="util" Jun 08 21:21:30.971492 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:30.971407 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9" containerName="util" Jun 08 21:21:30.971492 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:30.971418 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9" containerName="pull" Jun 08 21:21:30.971492 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:30.971423 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9" containerName="pull" Jun 08 21:21:30.971492 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:30.971470 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="702b2bc5-f9cb-484f-9df7-bd6eb8b2e1b9" containerName="extract" Jun 08 21:21:30.974551 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:30.974529 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-697d6d88bf-s8qrd" Jun 08 21:21:30.978144 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:30.978122 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 08 21:21:30.978471 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:30.978444 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 08 21:21:30.978557 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:30.978468 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 08 21:21:30.978618 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:30.978570 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 08 21:21:30.980129 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:30.980109 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-z49jz\"" Jun 08 21:21:30.991021 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:30.990998 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-697d6d88bf-s8qrd"] Jun 08 21:21:30.992373 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:30.992346 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/afe84586-1752-4bad-9c69-bb0ef9c403cb-tmp\") pod \"opendatahub-operator-controller-manager-697d6d88bf-s8qrd\" (UID: \"afe84586-1752-4bad-9c69-bb0ef9c403cb\") " pod="opendatahub/opendatahub-operator-controller-manager-697d6d88bf-s8qrd" Jun 08 21:21:30.992483 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:30.992378 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/afe84586-1752-4bad-9c69-bb0ef9c403cb-webhook-cert\") pod \"opendatahub-operator-controller-manager-697d6d88bf-s8qrd\" (UID: \"afe84586-1752-4bad-9c69-bb0ef9c403cb\") " pod="opendatahub/opendatahub-operator-controller-manager-697d6d88bf-s8qrd" Jun 08 21:21:30.992483 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:30.992433 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/afe84586-1752-4bad-9c69-bb0ef9c403cb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-697d6d88bf-s8qrd\" (UID: \"afe84586-1752-4bad-9c69-bb0ef9c403cb\") " pod="opendatahub/opendatahub-operator-controller-manager-697d6d88bf-s8qrd" Jun 08 21:21:30.992483 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:30.992475 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/afe84586-1752-4bad-9c69-bb0ef9c403cb-manifests\") pod \"opendatahub-operator-controller-manager-697d6d88bf-s8qrd\" (UID: \"afe84586-1752-4bad-9c69-bb0ef9c403cb\") " pod="opendatahub/opendatahub-operator-controller-manager-697d6d88bf-s8qrd" Jun 08 21:21:30.992645 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:30.992496 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tvcq\" (UniqueName: \"kubernetes.io/projected/afe84586-1752-4bad-9c69-bb0ef9c403cb-kube-api-access-8tvcq\") pod \"opendatahub-operator-controller-manager-697d6d88bf-s8qrd\" (UID: \"afe84586-1752-4bad-9c69-bb0ef9c403cb\") " pod="opendatahub/opendatahub-operator-controller-manager-697d6d88bf-s8qrd" Jun 08 21:21:31.093144 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:31.093109 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/afe84586-1752-4bad-9c69-bb0ef9c403cb-webhook-cert\") pod \"opendatahub-operator-controller-manager-697d6d88bf-s8qrd\" (UID: \"afe84586-1752-4bad-9c69-bb0ef9c403cb\") " pod="opendatahub/opendatahub-operator-controller-manager-697d6d88bf-s8qrd" Jun 08 21:21:31.093310 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:31.093170 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/afe84586-1752-4bad-9c69-bb0ef9c403cb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-697d6d88bf-s8qrd\" (UID: \"afe84586-1752-4bad-9c69-bb0ef9c403cb\") " pod="opendatahub/opendatahub-operator-controller-manager-697d6d88bf-s8qrd" Jun 08 21:21:31.093310 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:31.093223 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/afe84586-1752-4bad-9c69-bb0ef9c403cb-manifests\") pod \"opendatahub-operator-controller-manager-697d6d88bf-s8qrd\" (UID: \"afe84586-1752-4bad-9c69-bb0ef9c403cb\") " pod="opendatahub/opendatahub-operator-controller-manager-697d6d88bf-s8qrd" Jun 08 21:21:31.093310 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:31.093249 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tvcq\" (UniqueName: \"kubernetes.io/projected/afe84586-1752-4bad-9c69-bb0ef9c403cb-kube-api-access-8tvcq\") pod \"opendatahub-operator-controller-manager-697d6d88bf-s8qrd\" (UID: \"afe84586-1752-4bad-9c69-bb0ef9c403cb\") " pod="opendatahub/opendatahub-operator-controller-manager-697d6d88bf-s8qrd" Jun 08 21:21:31.093310 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:31.093284 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/afe84586-1752-4bad-9c69-bb0ef9c403cb-tmp\") pod \"opendatahub-operator-controller-manager-697d6d88bf-s8qrd\" (UID: \"afe84586-1752-4bad-9c69-bb0ef9c403cb\") " pod="opendatahub/opendatahub-operator-controller-manager-697d6d88bf-s8qrd" Jun 08 21:21:31.093621 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:31.093591 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/afe84586-1752-4bad-9c69-bb0ef9c403cb-manifests\") pod \"opendatahub-operator-controller-manager-697d6d88bf-s8qrd\" (UID: \"afe84586-1752-4bad-9c69-bb0ef9c403cb\") " pod="opendatahub/opendatahub-operator-controller-manager-697d6d88bf-s8qrd" Jun 08 21:21:31.095601 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:31.095572 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/afe84586-1752-4bad-9c69-bb0ef9c403cb-tmp\") pod \"opendatahub-operator-controller-manager-697d6d88bf-s8qrd\" (UID: \"afe84586-1752-4bad-9c69-bb0ef9c403cb\") " pod="opendatahub/opendatahub-operator-controller-manager-697d6d88bf-s8qrd" Jun 08 21:21:31.095817 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:31.095800 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/afe84586-1752-4bad-9c69-bb0ef9c403cb-webhook-cert\") pod \"opendatahub-operator-controller-manager-697d6d88bf-s8qrd\" (UID: \"afe84586-1752-4bad-9c69-bb0ef9c403cb\") " pod="opendatahub/opendatahub-operator-controller-manager-697d6d88bf-s8qrd" Jun 08 21:21:31.095859 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:31.095842 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/afe84586-1752-4bad-9c69-bb0ef9c403cb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-697d6d88bf-s8qrd\" (UID: \"afe84586-1752-4bad-9c69-bb0ef9c403cb\") " pod="opendatahub/opendatahub-operator-controller-manager-697d6d88bf-s8qrd" Jun 08 21:21:31.102242 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:31.102216 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tvcq\" (UniqueName: \"kubernetes.io/projected/afe84586-1752-4bad-9c69-bb0ef9c403cb-kube-api-access-8tvcq\") pod \"opendatahub-operator-controller-manager-697d6d88bf-s8qrd\" (UID: \"afe84586-1752-4bad-9c69-bb0ef9c403cb\") " pod="opendatahub/opendatahub-operator-controller-manager-697d6d88bf-s8qrd" Jun 08 21:21:31.285446 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:31.285410 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-697d6d88bf-s8qrd" Jun 08 21:21:31.426906 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:31.426882 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-697d6d88bf-s8qrd"] Jun 08 21:21:31.429271 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:21:31.429237 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafe84586_1752_4bad_9c69_bb0ef9c403cb.slice/crio-dad845e59c530ba98c3dc4020237fdcbaaa256a988bb9d4163e12fa90663087e WatchSource:0}: Error finding container dad845e59c530ba98c3dc4020237fdcbaaa256a988bb9d4163e12fa90663087e: Status 404 returned error can't find the container with id dad845e59c530ba98c3dc4020237fdcbaaa256a988bb9d4163e12fa90663087e Jun 08 21:21:32.035798 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:32.035713 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-697d6d88bf-s8qrd" event={"ID":"afe84586-1752-4bad-9c69-bb0ef9c403cb","Type":"ContainerStarted","Data":"dad845e59c530ba98c3dc4020237fdcbaaa256a988bb9d4163e12fa90663087e"} Jun 08 21:21:35.052411 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:35.052376 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-697d6d88bf-s8qrd" event={"ID":"afe84586-1752-4bad-9c69-bb0ef9c403cb","Type":"ContainerStarted","Data":"2fcfb2d85177228827bff88814c294746ee9941f98abd53cc7e6e966a117caaa"} Jun 08 21:21:36.058218 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:36.058180 2564 generic.go:356] "Generic (PLEG): container finished" podID="afe84586-1752-4bad-9c69-bb0ef9c403cb" containerID="2fcfb2d85177228827bff88814c294746ee9941f98abd53cc7e6e966a117caaa" exitCode=0 Jun 08 21:21:36.058616 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:36.058266 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-697d6d88bf-s8qrd" event={"ID":"afe84586-1752-4bad-9c69-bb0ef9c403cb","Type":"ContainerDied","Data":"2fcfb2d85177228827bff88814c294746ee9941f98abd53cc7e6e966a117caaa"} Jun 08 21:21:37.064758 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:37.064722 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-697d6d88bf-s8qrd" event={"ID":"afe84586-1752-4bad-9c69-bb0ef9c403cb","Type":"ContainerStarted","Data":"6024938ab6efd136d0c40dd4c75321d02eed460e2612eea9b73f4f2bacae268c"} Jun 08 21:21:37.065261 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:37.064867 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-697d6d88bf-s8qrd" Jun 08 21:21:37.089277 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:37.089226 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-697d6d88bf-s8qrd" podStartSLOduration=2.841227791 podStartE2EDuration="7.08920986s" totalImagesPullingTime="3.208188593s" totalInitContainerRuntime="1.039793476s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:21:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:21:37.088546989 +0000 UTC m=+469.228589886" watchObservedRunningTime="2026-06-08 21:21:37.08920986 +0000 UTC m=+469.229252740" Jun 08 21:21:48.072223 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:48.072189 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-697d6d88bf-s8qrd" Jun 08 21:21:49.512020 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:49.511987 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-f6d9d96c4-f9qd6"] Jun 08 21:21:49.526132 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:49.526103 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f6d9d96c4-f9qd6" Jun 08 21:21:49.531371 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:49.531328 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 08 21:21:49.531538 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:49.531429 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 08 21:21:49.531538 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:49.531360 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 08 21:21:49.531538 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:49.531466 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 08 21:21:49.533756 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:49.533676 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 08 21:21:49.534186 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:49.534164 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8lvmw\"" Jun 08 21:21:49.534925 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:49.534904 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f6d9d96c4-f9qd6"] Jun 08 21:21:49.648921 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:49.648860 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00aec5a6-55a4-4ba8-9612-c649ca6075bd-cert\") pod \"lws-controller-manager-f6d9d96c4-f9qd6\" (UID: \"00aec5a6-55a4-4ba8-9612-c649ca6075bd\") " pod="openshift-lws-operator/lws-controller-manager-f6d9d96c4-f9qd6" Jun 08 21:21:49.648921 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:49.648920 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/00aec5a6-55a4-4ba8-9612-c649ca6075bd-metrics-cert\") pod \"lws-controller-manager-f6d9d96c4-f9qd6\" (UID: \"00aec5a6-55a4-4ba8-9612-c649ca6075bd\") " pod="openshift-lws-operator/lws-controller-manager-f6d9d96c4-f9qd6" Jun 08 21:21:49.649183 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:49.648995 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/00aec5a6-55a4-4ba8-9612-c649ca6075bd-manager-config\") pod \"lws-controller-manager-f6d9d96c4-f9qd6\" (UID: \"00aec5a6-55a4-4ba8-9612-c649ca6075bd\") " pod="openshift-lws-operator/lws-controller-manager-f6d9d96c4-f9qd6" Jun 08 21:21:49.649183 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:49.649026 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7qsv\" (UniqueName: \"kubernetes.io/projected/00aec5a6-55a4-4ba8-9612-c649ca6075bd-kube-api-access-s7qsv\") pod \"lws-controller-manager-f6d9d96c4-f9qd6\" (UID: \"00aec5a6-55a4-4ba8-9612-c649ca6075bd\") " pod="openshift-lws-operator/lws-controller-manager-f6d9d96c4-f9qd6" Jun 08 21:21:49.750441 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:49.750396 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00aec5a6-55a4-4ba8-9612-c649ca6075bd-cert\") pod \"lws-controller-manager-f6d9d96c4-f9qd6\" (UID: \"00aec5a6-55a4-4ba8-9612-c649ca6075bd\") " pod="openshift-lws-operator/lws-controller-manager-f6d9d96c4-f9qd6" Jun 08 21:21:49.750441 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:49.750447 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/00aec5a6-55a4-4ba8-9612-c649ca6075bd-metrics-cert\") pod \"lws-controller-manager-f6d9d96c4-f9qd6\" (UID: \"00aec5a6-55a4-4ba8-9612-c649ca6075bd\") " pod="openshift-lws-operator/lws-controller-manager-f6d9d96c4-f9qd6" Jun 08 21:21:49.750678 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:49.750484 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/00aec5a6-55a4-4ba8-9612-c649ca6075bd-manager-config\") pod \"lws-controller-manager-f6d9d96c4-f9qd6\" (UID: \"00aec5a6-55a4-4ba8-9612-c649ca6075bd\") " pod="openshift-lws-operator/lws-controller-manager-f6d9d96c4-f9qd6" Jun 08 21:21:49.750678 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:49.750513 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7qsv\" (UniqueName: \"kubernetes.io/projected/00aec5a6-55a4-4ba8-9612-c649ca6075bd-kube-api-access-s7qsv\") pod \"lws-controller-manager-f6d9d96c4-f9qd6\" (UID: \"00aec5a6-55a4-4ba8-9612-c649ca6075bd\") " pod="openshift-lws-operator/lws-controller-manager-f6d9d96c4-f9qd6" Jun 08 21:21:49.751274 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:49.751247 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/00aec5a6-55a4-4ba8-9612-c649ca6075bd-manager-config\") pod \"lws-controller-manager-f6d9d96c4-f9qd6\" (UID: \"00aec5a6-55a4-4ba8-9612-c649ca6075bd\") " pod="openshift-lws-operator/lws-controller-manager-f6d9d96c4-f9qd6" Jun 08 21:21:49.753051 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:49.753032 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/00aec5a6-55a4-4ba8-9612-c649ca6075bd-metrics-cert\") pod \"lws-controller-manager-f6d9d96c4-f9qd6\" (UID: \"00aec5a6-55a4-4ba8-9612-c649ca6075bd\") " pod="openshift-lws-operator/lws-controller-manager-f6d9d96c4-f9qd6" Jun 08 21:21:49.753200 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:49.753182 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00aec5a6-55a4-4ba8-9612-c649ca6075bd-cert\") pod \"lws-controller-manager-f6d9d96c4-f9qd6\" (UID: \"00aec5a6-55a4-4ba8-9612-c649ca6075bd\") " pod="openshift-lws-operator/lws-controller-manager-f6d9d96c4-f9qd6" Jun 08 21:21:49.791717 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:49.791679 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7qsv\" (UniqueName: \"kubernetes.io/projected/00aec5a6-55a4-4ba8-9612-c649ca6075bd-kube-api-access-s7qsv\") pod \"lws-controller-manager-f6d9d96c4-f9qd6\" (UID: \"00aec5a6-55a4-4ba8-9612-c649ca6075bd\") " pod="openshift-lws-operator/lws-controller-manager-f6d9d96c4-f9qd6" Jun 08 21:21:49.836699 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:49.836664 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f6d9d96c4-f9qd6" Jun 08 21:21:49.983112 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:49.983084 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f6d9d96c4-f9qd6"] Jun 08 21:21:49.985058 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:21:49.985029 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00aec5a6_55a4_4ba8_9612_c649ca6075bd.slice/crio-ad5675897b00cfd4bad01230b19e0d622f58a24e2614f3e0c46e5273fbd2485f WatchSource:0}: Error finding container ad5675897b00cfd4bad01230b19e0d622f58a24e2614f3e0c46e5273fbd2485f: Status 404 returned error can't find the container with id ad5675897b00cfd4bad01230b19e0d622f58a24e2614f3e0c46e5273fbd2485f Jun 08 21:21:50.124171 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:50.124086 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f6d9d96c4-f9qd6" event={"ID":"00aec5a6-55a4-4ba8-9612-c649ca6075bd","Type":"ContainerStarted","Data":"ad5675897b00cfd4bad01230b19e0d622f58a24e2614f3e0c46e5273fbd2485f"} Jun 08 21:21:53.138290 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:53.138249 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f6d9d96c4-f9qd6" event={"ID":"00aec5a6-55a4-4ba8-9612-c649ca6075bd","Type":"ContainerStarted","Data":"8573dd826d1e135975c233de87cd718a5ac8fcab3bca269740e494f5c54c24de"} Jun 08 21:21:53.138677 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:53.138404 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-f6d9d96c4-f9qd6" Jun 08 21:21:53.156172 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:53.156116 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-f6d9d96c4-f9qd6" podStartSLOduration=2.026553763 podStartE2EDuration="4.156098528s" totalImagesPullingTime="2.129544765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:21:53.155422384 +0000 UTC m=+485.295465266" watchObservedRunningTime="2026-06-08 21:21:53.156098528 +0000 UTC m=+485.296141410" Jun 08 21:21:57.353929 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:57.353884 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p68qr"] Jun 08 21:21:57.361582 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:57.361552 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p68qr" Jun 08 21:21:57.364382 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:57.364353 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 21:21:57.365721 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:57.365692 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9466d\"" Jun 08 21:21:57.365848 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:57.365735 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 21:21:57.368037 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:57.368014 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p68qr"] Jun 08 21:21:57.516599 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:57.516565 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08f5fc87-a32d-4f4e-8887-6582b767a982-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p68qr\" (UID: \"08f5fc87-a32d-4f4e-8887-6582b767a982\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p68qr" Jun 08 21:21:57.516803 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:57.516611 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kgh5\" (UniqueName: \"kubernetes.io/projected/08f5fc87-a32d-4f4e-8887-6582b767a982-kube-api-access-5kgh5\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p68qr\" (UID: \"08f5fc87-a32d-4f4e-8887-6582b767a982\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p68qr" Jun 08 21:21:57.516803 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:57.516721 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08f5fc87-a32d-4f4e-8887-6582b767a982-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p68qr\" (UID: \"08f5fc87-a32d-4f4e-8887-6582b767a982\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p68qr" Jun 08 21:21:57.617645 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:57.617560 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08f5fc87-a32d-4f4e-8887-6582b767a982-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p68qr\" (UID: \"08f5fc87-a32d-4f4e-8887-6582b767a982\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p68qr" Jun 08 21:21:57.617645 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:57.617609 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kgh5\" (UniqueName: \"kubernetes.io/projected/08f5fc87-a32d-4f4e-8887-6582b767a982-kube-api-access-5kgh5\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p68qr\" (UID: \"08f5fc87-a32d-4f4e-8887-6582b767a982\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p68qr" Jun 08 21:21:57.617869 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:57.617671 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08f5fc87-a32d-4f4e-8887-6582b767a982-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p68qr\" (UID: \"08f5fc87-a32d-4f4e-8887-6582b767a982\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p68qr" Jun 08 21:21:57.617943 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:57.617923 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08f5fc87-a32d-4f4e-8887-6582b767a982-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p68qr\" (UID: \"08f5fc87-a32d-4f4e-8887-6582b767a982\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p68qr" Jun 08 21:21:57.617993 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:57.617946 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08f5fc87-a32d-4f4e-8887-6582b767a982-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p68qr\" (UID: \"08f5fc87-a32d-4f4e-8887-6582b767a982\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p68qr" Jun 08 21:21:57.633874 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:57.633842 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kgh5\" (UniqueName: \"kubernetes.io/projected/08f5fc87-a32d-4f4e-8887-6582b767a982-kube-api-access-5kgh5\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p68qr\" (UID: \"08f5fc87-a32d-4f4e-8887-6582b767a982\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p68qr" Jun 08 21:21:57.672303 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:57.672272 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p68qr" Jun 08 21:21:57.807311 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:57.807283 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p68qr"] Jun 08 21:21:57.809184 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:21:57.809152 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08f5fc87_a32d_4f4e_8887_6582b767a982.slice/crio-d4e16bc52839e9cc0c07bae634343a44586edb60d3c5699c64761e3db46b0d0a WatchSource:0}: Error finding container d4e16bc52839e9cc0c07bae634343a44586edb60d3c5699c64761e3db46b0d0a: Status 404 returned error can't find the container with id d4e16bc52839e9cc0c07bae634343a44586edb60d3c5699c64761e3db46b0d0a Jun 08 21:21:58.163106 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:58.162986 2564 generic.go:356] "Generic (PLEG): container finished" podID="08f5fc87-a32d-4f4e-8887-6582b767a982" containerID="60fa0fb80eda548b8f1ed46a9bc3288b4eb64e1b0d23c3bce81f3c4332cd3d0d" exitCode=0 Jun 08 21:21:58.163106 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:58.163060 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p68qr" event={"ID":"08f5fc87-a32d-4f4e-8887-6582b767a982","Type":"ContainerDied","Data":"60fa0fb80eda548b8f1ed46a9bc3288b4eb64e1b0d23c3bce81f3c4332cd3d0d"} Jun 08 21:21:58.163295 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:58.163140 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p68qr" event={"ID":"08f5fc87-a32d-4f4e-8887-6582b767a982","Type":"ContainerStarted","Data":"d4e16bc52839e9cc0c07bae634343a44586edb60d3c5699c64761e3db46b0d0a"} Jun 08 21:21:59.170581 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:59.170546 2564 generic.go:356] "Generic (PLEG): container finished" podID="08f5fc87-a32d-4f4e-8887-6582b767a982" containerID="25715a735a4069b85dc66bea2145ab2822b45729f596e72eeca955fad0079268" exitCode=0 Jun 08 21:21:59.171003 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:21:59.170590 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p68qr" event={"ID":"08f5fc87-a32d-4f4e-8887-6582b767a982","Type":"ContainerDied","Data":"25715a735a4069b85dc66bea2145ab2822b45729f596e72eeca955fad0079268"} Jun 08 21:21:59.409190 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:21:59.409152 2564 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08f5fc87_a32d_4f4e_8887_6582b767a982.slice/crio-conmon-c1e49f245b3454f8c5e487d4fe46ac373a69d55a45fb9278488c5d93a0fd6d6b.scope\": RecentStats: unable to find data in memory cache]" Jun 08 21:22:00.177035 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:00.177004 2564 generic.go:356] "Generic (PLEG): container finished" podID="08f5fc87-a32d-4f4e-8887-6582b767a982" containerID="c1e49f245b3454f8c5e487d4fe46ac373a69d55a45fb9278488c5d93a0fd6d6b" exitCode=0 Jun 08 21:22:00.177435 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:00.177144 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p68qr" event={"ID":"08f5fc87-a32d-4f4e-8887-6582b767a982","Type":"ContainerDied","Data":"c1e49f245b3454f8c5e487d4fe46ac373a69d55a45fb9278488c5d93a0fd6d6b"} Jun 08 21:22:01.311634 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:01.311609 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p68qr" Jun 08 21:22:01.447187 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:01.447097 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08f5fc87-a32d-4f4e-8887-6582b767a982-bundle\") pod \"08f5fc87-a32d-4f4e-8887-6582b767a982\" (UID: \"08f5fc87-a32d-4f4e-8887-6582b767a982\") " Jun 08 21:22:01.447187 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:01.447138 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08f5fc87-a32d-4f4e-8887-6582b767a982-util\") pod \"08f5fc87-a32d-4f4e-8887-6582b767a982\" (UID: \"08f5fc87-a32d-4f4e-8887-6582b767a982\") " Jun 08 21:22:01.447371 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:01.447237 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kgh5\" (UniqueName: \"kubernetes.io/projected/08f5fc87-a32d-4f4e-8887-6582b767a982-kube-api-access-5kgh5\") pod \"08f5fc87-a32d-4f4e-8887-6582b767a982\" (UID: \"08f5fc87-a32d-4f4e-8887-6582b767a982\") " Jun 08 21:22:01.448416 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:01.448380 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08f5fc87-a32d-4f4e-8887-6582b767a982-bundle" (OuterVolumeSpecName: "bundle") pod "08f5fc87-a32d-4f4e-8887-6582b767a982" (UID: "08f5fc87-a32d-4f4e-8887-6582b767a982"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:22:01.449649 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:01.449624 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08f5fc87-a32d-4f4e-8887-6582b767a982-kube-api-access-5kgh5" (OuterVolumeSpecName: "kube-api-access-5kgh5") pod "08f5fc87-a32d-4f4e-8887-6582b767a982" (UID: "08f5fc87-a32d-4f4e-8887-6582b767a982"). InnerVolumeSpecName "kube-api-access-5kgh5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:22:01.452669 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:01.452643 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08f5fc87-a32d-4f4e-8887-6582b767a982-util" (OuterVolumeSpecName: "util") pod "08f5fc87-a32d-4f4e-8887-6582b767a982" (UID: "08f5fc87-a32d-4f4e-8887-6582b767a982"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:22:01.548788 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:01.548743 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kgh5\" (UniqueName: \"kubernetes.io/projected/08f5fc87-a32d-4f4e-8887-6582b767a982-kube-api-access-5kgh5\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:22:01.548788 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:01.548783 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08f5fc87-a32d-4f4e-8887-6582b767a982-bundle\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:22:01.548788 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:01.548795 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08f5fc87-a32d-4f4e-8887-6582b767a982-util\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:22:02.188798 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:02.188765 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p68qr" Jun 08 21:22:02.188946 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:02.188765 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p68qr" event={"ID":"08f5fc87-a32d-4f4e-8887-6582b767a982","Type":"ContainerDied","Data":"d4e16bc52839e9cc0c07bae634343a44586edb60d3c5699c64761e3db46b0d0a"} Jun 08 21:22:02.188946 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:02.188900 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d4e16bc52839e9cc0c07bae634343a44586edb60d3c5699c64761e3db46b0d0a" Jun 08 21:22:04.145042 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:04.145002 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-f6d9d96c4-f9qd6" Jun 08 21:22:12.276585 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.276552 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdqbz"] Jun 08 21:22:12.276960 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.276847 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08f5fc87-a32d-4f4e-8887-6582b767a982" containerName="pull" Jun 08 21:22:12.276960 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.276857 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="08f5fc87-a32d-4f4e-8887-6582b767a982" containerName="pull" Jun 08 21:22:12.276960 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.276870 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08f5fc87-a32d-4f4e-8887-6582b767a982" containerName="util" Jun 08 21:22:12.276960 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.276875 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="08f5fc87-a32d-4f4e-8887-6582b767a982" containerName="util" Jun 08 21:22:12.276960 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.276880 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08f5fc87-a32d-4f4e-8887-6582b767a982" containerName="extract" Jun 08 21:22:12.276960 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.276886 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="08f5fc87-a32d-4f4e-8887-6582b767a982" containerName="extract" Jun 08 21:22:12.276960 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.276940 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="08f5fc87-a32d-4f4e-8887-6582b767a982" containerName="extract" Jun 08 21:22:12.280285 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.280268 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdqbz" Jun 08 21:22:12.283098 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.283060 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 21:22:12.283098 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.283062 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9466d\"" Jun 08 21:22:12.283262 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.283109 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 21:22:12.290616 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.290593 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdqbz"] Jun 08 21:22:12.424667 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.424631 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-865f89cc7c-xwxj9"] Jun 08 21:22:12.428110 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.428094 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-865f89cc7c-xwxj9" Jun 08 21:22:12.431199 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.431175 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-txn27\"" Jun 08 21:22:12.431308 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.431213 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 08 21:22:12.436408 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.436386 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-865f89cc7c-xwxj9"] Jun 08 21:22:12.438433 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.438408 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdqbz\" (UID: \"76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdqbz" Jun 08 21:22:12.438557 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.438442 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdqbz\" (UID: \"76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdqbz" Jun 08 21:22:12.438629 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.438602 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkt5p\" (UniqueName: \"kubernetes.io/projected/76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb-kube-api-access-fkt5p\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdqbz\" (UID: \"76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdqbz" Jun 08 21:22:12.540029 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.539992 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkt5p\" (UniqueName: \"kubernetes.io/projected/76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb-kube-api-access-fkt5p\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdqbz\" (UID: \"76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdqbz" Jun 08 21:22:12.540228 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.540048 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6pl7\" (UniqueName: \"kubernetes.io/projected/d406c41d-f20f-494f-8595-86b39d59a1ec-kube-api-access-j6pl7\") pod \"dashboard-redirect-865f89cc7c-xwxj9\" (UID: \"d406c41d-f20f-494f-8595-86b39d59a1ec\") " pod="opendatahub/dashboard-redirect-865f89cc7c-xwxj9" Jun 08 21:22:12.540228 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.540099 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdqbz\" (UID: \"76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdqbz" Jun 08 21:22:12.540228 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.540115 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdqbz\" (UID: \"76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdqbz" Jun 08 21:22:12.540228 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.540160 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d406c41d-f20f-494f-8595-86b39d59a1ec-redirect-config\") pod \"dashboard-redirect-865f89cc7c-xwxj9\" (UID: \"d406c41d-f20f-494f-8595-86b39d59a1ec\") " pod="opendatahub/dashboard-redirect-865f89cc7c-xwxj9" Jun 08 21:22:12.540481 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.540465 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdqbz\" (UID: \"76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdqbz" Jun 08 21:22:12.540537 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.540507 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdqbz\" (UID: \"76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdqbz" Jun 08 21:22:12.549400 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.549375 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkt5p\" (UniqueName: \"kubernetes.io/projected/76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb-kube-api-access-fkt5p\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdqbz\" (UID: \"76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdqbz" Jun 08 21:22:12.589340 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.589319 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdqbz" Jun 08 21:22:12.641542 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.641144 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6pl7\" (UniqueName: \"kubernetes.io/projected/d406c41d-f20f-494f-8595-86b39d59a1ec-kube-api-access-j6pl7\") pod \"dashboard-redirect-865f89cc7c-xwxj9\" (UID: \"d406c41d-f20f-494f-8595-86b39d59a1ec\") " pod="opendatahub/dashboard-redirect-865f89cc7c-xwxj9" Jun 08 21:22:12.641542 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.641239 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d406c41d-f20f-494f-8595-86b39d59a1ec-redirect-config\") pod \"dashboard-redirect-865f89cc7c-xwxj9\" (UID: \"d406c41d-f20f-494f-8595-86b39d59a1ec\") " pod="opendatahub/dashboard-redirect-865f89cc7c-xwxj9" Jun 08 21:22:12.642228 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.642093 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d406c41d-f20f-494f-8595-86b39d59a1ec-redirect-config\") pod \"dashboard-redirect-865f89cc7c-xwxj9\" (UID: \"d406c41d-f20f-494f-8595-86b39d59a1ec\") " pod="opendatahub/dashboard-redirect-865f89cc7c-xwxj9" Jun 08 21:22:12.652875 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.652841 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6pl7\" (UniqueName: \"kubernetes.io/projected/d406c41d-f20f-494f-8595-86b39d59a1ec-kube-api-access-j6pl7\") pod \"dashboard-redirect-865f89cc7c-xwxj9\" (UID: \"d406c41d-f20f-494f-8595-86b39d59a1ec\") " pod="opendatahub/dashboard-redirect-865f89cc7c-xwxj9" Jun 08 21:22:12.726427 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.726270 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdqbz"] Jun 08 21:22:12.729142 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:22:12.729114 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76fcbaa6_4ee2_4a8b_8768_34a51c8e2bdb.slice/crio-fca6d96e6874083bb2963c75905fda53306d6582e92fa2e4c149d80084553b91 WatchSource:0}: Error finding container fca6d96e6874083bb2963c75905fda53306d6582e92fa2e4c149d80084553b91: Status 404 returned error can't find the container with id fca6d96e6874083bb2963c75905fda53306d6582e92fa2e4c149d80084553b91 Jun 08 21:22:12.738949 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.738933 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-865f89cc7c-xwxj9" Jun 08 21:22:12.885797 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:12.885773 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-865f89cc7c-xwxj9"] Jun 08 21:22:12.892956 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:22:12.892925 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd406c41d_f20f_494f_8595_86b39d59a1ec.slice/crio-fc8b0a1404a87c6eca377e0b4465a10feb113c30b0d463aec1fa55e5961db912 WatchSource:0}: Error finding container fc8b0a1404a87c6eca377e0b4465a10feb113c30b0d463aec1fa55e5961db912: Status 404 returned error can't find the container with id fc8b0a1404a87c6eca377e0b4465a10feb113c30b0d463aec1fa55e5961db912 Jun 08 21:22:13.241430 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:13.241336 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-865f89cc7c-xwxj9" event={"ID":"d406c41d-f20f-494f-8595-86b39d59a1ec","Type":"ContainerStarted","Data":"fc8b0a1404a87c6eca377e0b4465a10feb113c30b0d463aec1fa55e5961db912"} Jun 08 21:22:13.242749 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:13.242725 2564 generic.go:356] "Generic (PLEG): container finished" podID="76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb" containerID="bac76d54c206cba93e533af36d369875906691b4daa7fc59f63514bb6c232669" exitCode=0 Jun 08 21:22:13.242874 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:13.242753 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdqbz" event={"ID":"76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb","Type":"ContainerDied","Data":"bac76d54c206cba93e533af36d369875906691b4daa7fc59f63514bb6c232669"} Jun 08 21:22:13.242874 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:13.242795 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdqbz" event={"ID":"76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb","Type":"ContainerStarted","Data":"fca6d96e6874083bb2963c75905fda53306d6582e92fa2e4c149d80084553b91"} Jun 08 21:22:14.252791 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:14.252719 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdqbz" event={"ID":"76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb","Type":"ContainerStarted","Data":"26e431d455aa3d810e5d7cf810a04d918d84fac0e8dd0daa4fd6d3a5cf79b5bb"} Jun 08 21:22:15.258735 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:15.258703 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-865f89cc7c-xwxj9" event={"ID":"d406c41d-f20f-494f-8595-86b39d59a1ec","Type":"ContainerStarted","Data":"430cba27fc65035743c4943f31f9e661fdc1930b001231ae57e1e2c1d42acd9e"} Jun 08 21:22:15.260544 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:15.260523 2564 generic.go:356] "Generic (PLEG): container finished" podID="76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb" containerID="26e431d455aa3d810e5d7cf810a04d918d84fac0e8dd0daa4fd6d3a5cf79b5bb" exitCode=0 Jun 08 21:22:15.260628 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:15.260590 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdqbz" event={"ID":"76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb","Type":"ContainerDied","Data":"26e431d455aa3d810e5d7cf810a04d918d84fac0e8dd0daa4fd6d3a5cf79b5bb"} Jun 08 21:22:15.277195 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:15.277152 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-865f89cc7c-xwxj9" podStartSLOduration=1.069499081 podStartE2EDuration="3.277136457s" totalImagesPullingTime="2.207637376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:22:15.276860724 +0000 UTC m=+507.416903606" watchObservedRunningTime="2026-06-08 21:22:15.277136457 +0000 UTC m=+507.417179338" Jun 08 21:22:16.267108 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:16.267057 2564 generic.go:356] "Generic (PLEG): container finished" podID="76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb" containerID="fa47263ba2f1eaa81e37c9ada55e3e5724fe0b84f7bb8dddc4674a05dd36d36c" exitCode=0 Jun 08 21:22:16.267520 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:16.267145 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdqbz" event={"ID":"76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb","Type":"ContainerDied","Data":"fa47263ba2f1eaa81e37c9ada55e3e5724fe0b84f7bb8dddc4674a05dd36d36c"} Jun 08 21:22:17.404912 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:17.404885 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdqbz" Jun 08 21:22:17.584016 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:17.583983 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkt5p\" (UniqueName: \"kubernetes.io/projected/76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb-kube-api-access-fkt5p\") pod \"76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb\" (UID: \"76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb\") " Jun 08 21:22:17.584231 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:17.584036 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb-bundle\") pod \"76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb\" (UID: \"76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb\") " Jun 08 21:22:17.584231 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:17.584131 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb-util\") pod \"76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb\" (UID: \"76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb\") " Jun 08 21:22:17.584911 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:17.584884 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb-bundle" (OuterVolumeSpecName: "bundle") pod "76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb" (UID: "76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:22:17.586303 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:17.586273 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb-kube-api-access-fkt5p" (OuterVolumeSpecName: "kube-api-access-fkt5p") pod "76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb" (UID: "76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb"). InnerVolumeSpecName "kube-api-access-fkt5p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:22:17.589746 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:17.589721 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb-util" (OuterVolumeSpecName: "util") pod "76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb" (UID: "76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:22:17.685095 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:17.685033 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkt5p\" (UniqueName: \"kubernetes.io/projected/76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb-kube-api-access-fkt5p\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:22:17.685095 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:17.685088 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb-bundle\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:22:17.685095 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:17.685099 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb-util\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:22:18.278242 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:18.278213 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdqbz" Jun 08 21:22:18.278242 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:18.278227 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdqbz" event={"ID":"76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb","Type":"ContainerDied","Data":"fca6d96e6874083bb2963c75905fda53306d6582e92fa2e4c149d80084553b91"} Jun 08 21:22:18.278448 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:18.278293 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fca6d96e6874083bb2963c75905fda53306d6582e92fa2e4c149d80084553b91" Jun 08 21:22:33.331090 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.331033 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8"] Jun 08 21:22:33.331548 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.331528 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb" containerName="util" Jun 08 21:22:33.331548 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.331546 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb" containerName="util" Jun 08 21:22:33.331624 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.331567 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb" containerName="extract" Jun 08 21:22:33.331624 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.331576 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb" containerName="extract" Jun 08 21:22:33.331694 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.331624 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb" containerName="pull" Jun 08 21:22:33.331694 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.331633 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb" containerName="pull" Jun 08 21:22:33.331761 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.331707 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="76fcbaa6-4ee2-4a8b-8768-34a51c8e2bdb" containerName="extract" Jun 08 21:22:33.335409 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.335391 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" Jun 08 21:22:33.337997 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.337967 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 08 21:22:33.337997 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.337987 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-b8q8b\"" Jun 08 21:22:33.346991 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.346968 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8"] Jun 08 21:22:33.424193 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.424155 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8538f355-b940-44a9-8963-00dbb5a82c5f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsglc8\" (UID: \"8538f355-b940-44a9-8963-00dbb5a82c5f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" Jun 08 21:22:33.424193 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.424196 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8538f355-b940-44a9-8963-00dbb5a82c5f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsglc8\" (UID: \"8538f355-b940-44a9-8963-00dbb5a82c5f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" Jun 08 21:22:33.424471 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.424213 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8538f355-b940-44a9-8963-00dbb5a82c5f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsglc8\" (UID: \"8538f355-b940-44a9-8963-00dbb5a82c5f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" Jun 08 21:22:33.424471 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.424271 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8538f355-b940-44a9-8963-00dbb5a82c5f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsglc8\" (UID: \"8538f355-b940-44a9-8963-00dbb5a82c5f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" Jun 08 21:22:33.424471 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.424381 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8538f355-b940-44a9-8963-00dbb5a82c5f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsglc8\" (UID: \"8538f355-b940-44a9-8963-00dbb5a82c5f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" Jun 08 21:22:33.424471 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.424420 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8538f355-b940-44a9-8963-00dbb5a82c5f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsglc8\" (UID: \"8538f355-b940-44a9-8963-00dbb5a82c5f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" Jun 08 21:22:33.424652 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.424505 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8538f355-b940-44a9-8963-00dbb5a82c5f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsglc8\" (UID: \"8538f355-b940-44a9-8963-00dbb5a82c5f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" Jun 08 21:22:33.424652 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.424537 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64wsp\" (UniqueName: \"kubernetes.io/projected/8538f355-b940-44a9-8963-00dbb5a82c5f-kube-api-access-64wsp\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsglc8\" (UID: \"8538f355-b940-44a9-8963-00dbb5a82c5f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" Jun 08 21:22:33.424652 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.424611 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8538f355-b940-44a9-8963-00dbb5a82c5f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsglc8\" (UID: \"8538f355-b940-44a9-8963-00dbb5a82c5f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" Jun 08 21:22:33.524996 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.524960 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8538f355-b940-44a9-8963-00dbb5a82c5f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsglc8\" (UID: \"8538f355-b940-44a9-8963-00dbb5a82c5f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" Jun 08 21:22:33.524996 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.525009 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64wsp\" (UniqueName: \"kubernetes.io/projected/8538f355-b940-44a9-8963-00dbb5a82c5f-kube-api-access-64wsp\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsglc8\" (UID: \"8538f355-b940-44a9-8963-00dbb5a82c5f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" Jun 08 21:22:33.525269 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.525034 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8538f355-b940-44a9-8963-00dbb5a82c5f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsglc8\" (UID: \"8538f355-b940-44a9-8963-00dbb5a82c5f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" Jun 08 21:22:33.525269 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.525055 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8538f355-b940-44a9-8963-00dbb5a82c5f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsglc8\" (UID: \"8538f355-b940-44a9-8963-00dbb5a82c5f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" Jun 08 21:22:33.525269 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.525104 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8538f355-b940-44a9-8963-00dbb5a82c5f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsglc8\" (UID: \"8538f355-b940-44a9-8963-00dbb5a82c5f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" Jun 08 21:22:33.525269 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.525124 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8538f355-b940-44a9-8963-00dbb5a82c5f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsglc8\" (UID: \"8538f355-b940-44a9-8963-00dbb5a82c5f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" Jun 08 21:22:33.525269 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.525148 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8538f355-b940-44a9-8963-00dbb5a82c5f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsglc8\" (UID: \"8538f355-b940-44a9-8963-00dbb5a82c5f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" Jun 08 21:22:33.525269 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.525186 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8538f355-b940-44a9-8963-00dbb5a82c5f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsglc8\" (UID: \"8538f355-b940-44a9-8963-00dbb5a82c5f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" Jun 08 21:22:33.525525 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.525406 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8538f355-b940-44a9-8963-00dbb5a82c5f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsglc8\" (UID: \"8538f355-b940-44a9-8963-00dbb5a82c5f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" Jun 08 21:22:33.525635 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.525612 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8538f355-b940-44a9-8963-00dbb5a82c5f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsglc8\" (UID: \"8538f355-b940-44a9-8963-00dbb5a82c5f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" Jun 08 21:22:33.525635 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.525626 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8538f355-b940-44a9-8963-00dbb5a82c5f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsglc8\" (UID: \"8538f355-b940-44a9-8963-00dbb5a82c5f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" Jun 08 21:22:33.525762 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.525712 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8538f355-b940-44a9-8963-00dbb5a82c5f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsglc8\" (UID: \"8538f355-b940-44a9-8963-00dbb5a82c5f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" Jun 08 21:22:33.525819 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.525805 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8538f355-b940-44a9-8963-00dbb5a82c5f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsglc8\" (UID: \"8538f355-b940-44a9-8963-00dbb5a82c5f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" Jun 08 21:22:33.526134 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.526116 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8538f355-b940-44a9-8963-00dbb5a82c5f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsglc8\" (UID: \"8538f355-b940-44a9-8963-00dbb5a82c5f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" Jun 08 21:22:33.527497 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.527475 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8538f355-b940-44a9-8963-00dbb5a82c5f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsglc8\" (UID: \"8538f355-b940-44a9-8963-00dbb5a82c5f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" Jun 08 21:22:33.527862 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.527844 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8538f355-b940-44a9-8963-00dbb5a82c5f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsglc8\" (UID: \"8538f355-b940-44a9-8963-00dbb5a82c5f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" Jun 08 21:22:33.534819 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.534794 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8538f355-b940-44a9-8963-00dbb5a82c5f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsglc8\" (UID: \"8538f355-b940-44a9-8963-00dbb5a82c5f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" Jun 08 21:22:33.534819 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.534805 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64wsp\" (UniqueName: \"kubernetes.io/projected/8538f355-b940-44a9-8963-00dbb5a82c5f-kube-api-access-64wsp\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsglc8\" (UID: \"8538f355-b940-44a9-8963-00dbb5a82c5f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" Jun 08 21:22:33.647089 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.646983 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" Jun 08 21:22:33.786657 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:33.786633 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8"] Jun 08 21:22:33.788479 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:22:33.788442 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8538f355_b940_44a9_8963_00dbb5a82c5f.slice/crio-47f505e22c85d73e10e96f83c460a71a03fa5db069905ce6af2329f600e686e9 WatchSource:0}: Error finding container 47f505e22c85d73e10e96f83c460a71a03fa5db069905ce6af2329f600e686e9: Status 404 returned error can't find the container with id 47f505e22c85d73e10e96f83c460a71a03fa5db069905ce6af2329f600e686e9 Jun 08 21:22:34.353043 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:34.353010 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" event={"ID":"8538f355-b940-44a9-8963-00dbb5a82c5f","Type":"ContainerStarted","Data":"47f505e22c85d73e10e96f83c460a71a03fa5db069905ce6af2329f600e686e9"} Jun 08 21:22:36.707930 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:36.707880 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 08 21:22:36.708212 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:36.707967 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 08 21:22:36.708212 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:36.708002 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 08 21:22:37.372091 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:37.372034 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" event={"ID":"8538f355-b940-44a9-8963-00dbb5a82c5f","Type":"ContainerStarted","Data":"6d38a3365513c850f4815e71777aee7b42bea48008d7b135226b40bf3b075ca3"} Jun 08 21:22:37.394257 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:37.394200 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" podStartSLOduration=1.477093515 podStartE2EDuration="4.394181019s" totalImagesPullingTime="2.917087504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:22:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:22:37.39325936 +0000 UTC m=+529.533302241" watchObservedRunningTime="2026-06-08 21:22:37.394181019 +0000 UTC m=+529.534223903" Jun 08 21:22:37.647799 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:37.647728 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" Jun 08 21:22:37.652232 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:37.652207 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" Jun 08 21:22:38.376308 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:38.376281 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" Jun 08 21:22:38.377183 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:38.377160 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsglc8" Jun 08 21:22:51.503699 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:51.503653 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nksvl"] Jun 08 21:22:51.516479 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:51.516450 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nksvl" Jun 08 21:22:51.518771 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:51.518734 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nksvl"] Jun 08 21:22:51.519496 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:51.519471 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-4bs45\"" Jun 08 21:22:51.520929 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:51.520898 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 08 21:22:51.521049 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:51.520964 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 08 21:22:51.589477 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:51.589441 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlbcx\" (UniqueName: \"kubernetes.io/projected/e4b292ab-387a-45db-8057-1243f5f86b73-kube-api-access-xlbcx\") pod \"kuadrant-operator-catalog-nksvl\" (UID: \"e4b292ab-387a-45db-8057-1243f5f86b73\") " pod="kuadrant-system/kuadrant-operator-catalog-nksvl" Jun 08 21:22:51.690095 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:51.690034 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlbcx\" (UniqueName: \"kubernetes.io/projected/e4b292ab-387a-45db-8057-1243f5f86b73-kube-api-access-xlbcx\") pod \"kuadrant-operator-catalog-nksvl\" (UID: \"e4b292ab-387a-45db-8057-1243f5f86b73\") " pod="kuadrant-system/kuadrant-operator-catalog-nksvl" Jun 08 21:22:51.698884 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:51.698857 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlbcx\" (UniqueName: \"kubernetes.io/projected/e4b292ab-387a-45db-8057-1243f5f86b73-kube-api-access-xlbcx\") pod \"kuadrant-operator-catalog-nksvl\" (UID: \"e4b292ab-387a-45db-8057-1243f5f86b73\") " pod="kuadrant-system/kuadrant-operator-catalog-nksvl" Jun 08 21:22:51.828158 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:51.828121 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nksvl" Jun 08 21:22:51.964172 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:51.964143 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nksvl"] Jun 08 21:22:51.967182 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:22:51.967154 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4b292ab_387a_45db_8057_1243f5f86b73.slice/crio-18e48639a272404fc5bdf3c7ee53b1494af07327453a2f36571a1c059d2eef74 WatchSource:0}: Error finding container 18e48639a272404fc5bdf3c7ee53b1494af07327453a2f36571a1c059d2eef74: Status 404 returned error can't find the container with id 18e48639a272404fc5bdf3c7ee53b1494af07327453a2f36571a1c059d2eef74 Jun 08 21:22:52.287408 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:52.287371 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nksvl"] Jun 08 21:22:52.304691 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:52.304661 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cdtgk"] Jun 08 21:22:52.309841 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:52.309807 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cdtgk" Jun 08 21:22:52.316890 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:52.316259 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cdtgk"] Jun 08 21:22:52.396588 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:52.396557 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj4lf\" (UniqueName: \"kubernetes.io/projected/f291ac39-cf96-4272-8178-8cd2b37672d7-kube-api-access-gj4lf\") pod \"kuadrant-operator-catalog-cdtgk\" (UID: \"f291ac39-cf96-4272-8178-8cd2b37672d7\") " pod="kuadrant-system/kuadrant-operator-catalog-cdtgk" Jun 08 21:22:52.441157 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:52.441120 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nksvl" event={"ID":"e4b292ab-387a-45db-8057-1243f5f86b73","Type":"ContainerStarted","Data":"18e48639a272404fc5bdf3c7ee53b1494af07327453a2f36571a1c059d2eef74"} Jun 08 21:22:52.497909 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:52.497868 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj4lf\" (UniqueName: \"kubernetes.io/projected/f291ac39-cf96-4272-8178-8cd2b37672d7-kube-api-access-gj4lf\") pod \"kuadrant-operator-catalog-cdtgk\" (UID: \"f291ac39-cf96-4272-8178-8cd2b37672d7\") " pod="kuadrant-system/kuadrant-operator-catalog-cdtgk" Jun 08 21:22:52.505951 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:52.505925 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj4lf\" (UniqueName: \"kubernetes.io/projected/f291ac39-cf96-4272-8178-8cd2b37672d7-kube-api-access-gj4lf\") pod \"kuadrant-operator-catalog-cdtgk\" (UID: \"f291ac39-cf96-4272-8178-8cd2b37672d7\") " pod="kuadrant-system/kuadrant-operator-catalog-cdtgk" Jun 08 21:22:52.626760 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:52.626679 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cdtgk" Jun 08 21:22:52.826019 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:52.825972 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cdtgk"] Jun 08 21:22:52.867384 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:22:52.867350 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf291ac39_cf96_4272_8178_8cd2b37672d7.slice/crio-6ffa70e5d8f7817deb91707297f8c22c7b0b7694b122571ba5eb9f4c7e9efceb WatchSource:0}: Error finding container 6ffa70e5d8f7817deb91707297f8c22c7b0b7694b122571ba5eb9f4c7e9efceb: Status 404 returned error can't find the container with id 6ffa70e5d8f7817deb91707297f8c22c7b0b7694b122571ba5eb9f4c7e9efceb Jun 08 21:22:53.447547 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:53.447502 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cdtgk" event={"ID":"f291ac39-cf96-4272-8178-8cd2b37672d7","Type":"ContainerStarted","Data":"6ffa70e5d8f7817deb91707297f8c22c7b0b7694b122571ba5eb9f4c7e9efceb"} Jun 08 21:22:54.454447 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:54.454352 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nksvl" event={"ID":"e4b292ab-387a-45db-8057-1243f5f86b73","Type":"ContainerStarted","Data":"0f6fe328c67f3b988935af00c5d96f4e0862f65a67b12d048de90628d18b8ed2"} Jun 08 21:22:54.454866 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:54.454426 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-nksvl" podUID="e4b292ab-387a-45db-8057-1243f5f86b73" containerName="registry-server" containerID="cri-o://0f6fe328c67f3b988935af00c5d96f4e0862f65a67b12d048de90628d18b8ed2" gracePeriod=2 Jun 08 21:22:54.456007 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:54.455986 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cdtgk" event={"ID":"f291ac39-cf96-4272-8178-8cd2b37672d7","Type":"ContainerStarted","Data":"83625940eeeeaa7f1f78236b0a8a381d60be921a319a12b15a5876485f8c8abd"} Jun 08 21:22:54.473427 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:54.473366 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-nksvl" podStartSLOduration=1.325668951 podStartE2EDuration="3.473350633s" totalImagesPullingTime="2.147681682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:22:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:22:54.472011368 +0000 UTC m=+546.612054249" watchObservedRunningTime="2026-06-08 21:22:54.473350633 +0000 UTC m=+546.613393546" Jun 08 21:22:54.490905 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:54.490865 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-cdtgk" podStartSLOduration=1.240304417 podStartE2EDuration="2.490850057s" totalImagesPullingTime="1.25054564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:22:54.489041001 +0000 UTC m=+546.629083873" watchObservedRunningTime="2026-06-08 21:22:54.490850057 +0000 UTC m=+546.630892938" Jun 08 21:22:54.725622 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:54.725590 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nksvl" Jun 08 21:22:54.817928 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:54.817894 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlbcx\" (UniqueName: \"kubernetes.io/projected/e4b292ab-387a-45db-8057-1243f5f86b73-kube-api-access-xlbcx\") pod \"e4b292ab-387a-45db-8057-1243f5f86b73\" (UID: \"e4b292ab-387a-45db-8057-1243f5f86b73\") " Jun 08 21:22:54.820281 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:54.820257 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4b292ab-387a-45db-8057-1243f5f86b73-kube-api-access-xlbcx" (OuterVolumeSpecName: "kube-api-access-xlbcx") pod "e4b292ab-387a-45db-8057-1243f5f86b73" (UID: "e4b292ab-387a-45db-8057-1243f5f86b73"). InnerVolumeSpecName "kube-api-access-xlbcx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:22:54.919412 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:54.919364 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlbcx\" (UniqueName: \"kubernetes.io/projected/e4b292ab-387a-45db-8057-1243f5f86b73-kube-api-access-xlbcx\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:22:55.461865 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:55.461771 2564 generic.go:356] "Generic (PLEG): container finished" podID="e4b292ab-387a-45db-8057-1243f5f86b73" containerID="0f6fe328c67f3b988935af00c5d96f4e0862f65a67b12d048de90628d18b8ed2" exitCode=0 Jun 08 21:22:55.461865 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:55.461819 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nksvl" Jun 08 21:22:55.462394 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:55.461866 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nksvl" event={"ID":"e4b292ab-387a-45db-8057-1243f5f86b73","Type":"ContainerDied","Data":"0f6fe328c67f3b988935af00c5d96f4e0862f65a67b12d048de90628d18b8ed2"} Jun 08 21:22:55.462394 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:55.461927 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nksvl" event={"ID":"e4b292ab-387a-45db-8057-1243f5f86b73","Type":"ContainerDied","Data":"18e48639a272404fc5bdf3c7ee53b1494af07327453a2f36571a1c059d2eef74"} Jun 08 21:22:55.462394 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:55.461956 2564 scope.go:117] "RemoveContainer" containerID="0f6fe328c67f3b988935af00c5d96f4e0862f65a67b12d048de90628d18b8ed2" Jun 08 21:22:55.472462 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:55.472442 2564 scope.go:117] "RemoveContainer" containerID="0f6fe328c67f3b988935af00c5d96f4e0862f65a67b12d048de90628d18b8ed2" Jun 08 21:22:55.472720 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:22:55.472702 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f6fe328c67f3b988935af00c5d96f4e0862f65a67b12d048de90628d18b8ed2\": container with ID starting with 0f6fe328c67f3b988935af00c5d96f4e0862f65a67b12d048de90628d18b8ed2 not found: ID does not exist" containerID="0f6fe328c67f3b988935af00c5d96f4e0862f65a67b12d048de90628d18b8ed2" Jun 08 21:22:55.472765 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:55.472728 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f6fe328c67f3b988935af00c5d96f4e0862f65a67b12d048de90628d18b8ed2"} err="failed to get container status \"0f6fe328c67f3b988935af00c5d96f4e0862f65a67b12d048de90628d18b8ed2\": rpc error: code = NotFound desc = could not find container \"0f6fe328c67f3b988935af00c5d96f4e0862f65a67b12d048de90628d18b8ed2\": container with ID starting with 0f6fe328c67f3b988935af00c5d96f4e0862f65a67b12d048de90628d18b8ed2 not found: ID does not exist" Jun 08 21:22:55.485246 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:55.485213 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nksvl"] Jun 08 21:22:55.489552 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:55.489526 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nksvl"] Jun 08 21:22:56.347654 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:22:56.347620 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4b292ab-387a-45db-8057-1243f5f86b73" path="/var/lib/kubelet/pods/e4b292ab-387a-45db-8057-1243f5f86b73/volumes" Jun 08 21:23:02.626905 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:02.626869 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-cdtgk" Jun 08 21:23:02.627534 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:02.626938 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-cdtgk" Jun 08 21:23:02.649222 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:02.649196 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-cdtgk" Jun 08 21:23:03.521461 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:03.521432 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-cdtgk" Jun 08 21:23:08.248710 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:08.248673 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx"] Jun 08 21:23:08.249104 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:08.248992 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4b292ab-387a-45db-8057-1243f5f86b73" containerName="registry-server" Jun 08 21:23:08.249104 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:08.249003 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4b292ab-387a-45db-8057-1243f5f86b73" containerName="registry-server" Jun 08 21:23:08.249104 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:08.249063 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4b292ab-387a-45db-8057-1243f5f86b73" containerName="registry-server" Jun 08 21:23:08.259552 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:08.259524 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx" Jun 08 21:23:08.259811 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:08.259789 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx"] Jun 08 21:23:08.262176 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:08.262152 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4nj2l\"" Jun 08 21:23:08.449160 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:08.449121 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8djh7\" (UniqueName: \"kubernetes.io/projected/51bbd0d6-f697-4f60-9a43-d94627eae43c-kube-api-access-8djh7\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx\" (UID: \"51bbd0d6-f697-4f60-9a43-d94627eae43c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx" Jun 08 21:23:08.449344 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:08.449177 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51bbd0d6-f697-4f60-9a43-d94627eae43c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx\" (UID: \"51bbd0d6-f697-4f60-9a43-d94627eae43c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx" Jun 08 21:23:08.449344 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:08.449297 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51bbd0d6-f697-4f60-9a43-d94627eae43c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx\" (UID: \"51bbd0d6-f697-4f60-9a43-d94627eae43c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx" Jun 08 21:23:08.449604 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:08.449585 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr"] Jun 08 21:23:08.453889 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:08.453867 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr" Jun 08 21:23:08.461185 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:08.461155 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr"] Jun 08 21:23:08.550190 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:08.550161 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr\" (UID: \"5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr" Jun 08 21:23:08.550339 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:08.550209 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51bbd0d6-f697-4f60-9a43-d94627eae43c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx\" (UID: \"51bbd0d6-f697-4f60-9a43-d94627eae43c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx" Jun 08 21:23:08.550339 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:08.550233 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr\" (UID: \"5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr" Jun 08 21:23:08.550339 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:08.550269 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8djh7\" (UniqueName: \"kubernetes.io/projected/51bbd0d6-f697-4f60-9a43-d94627eae43c-kube-api-access-8djh7\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx\" (UID: \"51bbd0d6-f697-4f60-9a43-d94627eae43c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx" Jun 08 21:23:08.550339 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:08.550309 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51bbd0d6-f697-4f60-9a43-d94627eae43c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx\" (UID: \"51bbd0d6-f697-4f60-9a43-d94627eae43c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx" Jun 08 21:23:08.550543 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:08.550349 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcjpv\" (UniqueName: \"kubernetes.io/projected/5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd-kube-api-access-tcjpv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr\" (UID: \"5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr" Jun 08 21:23:08.550587 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:08.550552 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51bbd0d6-f697-4f60-9a43-d94627eae43c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx\" (UID: \"51bbd0d6-f697-4f60-9a43-d94627eae43c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx" Jun 08 21:23:08.550665 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:08.550645 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51bbd0d6-f697-4f60-9a43-d94627eae43c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx\" (UID: \"51bbd0d6-f697-4f60-9a43-d94627eae43c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx" Jun 08 21:23:08.558108 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:08.558060 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8djh7\" (UniqueName: \"kubernetes.io/projected/51bbd0d6-f697-4f60-9a43-d94627eae43c-kube-api-access-8djh7\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx\" (UID: \"51bbd0d6-f697-4f60-9a43-d94627eae43c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx" Jun 08 21:23:08.569889 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:08.569870 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx" Jun 08 21:23:08.651695 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:08.651658 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcjpv\" (UniqueName: \"kubernetes.io/projected/5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd-kube-api-access-tcjpv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr\" (UID: \"5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr" Jun 08 21:23:08.651964 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:08.651734 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr\" (UID: \"5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr" Jun 08 21:23:08.651964 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:08.651779 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr\" (UID: \"5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr" Jun 08 21:23:08.652610 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:08.652445 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr\" (UID: \"5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr" Jun 08 21:23:08.652741 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:08.652702 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr\" (UID: \"5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr" Jun 08 21:23:08.660644 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:08.660616 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcjpv\" (UniqueName: \"kubernetes.io/projected/5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd-kube-api-access-tcjpv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr\" (UID: \"5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr" Jun 08 21:23:08.706831 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:08.706806 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx"] Jun 08 21:23:08.709088 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:23:08.709045 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51bbd0d6_f697_4f60_9a43_d94627eae43c.slice/crio-38c7f35cec2ba5a6ec9a8bda2eb8d76a95f293c6d6b685ffa29dbeaaa8fc0c38 WatchSource:0}: Error finding container 38c7f35cec2ba5a6ec9a8bda2eb8d76a95f293c6d6b685ffa29dbeaaa8fc0c38: Status 404 returned error can't find the container with id 38c7f35cec2ba5a6ec9a8bda2eb8d76a95f293c6d6b685ffa29dbeaaa8fc0c38 Jun 08 21:23:08.765130 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:08.765101 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr" Jun 08 21:23:08.903685 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:08.903661 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr"] Jun 08 21:23:08.905260 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:23:08.905229 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5acbc0e0_c6d4_45b2_b9f2_149b0a4da3bd.slice/crio-2bcfe3a4d5aa6dac1e8389fef33439af7e2470c9885779431f6d3ff376f45323 WatchSource:0}: Error finding container 2bcfe3a4d5aa6dac1e8389fef33439af7e2470c9885779431f6d3ff376f45323: Status 404 returned error can't find the container with id 2bcfe3a4d5aa6dac1e8389fef33439af7e2470c9885779431f6d3ff376f45323 Jun 08 21:23:09.050489 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:09.050460 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw"] Jun 08 21:23:09.054255 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:09.054236 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw" Jun 08 21:23:09.061176 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:09.061115 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw"] Jun 08 21:23:09.062045 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:09.062023 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3da7ddcf-9880-4b7b-b83a-cd9747ddb749-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw\" (UID: \"3da7ddcf-9880-4b7b-b83a-cd9747ddb749\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw" Jun 08 21:23:09.062166 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:09.062095 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3da7ddcf-9880-4b7b-b83a-cd9747ddb749-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw\" (UID: \"3da7ddcf-9880-4b7b-b83a-cd9747ddb749\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw" Jun 08 21:23:09.062215 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:09.062167 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6jps\" (UniqueName: \"kubernetes.io/projected/3da7ddcf-9880-4b7b-b83a-cd9747ddb749-kube-api-access-s6jps\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw\" (UID: \"3da7ddcf-9880-4b7b-b83a-cd9747ddb749\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw" Jun 08 21:23:09.162989 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:09.162952 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3da7ddcf-9880-4b7b-b83a-cd9747ddb749-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw\" (UID: \"3da7ddcf-9880-4b7b-b83a-cd9747ddb749\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw" Jun 08 21:23:09.163199 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:09.163034 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3da7ddcf-9880-4b7b-b83a-cd9747ddb749-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw\" (UID: \"3da7ddcf-9880-4b7b-b83a-cd9747ddb749\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw" Jun 08 21:23:09.163199 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:09.163100 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6jps\" (UniqueName: \"kubernetes.io/projected/3da7ddcf-9880-4b7b-b83a-cd9747ddb749-kube-api-access-s6jps\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw\" (UID: \"3da7ddcf-9880-4b7b-b83a-cd9747ddb749\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw" Jun 08 21:23:09.163409 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:09.163392 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3da7ddcf-9880-4b7b-b83a-cd9747ddb749-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw\" (UID: \"3da7ddcf-9880-4b7b-b83a-cd9747ddb749\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw" Jun 08 21:23:09.163446 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:09.163423 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3da7ddcf-9880-4b7b-b83a-cd9747ddb749-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw\" (UID: \"3da7ddcf-9880-4b7b-b83a-cd9747ddb749\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw" Jun 08 21:23:09.171274 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:09.171242 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6jps\" (UniqueName: \"kubernetes.io/projected/3da7ddcf-9880-4b7b-b83a-cd9747ddb749-kube-api-access-s6jps\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw\" (UID: \"3da7ddcf-9880-4b7b-b83a-cd9747ddb749\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw" Jun 08 21:23:09.398383 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:09.398284 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw" Jun 08 21:23:09.529136 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:09.529097 2564 generic.go:356] "Generic (PLEG): container finished" podID="51bbd0d6-f697-4f60-9a43-d94627eae43c" containerID="25017da46223ed1c24e5ab764a20f788f07b2851c23ccd2baa39e95ffc404382" exitCode=0 Jun 08 21:23:09.529300 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:09.529179 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx" event={"ID":"51bbd0d6-f697-4f60-9a43-d94627eae43c","Type":"ContainerDied","Data":"25017da46223ed1c24e5ab764a20f788f07b2851c23ccd2baa39e95ffc404382"} Jun 08 21:23:09.529300 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:09.529232 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx" event={"ID":"51bbd0d6-f697-4f60-9a43-d94627eae43c","Type":"ContainerStarted","Data":"38c7f35cec2ba5a6ec9a8bda2eb8d76a95f293c6d6b685ffa29dbeaaa8fc0c38"} Jun 08 21:23:09.532100 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:09.531991 2564 generic.go:356] "Generic (PLEG): container finished" podID="5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd" containerID="8208a832595bbfd5af7b80f5706817d4917f174fb859c422bf153397a437f959" exitCode=0 Jun 08 21:23:09.532100 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:09.532047 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr" event={"ID":"5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd","Type":"ContainerDied","Data":"8208a832595bbfd5af7b80f5706817d4917f174fb859c422bf153397a437f959"} Jun 08 21:23:09.532227 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:09.532111 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr" event={"ID":"5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd","Type":"ContainerStarted","Data":"2bcfe3a4d5aa6dac1e8389fef33439af7e2470c9885779431f6d3ff376f45323"} Jun 08 21:23:09.534033 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:09.533977 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw"] Jun 08 21:23:09.536326 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:23:09.536302 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3da7ddcf_9880_4b7b_b83a_cd9747ddb749.slice/crio-de62f600082b01e46318be1278de9e16a0e48c02979b01752dbb2805cd0939ef WatchSource:0}: Error finding container de62f600082b01e46318be1278de9e16a0e48c02979b01752dbb2805cd0939ef: Status 404 returned error can't find the container with id de62f600082b01e46318be1278de9e16a0e48c02979b01752dbb2805cd0939ef Jun 08 21:23:09.718136 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:09.718102 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r"] Jun 08 21:23:09.721677 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:09.721660 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r" Jun 08 21:23:09.730602 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:09.730578 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r"] Jun 08 21:23:09.768223 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:09.768192 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2be4404e-a1ca-4381-8cbe-af3cac581fd1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r\" (UID: \"2be4404e-a1ca-4381-8cbe-af3cac581fd1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r" Jun 08 21:23:09.768389 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:09.768234 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2be4404e-a1ca-4381-8cbe-af3cac581fd1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r\" (UID: \"2be4404e-a1ca-4381-8cbe-af3cac581fd1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r" Jun 08 21:23:09.768389 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:09.768266 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm8qh\" (UniqueName: \"kubernetes.io/projected/2be4404e-a1ca-4381-8cbe-af3cac581fd1-kube-api-access-dm8qh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r\" (UID: \"2be4404e-a1ca-4381-8cbe-af3cac581fd1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r" Jun 08 21:23:09.869467 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:09.869405 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2be4404e-a1ca-4381-8cbe-af3cac581fd1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r\" (UID: \"2be4404e-a1ca-4381-8cbe-af3cac581fd1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r" Jun 08 21:23:09.869467 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:09.869469 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm8qh\" (UniqueName: \"kubernetes.io/projected/2be4404e-a1ca-4381-8cbe-af3cac581fd1-kube-api-access-dm8qh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r\" (UID: \"2be4404e-a1ca-4381-8cbe-af3cac581fd1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r" Jun 08 21:23:09.869699 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:09.869519 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2be4404e-a1ca-4381-8cbe-af3cac581fd1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r\" (UID: \"2be4404e-a1ca-4381-8cbe-af3cac581fd1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r" Jun 08 21:23:09.869832 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:09.869811 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2be4404e-a1ca-4381-8cbe-af3cac581fd1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r\" (UID: \"2be4404e-a1ca-4381-8cbe-af3cac581fd1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r" Jun 08 21:23:09.869879 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:09.869847 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2be4404e-a1ca-4381-8cbe-af3cac581fd1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r\" (UID: \"2be4404e-a1ca-4381-8cbe-af3cac581fd1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r" Jun 08 21:23:09.880197 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:09.880163 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm8qh\" (UniqueName: \"kubernetes.io/projected/2be4404e-a1ca-4381-8cbe-af3cac581fd1-kube-api-access-dm8qh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r\" (UID: \"2be4404e-a1ca-4381-8cbe-af3cac581fd1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r" Jun 08 21:23:10.031624 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:10.031531 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r" Jun 08 21:23:10.169350 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:10.169321 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r"] Jun 08 21:23:10.171365 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:23:10.171338 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2be4404e_a1ca_4381_8cbe_af3cac581fd1.slice/crio-aa9126eff8b2b43b4f1564b7908c23229f1b3265ff8fdb27472ad31303edf5c9 WatchSource:0}: Error finding container aa9126eff8b2b43b4f1564b7908c23229f1b3265ff8fdb27472ad31303edf5c9: Status 404 returned error can't find the container with id aa9126eff8b2b43b4f1564b7908c23229f1b3265ff8fdb27472ad31303edf5c9 Jun 08 21:23:10.539530 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:10.539486 2564 generic.go:356] "Generic (PLEG): container finished" podID="3da7ddcf-9880-4b7b-b83a-cd9747ddb749" containerID="6ae4db9b93daa46491752175458c113a047dcfc05b0cb01be87510fa45ed2b9a" exitCode=0 Jun 08 21:23:10.539917 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:10.539654 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw" event={"ID":"3da7ddcf-9880-4b7b-b83a-cd9747ddb749","Type":"ContainerDied","Data":"6ae4db9b93daa46491752175458c113a047dcfc05b0cb01be87510fa45ed2b9a"} Jun 08 21:23:10.539917 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:10.539707 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw" event={"ID":"3da7ddcf-9880-4b7b-b83a-cd9747ddb749","Type":"ContainerStarted","Data":"de62f600082b01e46318be1278de9e16a0e48c02979b01752dbb2805cd0939ef"} Jun 08 21:23:10.542159 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:10.542133 2564 generic.go:356] "Generic (PLEG): container finished" podID="2be4404e-a1ca-4381-8cbe-af3cac581fd1" containerID="75ac2a43edd61569ed3fd4da638fb454342981721db5d76af6682c207996d7e0" exitCode=0 Jun 08 21:23:10.542265 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:10.542171 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r" event={"ID":"2be4404e-a1ca-4381-8cbe-af3cac581fd1","Type":"ContainerDied","Data":"75ac2a43edd61569ed3fd4da638fb454342981721db5d76af6682c207996d7e0"} Jun 08 21:23:10.542265 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:10.542207 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r" event={"ID":"2be4404e-a1ca-4381-8cbe-af3cac581fd1","Type":"ContainerStarted","Data":"aa9126eff8b2b43b4f1564b7908c23229f1b3265ff8fdb27472ad31303edf5c9"} Jun 08 21:23:11.554380 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:11.554350 2564 generic.go:356] "Generic (PLEG): container finished" podID="5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd" containerID="d77ab30c3b326b848a8ca599625e40344802088b613bfe0a05a9a4fbda6ef26d" exitCode=0 Jun 08 21:23:11.554755 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:11.554431 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr" event={"ID":"5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd","Type":"ContainerDied","Data":"d77ab30c3b326b848a8ca599625e40344802088b613bfe0a05a9a4fbda6ef26d"} Jun 08 21:23:11.556356 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:11.556335 2564 generic.go:356] "Generic (PLEG): container finished" podID="3da7ddcf-9880-4b7b-b83a-cd9747ddb749" containerID="19e52feb03e2d43d3e4f2bfebd3316a8a1722c5a3fe6f2bb76ac4a8a0c266f8f" exitCode=0 Jun 08 21:23:11.556477 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:11.556362 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw" event={"ID":"3da7ddcf-9880-4b7b-b83a-cd9747ddb749","Type":"ContainerDied","Data":"19e52feb03e2d43d3e4f2bfebd3316a8a1722c5a3fe6f2bb76ac4a8a0c266f8f"} Jun 08 21:23:11.558623 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:11.558602 2564 generic.go:356] "Generic (PLEG): container finished" podID="51bbd0d6-f697-4f60-9a43-d94627eae43c" containerID="d6e1bf0c8e3a414acdded4b11146c5c9859497c3daee77714ca552f9d5956fc5" exitCode=0 Jun 08 21:23:11.558714 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:11.558672 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx" event={"ID":"51bbd0d6-f697-4f60-9a43-d94627eae43c","Type":"ContainerDied","Data":"d6e1bf0c8e3a414acdded4b11146c5c9859497c3daee77714ca552f9d5956fc5"} Jun 08 21:23:11.560524 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:11.560505 2564 generic.go:356] "Generic (PLEG): container finished" podID="2be4404e-a1ca-4381-8cbe-af3cac581fd1" containerID="fb42f7b3c2f68ed670375ffadca8adf385466dcb9a2becdd3f572e979ab5b3c1" exitCode=0 Jun 08 21:23:11.560524 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:11.560531 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r" event={"ID":"2be4404e-a1ca-4381-8cbe-af3cac581fd1","Type":"ContainerDied","Data":"fb42f7b3c2f68ed670375ffadca8adf385466dcb9a2becdd3f572e979ab5b3c1"} Jun 08 21:23:12.568083 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:12.568033 2564 generic.go:356] "Generic (PLEG): container finished" podID="3da7ddcf-9880-4b7b-b83a-cd9747ddb749" containerID="144e42cbe0d7cd621effe1e34887539ada5dde096e2d267bb0c0ec15c063b561" exitCode=0 Jun 08 21:23:12.568475 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:12.568115 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw" event={"ID":"3da7ddcf-9880-4b7b-b83a-cd9747ddb749","Type":"ContainerDied","Data":"144e42cbe0d7cd621effe1e34887539ada5dde096e2d267bb0c0ec15c063b561"} Jun 08 21:23:12.570317 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:12.570294 2564 generic.go:356] "Generic (PLEG): container finished" podID="51bbd0d6-f697-4f60-9a43-d94627eae43c" containerID="a740f70ad20e09e345bad55bca2271574a0ab49659118a1f08ad3f19ad8fc55f" exitCode=0 Jun 08 21:23:12.570438 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:12.570361 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx" event={"ID":"51bbd0d6-f697-4f60-9a43-d94627eae43c","Type":"ContainerDied","Data":"a740f70ad20e09e345bad55bca2271574a0ab49659118a1f08ad3f19ad8fc55f"} Jun 08 21:23:12.572433 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:12.572412 2564 generic.go:356] "Generic (PLEG): container finished" podID="2be4404e-a1ca-4381-8cbe-af3cac581fd1" containerID="51e9e4dfc1bda3e8fede1f8ce56a87edea31b2dc40a2fda015979b37ea48beef" exitCode=0 Jun 08 21:23:12.572521 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:12.572482 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r" event={"ID":"2be4404e-a1ca-4381-8cbe-af3cac581fd1","Type":"ContainerDied","Data":"51e9e4dfc1bda3e8fede1f8ce56a87edea31b2dc40a2fda015979b37ea48beef"} Jun 08 21:23:12.574814 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:12.574793 2564 generic.go:356] "Generic (PLEG): container finished" podID="5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd" containerID="b964d914739d9e3fd144bd2620d5dfee748accaea6bba861e4fc3914d350b623" exitCode=0 Jun 08 21:23:12.574919 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:12.574846 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr" event={"ID":"5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd","Type":"ContainerDied","Data":"b964d914739d9e3fd144bd2620d5dfee748accaea6bba861e4fc3914d350b623"} Jun 08 21:23:13.721991 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:13.721960 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw" Jun 08 21:23:13.796315 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:13.796282 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx" Jun 08 21:23:13.799374 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:13.799347 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r" Jun 08 21:23:13.803055 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:13.803031 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr" Jun 08 21:23:13.803256 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:13.803239 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3da7ddcf-9880-4b7b-b83a-cd9747ddb749-util\") pod \"3da7ddcf-9880-4b7b-b83a-cd9747ddb749\" (UID: \"3da7ddcf-9880-4b7b-b83a-cd9747ddb749\") " Jun 08 21:23:13.803302 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:13.803287 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3da7ddcf-9880-4b7b-b83a-cd9747ddb749-bundle\") pod \"3da7ddcf-9880-4b7b-b83a-cd9747ddb749\" (UID: \"3da7ddcf-9880-4b7b-b83a-cd9747ddb749\") " Jun 08 21:23:13.803357 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:13.803346 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6jps\" (UniqueName: \"kubernetes.io/projected/3da7ddcf-9880-4b7b-b83a-cd9747ddb749-kube-api-access-s6jps\") pod \"3da7ddcf-9880-4b7b-b83a-cd9747ddb749\" (UID: \"3da7ddcf-9880-4b7b-b83a-cd9747ddb749\") " Jun 08 21:23:13.803745 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:13.803721 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3da7ddcf-9880-4b7b-b83a-cd9747ddb749-bundle" (OuterVolumeSpecName: "bundle") pod "3da7ddcf-9880-4b7b-b83a-cd9747ddb749" (UID: "3da7ddcf-9880-4b7b-b83a-cd9747ddb749"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:23:13.805503 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:13.805484 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3da7ddcf-9880-4b7b-b83a-cd9747ddb749-kube-api-access-s6jps" (OuterVolumeSpecName: "kube-api-access-s6jps") pod "3da7ddcf-9880-4b7b-b83a-cd9747ddb749" (UID: "3da7ddcf-9880-4b7b-b83a-cd9747ddb749"). InnerVolumeSpecName "kube-api-access-s6jps". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:23:13.810629 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:13.810611 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3da7ddcf-9880-4b7b-b83a-cd9747ddb749-util" (OuterVolumeSpecName: "util") pod "3da7ddcf-9880-4b7b-b83a-cd9747ddb749" (UID: "3da7ddcf-9880-4b7b-b83a-cd9747ddb749"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:23:13.904554 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:13.904472 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dm8qh\" (UniqueName: \"kubernetes.io/projected/2be4404e-a1ca-4381-8cbe-af3cac581fd1-kube-api-access-dm8qh\") pod \"2be4404e-a1ca-4381-8cbe-af3cac581fd1\" (UID: \"2be4404e-a1ca-4381-8cbe-af3cac581fd1\") " Jun 08 21:23:13.904554 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:13.904525 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51bbd0d6-f697-4f60-9a43-d94627eae43c-util\") pod \"51bbd0d6-f697-4f60-9a43-d94627eae43c\" (UID: \"51bbd0d6-f697-4f60-9a43-d94627eae43c\") " Jun 08 21:23:13.904554 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:13.904541 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd-bundle\") pod \"5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd\" (UID: \"5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd\") " Jun 08 21:23:13.904825 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:13.904677 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2be4404e-a1ca-4381-8cbe-af3cac581fd1-bundle\") pod \"2be4404e-a1ca-4381-8cbe-af3cac581fd1\" (UID: \"2be4404e-a1ca-4381-8cbe-af3cac581fd1\") " Jun 08 21:23:13.904825 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:13.904738 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51bbd0d6-f697-4f60-9a43-d94627eae43c-bundle\") pod \"51bbd0d6-f697-4f60-9a43-d94627eae43c\" (UID: \"51bbd0d6-f697-4f60-9a43-d94627eae43c\") " Jun 08 21:23:13.904825 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:13.904773 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcjpv\" (UniqueName: \"kubernetes.io/projected/5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd-kube-api-access-tcjpv\") pod \"5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd\" (UID: \"5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd\") " Jun 08 21:23:13.904825 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:13.904800 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8djh7\" (UniqueName: \"kubernetes.io/projected/51bbd0d6-f697-4f60-9a43-d94627eae43c-kube-api-access-8djh7\") pod \"51bbd0d6-f697-4f60-9a43-d94627eae43c\" (UID: \"51bbd0d6-f697-4f60-9a43-d94627eae43c\") " Jun 08 21:23:13.905032 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:13.904831 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2be4404e-a1ca-4381-8cbe-af3cac581fd1-util\") pod \"2be4404e-a1ca-4381-8cbe-af3cac581fd1\" (UID: \"2be4404e-a1ca-4381-8cbe-af3cac581fd1\") " Jun 08 21:23:13.905032 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:13.904909 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd-util\") pod \"5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd\" (UID: \"5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd\") " Jun 08 21:23:13.905294 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:13.905235 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd-bundle" (OuterVolumeSpecName: "bundle") pod "5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd" (UID: "5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:23:13.905294 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:13.905257 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51bbd0d6-f697-4f60-9a43-d94627eae43c-bundle" (OuterVolumeSpecName: "bundle") pod "51bbd0d6-f697-4f60-9a43-d94627eae43c" (UID: "51bbd0d6-f697-4f60-9a43-d94627eae43c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:23:13.905294 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:13.905243 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3da7ddcf-9880-4b7b-b83a-cd9747ddb749-bundle\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:23:13.905507 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:13.905308 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6jps\" (UniqueName: \"kubernetes.io/projected/3da7ddcf-9880-4b7b-b83a-cd9747ddb749-kube-api-access-s6jps\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:23:13.905507 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:13.905324 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3da7ddcf-9880-4b7b-b83a-cd9747ddb749-util\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:23:13.905815 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:13.905791 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2be4404e-a1ca-4381-8cbe-af3cac581fd1-bundle" (OuterVolumeSpecName: "bundle") pod "2be4404e-a1ca-4381-8cbe-af3cac581fd1" (UID: "2be4404e-a1ca-4381-8cbe-af3cac581fd1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:23:13.907102 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:13.907050 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd-kube-api-access-tcjpv" (OuterVolumeSpecName: "kube-api-access-tcjpv") pod "5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd" (UID: "5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd"). InnerVolumeSpecName "kube-api-access-tcjpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:23:13.907371 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:13.907353 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2be4404e-a1ca-4381-8cbe-af3cac581fd1-kube-api-access-dm8qh" (OuterVolumeSpecName: "kube-api-access-dm8qh") pod "2be4404e-a1ca-4381-8cbe-af3cac581fd1" (UID: "2be4404e-a1ca-4381-8cbe-af3cac581fd1"). InnerVolumeSpecName "kube-api-access-dm8qh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:23:13.907469 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:13.907445 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51bbd0d6-f697-4f60-9a43-d94627eae43c-kube-api-access-8djh7" (OuterVolumeSpecName: "kube-api-access-8djh7") pod "51bbd0d6-f697-4f60-9a43-d94627eae43c" (UID: "51bbd0d6-f697-4f60-9a43-d94627eae43c"). InnerVolumeSpecName "kube-api-access-8djh7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:23:13.911082 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:13.911046 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2be4404e-a1ca-4381-8cbe-af3cac581fd1-util" (OuterVolumeSpecName: "util") pod "2be4404e-a1ca-4381-8cbe-af3cac581fd1" (UID: "2be4404e-a1ca-4381-8cbe-af3cac581fd1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:23:13.911246 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:13.911225 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd-util" (OuterVolumeSpecName: "util") pod "5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd" (UID: "5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:23:13.975769 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:13.975729 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51bbd0d6-f697-4f60-9a43-d94627eae43c-util" (OuterVolumeSpecName: "util") pod "51bbd0d6-f697-4f60-9a43-d94627eae43c" (UID: "51bbd0d6-f697-4f60-9a43-d94627eae43c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:23:14.006036 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:14.006007 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51bbd0d6-f697-4f60-9a43-d94627eae43c-util\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:23:14.006036 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:14.006037 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd-bundle\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:23:14.006208 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:14.006045 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2be4404e-a1ca-4381-8cbe-af3cac581fd1-bundle\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:23:14.006208 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:14.006057 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51bbd0d6-f697-4f60-9a43-d94627eae43c-bundle\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:23:14.006208 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:14.006086 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcjpv\" (UniqueName: \"kubernetes.io/projected/5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd-kube-api-access-tcjpv\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:23:14.006208 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:14.006097 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8djh7\" (UniqueName: \"kubernetes.io/projected/51bbd0d6-f697-4f60-9a43-d94627eae43c-kube-api-access-8djh7\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:23:14.006208 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:14.006106 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2be4404e-a1ca-4381-8cbe-af3cac581fd1-util\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:23:14.006208 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:14.006113 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd-util\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:23:14.006208 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:14.006121 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dm8qh\" (UniqueName: \"kubernetes.io/projected/2be4404e-a1ca-4381-8cbe-af3cac581fd1-kube-api-access-dm8qh\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:23:14.587926 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:14.587898 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw" Jun 08 21:23:14.588115 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:14.587934 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw" event={"ID":"3da7ddcf-9880-4b7b-b83a-cd9747ddb749","Type":"ContainerDied","Data":"de62f600082b01e46318be1278de9e16a0e48c02979b01752dbb2805cd0939ef"} Jun 08 21:23:14.588115 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:14.588017 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de62f600082b01e46318be1278de9e16a0e48c02979b01752dbb2805cd0939ef" Jun 08 21:23:14.589981 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:14.589954 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx" event={"ID":"51bbd0d6-f697-4f60-9a43-d94627eae43c","Type":"ContainerDied","Data":"38c7f35cec2ba5a6ec9a8bda2eb8d76a95f293c6d6b685ffa29dbeaaa8fc0c38"} Jun 08 21:23:14.590140 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:14.589999 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="38c7f35cec2ba5a6ec9a8bda2eb8d76a95f293c6d6b685ffa29dbeaaa8fc0c38" Jun 08 21:23:14.590140 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:14.589998 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx" Jun 08 21:23:14.592233 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:14.592209 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r" Jun 08 21:23:14.592430 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:14.592248 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r" event={"ID":"2be4404e-a1ca-4381-8cbe-af3cac581fd1","Type":"ContainerDied","Data":"aa9126eff8b2b43b4f1564b7908c23229f1b3265ff8fdb27472ad31303edf5c9"} Jun 08 21:23:14.592430 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:14.592280 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa9126eff8b2b43b4f1564b7908c23229f1b3265ff8fdb27472ad31303edf5c9" Jun 08 21:23:14.594445 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:14.594422 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr" event={"ID":"5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd","Type":"ContainerDied","Data":"2bcfe3a4d5aa6dac1e8389fef33439af7e2470c9885779431f6d3ff376f45323"} Jun 08 21:23:14.594581 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:14.594466 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2bcfe3a4d5aa6dac1e8389fef33439af7e2470c9885779431f6d3ff376f45323" Jun 08 21:23:14.594637 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:14.594596 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr" Jun 08 21:23:24.491937 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.491895 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-529lw"] Jun 08 21:23:24.492307 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.492268 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2be4404e-a1ca-4381-8cbe-af3cac581fd1" containerName="pull" Jun 08 21:23:24.492307 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.492283 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2be4404e-a1ca-4381-8cbe-af3cac581fd1" containerName="pull" Jun 08 21:23:24.492307 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.492299 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51bbd0d6-f697-4f60-9a43-d94627eae43c" containerName="pull" Jun 08 21:23:24.492307 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.492306 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="51bbd0d6-f697-4f60-9a43-d94627eae43c" containerName="pull" Jun 08 21:23:24.492441 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.492317 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2be4404e-a1ca-4381-8cbe-af3cac581fd1" containerName="extract" Jun 08 21:23:24.492441 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.492326 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2be4404e-a1ca-4381-8cbe-af3cac581fd1" containerName="extract" Jun 08 21:23:24.492441 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.492333 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd" containerName="pull" Jun 08 21:23:24.492441 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.492338 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd" containerName="pull" Jun 08 21:23:24.492441 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.492347 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd" containerName="extract" Jun 08 21:23:24.492441 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.492352 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd" containerName="extract" Jun 08 21:23:24.492441 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.492357 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51bbd0d6-f697-4f60-9a43-d94627eae43c" containerName="extract" Jun 08 21:23:24.492441 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.492362 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="51bbd0d6-f697-4f60-9a43-d94627eae43c" containerName="extract" Jun 08 21:23:24.492441 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.492368 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3da7ddcf-9880-4b7b-b83a-cd9747ddb749" containerName="extract" Jun 08 21:23:24.492441 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.492374 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3da7ddcf-9880-4b7b-b83a-cd9747ddb749" containerName="extract" Jun 08 21:23:24.492441 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.492384 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3da7ddcf-9880-4b7b-b83a-cd9747ddb749" containerName="util" Jun 08 21:23:24.492441 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.492389 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3da7ddcf-9880-4b7b-b83a-cd9747ddb749" containerName="util" Jun 08 21:23:24.492441 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.492395 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd" containerName="util" Jun 08 21:23:24.492441 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.492400 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd" containerName="util" Jun 08 21:23:24.492441 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.492411 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51bbd0d6-f697-4f60-9a43-d94627eae43c" containerName="util" Jun 08 21:23:24.492441 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.492418 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="51bbd0d6-f697-4f60-9a43-d94627eae43c" containerName="util" Jun 08 21:23:24.492441 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.492426 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2be4404e-a1ca-4381-8cbe-af3cac581fd1" containerName="util" Jun 08 21:23:24.492441 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.492434 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2be4404e-a1ca-4381-8cbe-af3cac581fd1" containerName="util" Jun 08 21:23:24.492441 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.492443 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3da7ddcf-9880-4b7b-b83a-cd9747ddb749" containerName="pull" Jun 08 21:23:24.492951 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.492450 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3da7ddcf-9880-4b7b-b83a-cd9747ddb749" containerName="pull" Jun 08 21:23:24.492951 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.492505 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd" containerName="extract" Jun 08 21:23:24.492951 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.492513 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2be4404e-a1ca-4381-8cbe-af3cac581fd1" containerName="extract" Jun 08 21:23:24.492951 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.492522 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3da7ddcf-9880-4b7b-b83a-cd9747ddb749" containerName="extract" Jun 08 21:23:24.492951 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.492528 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="51bbd0d6-f697-4f60-9a43-d94627eae43c" containerName="extract" Jun 08 21:23:24.500184 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.500162 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-529lw" Jun 08 21:23:24.503166 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.503134 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 08 21:23:24.503299 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.503282 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-c7gg7\"" Jun 08 21:23:24.514192 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.514166 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-529lw"] Jun 08 21:23:24.592899 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.592864 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbbv4\" (UniqueName: \"kubernetes.io/projected/9bd998de-0179-4e5d-8e43-3ca2d052de08-kube-api-access-xbbv4\") pod \"dns-operator-controller-manager-864dd78c4c-529lw\" (UID: \"9bd998de-0179-4e5d-8e43-3ca2d052de08\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-529lw" Jun 08 21:23:24.693395 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.693357 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbbv4\" (UniqueName: \"kubernetes.io/projected/9bd998de-0179-4e5d-8e43-3ca2d052de08-kube-api-access-xbbv4\") pod \"dns-operator-controller-manager-864dd78c4c-529lw\" (UID: \"9bd998de-0179-4e5d-8e43-3ca2d052de08\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-529lw" Jun 08 21:23:24.704374 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.704348 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbbv4\" (UniqueName: \"kubernetes.io/projected/9bd998de-0179-4e5d-8e43-3ca2d052de08-kube-api-access-xbbv4\") pod \"dns-operator-controller-manager-864dd78c4c-529lw\" (UID: \"9bd998de-0179-4e5d-8e43-3ca2d052de08\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-529lw" Jun 08 21:23:24.815455 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.815421 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-529lw" Jun 08 21:23:24.949055 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:24.949026 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-529lw"] Jun 08 21:23:24.951268 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:23:24.951230 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bd998de_0179_4e5d_8e43_3ca2d052de08.slice/crio-730902acba5e144a9d3b27c87df98c4203f34547f13ddb426930da915a2f6571 WatchSource:0}: Error finding container 730902acba5e144a9d3b27c87df98c4203f34547f13ddb426930da915a2f6571: Status 404 returned error can't find the container with id 730902acba5e144a9d3b27c87df98c4203f34547f13ddb426930da915a2f6571 Jun 08 21:23:25.654442 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:25.654409 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-529lw" event={"ID":"9bd998de-0179-4e5d-8e43-3ca2d052de08","Type":"ContainerStarted","Data":"730902acba5e144a9d3b27c87df98c4203f34547f13ddb426930da915a2f6571"} Jun 08 21:23:27.668524 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:27.668474 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-529lw" event={"ID":"9bd998de-0179-4e5d-8e43-3ca2d052de08","Type":"ContainerStarted","Data":"6c2be90951e9044f66ef8b88acc9a2fbc65c66232128516a24126967ef6ecab7"} Jun 08 21:23:27.668895 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:27.668549 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-529lw" Jun 08 21:23:27.691351 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:27.691292 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-529lw" podStartSLOduration=1.191941522 podStartE2EDuration="3.691276613s" totalImagesPullingTime="2.499335091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:23:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:23:27.688146483 +0000 UTC m=+579.828189365" watchObservedRunningTime="2026-06-08 21:23:27.691276613 +0000 UTC m=+579.831319493" Jun 08 21:23:29.913511 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:29.913475 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-bnl2z"] Jun 08 21:23:29.917574 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:29.917552 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bnl2z" Jun 08 21:23:29.921194 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:29.921164 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-2778f\"" Jun 08 21:23:29.941119 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:29.941081 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-bnl2z"] Jun 08 21:23:30.041910 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:30.041869 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hf8n\" (UniqueName: \"kubernetes.io/projected/c3900765-8ae5-4915-8eb3-2ee7ff12e132-kube-api-access-8hf8n\") pod \"authorino-operator-75cc8d5cb7-bnl2z\" (UID: \"c3900765-8ae5-4915-8eb3-2ee7ff12e132\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-bnl2z" Jun 08 21:23:30.143230 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:30.143189 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hf8n\" (UniqueName: \"kubernetes.io/projected/c3900765-8ae5-4915-8eb3-2ee7ff12e132-kube-api-access-8hf8n\") pod \"authorino-operator-75cc8d5cb7-bnl2z\" (UID: \"c3900765-8ae5-4915-8eb3-2ee7ff12e132\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-bnl2z" Jun 08 21:23:30.164681 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:30.164609 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hf8n\" (UniqueName: \"kubernetes.io/projected/c3900765-8ae5-4915-8eb3-2ee7ff12e132-kube-api-access-8hf8n\") pod \"authorino-operator-75cc8d5cb7-bnl2z\" (UID: \"c3900765-8ae5-4915-8eb3-2ee7ff12e132\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-bnl2z" Jun 08 21:23:30.234521 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:30.234483 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bnl2z" Jun 08 21:23:30.376264 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:30.376239 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-bnl2z"] Jun 08 21:23:30.377954 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:23:30.377924 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3900765_8ae5_4915_8eb3_2ee7ff12e132.slice/crio-a79e39001c9ac9830f77a3ddef0c56182251c99122a6266f89194a3911911fb3 WatchSource:0}: Error finding container a79e39001c9ac9830f77a3ddef0c56182251c99122a6266f89194a3911911fb3: Status 404 returned error can't find the container with id a79e39001c9ac9830f77a3ddef0c56182251c99122a6266f89194a3911911fb3 Jun 08 21:23:30.686178 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:30.686143 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bnl2z" event={"ID":"c3900765-8ae5-4915-8eb3-2ee7ff12e132","Type":"ContainerStarted","Data":"a79e39001c9ac9830f77a3ddef0c56182251c99122a6266f89194a3911911fb3"} Jun 08 21:23:33.706249 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:33.706211 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bnl2z" event={"ID":"c3900765-8ae5-4915-8eb3-2ee7ff12e132","Type":"ContainerStarted","Data":"4bfb5ebc62aea66526a98195e3084e15b4ac4b096a246d64fa7758346bfc0179"} Jun 08 21:23:33.706739 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:33.706268 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bnl2z" Jun 08 21:23:33.725892 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:33.725842 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bnl2z" podStartSLOduration=2.437399692 podStartE2EDuration="4.725824386s" totalImagesPullingTime="2.288424694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:23:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:23:33.724375797 +0000 UTC m=+585.864418678" watchObservedRunningTime="2026-06-08 21:23:33.725824386 +0000 UTC m=+585.865867267" Jun 08 21:23:38.676304 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:38.676275 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-529lw" Jun 08 21:23:44.713151 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:44.713120 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bnl2z" Jun 08 21:23:46.246833 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:46.246800 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-k4svn"] Jun 08 21:23:46.251794 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:46.251775 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k4svn" Jun 08 21:23:46.254521 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:46.254498 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4nj2l\"" Jun 08 21:23:46.254521 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:46.254513 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 08 21:23:46.254521 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:46.254587 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 08 21:23:46.258582 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:46.258557 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-k4svn"] Jun 08 21:23:46.394977 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:46.394936 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69vbq\" (UniqueName: \"kubernetes.io/projected/237b1843-7e73-4117-b658-bf1ca4cd0e25-kube-api-access-69vbq\") pod \"kuadrant-console-plugin-66b5774985-k4svn\" (UID: \"237b1843-7e73-4117-b658-bf1ca4cd0e25\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k4svn" Jun 08 21:23:46.395193 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:46.394995 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/237b1843-7e73-4117-b658-bf1ca4cd0e25-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-k4svn\" (UID: \"237b1843-7e73-4117-b658-bf1ca4cd0e25\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k4svn" Jun 08 21:23:46.395193 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:46.395108 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/237b1843-7e73-4117-b658-bf1ca4cd0e25-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-k4svn\" (UID: \"237b1843-7e73-4117-b658-bf1ca4cd0e25\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k4svn" Jun 08 21:23:46.495952 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:46.495912 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/237b1843-7e73-4117-b658-bf1ca4cd0e25-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-k4svn\" (UID: \"237b1843-7e73-4117-b658-bf1ca4cd0e25\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k4svn" Jun 08 21:23:46.496138 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:46.495978 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69vbq\" (UniqueName: \"kubernetes.io/projected/237b1843-7e73-4117-b658-bf1ca4cd0e25-kube-api-access-69vbq\") pod \"kuadrant-console-plugin-66b5774985-k4svn\" (UID: \"237b1843-7e73-4117-b658-bf1ca4cd0e25\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k4svn" Jun 08 21:23:46.496138 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:46.496010 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/237b1843-7e73-4117-b658-bf1ca4cd0e25-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-k4svn\" (UID: \"237b1843-7e73-4117-b658-bf1ca4cd0e25\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k4svn" Jun 08 21:23:46.496631 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:46.496607 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/237b1843-7e73-4117-b658-bf1ca4cd0e25-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-k4svn\" (UID: \"237b1843-7e73-4117-b658-bf1ca4cd0e25\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k4svn" Jun 08 21:23:46.498567 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:46.498510 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/237b1843-7e73-4117-b658-bf1ca4cd0e25-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-k4svn\" (UID: \"237b1843-7e73-4117-b658-bf1ca4cd0e25\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k4svn" Jun 08 21:23:46.504917 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:46.504891 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69vbq\" (UniqueName: \"kubernetes.io/projected/237b1843-7e73-4117-b658-bf1ca4cd0e25-kube-api-access-69vbq\") pod \"kuadrant-console-plugin-66b5774985-k4svn\" (UID: \"237b1843-7e73-4117-b658-bf1ca4cd0e25\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k4svn" Jun 08 21:23:46.563625 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:46.563593 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k4svn" Jun 08 21:23:46.700854 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:46.700832 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-k4svn"] Jun 08 21:23:46.702723 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:23:46.702696 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod237b1843_7e73_4117_b658_bf1ca4cd0e25.slice/crio-857679e50689205b28aca37fb8ad9d4b18bfcea91a868188cdea4e8038a4db09 WatchSource:0}: Error finding container 857679e50689205b28aca37fb8ad9d4b18bfcea91a868188cdea4e8038a4db09: Status 404 returned error can't find the container with id 857679e50689205b28aca37fb8ad9d4b18bfcea91a868188cdea4e8038a4db09 Jun 08 21:23:46.775666 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:46.775587 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k4svn" event={"ID":"237b1843-7e73-4117-b658-bf1ca4cd0e25","Type":"ContainerStarted","Data":"857679e50689205b28aca37fb8ad9d4b18bfcea91a868188cdea4e8038a4db09"} Jun 08 21:23:55.641838 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:55.641753 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6xm6"] Jun 08 21:23:55.645442 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:55.645414 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6xm6" Jun 08 21:23:55.648804 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:55.648720 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-k2m4z\"" Jun 08 21:23:55.672245 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:55.672217 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6xm6"] Jun 08 21:23:55.782816 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:55.782783 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ce1884d-b052-49f7-8332-4586948add70-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-m6xm6\" (UID: \"0ce1884d-b052-49f7-8332-4586948add70\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6xm6" Jun 08 21:23:55.782992 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:55.782867 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55w8d\" (UniqueName: \"kubernetes.io/projected/0ce1884d-b052-49f7-8332-4586948add70-kube-api-access-55w8d\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-m6xm6\" (UID: \"0ce1884d-b052-49f7-8332-4586948add70\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6xm6" Jun 08 21:23:55.883589 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:55.883553 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55w8d\" (UniqueName: \"kubernetes.io/projected/0ce1884d-b052-49f7-8332-4586948add70-kube-api-access-55w8d\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-m6xm6\" (UID: \"0ce1884d-b052-49f7-8332-4586948add70\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6xm6" Jun 08 21:23:55.883754 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:55.883672 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ce1884d-b052-49f7-8332-4586948add70-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-m6xm6\" (UID: \"0ce1884d-b052-49f7-8332-4586948add70\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6xm6" Jun 08 21:23:55.884166 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:55.884139 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ce1884d-b052-49f7-8332-4586948add70-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-m6xm6\" (UID: \"0ce1884d-b052-49f7-8332-4586948add70\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6xm6" Jun 08 21:23:55.893060 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:55.892995 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55w8d\" (UniqueName: \"kubernetes.io/projected/0ce1884d-b052-49f7-8332-4586948add70-kube-api-access-55w8d\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-m6xm6\" (UID: \"0ce1884d-b052-49f7-8332-4586948add70\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6xm6" Jun 08 21:23:55.957492 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:55.957461 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6xm6" Jun 08 21:23:56.112531 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:56.112506 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6xm6"] Jun 08 21:23:56.114215 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:23:56.114188 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ce1884d_b052_49f7_8332_4586948add70.slice/crio-d43aa8fa39fd13fcdc817ee16cca0f4b0c3d58e771372e1547d718b11e696c6b WatchSource:0}: Error finding container d43aa8fa39fd13fcdc817ee16cca0f4b0c3d58e771372e1547d718b11e696c6b: Status 404 returned error can't find the container with id d43aa8fa39fd13fcdc817ee16cca0f4b0c3d58e771372e1547d718b11e696c6b Jun 08 21:23:56.317753 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:56.317723 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6xm6"] Jun 08 21:23:56.324847 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:56.324814 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6xm6"] Jun 08 21:23:56.354695 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:56.354666 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s47jb"] Jun 08 21:23:56.365097 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:56.365049 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s47jb"] Jun 08 21:23:56.365260 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:56.365179 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s47jb" Jun 08 21:23:56.389890 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:56.389859 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm9mh\" (UniqueName: \"kubernetes.io/projected/2b4c1cb4-e968-4d38-8821-3b8a0a36df2d-kube-api-access-lm9mh\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-s47jb\" (UID: \"2b4c1cb4-e968-4d38-8821-3b8a0a36df2d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s47jb" Jun 08 21:23:56.390022 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:56.389951 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b4c1cb4-e968-4d38-8821-3b8a0a36df2d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-s47jb\" (UID: \"2b4c1cb4-e968-4d38-8821-3b8a0a36df2d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s47jb" Jun 08 21:23:56.490481 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:56.490444 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm9mh\" (UniqueName: \"kubernetes.io/projected/2b4c1cb4-e968-4d38-8821-3b8a0a36df2d-kube-api-access-lm9mh\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-s47jb\" (UID: \"2b4c1cb4-e968-4d38-8821-3b8a0a36df2d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s47jb" Jun 08 21:23:56.490672 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:56.490542 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b4c1cb4-e968-4d38-8821-3b8a0a36df2d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-s47jb\" (UID: \"2b4c1cb4-e968-4d38-8821-3b8a0a36df2d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s47jb" Jun 08 21:23:56.490907 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:56.490887 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b4c1cb4-e968-4d38-8821-3b8a0a36df2d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-s47jb\" (UID: \"2b4c1cb4-e968-4d38-8821-3b8a0a36df2d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s47jb" Jun 08 21:23:56.502924 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:56.502897 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm9mh\" (UniqueName: \"kubernetes.io/projected/2b4c1cb4-e968-4d38-8821-3b8a0a36df2d-kube-api-access-lm9mh\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-s47jb\" (UID: \"2b4c1cb4-e968-4d38-8821-3b8a0a36df2d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s47jb" Jun 08 21:23:56.677220 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:56.677135 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s47jb" Jun 08 21:23:56.855478 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:23:56.855442 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s47jb"] Jun 08 21:24:11.286191 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:24:11.286141 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b4c1cb4_e968_4d38_8821_3b8a0a36df2d.slice/crio-7ac318bd52dff4eefd9ec83f38dc386a143334d9ad81541e6289a158580203bb WatchSource:0}: Error finding container 7ac318bd52dff4eefd9ec83f38dc386a143334d9ad81541e6289a158580203bb: Status 404 returned error can't find the container with id 7ac318bd52dff4eefd9ec83f38dc386a143334d9ad81541e6289a158580203bb Jun 08 21:24:11.932923 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:11.932879 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s47jb" event={"ID":"2b4c1cb4-e968-4d38-8821-3b8a0a36df2d","Type":"ContainerStarted","Data":"7ac318bd52dff4eefd9ec83f38dc386a143334d9ad81541e6289a158580203bb"} Jun 08 21:24:12.941853 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:12.941812 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s47jb" event={"ID":"2b4c1cb4-e968-4d38-8821-3b8a0a36df2d","Type":"ContainerStarted","Data":"7c63e7ba8becca0e4aea40a053552673955c4c281fe38ff00ee2a0864104a578"} Jun 08 21:24:12.942355 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:12.941909 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s47jb" Jun 08 21:24:12.943409 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:12.943385 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k4svn" event={"ID":"237b1843-7e73-4117-b658-bf1ca4cd0e25","Type":"ContainerStarted","Data":"75e32c8bca59620c3b374d94014b4f6dde95f6c0746b5d65efc0c47961de2bcd"} Jun 08 21:24:12.945172 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:12.945151 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6xm6" podUID="0ce1884d-b052-49f7-8332-4586948add70" containerName="manager" containerID="cri-o://3123c30fd712034fa0823aa747921135af691b3d7218a66fb84699e3a2b57e4c" gracePeriod=2 Jun 08 21:24:12.967269 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:12.967215 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s47jb" podStartSLOduration=15.72925945 podStartE2EDuration="16.967196251s" totalImagesPullingTime="1.237936801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:23:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:24:12.96493001 +0000 UTC m=+625.104972893" watchObservedRunningTime="2026-06-08 21:24:12.967196251 +0000 UTC m=+625.107239134" Jun 08 21:24:12.984363 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:12.984317 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k4svn" podStartSLOduration=1.142406232 podStartE2EDuration="26.98430155s" totalImagesPullingTime="25.841895318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:23:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:24:12.982646534 +0000 UTC m=+625.122689414" watchObservedRunningTime="2026-06-08 21:24:12.98430155 +0000 UTC m=+625.124344483" Jun 08 21:24:12.985043 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:24:12.985018 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-m6xm6\" is forbidden: User \"system:node:ip-10-0-135-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-79.ec2.internal' and this object" podUID="0ce1884d-b052-49f7-8332-4586948add70" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6xm6" Jun 08 21:24:13.178981 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:13.178956 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6xm6" Jun 08 21:24:13.181563 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:24:13.181538 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-m6xm6\" is forbidden: User \"system:node:ip-10-0-135-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-79.ec2.internal' and this object" podUID="0ce1884d-b052-49f7-8332-4586948add70" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6xm6" Jun 08 21:24:13.251904 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:13.251806 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ce1884d-b052-49f7-8332-4586948add70-extensions-socket-volume\") pod \"0ce1884d-b052-49f7-8332-4586948add70\" (UID: \"0ce1884d-b052-49f7-8332-4586948add70\") " Jun 08 21:24:13.251904 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:13.251856 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55w8d\" (UniqueName: \"kubernetes.io/projected/0ce1884d-b052-49f7-8332-4586948add70-kube-api-access-55w8d\") pod \"0ce1884d-b052-49f7-8332-4586948add70\" (UID: \"0ce1884d-b052-49f7-8332-4586948add70\") " Jun 08 21:24:13.252197 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:13.252169 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ce1884d-b052-49f7-8332-4586948add70-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0ce1884d-b052-49f7-8332-4586948add70" (UID: "0ce1884d-b052-49f7-8332-4586948add70"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:24:13.254181 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:13.254159 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ce1884d-b052-49f7-8332-4586948add70-kube-api-access-55w8d" (OuterVolumeSpecName: "kube-api-access-55w8d") pod "0ce1884d-b052-49f7-8332-4586948add70" (UID: "0ce1884d-b052-49f7-8332-4586948add70"). InnerVolumeSpecName "kube-api-access-55w8d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:24:13.352602 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:13.352565 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ce1884d-b052-49f7-8332-4586948add70-extensions-socket-volume\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:24:13.352602 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:13.352599 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55w8d\" (UniqueName: \"kubernetes.io/projected/0ce1884d-b052-49f7-8332-4586948add70-kube-api-access-55w8d\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:24:13.951299 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:13.951209 2564 generic.go:356] "Generic (PLEG): container finished" podID="0ce1884d-b052-49f7-8332-4586948add70" containerID="3123c30fd712034fa0823aa747921135af691b3d7218a66fb84699e3a2b57e4c" exitCode=2 Jun 08 21:24:13.951299 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:13.951264 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6xm6" Jun 08 21:24:13.951758 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:13.951311 2564 scope.go:117] "RemoveContainer" containerID="3123c30fd712034fa0823aa747921135af691b3d7218a66fb84699e3a2b57e4c" Jun 08 21:24:13.953899 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:24:13.953873 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-m6xm6\" is forbidden: User \"system:node:ip-10-0-135-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-79.ec2.internal' and this object" podUID="0ce1884d-b052-49f7-8332-4586948add70" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6xm6" Jun 08 21:24:13.962518 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:13.962181 2564 scope.go:117] "RemoveContainer" containerID="3123c30fd712034fa0823aa747921135af691b3d7218a66fb84699e3a2b57e4c" Jun 08 21:24:13.963769 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:24:13.963743 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3123c30fd712034fa0823aa747921135af691b3d7218a66fb84699e3a2b57e4c\": container with ID starting with 3123c30fd712034fa0823aa747921135af691b3d7218a66fb84699e3a2b57e4c not found: ID does not exist" containerID="3123c30fd712034fa0823aa747921135af691b3d7218a66fb84699e3a2b57e4c" Jun 08 21:24:13.963873 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:13.963805 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3123c30fd712034fa0823aa747921135af691b3d7218a66fb84699e3a2b57e4c"} err="failed to get container status \"3123c30fd712034fa0823aa747921135af691b3d7218a66fb84699e3a2b57e4c\": rpc error: code = NotFound desc = could not find container \"3123c30fd712034fa0823aa747921135af691b3d7218a66fb84699e3a2b57e4c\": container with ID starting with 3123c30fd712034fa0823aa747921135af691b3d7218a66fb84699e3a2b57e4c not found: ID does not exist" Jun 08 21:24:13.965533 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:24:13.965500 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-m6xm6\" is forbidden: User \"system:node:ip-10-0-135-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-79.ec2.internal' and this object" podUID="0ce1884d-b052-49f7-8332-4586948add70" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m6xm6" Jun 08 21:24:14.350123 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:14.350089 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ce1884d-b052-49f7-8332-4586948add70" path="/var/lib/kubelet/pods/0ce1884d-b052-49f7-8332-4586948add70/volumes" Jun 08 21:24:23.953466 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:23.953428 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s47jb" Jun 08 21:24:35.903366 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:35.903327 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s47jb"] Jun 08 21:24:35.903862 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:35.903548 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s47jb" podUID="2b4c1cb4-e968-4d38-8821-3b8a0a36df2d" containerName="manager" containerID="cri-o://7c63e7ba8becca0e4aea40a053552673955c4c281fe38ff00ee2a0864104a578" gracePeriod=10 Jun 08 21:24:36.083946 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:36.083917 2564 generic.go:356] "Generic (PLEG): container finished" podID="2b4c1cb4-e968-4d38-8821-3b8a0a36df2d" containerID="7c63e7ba8becca0e4aea40a053552673955c4c281fe38ff00ee2a0864104a578" exitCode=0 Jun 08 21:24:36.084239 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:36.083988 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s47jb" event={"ID":"2b4c1cb4-e968-4d38-8821-3b8a0a36df2d","Type":"ContainerDied","Data":"7c63e7ba8becca0e4aea40a053552673955c4c281fe38ff00ee2a0864104a578"} Jun 08 21:24:36.145815 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:36.145790 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s47jb" Jun 08 21:24:36.259088 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:36.258963 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lm9mh\" (UniqueName: \"kubernetes.io/projected/2b4c1cb4-e968-4d38-8821-3b8a0a36df2d-kube-api-access-lm9mh\") pod \"2b4c1cb4-e968-4d38-8821-3b8a0a36df2d\" (UID: \"2b4c1cb4-e968-4d38-8821-3b8a0a36df2d\") " Jun 08 21:24:36.259088 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:36.259023 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b4c1cb4-e968-4d38-8821-3b8a0a36df2d-extensions-socket-volume\") pod \"2b4c1cb4-e968-4d38-8821-3b8a0a36df2d\" (UID: \"2b4c1cb4-e968-4d38-8821-3b8a0a36df2d\") " Jun 08 21:24:36.259587 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:36.259559 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b4c1cb4-e968-4d38-8821-3b8a0a36df2d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2b4c1cb4-e968-4d38-8821-3b8a0a36df2d" (UID: "2b4c1cb4-e968-4d38-8821-3b8a0a36df2d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:24:36.261286 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:36.261265 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b4c1cb4-e968-4d38-8821-3b8a0a36df2d-kube-api-access-lm9mh" (OuterVolumeSpecName: "kube-api-access-lm9mh") pod "2b4c1cb4-e968-4d38-8821-3b8a0a36df2d" (UID: "2b4c1cb4-e968-4d38-8821-3b8a0a36df2d"). InnerVolumeSpecName "kube-api-access-lm9mh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:24:36.360144 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:36.360119 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lm9mh\" (UniqueName: \"kubernetes.io/projected/2b4c1cb4-e968-4d38-8821-3b8a0a36df2d-kube-api-access-lm9mh\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:24:36.360144 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:36.360144 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b4c1cb4-e968-4d38-8821-3b8a0a36df2d-extensions-socket-volume\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:24:37.091287 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:37.091258 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s47jb" Jun 08 21:24:37.091722 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:37.091293 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s47jb" event={"ID":"2b4c1cb4-e968-4d38-8821-3b8a0a36df2d","Type":"ContainerDied","Data":"7ac318bd52dff4eefd9ec83f38dc386a143334d9ad81541e6289a158580203bb"} Jun 08 21:24:37.091722 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:37.091360 2564 scope.go:117] "RemoveContainer" containerID="7c63e7ba8becca0e4aea40a053552673955c4c281fe38ff00ee2a0864104a578" Jun 08 21:24:37.112178 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:37.112147 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s47jb"] Jun 08 21:24:37.115735 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:37.115711 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s47jb"] Jun 08 21:24:38.352932 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:38.352901 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b4c1cb4-e968-4d38-8821-3b8a0a36df2d" path="/var/lib/kubelet/pods/2b4c1cb4-e968-4d38-8821-3b8a0a36df2d/volumes" Jun 08 21:24:40.218384 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.218340 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4"] Jun 08 21:24:40.218879 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.218804 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b4c1cb4-e968-4d38-8821-3b8a0a36df2d" containerName="manager" Jun 08 21:24:40.218879 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.218822 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b4c1cb4-e968-4d38-8821-3b8a0a36df2d" containerName="manager" Jun 08 21:24:40.218879 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.218839 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ce1884d-b052-49f7-8332-4586948add70" containerName="manager" Jun 08 21:24:40.218879 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.218849 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ce1884d-b052-49f7-8332-4586948add70" containerName="manager" Jun 08 21:24:40.219029 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.218912 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ce1884d-b052-49f7-8332-4586948add70" containerName="manager" Jun 08 21:24:40.219029 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.218922 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b4c1cb4-e968-4d38-8821-3b8a0a36df2d" containerName="manager" Jun 08 21:24:40.223464 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.223442 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:24:40.226047 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.226022 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-nl5bn\"" Jun 08 21:24:40.235175 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.235150 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4"] Jun 08 21:24:40.287919 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.287883 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59bfb807-f104-4ea0-a062-5c4e7ba6e24a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-64bd4\" (UID: \"59bfb807-f104-4ea0-a062-5c4e7ba6e24a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:24:40.288122 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.287937 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59bfb807-f104-4ea0-a062-5c4e7ba6e24a-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-64bd4\" (UID: \"59bfb807-f104-4ea0-a062-5c4e7ba6e24a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:24:40.288122 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.287963 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59bfb807-f104-4ea0-a062-5c4e7ba6e24a-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-64bd4\" (UID: \"59bfb807-f104-4ea0-a062-5c4e7ba6e24a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:24:40.288122 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.288004 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59bfb807-f104-4ea0-a062-5c4e7ba6e24a-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-64bd4\" (UID: \"59bfb807-f104-4ea0-a062-5c4e7ba6e24a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:24:40.288122 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.288031 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59bfb807-f104-4ea0-a062-5c4e7ba6e24a-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-64bd4\" (UID: \"59bfb807-f104-4ea0-a062-5c4e7ba6e24a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:24:40.288378 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.288148 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59bfb807-f104-4ea0-a062-5c4e7ba6e24a-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-64bd4\" (UID: \"59bfb807-f104-4ea0-a062-5c4e7ba6e24a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:24:40.288378 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.288174 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59bfb807-f104-4ea0-a062-5c4e7ba6e24a-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-64bd4\" (UID: \"59bfb807-f104-4ea0-a062-5c4e7ba6e24a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:24:40.288378 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.288198 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59bfb807-f104-4ea0-a062-5c4e7ba6e24a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-64bd4\" (UID: \"59bfb807-f104-4ea0-a062-5c4e7ba6e24a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:24:40.288378 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.288230 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcdzw\" (UniqueName: \"kubernetes.io/projected/59bfb807-f104-4ea0-a062-5c4e7ba6e24a-kube-api-access-bcdzw\") pod \"maas-default-gateway-openshift-default-8559cd5744-64bd4\" (UID: \"59bfb807-f104-4ea0-a062-5c4e7ba6e24a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:24:40.389377 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.389351 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59bfb807-f104-4ea0-a062-5c4e7ba6e24a-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-64bd4\" (UID: \"59bfb807-f104-4ea0-a062-5c4e7ba6e24a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:24:40.389377 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.389381 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59bfb807-f104-4ea0-a062-5c4e7ba6e24a-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-64bd4\" (UID: \"59bfb807-f104-4ea0-a062-5c4e7ba6e24a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:24:40.389628 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.389401 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59bfb807-f104-4ea0-a062-5c4e7ba6e24a-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-64bd4\" (UID: \"59bfb807-f104-4ea0-a062-5c4e7ba6e24a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:24:40.389628 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.389416 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59bfb807-f104-4ea0-a062-5c4e7ba6e24a-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-64bd4\" (UID: \"59bfb807-f104-4ea0-a062-5c4e7ba6e24a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:24:40.389628 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.389544 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59bfb807-f104-4ea0-a062-5c4e7ba6e24a-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-64bd4\" (UID: \"59bfb807-f104-4ea0-a062-5c4e7ba6e24a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:24:40.389628 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.389567 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59bfb807-f104-4ea0-a062-5c4e7ba6e24a-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-64bd4\" (UID: \"59bfb807-f104-4ea0-a062-5c4e7ba6e24a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:24:40.389628 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.389581 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59bfb807-f104-4ea0-a062-5c4e7ba6e24a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-64bd4\" (UID: \"59bfb807-f104-4ea0-a062-5c4e7ba6e24a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:24:40.389628 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.389614 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcdzw\" (UniqueName: \"kubernetes.io/projected/59bfb807-f104-4ea0-a062-5c4e7ba6e24a-kube-api-access-bcdzw\") pod \"maas-default-gateway-openshift-default-8559cd5744-64bd4\" (UID: \"59bfb807-f104-4ea0-a062-5c4e7ba6e24a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:24:40.389934 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.389658 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59bfb807-f104-4ea0-a062-5c4e7ba6e24a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-64bd4\" (UID: \"59bfb807-f104-4ea0-a062-5c4e7ba6e24a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:24:40.389934 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.389866 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59bfb807-f104-4ea0-a062-5c4e7ba6e24a-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-64bd4\" (UID: \"59bfb807-f104-4ea0-a062-5c4e7ba6e24a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:24:40.389934 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.389903 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59bfb807-f104-4ea0-a062-5c4e7ba6e24a-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-64bd4\" (UID: \"59bfb807-f104-4ea0-a062-5c4e7ba6e24a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:24:40.390048 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.389946 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59bfb807-f104-4ea0-a062-5c4e7ba6e24a-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-64bd4\" (UID: \"59bfb807-f104-4ea0-a062-5c4e7ba6e24a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:24:40.390360 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.390340 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59bfb807-f104-4ea0-a062-5c4e7ba6e24a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-64bd4\" (UID: \"59bfb807-f104-4ea0-a062-5c4e7ba6e24a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:24:40.390543 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.390521 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59bfb807-f104-4ea0-a062-5c4e7ba6e24a-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-64bd4\" (UID: \"59bfb807-f104-4ea0-a062-5c4e7ba6e24a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:24:40.391831 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.391812 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59bfb807-f104-4ea0-a062-5c4e7ba6e24a-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-64bd4\" (UID: \"59bfb807-f104-4ea0-a062-5c4e7ba6e24a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:24:40.392280 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.392254 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59bfb807-f104-4ea0-a062-5c4e7ba6e24a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-64bd4\" (UID: \"59bfb807-f104-4ea0-a062-5c4e7ba6e24a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:24:40.399344 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.399304 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59bfb807-f104-4ea0-a062-5c4e7ba6e24a-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-64bd4\" (UID: \"59bfb807-f104-4ea0-a062-5c4e7ba6e24a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:24:40.399468 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.399381 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcdzw\" (UniqueName: \"kubernetes.io/projected/59bfb807-f104-4ea0-a062-5c4e7ba6e24a-kube-api-access-bcdzw\") pod \"maas-default-gateway-openshift-default-8559cd5744-64bd4\" (UID: \"59bfb807-f104-4ea0-a062-5c4e7ba6e24a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:24:40.535381 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.535337 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:24:40.707576 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.707540 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4"] Jun 08 21:24:40.709348 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:24:40.709319 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59bfb807_f104_4ea0_a062_5c4e7ba6e24a.slice/crio-b066b3b8640e1812eb097f8b64c6b44eac072d29a7da4992708c296c3cb42cf5 WatchSource:0}: Error finding container b066b3b8640e1812eb097f8b64c6b44eac072d29a7da4992708c296c3cb42cf5: Status 404 returned error can't find the container with id b066b3b8640e1812eb097f8b64c6b44eac072d29a7da4992708c296c3cb42cf5 Jun 08 21:24:40.711803 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.711759 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 08 21:24:40.711895 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.711850 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 08 21:24:40.711941 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:40.711890 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 08 21:24:41.117406 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:41.117321 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" event={"ID":"59bfb807-f104-4ea0-a062-5c4e7ba6e24a","Type":"ContainerStarted","Data":"ecf5b5d038c6145d2798fa5db85d9d85d8ff19b6624cb598a7daee4ec1491f32"} Jun 08 21:24:41.117406 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:41.117372 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" event={"ID":"59bfb807-f104-4ea0-a062-5c4e7ba6e24a","Type":"ContainerStarted","Data":"b066b3b8640e1812eb097f8b64c6b44eac072d29a7da4992708c296c3cb42cf5"} Jun 08 21:24:41.142989 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:41.142928 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" podStartSLOduration=1.142912894 podStartE2EDuration="1.142912894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:24:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:24:41.139893871 +0000 UTC m=+653.279936762" watchObservedRunningTime="2026-06-08 21:24:41.142912894 +0000 UTC m=+653.282955775" Jun 08 21:24:41.536488 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:41.536451 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:24:41.538165 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:41.538135 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-64bd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jun 08 21:24:41.538294 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:41.538200 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" podUID="59bfb807-f104-4ea0-a062-5c4e7ba6e24a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jun 08 21:24:42.540729 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:42.540692 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:24:43.129137 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:43.129106 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:24:43.130181 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:43.130161 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:24:45.838640 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:45.838604 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c4w4p"] Jun 08 21:24:45.898376 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:45.898340 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c4w4p"] Jun 08 21:24:45.898545 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:45.898462 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-c4w4p" Jun 08 21:24:45.901248 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:45.901198 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 08 21:24:45.932883 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:45.932810 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c4w4p"] Jun 08 21:24:45.937929 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:45.937889 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3305c26b-2af0-4c30-b259-15f3f3d1fe5a-config-file\") pod \"limitador-limitador-64c94fd64f-c4w4p\" (UID: \"3305c26b-2af0-4c30-b259-15f3f3d1fe5a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c4w4p" Jun 08 21:24:45.938124 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:45.938040 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfsvl\" (UniqueName: \"kubernetes.io/projected/3305c26b-2af0-4c30-b259-15f3f3d1fe5a-kube-api-access-sfsvl\") pod \"limitador-limitador-64c94fd64f-c4w4p\" (UID: \"3305c26b-2af0-4c30-b259-15f3f3d1fe5a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c4w4p" Jun 08 21:24:46.038574 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:46.038538 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3305c26b-2af0-4c30-b259-15f3f3d1fe5a-config-file\") pod \"limitador-limitador-64c94fd64f-c4w4p\" (UID: \"3305c26b-2af0-4c30-b259-15f3f3d1fe5a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c4w4p" Jun 08 21:24:46.038777 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:46.038608 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfsvl\" (UniqueName: \"kubernetes.io/projected/3305c26b-2af0-4c30-b259-15f3f3d1fe5a-kube-api-access-sfsvl\") pod \"limitador-limitador-64c94fd64f-c4w4p\" (UID: \"3305c26b-2af0-4c30-b259-15f3f3d1fe5a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c4w4p" Jun 08 21:24:46.039480 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:46.039453 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3305c26b-2af0-4c30-b259-15f3f3d1fe5a-config-file\") pod \"limitador-limitador-64c94fd64f-c4w4p\" (UID: \"3305c26b-2af0-4c30-b259-15f3f3d1fe5a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c4w4p" Jun 08 21:24:46.049048 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:46.049015 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfsvl\" (UniqueName: \"kubernetes.io/projected/3305c26b-2af0-4c30-b259-15f3f3d1fe5a-kube-api-access-sfsvl\") pod \"limitador-limitador-64c94fd64f-c4w4p\" (UID: \"3305c26b-2af0-4c30-b259-15f3f3d1fe5a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c4w4p" Jun 08 21:24:46.213150 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:46.213041 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-c4w4p" Jun 08 21:24:46.354676 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:46.354654 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c4w4p"] Jun 08 21:24:46.357411 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:24:46.357373 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3305c26b_2af0_4c30_b259_15f3f3d1fe5a.slice/crio-d31bf18d90236cd1df3e16a55c53d495f1f127dc68401660721b28c6a4c3082e WatchSource:0}: Error finding container d31bf18d90236cd1df3e16a55c53d495f1f127dc68401660721b28c6a4c3082e: Status 404 returned error can't find the container with id d31bf18d90236cd1df3e16a55c53d495f1f127dc68401660721b28c6a4c3082e Jun 08 21:24:47.156705 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:47.156575 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-c4w4p" event={"ID":"3305c26b-2af0-4c30-b259-15f3f3d1fe5a","Type":"ContainerStarted","Data":"d31bf18d90236cd1df3e16a55c53d495f1f127dc68401660721b28c6a4c3082e"} Jun 08 21:24:49.170841 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:49.170801 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-c4w4p" event={"ID":"3305c26b-2af0-4c30-b259-15f3f3d1fe5a","Type":"ContainerStarted","Data":"e35f5c3f62a0f52b20162d19425043ced318faef734557db5cedd2ab38552b12"} Jun 08 21:24:49.171246 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:49.170894 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-c4w4p" Jun 08 21:24:49.189651 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:24:49.189600 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-c4w4p" podStartSLOduration=1.492215062 podStartE2EDuration="4.189584075s" totalImagesPullingTime="2.697369013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:24:49.187818101 +0000 UTC m=+661.327860982" watchObservedRunningTime="2026-06-08 21:24:49.189584075 +0000 UTC m=+661.329627006" Jun 08 21:25:00.178001 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:00.177963 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-c4w4p" Jun 08 21:25:00.192163 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:00.192131 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c4w4p"] Jun 08 21:25:00.230032 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:00.229973 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-c4w4p" podUID="3305c26b-2af0-4c30-b259-15f3f3d1fe5a" containerName="limitador" containerID="cri-o://e35f5c3f62a0f52b20162d19425043ced318faef734557db5cedd2ab38552b12" gracePeriod=30 Jun 08 21:25:00.793352 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:00.793291 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-c4w4p" Jun 08 21:25:00.867348 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:00.867314 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfsvl\" (UniqueName: \"kubernetes.io/projected/3305c26b-2af0-4c30-b259-15f3f3d1fe5a-kube-api-access-sfsvl\") pod \"3305c26b-2af0-4c30-b259-15f3f3d1fe5a\" (UID: \"3305c26b-2af0-4c30-b259-15f3f3d1fe5a\") " Jun 08 21:25:00.867517 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:00.867367 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3305c26b-2af0-4c30-b259-15f3f3d1fe5a-config-file\") pod \"3305c26b-2af0-4c30-b259-15f3f3d1fe5a\" (UID: \"3305c26b-2af0-4c30-b259-15f3f3d1fe5a\") " Jun 08 21:25:00.867740 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:00.867711 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3305c26b-2af0-4c30-b259-15f3f3d1fe5a-config-file" (OuterVolumeSpecName: "config-file") pod "3305c26b-2af0-4c30-b259-15f3f3d1fe5a" (UID: "3305c26b-2af0-4c30-b259-15f3f3d1fe5a"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 21:25:00.869576 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:00.869559 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3305c26b-2af0-4c30-b259-15f3f3d1fe5a-kube-api-access-sfsvl" (OuterVolumeSpecName: "kube-api-access-sfsvl") pod "3305c26b-2af0-4c30-b259-15f3f3d1fe5a" (UID: "3305c26b-2af0-4c30-b259-15f3f3d1fe5a"). InnerVolumeSpecName "kube-api-access-sfsvl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:25:00.968952 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:00.968917 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfsvl\" (UniqueName: \"kubernetes.io/projected/3305c26b-2af0-4c30-b259-15f3f3d1fe5a-kube-api-access-sfsvl\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:25:00.968952 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:00.968948 2564 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3305c26b-2af0-4c30-b259-15f3f3d1fe5a-config-file\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:25:01.237170 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:01.237062 2564 generic.go:356] "Generic (PLEG): container finished" podID="3305c26b-2af0-4c30-b259-15f3f3d1fe5a" containerID="e35f5c3f62a0f52b20162d19425043ced318faef734557db5cedd2ab38552b12" exitCode=0 Jun 08 21:25:01.237170 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:01.237115 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-c4w4p" event={"ID":"3305c26b-2af0-4c30-b259-15f3f3d1fe5a","Type":"ContainerDied","Data":"e35f5c3f62a0f52b20162d19425043ced318faef734557db5cedd2ab38552b12"} Jun 08 21:25:01.237170 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:01.237147 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-c4w4p" Jun 08 21:25:01.237699 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:01.237188 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-c4w4p" event={"ID":"3305c26b-2af0-4c30-b259-15f3f3d1fe5a","Type":"ContainerDied","Data":"d31bf18d90236cd1df3e16a55c53d495f1f127dc68401660721b28c6a4c3082e"} Jun 08 21:25:01.237699 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:01.237219 2564 scope.go:117] "RemoveContainer" containerID="e35f5c3f62a0f52b20162d19425043ced318faef734557db5cedd2ab38552b12" Jun 08 21:25:01.247343 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:01.247321 2564 scope.go:117] "RemoveContainer" containerID="e35f5c3f62a0f52b20162d19425043ced318faef734557db5cedd2ab38552b12" Jun 08 21:25:01.247650 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:25:01.247632 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e35f5c3f62a0f52b20162d19425043ced318faef734557db5cedd2ab38552b12\": container with ID starting with e35f5c3f62a0f52b20162d19425043ced318faef734557db5cedd2ab38552b12 not found: ID does not exist" containerID="e35f5c3f62a0f52b20162d19425043ced318faef734557db5cedd2ab38552b12" Jun 08 21:25:01.247700 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:01.247662 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e35f5c3f62a0f52b20162d19425043ced318faef734557db5cedd2ab38552b12"} err="failed to get container status \"e35f5c3f62a0f52b20162d19425043ced318faef734557db5cedd2ab38552b12\": rpc error: code = NotFound desc = could not find container \"e35f5c3f62a0f52b20162d19425043ced318faef734557db5cedd2ab38552b12\": container with ID starting with e35f5c3f62a0f52b20162d19425043ced318faef734557db5cedd2ab38552b12 not found: ID does not exist" Jun 08 21:25:01.258916 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:01.258887 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c4w4p"] Jun 08 21:25:01.262980 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:01.262951 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c4w4p"] Jun 08 21:25:02.347833 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:02.347797 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3305c26b-2af0-4c30-b259-15f3f3d1fe5a" path="/var/lib/kubelet/pods/3305c26b-2af0-4c30-b259-15f3f3d1fe5a/volumes" Jun 08 21:25:05.517649 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:05.517615 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-c64kz"] Jun 08 21:25:05.518164 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:05.518144 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3305c26b-2af0-4c30-b259-15f3f3d1fe5a" containerName="limitador" Jun 08 21:25:05.518252 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:05.518166 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3305c26b-2af0-4c30-b259-15f3f3d1fe5a" containerName="limitador" Jun 08 21:25:05.518305 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:05.518284 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3305c26b-2af0-4c30-b259-15f3f3d1fe5a" containerName="limitador" Jun 08 21:25:05.521543 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:05.521524 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-c64kz" Jun 08 21:25:05.524530 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:05.524508 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 08 21:25:05.527634 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:05.527611 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-c64kz"] Jun 08 21:25:05.610899 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:05.610856 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8zj7\" (UniqueName: \"kubernetes.io/projected/fd0ac10c-1b22-4ca1-9eba-998b940799bd-kube-api-access-s8zj7\") pod \"postgres-69fb4594cf-c64kz\" (UID: \"fd0ac10c-1b22-4ca1-9eba-998b940799bd\") " pod="opendatahub/postgres-69fb4594cf-c64kz" Jun 08 21:25:05.611109 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:05.610911 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fd0ac10c-1b22-4ca1-9eba-998b940799bd-data\") pod \"postgres-69fb4594cf-c64kz\" (UID: \"fd0ac10c-1b22-4ca1-9eba-998b940799bd\") " pod="opendatahub/postgres-69fb4594cf-c64kz" Jun 08 21:25:05.711607 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:05.711564 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8zj7\" (UniqueName: \"kubernetes.io/projected/fd0ac10c-1b22-4ca1-9eba-998b940799bd-kube-api-access-s8zj7\") pod \"postgres-69fb4594cf-c64kz\" (UID: \"fd0ac10c-1b22-4ca1-9eba-998b940799bd\") " pod="opendatahub/postgres-69fb4594cf-c64kz" Jun 08 21:25:05.711607 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:05.711608 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fd0ac10c-1b22-4ca1-9eba-998b940799bd-data\") pod \"postgres-69fb4594cf-c64kz\" (UID: \"fd0ac10c-1b22-4ca1-9eba-998b940799bd\") " pod="opendatahub/postgres-69fb4594cf-c64kz" Jun 08 21:25:05.712023 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:05.712004 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fd0ac10c-1b22-4ca1-9eba-998b940799bd-data\") pod \"postgres-69fb4594cf-c64kz\" (UID: \"fd0ac10c-1b22-4ca1-9eba-998b940799bd\") " pod="opendatahub/postgres-69fb4594cf-c64kz" Jun 08 21:25:05.721170 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:05.721149 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8zj7\" (UniqueName: \"kubernetes.io/projected/fd0ac10c-1b22-4ca1-9eba-998b940799bd-kube-api-access-s8zj7\") pod \"postgres-69fb4594cf-c64kz\" (UID: \"fd0ac10c-1b22-4ca1-9eba-998b940799bd\") " pod="opendatahub/postgres-69fb4594cf-c64kz" Jun 08 21:25:05.832658 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:05.832606 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-c64kz" Jun 08 21:25:05.971017 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:05.970992 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-c64kz"] Jun 08 21:25:05.972277 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:25:05.972243 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd0ac10c_1b22_4ca1_9eba_998b940799bd.slice/crio-553073d1559f63bdd9f52e93b99096fa4966dd6a495b66e29e63a99fa4235ddb WatchSource:0}: Error finding container 553073d1559f63bdd9f52e93b99096fa4966dd6a495b66e29e63a99fa4235ddb: Status 404 returned error can't find the container with id 553073d1559f63bdd9f52e93b99096fa4966dd6a495b66e29e63a99fa4235ddb Jun 08 21:25:06.272514 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:06.272424 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-c64kz" event={"ID":"fd0ac10c-1b22-4ca1-9eba-998b940799bd","Type":"ContainerStarted","Data":"553073d1559f63bdd9f52e93b99096fa4966dd6a495b66e29e63a99fa4235ddb"} Jun 08 21:25:09.291005 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:09.290962 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-c64kz" event={"ID":"fd0ac10c-1b22-4ca1-9eba-998b940799bd","Type":"ContainerStarted","Data":"5754e111897ff1febbeccfb8b1a78db3c5393dec0b351124dff88fc57e40416a"} Jun 08 21:25:09.291434 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:09.291176 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-c64kz" Jun 08 21:25:09.307499 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:09.307438 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-c64kz" podStartSLOduration=2.011804875 podStartE2EDuration="4.307424755s" totalImagesPullingTime="2.29561988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:25:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:25:09.306876439 +0000 UTC m=+681.446919320" watchObservedRunningTime="2026-06-08 21:25:09.307424755 +0000 UTC m=+681.447467636" Jun 08 21:25:15.330216 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:15.330188 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-c64kz" Jun 08 21:25:16.783484 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:16.783445 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x5t6n"] Jun 08 21:25:16.864208 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:16.864166 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x5t6n"] Jun 08 21:25:16.864390 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:16.864303 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x5t6n" Jun 08 21:25:16.867482 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:16.867457 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 21:25:16.868655 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:16.868624 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 21:25:16.868787 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:16.868658 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9466d\"" Jun 08 21:25:17.015814 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:17.015773 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64d80966-d4be-42b8-a56f-fb0c3e8d4a25-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x5t6n\" (UID: \"64d80966-d4be-42b8-a56f-fb0c3e8d4a25\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x5t6n" Jun 08 21:25:17.015996 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:17.015824 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64d80966-d4be-42b8-a56f-fb0c3e8d4a25-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x5t6n\" (UID: \"64d80966-d4be-42b8-a56f-fb0c3e8d4a25\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x5t6n" Jun 08 21:25:17.015996 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:17.015924 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqwp6\" (UniqueName: \"kubernetes.io/projected/64d80966-d4be-42b8-a56f-fb0c3e8d4a25-kube-api-access-jqwp6\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x5t6n\" (UID: \"64d80966-d4be-42b8-a56f-fb0c3e8d4a25\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x5t6n" Jun 08 21:25:17.117273 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:17.117227 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqwp6\" (UniqueName: \"kubernetes.io/projected/64d80966-d4be-42b8-a56f-fb0c3e8d4a25-kube-api-access-jqwp6\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x5t6n\" (UID: \"64d80966-d4be-42b8-a56f-fb0c3e8d4a25\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x5t6n" Jun 08 21:25:17.117457 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:17.117303 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64d80966-d4be-42b8-a56f-fb0c3e8d4a25-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x5t6n\" (UID: \"64d80966-d4be-42b8-a56f-fb0c3e8d4a25\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x5t6n" Jun 08 21:25:17.117457 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:17.117337 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64d80966-d4be-42b8-a56f-fb0c3e8d4a25-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x5t6n\" (UID: \"64d80966-d4be-42b8-a56f-fb0c3e8d4a25\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x5t6n" Jun 08 21:25:17.117733 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:17.117712 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64d80966-d4be-42b8-a56f-fb0c3e8d4a25-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x5t6n\" (UID: \"64d80966-d4be-42b8-a56f-fb0c3e8d4a25\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x5t6n" Jun 08 21:25:17.117733 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:17.117724 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64d80966-d4be-42b8-a56f-fb0c3e8d4a25-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x5t6n\" (UID: \"64d80966-d4be-42b8-a56f-fb0c3e8d4a25\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x5t6n" Jun 08 21:25:17.127050 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:17.127019 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqwp6\" (UniqueName: \"kubernetes.io/projected/64d80966-d4be-42b8-a56f-fb0c3e8d4a25-kube-api-access-jqwp6\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x5t6n\" (UID: \"64d80966-d4be-42b8-a56f-fb0c3e8d4a25\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x5t6n" Jun 08 21:25:17.173869 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:17.173828 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x5t6n" Jun 08 21:25:17.320915 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:17.320887 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x5t6n"] Jun 08 21:25:17.323652 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:25:17.323625 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64d80966_d4be_42b8_a56f_fb0c3e8d4a25.slice/crio-da849df7f095c3f5255032e81e60bb50b900eef6f698e68e440fb89719f1bbbb WatchSource:0}: Error finding container da849df7f095c3f5255032e81e60bb50b900eef6f698e68e440fb89719f1bbbb: Status 404 returned error can't find the container with id da849df7f095c3f5255032e81e60bb50b900eef6f698e68e440fb89719f1bbbb Jun 08 21:25:17.335423 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:17.335394 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x5t6n" event={"ID":"64d80966-d4be-42b8-a56f-fb0c3e8d4a25","Type":"ContainerStarted","Data":"da849df7f095c3f5255032e81e60bb50b900eef6f698e68e440fb89719f1bbbb"} Jun 08 21:25:18.342612 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:18.342576 2564 generic.go:356] "Generic (PLEG): container finished" podID="64d80966-d4be-42b8-a56f-fb0c3e8d4a25" containerID="4a3bc3fa77a21dca87f7dde277bad4c33e845f837031d7ef0b38c518a03c1da4" exitCode=0 Jun 08 21:25:18.348305 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:18.348281 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x5t6n" event={"ID":"64d80966-d4be-42b8-a56f-fb0c3e8d4a25","Type":"ContainerDied","Data":"4a3bc3fa77a21dca87f7dde277bad4c33e845f837031d7ef0b38c518a03c1da4"} Jun 08 21:25:19.350673 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:19.350640 2564 generic.go:356] "Generic (PLEG): container finished" podID="64d80966-d4be-42b8-a56f-fb0c3e8d4a25" containerID="dbc7f40006a26f004b11ca928aa8f819e269a8e995cbf6efdfe00b547f47e28c" exitCode=0 Jun 08 21:25:19.351177 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:19.350688 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x5t6n" event={"ID":"64d80966-d4be-42b8-a56f-fb0c3e8d4a25","Type":"ContainerDied","Data":"dbc7f40006a26f004b11ca928aa8f819e269a8e995cbf6efdfe00b547f47e28c"} Jun 08 21:25:20.357836 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:20.357802 2564 generic.go:356] "Generic (PLEG): container finished" podID="64d80966-d4be-42b8-a56f-fb0c3e8d4a25" containerID="d72a23ded6ca861e467da29db989141d9e797e7399b5838b2dec5778aea6b403" exitCode=0 Jun 08 21:25:20.358259 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:20.357890 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x5t6n" event={"ID":"64d80966-d4be-42b8-a56f-fb0c3e8d4a25","Type":"ContainerDied","Data":"d72a23ded6ca861e467da29db989141d9e797e7399b5838b2dec5778aea6b403"} Jun 08 21:25:21.504551 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:21.504520 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x5t6n" Jun 08 21:25:21.658908 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:21.658802 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64d80966-d4be-42b8-a56f-fb0c3e8d4a25-bundle\") pod \"64d80966-d4be-42b8-a56f-fb0c3e8d4a25\" (UID: \"64d80966-d4be-42b8-a56f-fb0c3e8d4a25\") " Jun 08 21:25:21.659058 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:21.658919 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64d80966-d4be-42b8-a56f-fb0c3e8d4a25-util\") pod \"64d80966-d4be-42b8-a56f-fb0c3e8d4a25\" (UID: \"64d80966-d4be-42b8-a56f-fb0c3e8d4a25\") " Jun 08 21:25:21.659058 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:21.659014 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqwp6\" (UniqueName: \"kubernetes.io/projected/64d80966-d4be-42b8-a56f-fb0c3e8d4a25-kube-api-access-jqwp6\") pod \"64d80966-d4be-42b8-a56f-fb0c3e8d4a25\" (UID: \"64d80966-d4be-42b8-a56f-fb0c3e8d4a25\") " Jun 08 21:25:21.659470 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:21.659450 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64d80966-d4be-42b8-a56f-fb0c3e8d4a25-bundle" (OuterVolumeSpecName: "bundle") pod "64d80966-d4be-42b8-a56f-fb0c3e8d4a25" (UID: "64d80966-d4be-42b8-a56f-fb0c3e8d4a25"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:25:21.661407 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:21.661370 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64d80966-d4be-42b8-a56f-fb0c3e8d4a25-kube-api-access-jqwp6" (OuterVolumeSpecName: "kube-api-access-jqwp6") pod "64d80966-d4be-42b8-a56f-fb0c3e8d4a25" (UID: "64d80966-d4be-42b8-a56f-fb0c3e8d4a25"). InnerVolumeSpecName "kube-api-access-jqwp6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:25:21.664588 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:21.664567 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64d80966-d4be-42b8-a56f-fb0c3e8d4a25-util" (OuterVolumeSpecName: "util") pod "64d80966-d4be-42b8-a56f-fb0c3e8d4a25" (UID: "64d80966-d4be-42b8-a56f-fb0c3e8d4a25"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:25:21.759973 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:21.759928 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqwp6\" (UniqueName: \"kubernetes.io/projected/64d80966-d4be-42b8-a56f-fb0c3e8d4a25-kube-api-access-jqwp6\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:25:21.759973 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:21.759966 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64d80966-d4be-42b8-a56f-fb0c3e8d4a25-bundle\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:25:21.759973 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:21.759975 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64d80966-d4be-42b8-a56f-fb0c3e8d4a25-util\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:25:22.372979 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:22.372954 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x5t6n" Jun 08 21:25:22.373139 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:22.372948 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x5t6n" event={"ID":"64d80966-d4be-42b8-a56f-fb0c3e8d4a25","Type":"ContainerDied","Data":"da849df7f095c3f5255032e81e60bb50b900eef6f698e68e440fb89719f1bbbb"} Jun 08 21:25:22.373139 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:22.373101 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da849df7f095c3f5255032e81e60bb50b900eef6f698e68e440fb89719f1bbbb" Jun 08 21:25:45.083778 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:45.083738 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 21:25:45.084239 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:45.084104 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64d80966-d4be-42b8-a56f-fb0c3e8d4a25" containerName="pull" Jun 08 21:25:45.084239 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:45.084117 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="64d80966-d4be-42b8-a56f-fb0c3e8d4a25" containerName="pull" Jun 08 21:25:45.084239 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:45.084130 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64d80966-d4be-42b8-a56f-fb0c3e8d4a25" containerName="extract" Jun 08 21:25:45.084239 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:45.084136 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="64d80966-d4be-42b8-a56f-fb0c3e8d4a25" containerName="extract" Jun 08 21:25:45.084239 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:45.084146 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64d80966-d4be-42b8-a56f-fb0c3e8d4a25" containerName="util" Jun 08 21:25:45.084239 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:45.084152 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="64d80966-d4be-42b8-a56f-fb0c3e8d4a25" containerName="util" Jun 08 21:25:45.084239 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:45.084210 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="64d80966-d4be-42b8-a56f-fb0c3e8d4a25" containerName="extract" Jun 08 21:25:45.087440 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:45.087423 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 21:25:45.090264 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:45.090242 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 08 21:25:45.090384 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:45.090317 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 08 21:25:45.090384 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:45.090325 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 08 21:25:45.091532 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:45.091512 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-xsjb9\"" Jun 08 21:25:45.098568 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:45.098539 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 21:25:45.159730 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:45.159695 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfmzk\" (UniqueName: \"kubernetes.io/projected/9d66b292-877d-40df-b64d-302e89ad104d-kube-api-access-tfmzk\") pod \"maas-keycloak-0\" (UID: \"9d66b292-877d-40df-b64d-302e89ad104d\") " pod="keycloak-system/maas-keycloak-0" Jun 08 21:25:45.260366 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:45.260311 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfmzk\" (UniqueName: \"kubernetes.io/projected/9d66b292-877d-40df-b64d-302e89ad104d-kube-api-access-tfmzk\") pod \"maas-keycloak-0\" (UID: \"9d66b292-877d-40df-b64d-302e89ad104d\") " pod="keycloak-system/maas-keycloak-0" Jun 08 21:25:45.268781 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:45.268749 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfmzk\" (UniqueName: \"kubernetes.io/projected/9d66b292-877d-40df-b64d-302e89ad104d-kube-api-access-tfmzk\") pod \"maas-keycloak-0\" (UID: \"9d66b292-877d-40df-b64d-302e89ad104d\") " pod="keycloak-system/maas-keycloak-0" Jun 08 21:25:45.399681 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:45.399598 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 21:25:45.537771 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:45.537739 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 21:25:45.539358 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:25:45.539328 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d66b292_877d_40df_b64d_302e89ad104d.slice/crio-c6e2874f1f9a3550281d8a01d5721c88a0d66bf62cb9eebd1b929c0b7a2e7559 WatchSource:0}: Error finding container c6e2874f1f9a3550281d8a01d5721c88a0d66bf62cb9eebd1b929c0b7a2e7559: Status 404 returned error can't find the container with id c6e2874f1f9a3550281d8a01d5721c88a0d66bf62cb9eebd1b929c0b7a2e7559 Jun 08 21:25:45.540680 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:45.540661 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 21:25:46.508441 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:46.508391 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"9d66b292-877d-40df-b64d-302e89ad104d","Type":"ContainerStarted","Data":"c6e2874f1f9a3550281d8a01d5721c88a0d66bf62cb9eebd1b929c0b7a2e7559"} Jun 08 21:25:50.702284 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:50.702256 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 08 21:25:51.546842 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:51.546783 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"9d66b292-877d-40df-b64d-302e89ad104d","Type":"ContainerStarted","Data":"e2f639c36989e41784c37fbad08f30c24ac352fcbd277a69f03e5538bf6606f0"} Jun 08 21:25:51.565597 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:51.565534 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.406773893 podStartE2EDuration="6.565519257s" totalImagesPullingTime="5.158745364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:25:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:25:51.563469856 +0000 UTC m=+723.703512738" watchObservedRunningTime="2026-06-08 21:25:51.565519257 +0000 UTC m=+723.705562141" Jun 08 21:25:52.400507 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:52.400455 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 08 21:25:52.402514 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:52.402470 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9d66b292-877d-40df-b64d-302e89ad104d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 08 21:25:53.400031 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:53.399981 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9d66b292-877d-40df-b64d-302e89ad104d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 08 21:25:54.400739 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:54.400685 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9d66b292-877d-40df-b64d-302e89ad104d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 08 21:25:55.400280 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:55.400206 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9d66b292-877d-40df-b64d-302e89ad104d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 08 21:25:55.401507 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:55.400809 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 08 21:25:56.401136 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:56.401010 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9d66b292-877d-40df-b64d-302e89ad104d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 08 21:25:57.400122 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:57.400045 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9d66b292-877d-40df-b64d-302e89ad104d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 08 21:25:58.400833 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:58.400781 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9d66b292-877d-40df-b64d-302e89ad104d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 08 21:25:59.400795 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:25:59.400744 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9d66b292-877d-40df-b64d-302e89ad104d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 08 21:26:00.401015 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:00.400965 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9d66b292-877d-40df-b64d-302e89ad104d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 08 21:26:01.400182 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:01.400127 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9d66b292-877d-40df-b64d-302e89ad104d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 08 21:26:02.400911 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:02.400853 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9d66b292-877d-40df-b64d-302e89ad104d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 08 21:26:03.400524 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:03.400466 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9d66b292-877d-40df-b64d-302e89ad104d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 08 21:26:04.531140 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:04.531094 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 08 21:26:04.550362 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:04.550294 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="9d66b292-877d-40df-b64d-302e89ad104d" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 21:26:14.537363 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:14.537324 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 08 21:26:20.808699 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:20.808665 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bbdb77c66-jf8qf"] Jun 08 21:26:20.819324 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:20.819297 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bbdb77c66-jf8qf" Jun 08 21:26:20.823921 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:20.823889 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bbdb77c66-jf8qf"] Jun 08 21:26:20.824400 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:20.824374 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 08 21:26:20.824400 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:20.824386 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 08 21:26:20.825732 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:20.825708 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pvbsz\"" Jun 08 21:26:20.894353 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:20.894322 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vg6k\" (UniqueName: \"kubernetes.io/projected/42bcc7a7-30a5-4b94-a5ac-6f42053f68ce-kube-api-access-5vg6k\") pod \"maas-controller-7bbdb77c66-jf8qf\" (UID: \"42bcc7a7-30a5-4b94-a5ac-6f42053f68ce\") " pod="opendatahub/maas-controller-7bbdb77c66-jf8qf" Jun 08 21:26:20.894518 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:20.894381 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/42bcc7a7-30a5-4b94-a5ac-6f42053f68ce-webhook-cert\") pod \"maas-controller-7bbdb77c66-jf8qf\" (UID: \"42bcc7a7-30a5-4b94-a5ac-6f42053f68ce\") " pod="opendatahub/maas-controller-7bbdb77c66-jf8qf" Jun 08 21:26:20.995558 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:20.995503 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vg6k\" (UniqueName: \"kubernetes.io/projected/42bcc7a7-30a5-4b94-a5ac-6f42053f68ce-kube-api-access-5vg6k\") pod \"maas-controller-7bbdb77c66-jf8qf\" (UID: \"42bcc7a7-30a5-4b94-a5ac-6f42053f68ce\") " pod="opendatahub/maas-controller-7bbdb77c66-jf8qf" Jun 08 21:26:20.995739 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:20.995633 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/42bcc7a7-30a5-4b94-a5ac-6f42053f68ce-webhook-cert\") pod \"maas-controller-7bbdb77c66-jf8qf\" (UID: \"42bcc7a7-30a5-4b94-a5ac-6f42053f68ce\") " pod="opendatahub/maas-controller-7bbdb77c66-jf8qf" Jun 08 21:26:21.003145 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:20.998945 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/42bcc7a7-30a5-4b94-a5ac-6f42053f68ce-webhook-cert\") pod \"maas-controller-7bbdb77c66-jf8qf\" (UID: \"42bcc7a7-30a5-4b94-a5ac-6f42053f68ce\") " pod="opendatahub/maas-controller-7bbdb77c66-jf8qf" Jun 08 21:26:21.007393 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:21.007367 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vg6k\" (UniqueName: \"kubernetes.io/projected/42bcc7a7-30a5-4b94-a5ac-6f42053f68ce-kube-api-access-5vg6k\") pod \"maas-controller-7bbdb77c66-jf8qf\" (UID: \"42bcc7a7-30a5-4b94-a5ac-6f42053f68ce\") " pod="opendatahub/maas-controller-7bbdb77c66-jf8qf" Jun 08 21:26:21.130396 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:21.130305 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bbdb77c66-jf8qf" Jun 08 21:26:21.268544 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:21.268517 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bbdb77c66-jf8qf"] Jun 08 21:26:21.270463 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:26:21.270435 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42bcc7a7_30a5_4b94_a5ac_6f42053f68ce.slice/crio-1af85068ec00bc81024d500a00786d983809ae4df14b67db994df1d46deca91a WatchSource:0}: Error finding container 1af85068ec00bc81024d500a00786d983809ae4df14b67db994df1d46deca91a: Status 404 returned error can't find the container with id 1af85068ec00bc81024d500a00786d983809ae4df14b67db994df1d46deca91a Jun 08 21:26:21.766207 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:21.766160 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bbdb77c66-jf8qf" event={"ID":"42bcc7a7-30a5-4b94-a5ac-6f42053f68ce","Type":"ContainerStarted","Data":"1af85068ec00bc81024d500a00786d983809ae4df14b67db994df1d46deca91a"} Jun 08 21:26:23.782491 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:23.782448 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bbdb77c66-jf8qf" event={"ID":"42bcc7a7-30a5-4b94-a5ac-6f42053f68ce","Type":"ContainerStarted","Data":"08774fb9f941e43c900ad92e8d1844b9916636edfa32ebc20df6c642d1fddbd8"} Jun 08 21:26:23.782921 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:23.782538 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bbdb77c66-jf8qf" Jun 08 21:26:23.806443 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:23.806391 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7bbdb77c66-jf8qf" podStartSLOduration=1.371914285 podStartE2EDuration="3.806372299s" totalImagesPullingTime="2.434458014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:26:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:26:23.802779275 +0000 UTC m=+755.942822173" watchObservedRunningTime="2026-06-08 21:26:23.806372299 +0000 UTC m=+755.946415219" Jun 08 21:26:34.795001 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:34.794965 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bbdb77c66-jf8qf" Jun 08 21:26:35.650737 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:35.650698 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bbdb77c66-jf8qf"] Jun 08 21:26:35.650965 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:35.650927 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7bbdb77c66-jf8qf" podUID="42bcc7a7-30a5-4b94-a5ac-6f42053f68ce" containerName="manager" containerID="cri-o://08774fb9f941e43c900ad92e8d1844b9916636edfa32ebc20df6c642d1fddbd8" gracePeriod=30 Jun 08 21:26:35.856182 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:35.856150 2564 generic.go:356] "Generic (PLEG): container finished" podID="42bcc7a7-30a5-4b94-a5ac-6f42053f68ce" containerID="08774fb9f941e43c900ad92e8d1844b9916636edfa32ebc20df6c642d1fddbd8" exitCode=0 Jun 08 21:26:35.856625 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:35.856232 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bbdb77c66-jf8qf" event={"ID":"42bcc7a7-30a5-4b94-a5ac-6f42053f68ce","Type":"ContainerDied","Data":"08774fb9f941e43c900ad92e8d1844b9916636edfa32ebc20df6c642d1fddbd8"} Jun 08 21:26:35.897743 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:35.897719 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bbdb77c66-jf8qf" Jun 08 21:26:35.926166 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:35.926094 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vg6k\" (UniqueName: \"kubernetes.io/projected/42bcc7a7-30a5-4b94-a5ac-6f42053f68ce-kube-api-access-5vg6k\") pod \"42bcc7a7-30a5-4b94-a5ac-6f42053f68ce\" (UID: \"42bcc7a7-30a5-4b94-a5ac-6f42053f68ce\") " Jun 08 21:26:35.926312 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:35.926181 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/42bcc7a7-30a5-4b94-a5ac-6f42053f68ce-webhook-cert\") pod \"42bcc7a7-30a5-4b94-a5ac-6f42053f68ce\" (UID: \"42bcc7a7-30a5-4b94-a5ac-6f42053f68ce\") " Jun 08 21:26:35.928548 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:35.928516 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42bcc7a7-30a5-4b94-a5ac-6f42053f68ce-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "42bcc7a7-30a5-4b94-a5ac-6f42053f68ce" (UID: "42bcc7a7-30a5-4b94-a5ac-6f42053f68ce"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 21:26:35.928642 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:35.928516 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42bcc7a7-30a5-4b94-a5ac-6f42053f68ce-kube-api-access-5vg6k" (OuterVolumeSpecName: "kube-api-access-5vg6k") pod "42bcc7a7-30a5-4b94-a5ac-6f42053f68ce" (UID: "42bcc7a7-30a5-4b94-a5ac-6f42053f68ce"). InnerVolumeSpecName "kube-api-access-5vg6k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:26:36.027115 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:36.027062 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vg6k\" (UniqueName: \"kubernetes.io/projected/42bcc7a7-30a5-4b94-a5ac-6f42053f68ce-kube-api-access-5vg6k\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:26:36.027115 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:36.027111 2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/42bcc7a7-30a5-4b94-a5ac-6f42053f68ce-webhook-cert\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:26:36.862483 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:36.862454 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bbdb77c66-jf8qf" Jun 08 21:26:36.862483 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:36.862480 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bbdb77c66-jf8qf" event={"ID":"42bcc7a7-30a5-4b94-a5ac-6f42053f68ce","Type":"ContainerDied","Data":"1af85068ec00bc81024d500a00786d983809ae4df14b67db994df1d46deca91a"} Jun 08 21:26:36.862953 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:36.862540 2564 scope.go:117] "RemoveContainer" containerID="08774fb9f941e43c900ad92e8d1844b9916636edfa32ebc20df6c642d1fddbd8" Jun 08 21:26:36.880920 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:36.880896 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bbdb77c66-jf8qf"] Jun 08 21:26:36.885377 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:36.885356 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7bbdb77c66-jf8qf"] Jun 08 21:26:38.347929 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:38.347898 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42bcc7a7-30a5-4b94-a5ac-6f42053f68ce" path="/var/lib/kubelet/pods/42bcc7a7-30a5-4b94-a5ac-6f42053f68ce/volumes" Jun 08 21:26:55.014303 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:55.014271 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-76cdcb8cdb-v2gwb"] Jun 08 21:26:55.014702 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:55.014639 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42bcc7a7-30a5-4b94-a5ac-6f42053f68ce" containerName="manager" Jun 08 21:26:55.014702 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:55.014650 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="42bcc7a7-30a5-4b94-a5ac-6f42053f68ce" containerName="manager" Jun 08 21:26:55.014775 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:55.014711 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="42bcc7a7-30a5-4b94-a5ac-6f42053f68ce" containerName="manager" Jun 08 21:26:55.019108 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:55.019087 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-76cdcb8cdb-v2gwb" Jun 08 21:26:55.022395 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:55.022365 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-kbkvs\"" Jun 08 21:26:55.022395 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:55.022388 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 08 21:26:55.029398 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:55.029375 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-76cdcb8cdb-v2gwb"] Jun 08 21:26:55.086208 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:55.086174 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8kgl\" (UniqueName: \"kubernetes.io/projected/16bc3277-f351-4a07-aee8-27dd4d3782f3-kube-api-access-g8kgl\") pod \"maas-api-76cdcb8cdb-v2gwb\" (UID: \"16bc3277-f351-4a07-aee8-27dd4d3782f3\") " pod="opendatahub/maas-api-76cdcb8cdb-v2gwb" Jun 08 21:26:55.086380 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:55.086240 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16bc3277-f351-4a07-aee8-27dd4d3782f3-maas-api-tls\") pod \"maas-api-76cdcb8cdb-v2gwb\" (UID: \"16bc3277-f351-4a07-aee8-27dd4d3782f3\") " pod="opendatahub/maas-api-76cdcb8cdb-v2gwb" Jun 08 21:26:55.187387 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:55.187350 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8kgl\" (UniqueName: \"kubernetes.io/projected/16bc3277-f351-4a07-aee8-27dd4d3782f3-kube-api-access-g8kgl\") pod \"maas-api-76cdcb8cdb-v2gwb\" (UID: \"16bc3277-f351-4a07-aee8-27dd4d3782f3\") " pod="opendatahub/maas-api-76cdcb8cdb-v2gwb" Jun 08 21:26:55.187571 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:55.187421 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16bc3277-f351-4a07-aee8-27dd4d3782f3-maas-api-tls\") pod \"maas-api-76cdcb8cdb-v2gwb\" (UID: \"16bc3277-f351-4a07-aee8-27dd4d3782f3\") " pod="opendatahub/maas-api-76cdcb8cdb-v2gwb" Jun 08 21:26:55.190200 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:55.190179 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16bc3277-f351-4a07-aee8-27dd4d3782f3-maas-api-tls\") pod \"maas-api-76cdcb8cdb-v2gwb\" (UID: \"16bc3277-f351-4a07-aee8-27dd4d3782f3\") " pod="opendatahub/maas-api-76cdcb8cdb-v2gwb" Jun 08 21:26:55.195172 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:55.195154 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8kgl\" (UniqueName: \"kubernetes.io/projected/16bc3277-f351-4a07-aee8-27dd4d3782f3-kube-api-access-g8kgl\") pod \"maas-api-76cdcb8cdb-v2gwb\" (UID: \"16bc3277-f351-4a07-aee8-27dd4d3782f3\") " pod="opendatahub/maas-api-76cdcb8cdb-v2gwb" Jun 08 21:26:55.330727 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:55.330693 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-76cdcb8cdb-v2gwb" Jun 08 21:26:55.455670 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:55.455636 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-4hc67"] Jun 08 21:26:55.459654 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:55.459630 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-4hc67" Jun 08 21:26:55.462655 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:55.462623 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 08 21:26:55.468585 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:55.468562 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-4hc67"] Jun 08 21:26:55.483132 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:55.483103 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-76cdcb8cdb-v2gwb"] Jun 08 21:26:55.484932 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:26:55.484906 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16bc3277_f351_4a07_aee8_27dd4d3782f3.slice/crio-96170930483de2fa1831e0eabb53cd75b21fc4e6ce573e712e0ba6e86aa59a6e WatchSource:0}: Error finding container 96170930483de2fa1831e0eabb53cd75b21fc4e6ce573e712e0ba6e86aa59a6e: Status 404 returned error can't find the container with id 96170930483de2fa1831e0eabb53cd75b21fc4e6ce573e712e0ba6e86aa59a6e Jun 08 21:26:55.591499 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:55.591380 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lccs5\" (UniqueName: \"kubernetes.io/projected/ca395f35-dc26-433a-bcfe-a512c8b91bc5-kube-api-access-lccs5\") pod \"payload-pre-processing-67d7689b65-4hc67\" (UID: \"ca395f35-dc26-433a-bcfe-a512c8b91bc5\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-4hc67" Jun 08 21:26:55.692840 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:55.692804 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lccs5\" (UniqueName: \"kubernetes.io/projected/ca395f35-dc26-433a-bcfe-a512c8b91bc5-kube-api-access-lccs5\") pod \"payload-pre-processing-67d7689b65-4hc67\" (UID: \"ca395f35-dc26-433a-bcfe-a512c8b91bc5\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-4hc67" Jun 08 21:26:55.701157 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:55.701121 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lccs5\" (UniqueName: \"kubernetes.io/projected/ca395f35-dc26-433a-bcfe-a512c8b91bc5-kube-api-access-lccs5\") pod \"payload-pre-processing-67d7689b65-4hc67\" (UID: \"ca395f35-dc26-433a-bcfe-a512c8b91bc5\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-4hc67" Jun 08 21:26:55.771607 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:55.771573 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-4hc67" Jun 08 21:26:55.907747 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:55.907711 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-4hc67"] Jun 08 21:26:55.911158 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:26:55.911128 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca395f35_dc26_433a_bcfe_a512c8b91bc5.slice/crio-24a237e5a912b11472ee77f5dd8031b5e41dfd8c048584b2fe4e622e1569b2a2 WatchSource:0}: Error finding container 24a237e5a912b11472ee77f5dd8031b5e41dfd8c048584b2fe4e622e1569b2a2: Status 404 returned error can't find the container with id 24a237e5a912b11472ee77f5dd8031b5e41dfd8c048584b2fe4e622e1569b2a2 Jun 08 21:26:55.967725 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:55.967687 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-4hc67" event={"ID":"ca395f35-dc26-433a-bcfe-a512c8b91bc5","Type":"ContainerStarted","Data":"24a237e5a912b11472ee77f5dd8031b5e41dfd8c048584b2fe4e622e1569b2a2"} Jun 08 21:26:55.968963 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:55.968938 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-76cdcb8cdb-v2gwb" event={"ID":"16bc3277-f351-4a07-aee8-27dd4d3782f3","Type":"ContainerStarted","Data":"96170930483de2fa1831e0eabb53cd75b21fc4e6ce573e712e0ba6e86aa59a6e"} Jun 08 21:26:58.006316 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:58.006228 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-4hc67" event={"ID":"ca395f35-dc26-433a-bcfe-a512c8b91bc5","Type":"ContainerStarted","Data":"3028cdf6fbc84ad78f1f70d52c276edec816bf7239d604671f05d4500512a451"} Jun 08 21:26:58.006865 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:58.006804 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-4hc67" Jun 08 21:26:58.008537 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:58.008513 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-76cdcb8cdb-v2gwb" event={"ID":"16bc3277-f351-4a07-aee8-27dd4d3782f3","Type":"ContainerStarted","Data":"08f6bb839b28109244f91cdd0f9ac11fe89740fb01d207be71f66874c1f89574"} Jun 08 21:26:58.008667 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:58.008647 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-76cdcb8cdb-v2gwb" Jun 08 21:26:58.023714 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:58.023665 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-4hc67" podStartSLOduration=1.176920893 podStartE2EDuration="3.023649713s" totalImagesPullingTime="1.84672882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:26:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:26:58.021639441 +0000 UTC m=+790.161682324" watchObservedRunningTime="2026-06-08 21:26:58.023649713 +0000 UTC m=+790.163692590" Jun 08 21:26:58.042941 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:26:58.042885 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-76cdcb8cdb-v2gwb" podStartSLOduration=1.771379547 podStartE2EDuration="4.042869565s" totalImagesPullingTime="2.271490018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:26:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:26:58.040159872 +0000 UTC m=+790.180202752" watchObservedRunningTime="2026-06-08 21:26:58.042869565 +0000 UTC m=+790.182912445" Jun 08 21:27:03.039510 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:03.039476 2564 generic.go:356] "Generic (PLEG): container finished" podID="59bfb807-f104-4ea0-a062-5c4e7ba6e24a" containerID="ecf5b5d038c6145d2798fa5db85d9d85d8ff19b6624cb598a7daee4ec1491f32" exitCode=0 Jun 08 21:27:03.039912 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:03.039550 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" event={"ID":"59bfb807-f104-4ea0-a062-5c4e7ba6e24a","Type":"ContainerDied","Data":"ecf5b5d038c6145d2798fa5db85d9d85d8ff19b6624cb598a7daee4ec1491f32"} Jun 08 21:27:03.039984 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:03.039967 2564 scope.go:117] "RemoveContainer" containerID="ecf5b5d038c6145d2798fa5db85d9d85d8ff19b6624cb598a7daee4ec1491f32" Jun 08 21:27:03.040987 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:03.040951 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 08 21:27:03.041063 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:03.041046 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 08 21:27:03.041139 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:03.041121 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 08 21:27:04.020243 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:04.020213 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-76cdcb8cdb-v2gwb" Jun 08 21:27:04.048106 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:04.048048 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" event={"ID":"59bfb807-f104-4ea0-a062-5c4e7ba6e24a","Type":"ContainerStarted","Data":"318740c5118d99a1891a1e5e04bcfda06c8a1eae3607741d3b6ee7f70ee4532e"} Jun 08 21:27:04.536130 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:04.536092 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:27:04.536330 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:04.536297 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-64bd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jun 08 21:27:04.536410 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:04.536354 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" podUID="59bfb807-f104-4ea0-a062-5c4e7ba6e24a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jun 08 21:27:05.536552 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:05.536512 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-64bd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jun 08 21:27:05.536965 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:05.536571 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" podUID="59bfb807-f104-4ea0-a062-5c4e7ba6e24a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jun 08 21:27:05.757659 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:05.757623 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 21:27:05.757844 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:05.757818 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="9d66b292-877d-40df-b64d-302e89ad104d" containerName="keycloak" containerID="cri-o://e2f639c36989e41784c37fbad08f30c24ac352fcbd277a69f03e5538bf6606f0" gracePeriod=30 Jun 08 21:27:06.535979 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:06.535946 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-64bd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jun 08 21:27:06.536163 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:06.536000 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" podUID="59bfb807-f104-4ea0-a062-5c4e7ba6e24a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jun 08 21:27:07.455847 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:07.455818 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 21:27:07.536745 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:07.536715 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-64bd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jun 08 21:27:07.536897 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:07.536777 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" podUID="59bfb807-f104-4ea0-a062-5c4e7ba6e24a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jun 08 21:27:07.608848 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:07.608814 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfmzk\" (UniqueName: \"kubernetes.io/projected/9d66b292-877d-40df-b64d-302e89ad104d-kube-api-access-tfmzk\") pod \"9d66b292-877d-40df-b64d-302e89ad104d\" (UID: \"9d66b292-877d-40df-b64d-302e89ad104d\") " Jun 08 21:27:07.611317 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:07.611294 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d66b292-877d-40df-b64d-302e89ad104d-kube-api-access-tfmzk" (OuterVolumeSpecName: "kube-api-access-tfmzk") pod "9d66b292-877d-40df-b64d-302e89ad104d" (UID: "9d66b292-877d-40df-b64d-302e89ad104d"). InnerVolumeSpecName "kube-api-access-tfmzk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:27:07.710262 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:07.710219 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfmzk\" (UniqueName: \"kubernetes.io/projected/9d66b292-877d-40df-b64d-302e89ad104d-kube-api-access-tfmzk\") on node \"ip-10-0-135-79.ec2.internal\" DevicePath \"\"" Jun 08 21:27:08.074773 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:08.074741 2564 generic.go:356] "Generic (PLEG): container finished" podID="9d66b292-877d-40df-b64d-302e89ad104d" containerID="e2f639c36989e41784c37fbad08f30c24ac352fcbd277a69f03e5538bf6606f0" exitCode=143 Jun 08 21:27:08.074947 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:08.074783 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"9d66b292-877d-40df-b64d-302e89ad104d","Type":"ContainerDied","Data":"e2f639c36989e41784c37fbad08f30c24ac352fcbd277a69f03e5538bf6606f0"} Jun 08 21:27:08.074947 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:08.074791 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 21:27:08.074947 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:08.074833 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"9d66b292-877d-40df-b64d-302e89ad104d","Type":"ContainerDied","Data":"c6e2874f1f9a3550281d8a01d5721c88a0d66bf62cb9eebd1b929c0b7a2e7559"} Jun 08 21:27:08.074947 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:08.074861 2564 scope.go:117] "RemoveContainer" containerID="e2f639c36989e41784c37fbad08f30c24ac352fcbd277a69f03e5538bf6606f0" Jun 08 21:27:08.085625 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:08.085603 2564 scope.go:117] "RemoveContainer" containerID="e2f639c36989e41784c37fbad08f30c24ac352fcbd277a69f03e5538bf6606f0" Jun 08 21:27:08.085900 ip-10-0-135-79 kubenswrapper[2564]: E0608 21:27:08.085880 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2f639c36989e41784c37fbad08f30c24ac352fcbd277a69f03e5538bf6606f0\": container with ID starting with e2f639c36989e41784c37fbad08f30c24ac352fcbd277a69f03e5538bf6606f0 not found: ID does not exist" containerID="e2f639c36989e41784c37fbad08f30c24ac352fcbd277a69f03e5538bf6606f0" Jun 08 21:27:08.085968 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:08.085906 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2f639c36989e41784c37fbad08f30c24ac352fcbd277a69f03e5538bf6606f0"} err="failed to get container status \"e2f639c36989e41784c37fbad08f30c24ac352fcbd277a69f03e5538bf6606f0\": rpc error: code = NotFound desc = could not find container \"e2f639c36989e41784c37fbad08f30c24ac352fcbd277a69f03e5538bf6606f0\": container with ID starting with e2f639c36989e41784c37fbad08f30c24ac352fcbd277a69f03e5538bf6606f0 not found: ID does not exist" Jun 08 21:27:08.098311 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:08.098284 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 21:27:08.101571 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:08.101548 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 21:27:08.122619 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:08.122593 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 21:27:08.122968 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:08.122955 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d66b292-877d-40df-b64d-302e89ad104d" containerName="keycloak" Jun 08 21:27:08.123011 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:08.122970 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d66b292-877d-40df-b64d-302e89ad104d" containerName="keycloak" Jun 08 21:27:08.123052 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:08.123043 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d66b292-877d-40df-b64d-302e89ad104d" containerName="keycloak" Jun 08 21:27:08.127510 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:08.127494 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 21:27:08.130219 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:08.130194 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 08 21:27:08.130319 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:08.130260 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 08 21:27:08.130373 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:08.130260 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 08 21:27:08.130481 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:08.130466 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-xsjb9\"" Jun 08 21:27:08.130533 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:08.130507 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 08 21:27:08.135304 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:08.135279 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 21:27:08.214987 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:08.214951 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/6fd14e52-e94f-4768-b30b-9f7ed4f3ba9b-test-realms\") pod \"maas-keycloak-0\" (UID: \"6fd14e52-e94f-4768-b30b-9f7ed4f3ba9b\") " pod="keycloak-system/maas-keycloak-0" Jun 08 21:27:08.215210 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:08.215000 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q69sl\" (UniqueName: \"kubernetes.io/projected/6fd14e52-e94f-4768-b30b-9f7ed4f3ba9b-kube-api-access-q69sl\") pod \"maas-keycloak-0\" (UID: \"6fd14e52-e94f-4768-b30b-9f7ed4f3ba9b\") " pod="keycloak-system/maas-keycloak-0" Jun 08 21:27:08.315985 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:08.315950 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/6fd14e52-e94f-4768-b30b-9f7ed4f3ba9b-test-realms\") pod \"maas-keycloak-0\" (UID: \"6fd14e52-e94f-4768-b30b-9f7ed4f3ba9b\") " pod="keycloak-system/maas-keycloak-0" Jun 08 21:27:08.315985 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:08.315990 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q69sl\" (UniqueName: \"kubernetes.io/projected/6fd14e52-e94f-4768-b30b-9f7ed4f3ba9b-kube-api-access-q69sl\") pod \"maas-keycloak-0\" (UID: \"6fd14e52-e94f-4768-b30b-9f7ed4f3ba9b\") " pod="keycloak-system/maas-keycloak-0" Jun 08 21:27:08.316727 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:08.316701 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/6fd14e52-e94f-4768-b30b-9f7ed4f3ba9b-test-realms\") pod \"maas-keycloak-0\" (UID: \"6fd14e52-e94f-4768-b30b-9f7ed4f3ba9b\") " pod="keycloak-system/maas-keycloak-0" Jun 08 21:27:08.324731 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:08.324707 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q69sl\" (UniqueName: \"kubernetes.io/projected/6fd14e52-e94f-4768-b30b-9f7ed4f3ba9b-kube-api-access-q69sl\") pod \"maas-keycloak-0\" (UID: \"6fd14e52-e94f-4768-b30b-9f7ed4f3ba9b\") " pod="keycloak-system/maas-keycloak-0" Jun 08 21:27:08.347701 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:08.347635 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d66b292-877d-40df-b64d-302e89ad104d" path="/var/lib/kubelet/pods/9d66b292-877d-40df-b64d-302e89ad104d/volumes" Jun 08 21:27:08.438472 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:08.438439 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 21:27:08.542650 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:08.542618 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:27:08.543529 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:08.543506 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:27:08.544487 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:08.544452 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-64bd4" Jun 08 21:27:08.583013 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:08.582953 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 21:27:08.586195 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:27:08.586161 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fd14e52_e94f_4768_b30b_9f7ed4f3ba9b.slice/crio-022bdc04197959a7c6baae81414b15ff04c3851a4fb61d326bac0a721aba074e WatchSource:0}: Error finding container 022bdc04197959a7c6baae81414b15ff04c3851a4fb61d326bac0a721aba074e: Status 404 returned error can't find the container with id 022bdc04197959a7c6baae81414b15ff04c3851a4fb61d326bac0a721aba074e Jun 08 21:27:09.084505 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:09.084469 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"6fd14e52-e94f-4768-b30b-9f7ed4f3ba9b","Type":"ContainerStarted","Data":"022bdc04197959a7c6baae81414b15ff04c3851a4fb61d326bac0a721aba074e"} Jun 08 21:27:10.022758 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:10.022716 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-4hc67" Jun 08 21:27:10.097563 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:10.097523 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"6fd14e52-e94f-4768-b30b-9f7ed4f3ba9b","Type":"ContainerStarted","Data":"338cae0c77488036525ea22abf10d9449f0d71d0c43264e835bb9d285ac2d30b"} Jun 08 21:27:10.115860 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:10.115795 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.623057244 podStartE2EDuration="2.11569385s" totalImagesPullingTime="492.636606ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:27:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:27:10.114363388 +0000 UTC m=+802.254406274" watchObservedRunningTime="2026-06-08 21:27:10.11569385 +0000 UTC m=+802.255736734" Jun 08 21:27:10.438727 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:10.438680 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 08 21:27:10.440769 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:10.440731 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6fd14e52-e94f-4768-b30b-9f7ed4f3ba9b" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 08 21:27:11.439051 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:11.439005 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6fd14e52-e94f-4768-b30b-9f7ed4f3ba9b" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 08 21:27:12.439460 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:12.439411 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6fd14e52-e94f-4768-b30b-9f7ed4f3ba9b" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 08 21:27:13.439900 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:13.439479 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6fd14e52-e94f-4768-b30b-9f7ed4f3ba9b" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 08 21:27:14.439845 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:14.439778 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6fd14e52-e94f-4768-b30b-9f7ed4f3ba9b" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 08 21:27:15.439529 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:15.439463 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6fd14e52-e94f-4768-b30b-9f7ed4f3ba9b" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 08 21:27:16.439965 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:16.439903 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6fd14e52-e94f-4768-b30b-9f7ed4f3ba9b" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 08 21:27:17.439051 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:17.439003 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6fd14e52-e94f-4768-b30b-9f7ed4f3ba9b" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 08 21:27:18.439388 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:18.439341 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 08 21:27:18.439894 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:18.439686 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6fd14e52-e94f-4768-b30b-9f7ed4f3ba9b" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 08 21:27:19.438952 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:19.438901 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6fd14e52-e94f-4768-b30b-9f7ed4f3ba9b" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 08 21:27:20.439367 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:20.439317 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6fd14e52-e94f-4768-b30b-9f7ed4f3ba9b" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 08 21:27:21.439436 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:21.439380 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6fd14e52-e94f-4768-b30b-9f7ed4f3ba9b" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 08 21:27:22.552844 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:22.552793 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 08 21:27:22.568850 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:22.568791 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="6fd14e52-e94f-4768-b30b-9f7ed4f3ba9b" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 21:27:32.557427 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:32.557371 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="6fd14e52-e94f-4768-b30b-9f7ed4f3ba9b" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 21:27:42.558832 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:27:42.558783 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 08 21:28:00.340829 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:00.340792 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx"] Jun 08 21:28:00.344472 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:00.344448 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx" Jun 08 21:28:00.347054 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:00.347031 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 08 21:28:00.348491 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:00.348460 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nktt5\"" Jun 08 21:28:00.348627 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:00.348613 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 08 21:28:00.348698 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:00.348687 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 08 21:28:00.352912 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:00.352613 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx"] Jun 08 21:28:00.402908 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:00.402868 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9440b411-ecea-4d95-8354-34ce42008c5a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx\" (UID: \"9440b411-ecea-4d95-8354-34ce42008c5a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx" Jun 08 21:28:00.403097 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:00.402916 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9440b411-ecea-4d95-8354-34ce42008c5a-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx\" (UID: \"9440b411-ecea-4d95-8354-34ce42008c5a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx" Jun 08 21:28:00.403097 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:00.403003 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9440b411-ecea-4d95-8354-34ce42008c5a-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx\" (UID: \"9440b411-ecea-4d95-8354-34ce42008c5a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx" Jun 08 21:28:00.403097 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:00.403033 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9440b411-ecea-4d95-8354-34ce42008c5a-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx\" (UID: \"9440b411-ecea-4d95-8354-34ce42008c5a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx" Jun 08 21:28:00.403097 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:00.403054 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xrn4\" (UniqueName: \"kubernetes.io/projected/9440b411-ecea-4d95-8354-34ce42008c5a-kube-api-access-7xrn4\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx\" (UID: \"9440b411-ecea-4d95-8354-34ce42008c5a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx" Jun 08 21:28:00.403278 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:00.403126 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9440b411-ecea-4d95-8354-34ce42008c5a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx\" (UID: \"9440b411-ecea-4d95-8354-34ce42008c5a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx" Jun 08 21:28:00.504368 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:00.504330 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9440b411-ecea-4d95-8354-34ce42008c5a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx\" (UID: \"9440b411-ecea-4d95-8354-34ce42008c5a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx" Jun 08 21:28:00.504555 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:00.504380 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9440b411-ecea-4d95-8354-34ce42008c5a-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx\" (UID: \"9440b411-ecea-4d95-8354-34ce42008c5a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx" Jun 08 21:28:00.504555 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:00.504420 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9440b411-ecea-4d95-8354-34ce42008c5a-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx\" (UID: \"9440b411-ecea-4d95-8354-34ce42008c5a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx" Jun 08 21:28:00.504555 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:00.504438 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9440b411-ecea-4d95-8354-34ce42008c5a-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx\" (UID: \"9440b411-ecea-4d95-8354-34ce42008c5a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx" Jun 08 21:28:00.504555 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:00.504459 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xrn4\" (UniqueName: \"kubernetes.io/projected/9440b411-ecea-4d95-8354-34ce42008c5a-kube-api-access-7xrn4\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx\" (UID: \"9440b411-ecea-4d95-8354-34ce42008c5a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx" Jun 08 21:28:00.504555 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:00.504481 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9440b411-ecea-4d95-8354-34ce42008c5a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx\" (UID: \"9440b411-ecea-4d95-8354-34ce42008c5a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx" Jun 08 21:28:00.504809 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:00.504789 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9440b411-ecea-4d95-8354-34ce42008c5a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx\" (UID: \"9440b411-ecea-4d95-8354-34ce42008c5a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx" Jun 08 21:28:00.504868 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:00.504804 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9440b411-ecea-4d95-8354-34ce42008c5a-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx\" (UID: \"9440b411-ecea-4d95-8354-34ce42008c5a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx" Jun 08 21:28:00.504936 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:00.504916 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9440b411-ecea-4d95-8354-34ce42008c5a-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx\" (UID: \"9440b411-ecea-4d95-8354-34ce42008c5a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx" Jun 08 21:28:00.506870 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:00.506846 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9440b411-ecea-4d95-8354-34ce42008c5a-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx\" (UID: \"9440b411-ecea-4d95-8354-34ce42008c5a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx" Jun 08 21:28:00.507141 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:00.507124 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9440b411-ecea-4d95-8354-34ce42008c5a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx\" (UID: \"9440b411-ecea-4d95-8354-34ce42008c5a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx" Jun 08 21:28:00.512326 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:00.512304 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xrn4\" (UniqueName: \"kubernetes.io/projected/9440b411-ecea-4d95-8354-34ce42008c5a-kube-api-access-7xrn4\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx\" (UID: \"9440b411-ecea-4d95-8354-34ce42008c5a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx" Jun 08 21:28:00.656558 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:00.656451 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx" Jun 08 21:28:00.790913 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:00.790880 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx"] Jun 08 21:28:00.792415 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:28:00.792392 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9440b411_ecea_4d95_8354_34ce42008c5a.slice/crio-2021fae8a8d34a621b77f903d019d5ca9cc638bd609dc118ec9c0bb0ee3bb2b0 WatchSource:0}: Error finding container 2021fae8a8d34a621b77f903d019d5ca9cc638bd609dc118ec9c0bb0ee3bb2b0: Status 404 returned error can't find the container with id 2021fae8a8d34a621b77f903d019d5ca9cc638bd609dc118ec9c0bb0ee3bb2b0 Jun 08 21:28:01.433949 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:01.433912 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx" event={"ID":"9440b411-ecea-4d95-8354-34ce42008c5a","Type":"ContainerStarted","Data":"2021fae8a8d34a621b77f903d019d5ca9cc638bd609dc118ec9c0bb0ee3bb2b0"} Jun 08 21:28:05.468416 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:05.468373 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx" event={"ID":"9440b411-ecea-4d95-8354-34ce42008c5a","Type":"ContainerStarted","Data":"816f1339f1e2df96475e2c7a4cd59856c87443f4d07d3c346e751c8e69f583c3"} Jun 08 21:28:06.475481 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:06.475374 2564 generic.go:356] "Generic (PLEG): container finished" podID="9440b411-ecea-4d95-8354-34ce42008c5a" containerID="816f1339f1e2df96475e2c7a4cd59856c87443f4d07d3c346e751c8e69f583c3" exitCode=0 Jun 08 21:28:06.475481 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:06.475469 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx" event={"ID":"9440b411-ecea-4d95-8354-34ce42008c5a","Type":"ContainerDied","Data":"816f1339f1e2df96475e2c7a4cd59856c87443f4d07d3c346e751c8e69f583c3"} Jun 08 21:28:08.489396 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:08.489355 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx" event={"ID":"9440b411-ecea-4d95-8354-34ce42008c5a","Type":"ContainerStarted","Data":"bb6a29f794dec613a677b20b262dbbd9b977e48dbaf1d09cbd40d9ed6c5572cc"} Jun 08 21:28:08.510617 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:08.510562 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx" podStartSLOduration=2.14730014 podStartE2EDuration="8.510546872s" totalImagesPullingTime="5.05728819s" totalInitContainerRuntime="1.305958542s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:28:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:28:08.507941521 +0000 UTC m=+860.647984402" watchObservedRunningTime="2026-06-08 21:28:08.510546872 +0000 UTC m=+860.650589747" Jun 08 21:28:10.657059 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:10.657020 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx" Jun 08 21:28:10.657498 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:10.657103 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx" Jun 08 21:28:10.670050 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:10.670020 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx" Jun 08 21:28:11.517040 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:11.517011 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx" Jun 08 21:28:29.207653 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:29.207620 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8"] Jun 08 21:28:29.231394 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:29.231362 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8"] Jun 08 21:28:29.231549 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:29.231486 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8" Jun 08 21:28:29.234367 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:29.234345 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 08 21:28:29.373158 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:29.373111 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/679be3f6-e860-4fa7-aeb1-649332c4063f-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8\" (UID: \"679be3f6-e860-4fa7-aeb1-649332c4063f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8" Jun 08 21:28:29.373340 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:29.373167 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/679be3f6-e860-4fa7-aeb1-649332c4063f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8\" (UID: \"679be3f6-e860-4fa7-aeb1-649332c4063f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8" Jun 08 21:28:29.373340 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:29.373249 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/679be3f6-e860-4fa7-aeb1-649332c4063f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8\" (UID: \"679be3f6-e860-4fa7-aeb1-649332c4063f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8" Jun 08 21:28:29.373340 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:29.373282 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpc2g\" (UniqueName: \"kubernetes.io/projected/679be3f6-e860-4fa7-aeb1-649332c4063f-kube-api-access-bpc2g\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8\" (UID: \"679be3f6-e860-4fa7-aeb1-649332c4063f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8" Jun 08 21:28:29.373340 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:29.373334 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/679be3f6-e860-4fa7-aeb1-649332c4063f-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8\" (UID: \"679be3f6-e860-4fa7-aeb1-649332c4063f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8" Jun 08 21:28:29.373504 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:29.373359 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/679be3f6-e860-4fa7-aeb1-649332c4063f-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8\" (UID: \"679be3f6-e860-4fa7-aeb1-649332c4063f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8" Jun 08 21:28:29.473924 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:29.473822 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/679be3f6-e860-4fa7-aeb1-649332c4063f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8\" (UID: \"679be3f6-e860-4fa7-aeb1-649332c4063f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8" Jun 08 21:28:29.473924 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:29.473866 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpc2g\" (UniqueName: \"kubernetes.io/projected/679be3f6-e860-4fa7-aeb1-649332c4063f-kube-api-access-bpc2g\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8\" (UID: \"679be3f6-e860-4fa7-aeb1-649332c4063f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8" Jun 08 21:28:29.474211 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:29.473998 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/679be3f6-e860-4fa7-aeb1-649332c4063f-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8\" (UID: \"679be3f6-e860-4fa7-aeb1-649332c4063f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8" Jun 08 21:28:29.474211 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:29.474063 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/679be3f6-e860-4fa7-aeb1-649332c4063f-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8\" (UID: \"679be3f6-e860-4fa7-aeb1-649332c4063f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8" Jun 08 21:28:29.474324 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:29.474217 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/679be3f6-e860-4fa7-aeb1-649332c4063f-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8\" (UID: \"679be3f6-e860-4fa7-aeb1-649332c4063f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8" Jun 08 21:28:29.474324 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:29.474270 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/679be3f6-e860-4fa7-aeb1-649332c4063f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8\" (UID: \"679be3f6-e860-4fa7-aeb1-649332c4063f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8" Jun 08 21:28:29.474538 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:29.474517 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/679be3f6-e860-4fa7-aeb1-649332c4063f-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8\" (UID: \"679be3f6-e860-4fa7-aeb1-649332c4063f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8" Jun 08 21:28:29.474640 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:29.474557 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/679be3f6-e860-4fa7-aeb1-649332c4063f-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8\" (UID: \"679be3f6-e860-4fa7-aeb1-649332c4063f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8" Jun 08 21:28:29.474640 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:29.474601 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/679be3f6-e860-4fa7-aeb1-649332c4063f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8\" (UID: \"679be3f6-e860-4fa7-aeb1-649332c4063f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8" Jun 08 21:28:29.476354 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:29.476334 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/679be3f6-e860-4fa7-aeb1-649332c4063f-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8\" (UID: \"679be3f6-e860-4fa7-aeb1-649332c4063f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8" Jun 08 21:28:29.476657 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:29.476640 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/679be3f6-e860-4fa7-aeb1-649332c4063f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8\" (UID: \"679be3f6-e860-4fa7-aeb1-649332c4063f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8" Jun 08 21:28:29.481551 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:29.481527 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpc2g\" (UniqueName: \"kubernetes.io/projected/679be3f6-e860-4fa7-aeb1-649332c4063f-kube-api-access-bpc2g\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8\" (UID: \"679be3f6-e860-4fa7-aeb1-649332c4063f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8" Jun 08 21:28:29.542341 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:29.542300 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8" Jun 08 21:28:29.689545 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:29.689513 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8"] Jun 08 21:28:29.690874 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:28:29.690840 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod679be3f6_e860_4fa7_aeb1_649332c4063f.slice/crio-dbe8fab5f2b541149e9a6f866961fe97f8544d9c9f5a918ac022365a189883fc WatchSource:0}: Error finding container dbe8fab5f2b541149e9a6f866961fe97f8544d9c9f5a918ac022365a189883fc: Status 404 returned error can't find the container with id dbe8fab5f2b541149e9a6f866961fe97f8544d9c9f5a918ac022365a189883fc Jun 08 21:28:30.624823 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:30.624789 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8" event={"ID":"679be3f6-e860-4fa7-aeb1-649332c4063f","Type":"ContainerStarted","Data":"7826cf49ab8c7a41c703eda9973c0a05014c2a7dc16c9d6c79b8c5e8cbdc699d"} Jun 08 21:28:30.625261 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:30.624847 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8" event={"ID":"679be3f6-e860-4fa7-aeb1-649332c4063f","Type":"ContainerStarted","Data":"dbe8fab5f2b541149e9a6f866961fe97f8544d9c9f5a918ac022365a189883fc"} Jun 08 21:28:41.826955 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:41.826909 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9"] Jun 08 21:28:41.832750 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:41.832723 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9" Jun 08 21:28:41.835633 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:41.835605 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 08 21:28:41.841436 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:41.841409 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9"] Jun 08 21:28:41.991460 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:41.991415 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7918470a-6e35-4373-976d-4ec0fb5ef395-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9\" (UID: \"7918470a-6e35-4373-976d-4ec0fb5ef395\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9" Jun 08 21:28:41.991690 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:41.991475 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7918470a-6e35-4373-976d-4ec0fb5ef395-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9\" (UID: \"7918470a-6e35-4373-976d-4ec0fb5ef395\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9" Jun 08 21:28:41.991690 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:41.991542 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7918470a-6e35-4373-976d-4ec0fb5ef395-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9\" (UID: \"7918470a-6e35-4373-976d-4ec0fb5ef395\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9" Jun 08 21:28:41.991690 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:41.991593 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7918470a-6e35-4373-976d-4ec0fb5ef395-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9\" (UID: \"7918470a-6e35-4373-976d-4ec0fb5ef395\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9" Jun 08 21:28:41.991690 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:41.991641 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7918470a-6e35-4373-976d-4ec0fb5ef395-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9\" (UID: \"7918470a-6e35-4373-976d-4ec0fb5ef395\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9" Jun 08 21:28:41.991863 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:41.991720 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhpts\" (UniqueName: \"kubernetes.io/projected/7918470a-6e35-4373-976d-4ec0fb5ef395-kube-api-access-nhpts\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9\" (UID: \"7918470a-6e35-4373-976d-4ec0fb5ef395\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9" Jun 08 21:28:42.093018 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:42.092914 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7918470a-6e35-4373-976d-4ec0fb5ef395-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9\" (UID: \"7918470a-6e35-4373-976d-4ec0fb5ef395\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9" Jun 08 21:28:42.093018 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:42.092973 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhpts\" (UniqueName: \"kubernetes.io/projected/7918470a-6e35-4373-976d-4ec0fb5ef395-kube-api-access-nhpts\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9\" (UID: \"7918470a-6e35-4373-976d-4ec0fb5ef395\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9" Jun 08 21:28:42.093295 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:42.093041 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7918470a-6e35-4373-976d-4ec0fb5ef395-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9\" (UID: \"7918470a-6e35-4373-976d-4ec0fb5ef395\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9" Jun 08 21:28:42.093295 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:42.093125 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7918470a-6e35-4373-976d-4ec0fb5ef395-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9\" (UID: \"7918470a-6e35-4373-976d-4ec0fb5ef395\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9" Jun 08 21:28:42.093295 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:42.093167 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7918470a-6e35-4373-976d-4ec0fb5ef395-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9\" (UID: \"7918470a-6e35-4373-976d-4ec0fb5ef395\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9" Jun 08 21:28:42.093295 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:42.093194 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7918470a-6e35-4373-976d-4ec0fb5ef395-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9\" (UID: \"7918470a-6e35-4373-976d-4ec0fb5ef395\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9" Jun 08 21:28:42.093538 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:42.093520 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7918470a-6e35-4373-976d-4ec0fb5ef395-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9\" (UID: \"7918470a-6e35-4373-976d-4ec0fb5ef395\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9" Jun 08 21:28:42.093594 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:42.093552 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7918470a-6e35-4373-976d-4ec0fb5ef395-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9\" (UID: \"7918470a-6e35-4373-976d-4ec0fb5ef395\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9" Jun 08 21:28:42.093663 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:42.093638 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7918470a-6e35-4373-976d-4ec0fb5ef395-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9\" (UID: \"7918470a-6e35-4373-976d-4ec0fb5ef395\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9" Jun 08 21:28:42.095530 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:42.095509 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7918470a-6e35-4373-976d-4ec0fb5ef395-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9\" (UID: \"7918470a-6e35-4373-976d-4ec0fb5ef395\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9" Jun 08 21:28:42.095695 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:42.095677 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7918470a-6e35-4373-976d-4ec0fb5ef395-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9\" (UID: \"7918470a-6e35-4373-976d-4ec0fb5ef395\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9" Jun 08 21:28:42.101482 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:42.101453 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhpts\" (UniqueName: \"kubernetes.io/projected/7918470a-6e35-4373-976d-4ec0fb5ef395-kube-api-access-nhpts\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9\" (UID: \"7918470a-6e35-4373-976d-4ec0fb5ef395\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9" Jun 08 21:28:42.145444 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:42.145405 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9" Jun 08 21:28:42.287222 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:42.287179 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9"] Jun 08 21:28:42.288639 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:28:42.288612 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7918470a_6e35_4373_976d_4ec0fb5ef395.slice/crio-fcec6e6dc18d930db5d44df1d3757fdcb06698cb1ef74da0cfd9c3ef5f24b66c WatchSource:0}: Error finding container fcec6e6dc18d930db5d44df1d3757fdcb06698cb1ef74da0cfd9c3ef5f24b66c: Status 404 returned error can't find the container with id fcec6e6dc18d930db5d44df1d3757fdcb06698cb1ef74da0cfd9c3ef5f24b66c Jun 08 21:28:42.693545 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:42.693455 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9" event={"ID":"7918470a-6e35-4373-976d-4ec0fb5ef395","Type":"ContainerStarted","Data":"827e88199d79a2dff4c5f63f99adf61dbe4d9857b539749e61beb31e9214ae13"} Jun 08 21:28:42.693545 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:42.693522 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9" event={"ID":"7918470a-6e35-4373-976d-4ec0fb5ef395","Type":"ContainerStarted","Data":"fcec6e6dc18d930db5d44df1d3757fdcb06698cb1ef74da0cfd9c3ef5f24b66c"} Jun 08 21:28:51.104633 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:51.104586 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq"] Jun 08 21:28:51.110210 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:51.110188 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq" Jun 08 21:28:51.113406 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:51.113381 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 08 21:28:51.118794 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:51.118769 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq"] Jun 08 21:28:51.170738 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:51.170692 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a103d5a-d9cf-4931-810b-9705ce6b5660-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq\" (UID: \"1a103d5a-d9cf-4931-810b-9705ce6b5660\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq" Jun 08 21:28:51.170738 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:51.170740 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a103d5a-d9cf-4931-810b-9705ce6b5660-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq\" (UID: \"1a103d5a-d9cf-4931-810b-9705ce6b5660\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq" Jun 08 21:28:51.171002 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:51.170782 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a103d5a-d9cf-4931-810b-9705ce6b5660-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq\" (UID: \"1a103d5a-d9cf-4931-810b-9705ce6b5660\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq" Jun 08 21:28:51.171002 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:51.170902 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xxq8\" (UniqueName: \"kubernetes.io/projected/1a103d5a-d9cf-4931-810b-9705ce6b5660-kube-api-access-9xxq8\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq\" (UID: \"1a103d5a-d9cf-4931-810b-9705ce6b5660\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq" Jun 08 21:28:51.171002 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:51.170946 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1a103d5a-d9cf-4931-810b-9705ce6b5660-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq\" (UID: \"1a103d5a-d9cf-4931-810b-9705ce6b5660\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq" Jun 08 21:28:51.171002 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:51.170966 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a103d5a-d9cf-4931-810b-9705ce6b5660-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq\" (UID: \"1a103d5a-d9cf-4931-810b-9705ce6b5660\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq" Jun 08 21:28:51.272034 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:51.271993 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a103d5a-d9cf-4931-810b-9705ce6b5660-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq\" (UID: \"1a103d5a-d9cf-4931-810b-9705ce6b5660\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq" Jun 08 21:28:51.272256 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:51.272057 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xxq8\" (UniqueName: \"kubernetes.io/projected/1a103d5a-d9cf-4931-810b-9705ce6b5660-kube-api-access-9xxq8\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq\" (UID: \"1a103d5a-d9cf-4931-810b-9705ce6b5660\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq" Jun 08 21:28:51.272256 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:51.272114 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1a103d5a-d9cf-4931-810b-9705ce6b5660-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq\" (UID: \"1a103d5a-d9cf-4931-810b-9705ce6b5660\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq" Jun 08 21:28:51.272256 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:51.272132 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a103d5a-d9cf-4931-810b-9705ce6b5660-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq\" (UID: \"1a103d5a-d9cf-4931-810b-9705ce6b5660\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq" Jun 08 21:28:51.272256 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:51.272151 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a103d5a-d9cf-4931-810b-9705ce6b5660-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq\" (UID: \"1a103d5a-d9cf-4931-810b-9705ce6b5660\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq" Jun 08 21:28:51.272256 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:51.272182 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a103d5a-d9cf-4931-810b-9705ce6b5660-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq\" (UID: \"1a103d5a-d9cf-4931-810b-9705ce6b5660\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq" Jun 08 21:28:51.272535 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:51.272506 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a103d5a-d9cf-4931-810b-9705ce6b5660-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq\" (UID: \"1a103d5a-d9cf-4931-810b-9705ce6b5660\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq" Jun 08 21:28:51.272590 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:51.272529 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1a103d5a-d9cf-4931-810b-9705ce6b5660-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq\" (UID: \"1a103d5a-d9cf-4931-810b-9705ce6b5660\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq" Jun 08 21:28:51.272590 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:51.272569 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a103d5a-d9cf-4931-810b-9705ce6b5660-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq\" (UID: \"1a103d5a-d9cf-4931-810b-9705ce6b5660\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq" Jun 08 21:28:51.274632 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:51.274610 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a103d5a-d9cf-4931-810b-9705ce6b5660-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq\" (UID: \"1a103d5a-d9cf-4931-810b-9705ce6b5660\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq" Jun 08 21:28:51.274883 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:51.274864 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a103d5a-d9cf-4931-810b-9705ce6b5660-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq\" (UID: \"1a103d5a-d9cf-4931-810b-9705ce6b5660\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq" Jun 08 21:28:51.280806 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:51.280775 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xxq8\" (UniqueName: \"kubernetes.io/projected/1a103d5a-d9cf-4931-810b-9705ce6b5660-kube-api-access-9xxq8\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq\" (UID: \"1a103d5a-d9cf-4931-810b-9705ce6b5660\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq" Jun 08 21:28:51.422189 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:51.422056 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq" Jun 08 21:28:51.568045 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:51.568010 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq"] Jun 08 21:28:51.568561 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:28:51.568533 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a103d5a_d9cf_4931_810b_9705ce6b5660.slice/crio-012caa12c1fab6ee9df3db6eceefafbec7b64039b3260ef5674b31aa93dd07b6 WatchSource:0}: Error finding container 012caa12c1fab6ee9df3db6eceefafbec7b64039b3260ef5674b31aa93dd07b6: Status 404 returned error can't find the container with id 012caa12c1fab6ee9df3db6eceefafbec7b64039b3260ef5674b31aa93dd07b6 Jun 08 21:28:51.752646 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:51.752539 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq" event={"ID":"1a103d5a-d9cf-4931-810b-9705ce6b5660","Type":"ContainerStarted","Data":"29a29e9e25d4e1a7f539278b90faf82b699c70cc38a72dfa636a7bf67532a435"} Jun 08 21:28:51.752646 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:28:51.752595 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq" event={"ID":"1a103d5a-d9cf-4931-810b-9705ce6b5660","Type":"ContainerStarted","Data":"012caa12c1fab6ee9df3db6eceefafbec7b64039b3260ef5674b31aa93dd07b6"} Jun 08 21:29:35.007479 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:29:35.007445 2564 generic.go:356] "Generic (PLEG): container finished" podID="7918470a-6e35-4373-976d-4ec0fb5ef395" containerID="827e88199d79a2dff4c5f63f99adf61dbe4d9857b539749e61beb31e9214ae13" exitCode=0 Jun 08 21:29:35.007897 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:29:35.007520 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9" event={"ID":"7918470a-6e35-4373-976d-4ec0fb5ef395","Type":"ContainerDied","Data":"827e88199d79a2dff4c5f63f99adf61dbe4d9857b539749e61beb31e9214ae13"} Jun 08 21:29:36.015249 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:29:36.015197 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9" event={"ID":"7918470a-6e35-4373-976d-4ec0fb5ef395","Type":"ContainerStarted","Data":"85e97869de040d4982b54b772ce9530891519406c5522e0cd667fcd2df5fef1b"} Jun 08 21:29:36.033390 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:29:36.033339 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9" podStartSLOduration=2.778019014 podStartE2EDuration="55.033323086s" totalImagesPullingTime="221.49888ms" totalInitContainerRuntime="52.033805192s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:29:36.032571244 +0000 UTC m=+948.172614126" watchObservedRunningTime="2026-06-08 21:29:36.033323086 +0000 UTC m=+948.173366001" Jun 08 21:29:42.146303 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:29:42.146264 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9" Jun 08 21:29:42.146696 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:29:42.146329 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9" Jun 08 21:29:42.160979 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:29:42.159659 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9" Jun 08 21:29:43.067155 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:29:43.067124 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9" Jun 08 21:29:44.064061 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:29:44.064029 2564 generic.go:356] "Generic (PLEG): container finished" podID="1a103d5a-d9cf-4931-810b-9705ce6b5660" containerID="29a29e9e25d4e1a7f539278b90faf82b699c70cc38a72dfa636a7bf67532a435" exitCode=0 Jun 08 21:29:44.064490 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:29:44.064100 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq" event={"ID":"1a103d5a-d9cf-4931-810b-9705ce6b5660","Type":"ContainerDied","Data":"29a29e9e25d4e1a7f539278b90faf82b699c70cc38a72dfa636a7bf67532a435"} Jun 08 21:29:45.072582 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:29:45.072545 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq" event={"ID":"1a103d5a-d9cf-4931-810b-9705ce6b5660","Type":"ContainerStarted","Data":"754da0ecb198053b371dbc72f5107dd30a3e2734a1359de6e6d0711973d5491a"} Jun 08 21:29:45.091895 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:29:45.091853 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq" podStartSLOduration=1.952170015 podStartE2EDuration="54.091839243s" totalImagesPullingTime="257.932153ms" totalInitContainerRuntime="51.881737075s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:28:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:29:45.090617842 +0000 UTC m=+957.230660722" watchObservedRunningTime="2026-06-08 21:29:45.091839243 +0000 UTC m=+957.231882124" Jun 08 21:29:51.422732 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:29:51.422685 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq" Jun 08 21:29:51.423284 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:29:51.422793 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq" Jun 08 21:29:51.435781 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:29:51.435752 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq" Jun 08 21:29:52.126088 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:29:52.126038 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq" Jun 08 21:39:39.470555 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:39.470530 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-865f89cc7c-xwxj9_d406c41d-f20f-494f-8595-86b39d59a1ec/nginx/0.log" Jun 08 21:39:39.823898 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:39.823870 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-76cdcb8cdb-v2gwb_16bc3277-f351-4a07-aee8-27dd4d3782f3/maas-api/0.log" Jun 08 21:39:40.571681 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:40.571652 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-697d6d88bf-s8qrd_afe84586-1752-4bad-9c69-bb0ef9c403cb/copy-manifests/0.log" Jun 08 21:39:40.579109 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:40.579085 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-697d6d88bf-s8qrd_afe84586-1752-4bad-9c69-bb0ef9c403cb/manager/0.log" Jun 08 21:39:40.802845 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:40.802819 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-c64kz_fd0ac10c-1b22-4ca1-9eba-998b940799bd/postgres/0.log" Jun 08 21:39:41.565514 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:41.565479 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx_51bbd0d6-f697-4f60-9a43-d94627eae43c/util/0.log" Jun 08 21:39:41.573627 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:41.573602 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx_51bbd0d6-f697-4f60-9a43-d94627eae43c/pull/0.log" Jun 08 21:39:41.581963 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:41.581944 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx_51bbd0d6-f697-4f60-9a43-d94627eae43c/extract/0.log" Jun 08 21:39:41.692491 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:41.692465 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw_3da7ddcf-9880-4b7b-b83a-cd9747ddb749/extract/0.log" Jun 08 21:39:41.698701 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:41.698683 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw_3da7ddcf-9880-4b7b-b83a-cd9747ddb749/util/0.log" Jun 08 21:39:41.704870 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:41.704853 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw_3da7ddcf-9880-4b7b-b83a-cd9747ddb749/pull/0.log" Jun 08 21:39:41.816640 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:41.816580 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r_2be4404e-a1ca-4381-8cbe-af3cac581fd1/util/0.log" Jun 08 21:39:41.822824 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:41.822805 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r_2be4404e-a1ca-4381-8cbe-af3cac581fd1/pull/0.log" Jun 08 21:39:41.829257 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:41.829238 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r_2be4404e-a1ca-4381-8cbe-af3cac581fd1/extract/0.log" Jun 08 21:39:41.933774 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:41.933746 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr_5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd/pull/0.log" Jun 08 21:39:41.939859 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:41.939838 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr_5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd/extract/0.log" Jun 08 21:39:41.945182 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:41.945167 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr_5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd/util/0.log" Jun 08 21:39:42.187608 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:42.187523 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-bnl2z_c3900765-8ae5-4915-8eb3-2ee7ff12e132/manager/0.log" Jun 08 21:39:42.298867 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:42.298837 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-529lw_9bd998de-0179-4e5d-8e43-3ca2d052de08/manager/0.log" Jun 08 21:39:42.405630 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:42.405605 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-k4svn_237b1843-7e73-4117-b658-bf1ca4cd0e25/kuadrant-console-plugin/0.log" Jun 08 21:39:42.521466 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:42.521395 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-cdtgk_f291ac39-cf96-4272-8178-8cd2b37672d7/registry-server/0.log" Jun 08 21:39:43.191775 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:43.191744 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcsglc8_8538f355-b940-44a9-8963-00dbb5a82c5f/istio-proxy/0.log" Jun 08 21:39:43.646291 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:43.646262 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-64bd4_59bfb807-f104-4ea0-a062-5c4e7ba6e24a/istio-proxy/1.log" Jun 08 21:39:43.758448 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:43.758421 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-4hc67_ca395f35-dc26-433a-bcfe-a512c8b91bc5/payload-pre-processing/0.log" Jun 08 21:39:43.976659 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:43.976580 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-666f6c5b9c-ssbtn_7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3/router/0.log" Jun 08 21:39:44.308666 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:44.308628 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx_9440b411-ecea-4d95-8354-34ce42008c5a/storage-initializer/0.log" Jun 08 21:39:44.315921 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:44.315897 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-vmbvx_9440b411-ecea-4d95-8354-34ce42008c5a/main/0.log" Jun 08 21:39:44.535770 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:44.535741 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-hh2c8_679be3f6-e860-4fa7-aeb1-649332c4063f/storage-initializer/0.log" Jun 08 21:39:44.646738 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:44.646665 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9_7918470a-6e35-4373-976d-4ec0fb5ef395/storage-initializer/0.log" Jun 08 21:39:44.653212 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:44.653192 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c64xg9_7918470a-6e35-4373-976d-4ec0fb5ef395/main/0.log" Jun 08 21:39:44.758839 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:44.758815 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq_1a103d5a-d9cf-4931-810b-9705ce6b5660/storage-initializer/0.log" Jun 08 21:39:44.768685 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:44.768662 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-rrmpq_1a103d5a-d9cf-4931-810b-9705ce6b5660/main/0.log" Jun 08 21:39:51.756058 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:51.756025 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qgmqb_30982bae-7fbf-49b2-a16a-2b01df5d6a30/global-pull-secret-syncer/0.log" Jun 08 21:39:51.826924 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:51.826892 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-km8nj_3ccf1861-eb1f-494e-87b4-1508123ccfd6/konnectivity-agent/0.log" Jun 08 21:39:51.918347 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:51.918320 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-79.ec2.internal_8d2f4ab0296ea13816c307edf2a2d2c0/haproxy/0.log" Jun 08 21:39:56.438748 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:56.438719 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx_51bbd0d6-f697-4f60-9a43-d94627eae43c/extract/0.log" Jun 08 21:39:56.461360 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:56.461334 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx_51bbd0d6-f697-4f60-9a43-d94627eae43c/util/0.log" Jun 08 21:39:56.480672 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:56.480651 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wbwnx_51bbd0d6-f697-4f60-9a43-d94627eae43c/pull/0.log" Jun 08 21:39:56.506787 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:56.506764 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw_3da7ddcf-9880-4b7b-b83a-cd9747ddb749/extract/0.log" Jun 08 21:39:56.527192 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:56.527171 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw_3da7ddcf-9880-4b7b-b83a-cd9747ddb749/util/0.log" Jun 08 21:39:56.547506 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:56.547484 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cd2gw_3da7ddcf-9880-4b7b-b83a-cd9747ddb749/pull/0.log" Jun 08 21:39:56.574773 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:56.574752 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r_2be4404e-a1ca-4381-8cbe-af3cac581fd1/extract/0.log" Jun 08 21:39:56.594928 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:56.594912 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r_2be4404e-a1ca-4381-8cbe-af3cac581fd1/util/0.log" Jun 08 21:39:56.626253 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:56.626234 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nh72r_2be4404e-a1ca-4381-8cbe-af3cac581fd1/pull/0.log" Jun 08 21:39:56.655573 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:56.655553 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr_5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd/extract/0.log" Jun 08 21:39:56.676085 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:56.676037 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr_5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd/util/0.log" Jun 08 21:39:56.700306 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:56.700240 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lldcr_5acbc0e0-c6d4-45b2-b9f2-149b0a4da3bd/pull/0.log" Jun 08 21:39:56.902567 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:56.902533 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-bnl2z_c3900765-8ae5-4915-8eb3-2ee7ff12e132/manager/0.log" Jun 08 21:39:56.924527 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:56.924502 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-529lw_9bd998de-0179-4e5d-8e43-3ca2d052de08/manager/0.log" Jun 08 21:39:56.947469 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:56.947444 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-k4svn_237b1843-7e73-4117-b658-bf1ca4cd0e25/kuadrant-console-plugin/0.log" Jun 08 21:39:56.986311 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:56.986247 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-cdtgk_f291ac39-cf96-4272-8178-8cd2b37672d7/registry-server/0.log" Jun 08 21:39:58.803457 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:58.803427 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-cvwhd_1bd23943-c430-434a-b125-d5957fd6c8ee/cluster-monitoring-operator/0.log" Jun 08 21:39:59.125781 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:59.125696 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xphsd_d84c3bbe-7f8e-4d22-9135-ab07ec3229fc/node-exporter/0.log" Jun 08 21:39:59.145524 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:59.145502 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xphsd_d84c3bbe-7f8e-4d22-9135-ab07ec3229fc/kube-rbac-proxy/0.log" Jun 08 21:39:59.166944 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:59.166921 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xphsd_d84c3bbe-7f8e-4d22-9135-ab07ec3229fc/init-textfile/0.log" Jun 08 21:39:59.192335 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:59.192315 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-69gk5_9344bf3f-c069-46ae-a9ba-725376e7ecc7/kube-rbac-proxy-main/0.log" Jun 08 21:39:59.212063 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:59.212042 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-69gk5_9344bf3f-c069-46ae-a9ba-725376e7ecc7/kube-rbac-proxy-self/0.log" Jun 08 21:39:59.234016 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:59.233989 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-69gk5_9344bf3f-c069-46ae-a9ba-725376e7ecc7/openshift-state-metrics/0.log" Jun 08 21:39:59.456108 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:59.456061 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-x5lsk_7cb4d3c5-5f41-475c-b2ed-09835366e940/prometheus-operator/0.log" Jun 08 21:39:59.491848 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:59.491827 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-x5lsk_7cb4d3c5-5f41-475c-b2ed-09835366e940/kube-rbac-proxy/0.log" Jun 08 21:39:59.522019 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:39:59.521960 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-w2bbf_e453a443-47fe-4d29-aa22-a7ba786d1976/prometheus-operator-admission-webhook/0.log" Jun 08 21:40:02.416794 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:02.416762 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-tkkdm_ce7d9d0d-9af9-49df-ab21-c514fe47c28f/download-server/0.log" Jun 08 21:40:03.035467 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:03.035419 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p4wg5/perf-node-gather-daemonset-8bsmw"] Jun 08 21:40:03.039181 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:03.039164 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p4wg5/perf-node-gather-daemonset-8bsmw" Jun 08 21:40:03.042135 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:03.042113 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p4wg5\"/\"openshift-service-ca.crt\"" Jun 08 21:40:03.042270 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:03.042237 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p4wg5\"/\"default-dockercfg-jxtnm\"" Jun 08 21:40:03.043368 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:03.043344 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p4wg5\"/\"kube-root-ca.crt\"" Jun 08 21:40:03.047316 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:03.047298 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p4wg5/perf-node-gather-daemonset-8bsmw"] Jun 08 21:40:03.093945 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:03.093917 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kn2x\" (UniqueName: \"kubernetes.io/projected/49c158ec-2237-4289-a61a-6f5366aa05bb-kube-api-access-6kn2x\") pod \"perf-node-gather-daemonset-8bsmw\" (UID: \"49c158ec-2237-4289-a61a-6f5366aa05bb\") " pod="openshift-must-gather-p4wg5/perf-node-gather-daemonset-8bsmw" Jun 08 21:40:03.094116 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:03.093956 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/49c158ec-2237-4289-a61a-6f5366aa05bb-proc\") pod \"perf-node-gather-daemonset-8bsmw\" (UID: \"49c158ec-2237-4289-a61a-6f5366aa05bb\") " pod="openshift-must-gather-p4wg5/perf-node-gather-daemonset-8bsmw" Jun 08 21:40:03.094116 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:03.093982 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49c158ec-2237-4289-a61a-6f5366aa05bb-lib-modules\") pod \"perf-node-gather-daemonset-8bsmw\" (UID: \"49c158ec-2237-4289-a61a-6f5366aa05bb\") " pod="openshift-must-gather-p4wg5/perf-node-gather-daemonset-8bsmw" Jun 08 21:40:03.094116 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:03.094098 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/49c158ec-2237-4289-a61a-6f5366aa05bb-podres\") pod \"perf-node-gather-daemonset-8bsmw\" (UID: \"49c158ec-2237-4289-a61a-6f5366aa05bb\") " pod="openshift-must-gather-p4wg5/perf-node-gather-daemonset-8bsmw" Jun 08 21:40:03.094271 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:03.094141 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49c158ec-2237-4289-a61a-6f5366aa05bb-sys\") pod \"perf-node-gather-daemonset-8bsmw\" (UID: \"49c158ec-2237-4289-a61a-6f5366aa05bb\") " pod="openshift-must-gather-p4wg5/perf-node-gather-daemonset-8bsmw" Jun 08 21:40:03.195367 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:03.195332 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49c158ec-2237-4289-a61a-6f5366aa05bb-sys\") pod \"perf-node-gather-daemonset-8bsmw\" (UID: \"49c158ec-2237-4289-a61a-6f5366aa05bb\") " pod="openshift-must-gather-p4wg5/perf-node-gather-daemonset-8bsmw" Jun 08 21:40:03.195511 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:03.195428 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kn2x\" (UniqueName: \"kubernetes.io/projected/49c158ec-2237-4289-a61a-6f5366aa05bb-kube-api-access-6kn2x\") pod \"perf-node-gather-daemonset-8bsmw\" (UID: \"49c158ec-2237-4289-a61a-6f5366aa05bb\") " pod="openshift-must-gather-p4wg5/perf-node-gather-daemonset-8bsmw" Jun 08 21:40:03.195511 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:03.195452 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/49c158ec-2237-4289-a61a-6f5366aa05bb-proc\") pod \"perf-node-gather-daemonset-8bsmw\" (UID: \"49c158ec-2237-4289-a61a-6f5366aa05bb\") " pod="openshift-must-gather-p4wg5/perf-node-gather-daemonset-8bsmw" Jun 08 21:40:03.195511 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:03.195460 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49c158ec-2237-4289-a61a-6f5366aa05bb-sys\") pod \"perf-node-gather-daemonset-8bsmw\" (UID: \"49c158ec-2237-4289-a61a-6f5366aa05bb\") " pod="openshift-must-gather-p4wg5/perf-node-gather-daemonset-8bsmw" Jun 08 21:40:03.195511 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:03.195475 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49c158ec-2237-4289-a61a-6f5366aa05bb-lib-modules\") pod \"perf-node-gather-daemonset-8bsmw\" (UID: \"49c158ec-2237-4289-a61a-6f5366aa05bb\") " pod="openshift-must-gather-p4wg5/perf-node-gather-daemonset-8bsmw" Jun 08 21:40:03.195667 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:03.195529 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/49c158ec-2237-4289-a61a-6f5366aa05bb-podres\") pod \"perf-node-gather-daemonset-8bsmw\" (UID: \"49c158ec-2237-4289-a61a-6f5366aa05bb\") " pod="openshift-must-gather-p4wg5/perf-node-gather-daemonset-8bsmw" Jun 08 21:40:03.195667 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:03.195566 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/49c158ec-2237-4289-a61a-6f5366aa05bb-proc\") pod \"perf-node-gather-daemonset-8bsmw\" (UID: \"49c158ec-2237-4289-a61a-6f5366aa05bb\") " pod="openshift-must-gather-p4wg5/perf-node-gather-daemonset-8bsmw" Jun 08 21:40:03.195667 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:03.195574 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49c158ec-2237-4289-a61a-6f5366aa05bb-lib-modules\") pod \"perf-node-gather-daemonset-8bsmw\" (UID: \"49c158ec-2237-4289-a61a-6f5366aa05bb\") " pod="openshift-must-gather-p4wg5/perf-node-gather-daemonset-8bsmw" Jun 08 21:40:03.195762 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:03.195665 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/49c158ec-2237-4289-a61a-6f5366aa05bb-podres\") pod \"perf-node-gather-daemonset-8bsmw\" (UID: \"49c158ec-2237-4289-a61a-6f5366aa05bb\") " pod="openshift-must-gather-p4wg5/perf-node-gather-daemonset-8bsmw" Jun 08 21:40:03.203899 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:03.203871 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kn2x\" (UniqueName: \"kubernetes.io/projected/49c158ec-2237-4289-a61a-6f5366aa05bb-kube-api-access-6kn2x\") pod \"perf-node-gather-daemonset-8bsmw\" (UID: \"49c158ec-2237-4289-a61a-6f5366aa05bb\") " pod="openshift-must-gather-p4wg5/perf-node-gather-daemonset-8bsmw" Jun 08 21:40:03.349981 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:03.349888 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p4wg5/perf-node-gather-daemonset-8bsmw" Jun 08 21:40:03.489197 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:03.489165 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p4wg5/perf-node-gather-daemonset-8bsmw"] Jun 08 21:40:03.489564 ip-10-0-135-79 kubenswrapper[2564]: W0608 21:40:03.489513 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod49c158ec_2237_4289_a61a_6f5366aa05bb.slice/crio-b3ad1707b730d92a2f4535a31b2db0475fc156acf6d3a57ca1aa39129a73e2c7 WatchSource:0}: Error finding container b3ad1707b730d92a2f4535a31b2db0475fc156acf6d3a57ca1aa39129a73e2c7: Status 404 returned error can't find the container with id b3ad1707b730d92a2f4535a31b2db0475fc156acf6d3a57ca1aa39129a73e2c7 Jun 08 21:40:03.780775 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:03.780678 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p4wg5/perf-node-gather-daemonset-8bsmw" event={"ID":"49c158ec-2237-4289-a61a-6f5366aa05bb","Type":"ContainerStarted","Data":"23f23c55bfc409575e2305c13c0a587aaeb4a70cc048b2b5134b99d9c24cdfef"} Jun 08 21:40:03.780775 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:03.780734 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p4wg5/perf-node-gather-daemonset-8bsmw" event={"ID":"49c158ec-2237-4289-a61a-6f5366aa05bb","Type":"ContainerStarted","Data":"b3ad1707b730d92a2f4535a31b2db0475fc156acf6d3a57ca1aa39129a73e2c7"} Jun 08 21:40:03.781004 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:03.780829 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-p4wg5/perf-node-gather-daemonset-8bsmw" Jun 08 21:40:03.797402 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:03.797355 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-p4wg5/perf-node-gather-daemonset-8bsmw" podStartSLOduration=0.797342849 podStartE2EDuration="797.342849ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:40:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:40:03.795767201 +0000 UTC m=+1575.935810084" watchObservedRunningTime="2026-06-08 21:40:03.797342849 +0000 UTC m=+1575.937385730" Jun 08 21:40:04.344816 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:04.344785 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-84b76_32c5f89b-dbcb-4c62-b411-d5ce3b45ee03/dns/0.log" Jun 08 21:40:04.373889 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:04.373861 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-84b76_32c5f89b-dbcb-4c62-b411-d5ce3b45ee03/kube-rbac-proxy/0.log" Jun 08 21:40:04.473156 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:04.473129 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bx6xk_c1390673-1d07-4f52-b5cd-da6da7cdbdf6/dns-node-resolver/0.log" Jun 08 21:40:05.070201 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:05.070174 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zmr52_8ee88a26-ad92-4bad-91b5-612089504d71/node-ca/0.log" Jun 08 21:40:05.987034 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:05.987000 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcsglc8_8538f355-b940-44a9-8963-00dbb5a82c5f/istio-proxy/0.log" Jun 08 21:40:06.110911 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:06.110879 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-64bd4_59bfb807-f104-4ea0-a062-5c4e7ba6e24a/istio-proxy/0.log" Jun 08 21:40:06.127815 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:06.127785 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-64bd4_59bfb807-f104-4ea0-a062-5c4e7ba6e24a/istio-proxy/1.log" Jun 08 21:40:06.166314 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:06.166286 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-4hc67_ca395f35-dc26-433a-bcfe-a512c8b91bc5/payload-pre-processing/0.log" Jun 08 21:40:06.210658 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:06.210631 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-666f6c5b9c-ssbtn_7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3/router/0.log" Jun 08 21:40:06.867328 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:06.867268 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ms72g_5d9e9533-81fc-454f-83ae-7482b70c189a/serve-healthcheck-canary/0.log" Jun 08 21:40:07.375623 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:07.375597 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-pp7gc_5afccbef-c7e7-4921-8292-381bf51a0dda/insights-operator/0.log" Jun 08 21:40:07.376898 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:07.376878 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-pp7gc_5afccbef-c7e7-4921-8292-381bf51a0dda/insights-operator/1.log" Jun 08 21:40:07.538683 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:07.538655 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s78h5_9f785d5c-de8c-45ea-b361-0026649bd952/kube-rbac-proxy/0.log" Jun 08 21:40:07.562727 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:07.562703 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s78h5_9f785d5c-de8c-45ea-b361-0026649bd952/exporter/0.log" Jun 08 21:40:07.584107 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:07.584055 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s78h5_9f785d5c-de8c-45ea-b361-0026649bd952/extractor/0.log" Jun 08 21:40:09.796534 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:09.796503 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-p4wg5/perf-node-gather-daemonset-8bsmw" Jun 08 21:40:09.844773 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:09.844747 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-865f89cc7c-xwxj9_d406c41d-f20f-494f-8595-86b39d59a1ec/nginx/0.log" Jun 08 21:40:09.962406 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:09.962375 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-76cdcb8cdb-v2gwb_16bc3277-f351-4a07-aee8-27dd4d3782f3/maas-api/0.log" Jun 08 21:40:10.244375 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:10.244309 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-697d6d88bf-s8qrd_afe84586-1752-4bad-9c69-bb0ef9c403cb/manager/0.log" Jun 08 21:40:10.266283 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:10.266260 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-697d6d88bf-s8qrd_afe84586-1752-4bad-9c69-bb0ef9c403cb/copy-manifests/0.log" Jun 08 21:40:10.341940 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:10.341914 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-c64kz_fd0ac10c-1b22-4ca1-9eba-998b940799bd/postgres/0.log" Jun 08 21:40:11.961720 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:11.961646 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-f6d9d96c4-f9qd6_00aec5a6-55a4-4ba8-9612-c649ca6075bd/manager/0.log" Jun 08 21:40:17.258694 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:17.258663 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcsglc8_8538f355-b940-44a9-8963-00dbb5a82c5f/istio-proxy/0.log" Jun 08 21:40:17.327670 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:17.327638 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-h2l72_d77374d1-a814-43ff-8298-aaa87f0c3c33/migrator/0.log" Jun 08 21:40:17.344483 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:17.344459 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-64bd4_59bfb807-f104-4ea0-a062-5c4e7ba6e24a/istio-proxy/0.log" Jun 08 21:40:17.350892 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:17.350874 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-h2l72_d77374d1-a814-43ff-8298-aaa87f0c3c33/graceful-termination/0.log" Jun 08 21:40:17.362833 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:17.362815 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-64bd4_59bfb807-f104-4ea0-a062-5c4e7ba6e24a/istio-proxy/1.log" Jun 08 21:40:17.389917 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:17.389892 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-4hc67_ca395f35-dc26-433a-bcfe-a512c8b91bc5/payload-pre-processing/0.log" Jun 08 21:40:17.418351 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:17.418330 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-666f6c5b9c-ssbtn_7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3/router/0.log" Jun 08 21:40:18.579727 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:18.579690 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcsglc8_8538f355-b940-44a9-8963-00dbb5a82c5f/istio-proxy/0.log" Jun 08 21:40:18.670697 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:18.670668 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-64bd4_59bfb807-f104-4ea0-a062-5c4e7ba6e24a/istio-proxy/0.log" Jun 08 21:40:18.692370 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:18.692343 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-64bd4_59bfb807-f104-4ea0-a062-5c4e7ba6e24a/istio-proxy/1.log" Jun 08 21:40:18.718408 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:18.718384 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-4hc67_ca395f35-dc26-433a-bcfe-a512c8b91bc5/payload-pre-processing/0.log" Jun 08 21:40:18.749273 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:18.749240 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-666f6c5b9c-ssbtn_7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3/router/0.log" Jun 08 21:40:18.929516 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:18.929412 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8rdm2_d152d239-9949-4c45-ae86-7975965aeaa1/kube-multus/0.log" Jun 08 21:40:19.282412 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:19.282339 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mlh7b_68070959-71b5-45c6-828d-0a404231b097/kube-multus-additional-cni-plugins/0.log" Jun 08 21:40:19.303415 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:19.303393 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mlh7b_68070959-71b5-45c6-828d-0a404231b097/egress-router-binary-copy/0.log" Jun 08 21:40:19.323653 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:19.323626 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mlh7b_68070959-71b5-45c6-828d-0a404231b097/cni-plugins/0.log" Jun 08 21:40:19.343412 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:19.343381 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mlh7b_68070959-71b5-45c6-828d-0a404231b097/bond-cni-plugin/0.log" Jun 08 21:40:19.362854 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:19.362838 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mlh7b_68070959-71b5-45c6-828d-0a404231b097/routeoverride-cni/0.log" Jun 08 21:40:19.383541 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:19.383520 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mlh7b_68070959-71b5-45c6-828d-0a404231b097/whereabouts-cni-bincopy/0.log" Jun 08 21:40:19.403623 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:19.403602 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mlh7b_68070959-71b5-45c6-828d-0a404231b097/whereabouts-cni/0.log" Jun 08 21:40:19.531819 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:19.531796 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9jghf_69e600b7-7393-4b2c-8e83-3b5fd3e07b31/network-metrics-daemon/0.log" Jun 08 21:40:19.551159 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:19.551135 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9jghf_69e600b7-7393-4b2c-8e83-3b5fd3e07b31/kube-rbac-proxy/0.log" Jun 08 21:40:20.326405 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:20.326367 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcsglc8_8538f355-b940-44a9-8963-00dbb5a82c5f/istio-proxy/0.log" Jun 08 21:40:20.412381 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:20.412342 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-64bd4_59bfb807-f104-4ea0-a062-5c4e7ba6e24a/istio-proxy/0.log" Jun 08 21:40:20.430050 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:20.430024 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-64bd4_59bfb807-f104-4ea0-a062-5c4e7ba6e24a/istio-proxy/1.log" Jun 08 21:40:20.455124 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:20.455090 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-4hc67_ca395f35-dc26-433a-bcfe-a512c8b91bc5/payload-pre-processing/0.log" Jun 08 21:40:20.479919 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:20.479896 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-666f6c5b9c-ssbtn_7b92e7ad-862c-4b47-9c9f-4d73ca2e55d3/router/0.log" Jun 08 21:40:20.920209 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:20.920183 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbt69_9eb3105f-0406-4c64-b8c3-38b78c40d6d0/ovn-controller/0.log" Jun 08 21:40:20.937033 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:20.937013 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbt69_9eb3105f-0406-4c64-b8c3-38b78c40d6d0/ovn-acl-logging/0.log" Jun 08 21:40:20.963191 ip-10-0-135-79 kubenswrapper[2564]: I0608 21:40:20.963166 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pbt69_9eb3105f-0406-4c64-b8c3-38b78c40d6d0/kube-rbac-proxy-node/0.log"