Jul 08 18:43:25.720758 ip-10-0-143-239 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 08 18:43:25.720767 ip-10-0-143-239 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 08 18:43:25.720774 ip-10-0-143-239 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 08 18:43:25.720989 ip-10-0-143-239 systemd[1]: Failed to start Kubernetes Kubelet. Jul 08 18:43:35.768487 ip-10-0-143-239 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 08 18:43:35.768501 ip-10-0-143-239 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot bb5567b34cbb4d00bae8f3c399cc0d46 -- Jul 08 18:45:36.010874 ip-10-0-143-239 systemd[1]: Starting Kubernetes Kubelet... Jul 08 18:45:36.399279 ip-10-0-143-239 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 18:45:36.399279 ip-10-0-143-239 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 18:45:36.399279 ip-10-0-143-239 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 18:45:36.399279 ip-10-0-143-239 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 18:45:36.399279 ip-10-0-143-239 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 18:45:36.399279 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.392804 2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 18:45:36.639670 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406210 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:45:36.639670 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406226 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:45:36.639670 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406230 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:45:36.639670 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406233 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:45:36.639670 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406237 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:45:36.639670 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406240 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:45:36.639670 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406243 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:45:36.639670 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406245 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:45:36.639670 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406248 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:45:36.639670 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406251 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:45:36.639670 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406253 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:45:36.639670 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406256 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:45:36.639670 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406258 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:45:36.639670 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406261 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:45:36.639670 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406263 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:45:36.639670 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406269 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:45:36.639670 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406274 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:45:36.639670 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406277 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:45:36.639670 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406279 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:45:36.639670 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406282 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:45:36.475995 ip-10-0-143-239 systemd[1]: Started Kubernetes Kubelet. Jul 08 18:45:36.652397 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406285 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:45:36.652397 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406288 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:45:36.652397 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406294 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:45:36.652397 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406296 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:45:36.652397 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406299 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:45:36.652397 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406302 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:45:36.652397 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406305 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:45:36.652397 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406308 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:45:36.652397 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406310 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:45:36.652397 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406313 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:45:36.652397 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406316 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:45:36.652397 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406319 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:45:36.652397 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406321 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:45:36.652397 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406324 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:45:36.652397 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406326 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:45:36.652397 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406329 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:45:36.652397 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406331 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:45:36.652397 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406334 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:45:36.652397 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406337 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:45:36.652397 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406339 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:45:36.653338 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406341 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:45:36.653338 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406344 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:45:36.653338 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406347 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:45:36.653338 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406351 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:45:36.653338 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406354 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:45:36.653338 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406358 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:45:36.653338 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406360 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:45:36.653338 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406363 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:45:36.653338 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406366 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:45:36.653338 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406368 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:45:36.653338 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406371 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:45:36.653338 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406374 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:45:36.653338 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406376 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:45:36.653338 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406379 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:45:36.653338 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406383 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:45:36.653338 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406386 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:45:36.653338 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406389 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:45:36.653338 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406392 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:45:36.653338 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406394 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:45:36.653987 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406397 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:45:36.653987 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406400 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:45:36.653987 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406402 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:45:36.653987 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406405 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:45:36.653987 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406407 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:45:36.653987 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406410 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:45:36.653987 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406412 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:45:36.653987 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406415 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:45:36.653987 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406418 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:45:36.653987 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406420 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:45:36.653987 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406422 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:45:36.653987 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406425 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:45:36.653987 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406427 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:45:36.653987 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406430 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:45:36.653987 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406433 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:45:36.653987 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406435 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:45:36.653987 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406437 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:45:36.653987 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406440 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:45:36.653987 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406442 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:45:36.653987 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406445 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:45:36.654675 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406447 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:45:36.654675 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406450 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:45:36.654675 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406452 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:45:36.654675 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406457 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:45:36.654675 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406461 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:45:36.654675 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406464 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:45:36.654675 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406467 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:45:36.654675 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406470 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:45:36.654675 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406474 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:45:36.654675 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406476 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:45:36.654675 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406479 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:45:36.654675 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406481 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:45:36.654675 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406484 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:45:36.654675 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406486 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:45:36.654675 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406489 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:45:36.654675 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406491 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:45:36.654675 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406494 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:45:36.654675 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406497 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:45:36.654675 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406499 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:45:36.655341 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.406503 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:45:36.655341 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407227 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:45:36.655341 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407233 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:45:36.655341 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407236 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:45:36.655341 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407239 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:45:36.655341 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407242 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:45:36.655341 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407245 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:45:36.655341 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407248 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:45:36.655341 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407250 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:45:36.655341 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407253 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:45:36.655341 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407256 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:45:36.655341 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407259 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:45:36.655341 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407261 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:45:36.655341 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407264 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:45:36.655341 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407267 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:45:36.655341 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407269 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:45:36.655341 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407272 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:45:36.655341 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407275 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:45:36.655341 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407278 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:45:36.655341 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407281 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:45:36.656168 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407284 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:45:36.656168 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407287 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:45:36.656168 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407290 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:45:36.656168 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407292 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:45:36.656168 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407295 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:45:36.656168 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407299 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:45:36.656168 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407303 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:45:36.656168 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407306 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:45:36.656168 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407309 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:45:36.656168 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407312 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:45:36.656168 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407315 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:45:36.656168 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407318 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:45:36.656168 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407321 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:45:36.656168 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407323 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:45:36.656168 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407327 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:45:36.656168 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407330 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:45:36.656168 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407332 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:45:36.656168 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407335 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:45:36.656168 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407338 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:45:36.656956 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407341 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:45:36.656956 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407344 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:45:36.656956 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407347 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:45:36.656956 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407349 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:45:36.656956 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407352 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:45:36.656956 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407355 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:45:36.656956 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407357 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:45:36.656956 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407360 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:45:36.656956 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407362 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:45:36.656956 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407365 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:45:36.656956 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407368 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:45:36.656956 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407370 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:45:36.656956 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407373 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:45:36.656956 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407376 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:45:36.656956 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407379 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:45:36.656956 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407382 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:45:36.656956 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407385 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:45:36.656956 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407387 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:45:36.656956 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407390 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:45:36.657687 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407392 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:45:36.657687 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407395 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:45:36.657687 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407397 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:45:36.657687 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407400 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:45:36.657687 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407403 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:45:36.657687 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407405 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:45:36.657687 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407408 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:45:36.657687 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407410 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:45:36.657687 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407412 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:45:36.657687 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407415 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:45:36.657687 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407417 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:45:36.657687 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407420 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:45:36.657687 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407423 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:45:36.657687 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407427 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:45:36.657687 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407430 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:45:36.657687 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407434 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:45:36.657687 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407436 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:45:36.657687 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407440 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:45:36.657687 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407442 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:45:36.657687 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407445 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:45:36.658354 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407447 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:45:36.658354 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407450 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:45:36.658354 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407453 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:45:36.658354 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407455 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:45:36.658354 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407458 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:45:36.658354 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407460 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:45:36.658354 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407463 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:45:36.658354 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407466 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:45:36.658354 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407469 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:45:36.658354 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407472 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:45:36.658354 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407474 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:45:36.658354 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407476 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:45:36.658354 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407479 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:45:36.658354 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407482 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:45:36.658354 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407486 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:45:36.658354 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407488 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:45:36.658354 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407492 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:45:36.658354 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407496 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:45:36.658354 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407498 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:45:36.659073 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407501 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:45:36.659073 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407503 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:45:36.659073 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407506 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:45:36.659073 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407927 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:45:36.659073 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407932 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:45:36.659073 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407935 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:45:36.659073 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407937 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:45:36.659073 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407940 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:45:36.659073 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407943 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:45:36.659073 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407946 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:45:36.659073 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407948 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:45:36.659073 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407951 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:45:36.659073 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407954 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:45:36.659073 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407956 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:45:36.659073 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407959 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:45:36.659073 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407961 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:45:36.659073 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407964 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:45:36.659073 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407966 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:45:36.659073 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407969 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:45:36.659073 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407972 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:45:36.659696 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407974 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:45:36.659696 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407977 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:45:36.659696 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407980 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:45:36.659696 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407983 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:45:36.659696 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407985 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:45:36.659696 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407988 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:45:36.659696 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407991 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:45:36.659696 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407993 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:45:36.659696 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407996 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:45:36.659696 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.407998 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:45:36.659696 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408003 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:45:36.659696 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408005 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:45:36.659696 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408008 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:45:36.659696 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408010 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:45:36.659696 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408013 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:45:36.659696 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408015 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:45:36.659696 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408017 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:45:36.659696 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408020 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:45:36.659696 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408022 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:45:36.659696 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408025 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:45:36.882585 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408028 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:45:36.882585 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408030 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:45:36.882585 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408033 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:45:36.882585 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408035 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:45:36.882585 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408037 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:45:36.882585 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408040 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:45:36.882585 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408042 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:45:36.882585 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408045 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:45:36.882585 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408047 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:45:36.882585 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408050 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:45:36.882585 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408052 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:45:36.882585 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408055 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:45:36.882585 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408058 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:45:36.882585 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408061 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:45:36.882585 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408064 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:45:36.882585 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408067 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:45:36.882585 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408069 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:45:36.882585 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408072 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:45:36.882585 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408074 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:45:36.882585 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408077 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:45:36.883518 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408079 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:45:36.883518 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408081 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:45:36.883518 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408087 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:45:36.883518 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408090 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:45:36.883518 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408092 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:45:36.883518 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408095 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:45:36.883518 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408097 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:45:36.883518 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408100 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:45:36.883518 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408102 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:45:36.883518 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408105 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:45:36.883518 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408109 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:45:36.883518 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408112 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:45:36.883518 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408115 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:45:36.883518 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408118 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:45:36.883518 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408121 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:45:36.883518 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408125 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:45:36.883518 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408128 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:45:36.883518 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408131 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:45:36.883518 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408133 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:45:36.884250 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408136 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:45:36.884250 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408138 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:45:36.884250 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408141 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:45:36.884250 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408144 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:45:36.884250 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408146 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:45:36.884250 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408149 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:45:36.884250 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408152 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:45:36.884250 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408154 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:45:36.884250 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408162 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:45:36.884250 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408165 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:45:36.884250 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408167 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:45:36.884250 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408170 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:45:36.884250 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408173 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:45:36.884250 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408176 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:45:36.884250 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408179 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:45:36.884250 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408184 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:45:36.884250 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408187 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:45:36.884250 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408190 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:45:36.884250 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408193 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:45:36.884854 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408196 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:45:36.884854 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408199 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:45:36.884854 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408201 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:45:36.884854 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408204 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:45:36.884854 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408270 2572 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 18:45:36.884854 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408277 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 18:45:36.884854 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408284 2572 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 18:45:36.884854 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408288 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 18:45:36.884854 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408292 2572 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 18:45:36.884854 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408295 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 18:45:36.884854 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408299 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 18:45:36.884854 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408304 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 18:45:36.884854 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408307 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 18:45:36.884854 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408311 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 18:45:36.884854 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408315 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 18:45:36.884854 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408319 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 18:45:36.884854 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408322 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 18:45:36.884854 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408325 2572 flags.go:64] FLAG: --cgroup-root="" Jul 08 18:45:36.884854 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408328 2572 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 18:45:36.884854 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408331 2572 flags.go:64] FLAG: --client-ca-file="" Jul 08 18:45:36.884854 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408335 2572 flags.go:64] FLAG: --cloud-provider="external" Jul 08 18:45:36.884854 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408338 2572 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 18:45:36.884854 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408342 2572 flags.go:64] FLAG: --cluster-domain="" Jul 08 18:45:36.884854 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408344 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 18:45:36.885637 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408347 2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 18:45:36.885637 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408350 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 18:45:36.885637 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408354 2572 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 18:45:36.885637 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408358 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 18:45:36.885637 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408362 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 18:45:36.885637 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408365 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 18:45:36.885637 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408368 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 18:45:36.885637 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408371 2572 flags.go:64] FLAG: --contention-profiling="false" Jul 08 18:45:36.885637 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408374 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 18:45:36.885637 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408376 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 18:45:36.885637 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408380 2572 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 18:45:36.885637 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408383 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 18:45:36.885637 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408387 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 18:45:36.885637 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408390 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 18:45:36.885637 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408393 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 18:45:36.885637 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408395 2572 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 18:45:36.885637 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408398 2572 flags.go:64] FLAG: --enable-server="true" Jul 08 18:45:36.885637 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408401 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 18:45:36.885637 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408406 2572 flags.go:64] FLAG: --event-burst="100" Jul 08 18:45:36.885637 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408409 2572 flags.go:64] FLAG: --event-qps="50" Jul 08 18:45:36.885637 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408411 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 18:45:36.885637 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408416 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 18:45:36.885637 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408419 2572 flags.go:64] FLAG: --eviction-hard="" Jul 08 18:45:36.885637 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408422 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 18:45:36.886384 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408425 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 18:45:36.886384 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408428 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 18:45:36.886384 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408431 2572 flags.go:64] FLAG: --eviction-soft="" Jul 08 18:45:36.886384 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408434 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 18:45:36.886384 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408437 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 18:45:36.886384 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408441 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 18:45:36.886384 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408444 2572 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 18:45:36.886384 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408447 2572 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 18:45:36.886384 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408450 2572 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 18:45:36.886384 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408453 2572 flags.go:64] FLAG: --feature-gates="" Jul 08 18:45:36.886384 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408456 2572 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 18:45:36.886384 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408459 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 18:45:36.886384 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408464 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 18:45:36.886384 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408467 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 18:45:36.886384 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408470 2572 flags.go:64] FLAG: --healthz-port="10248" Jul 08 18:45:36.886384 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408473 2572 flags.go:64] FLAG: --help="false" Jul 08 18:45:36.886384 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408475 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-143-239.ec2.internal" Jul 08 18:45:36.886384 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408478 2572 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 18:45:36.886384 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408481 2572 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 18:45:36.886384 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408484 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 18:45:36.886384 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408488 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 18:45:36.886384 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408491 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 18:45:36.886384 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408494 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 18:45:36.886384 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408497 2572 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 18:45:36.887270 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408500 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 18:45:36.887270 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408503 2572 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 18:45:36.887270 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408506 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 18:45:36.887270 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408509 2572 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 18:45:36.887270 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408512 2572 flags.go:64] FLAG: --kube-reserved="" Jul 08 18:45:36.887270 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408516 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 18:45:36.887270 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408519 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 18:45:36.887270 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408522 2572 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 18:45:36.887270 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408524 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 18:45:36.887270 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408527 2572 flags.go:64] FLAG: --lock-file="" Jul 08 18:45:36.887270 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408530 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 18:45:36.887270 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408533 2572 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 18:45:36.887270 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408536 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 18:45:36.887270 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408542 2572 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 18:45:36.887270 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408545 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 18:45:36.887270 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408548 2572 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 18:45:36.887270 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408551 2572 flags.go:64] FLAG: --logging-format="text" Jul 08 18:45:36.887270 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408554 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 18:45:36.887270 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408557 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 18:45:36.887270 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408560 2572 flags.go:64] FLAG: --manifest-url="" Jul 08 18:45:36.887270 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408565 2572 flags.go:64] FLAG: --manifest-url-header="" Jul 08 18:45:36.887270 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408569 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 18:45:36.887270 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408572 2572 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 18:45:36.887270 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408576 2572 flags.go:64] FLAG: --max-pods="110" Jul 08 18:45:36.887270 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408579 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 18:45:36.888081 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408582 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 18:45:36.888081 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408585 2572 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 18:45:36.888081 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408603 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 18:45:36.888081 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408606 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 18:45:36.888081 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408609 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 18:45:36.888081 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408612 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 18:45:36.888081 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408620 2572 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 18:45:36.888081 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408622 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 18:45:36.888081 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408625 2572 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 18:45:36.888081 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408628 2572 flags.go:64] FLAG: --pod-cidr="" Jul 08 18:45:36.888081 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408631 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 18:45:36.888081 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408637 2572 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 18:45:36.888081 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408641 2572 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 18:45:36.888081 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408644 2572 flags.go:64] FLAG: --pods-per-core="0" Jul 08 18:45:36.888081 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408647 2572 flags.go:64] FLAG: --port="10250" Jul 08 18:45:36.888081 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408650 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 18:45:36.888081 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408653 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09519d8dc4c1482ad" Jul 08 18:45:36.888081 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408656 2572 flags.go:64] FLAG: --qos-reserved="" Jul 08 18:45:36.888081 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408659 2572 flags.go:64] FLAG: --read-only-port="10255" Jul 08 18:45:36.888081 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408662 2572 flags.go:64] FLAG: --register-node="true" Jul 08 18:45:36.888081 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408665 2572 flags.go:64] FLAG: --register-with-taints="" Jul 08 18:45:36.888081 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408668 2572 flags.go:64] FLAG: --registry-burst="10" Jul 08 18:45:36.888081 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408672 2572 flags.go:64] FLAG: --registry-qps="5" Jul 08 18:45:36.888081 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408675 2572 flags.go:64] FLAG: --reserved-cpus="" Jul 08 18:45:36.888921 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408677 2572 flags.go:64] FLAG: --reserved-memory="" Jul 08 18:45:36.888921 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408681 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 18:45:36.888921 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408684 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 18:45:36.888921 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408687 2572 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 18:45:36.888921 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408691 2572 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 18:45:36.888921 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408694 2572 flags.go:64] FLAG: --runonce="false" Jul 08 18:45:36.888921 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408696 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 18:45:36.888921 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408699 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 18:45:36.888921 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408702 2572 flags.go:64] FLAG: --seccomp-default="false" Jul 08 18:45:36.888921 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408705 2572 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 18:45:36.888921 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408708 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 18:45:36.888921 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408711 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 18:45:36.888921 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408714 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 18:45:36.888921 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408717 2572 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 18:45:36.888921 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408720 2572 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 18:45:36.888921 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408723 2572 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 18:45:36.888921 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408726 2572 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 18:45:36.888921 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408728 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 18:45:36.888921 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408731 2572 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 18:45:36.888921 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408734 2572 flags.go:64] FLAG: --system-cgroups="" Jul 08 18:45:36.888921 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408738 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 18:45:36.888921 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408743 2572 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 18:45:36.888921 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408746 2572 flags.go:64] FLAG: --tls-cert-file="" Jul 08 18:45:36.888921 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408748 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 18:45:36.888921 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408752 2572 flags.go:64] FLAG: --tls-min-version="" Jul 08 18:45:36.889708 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408755 2572 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 18:45:36.889708 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408758 2572 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 18:45:36.889708 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408760 2572 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 18:45:36.889708 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408763 2572 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 18:45:36.889708 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408766 2572 flags.go:64] FLAG: --v="2" Jul 08 18:45:36.889708 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408770 2572 flags.go:64] FLAG: --version="false" Jul 08 18:45:36.889708 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408775 2572 flags.go:64] FLAG: --vmodule="" Jul 08 18:45:36.889708 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408779 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 18:45:36.889708 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.408782 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 18:45:36.889708 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408899 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:45:36.889708 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408904 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:45:36.889708 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408908 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:45:36.889708 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408911 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:45:36.889708 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408914 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:45:36.889708 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408916 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:45:36.889708 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408919 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:45:36.889708 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408923 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:45:36.889708 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408927 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:45:36.889708 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408930 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:45:36.889708 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408933 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:45:36.889708 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408936 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:45:36.890455 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408938 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:45:36.890455 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408941 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:45:36.890455 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408944 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:45:36.890455 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408947 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:45:36.890455 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408950 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:45:36.890455 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408953 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:45:36.890455 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408957 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:45:36.890455 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408959 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:45:36.890455 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408962 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:45:36.890455 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408965 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:45:36.890455 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408968 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:45:36.890455 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408970 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:45:36.890455 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408973 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:45:36.890455 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408975 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:45:36.890455 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408978 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:45:36.890455 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408981 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:45:36.890455 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408983 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:45:36.890455 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408985 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:45:36.890455 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408988 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:45:36.890455 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408991 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:45:36.891048 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408993 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:45:36.891048 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.408996 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:45:36.891048 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409000 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:45:36.891048 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409003 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:45:36.891048 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409005 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:45:36.891048 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409008 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:45:36.891048 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409010 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:45:36.891048 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409013 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:45:36.891048 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409016 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:45:36.891048 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409018 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:45:36.891048 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409021 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:45:36.891048 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409024 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:45:36.891048 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409026 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:45:36.891048 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409028 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:45:36.891048 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409031 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:45:36.891048 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409033 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:45:36.891048 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409036 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:45:36.891048 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409039 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:45:36.891048 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409042 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:45:36.891048 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409045 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:45:36.891940 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409047 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:45:36.891940 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409050 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:45:36.891940 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409052 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:45:36.891940 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409055 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:45:36.891940 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409058 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:45:36.891940 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409060 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:45:36.891940 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409063 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:45:36.891940 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409065 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:45:36.891940 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409068 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:45:36.891940 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409070 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:45:36.891940 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409074 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:45:36.891940 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409078 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:45:36.891940 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409081 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:45:36.891940 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409084 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:45:36.891940 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409088 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:45:36.891940 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409090 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:45:36.891940 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409093 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:45:36.891940 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409095 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:45:36.891940 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409098 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:45:36.892491 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409100 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:45:36.892491 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409104 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:45:36.892491 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409107 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:45:36.892491 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409110 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:45:36.892491 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409113 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:45:36.892491 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409115 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:45:36.892491 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409119 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:45:36.892491 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409121 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:45:36.892491 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409124 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:45:36.892491 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409126 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:45:36.892491 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409129 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:45:36.892491 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409132 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:45:36.892491 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409135 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:45:36.892491 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409138 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:45:36.892491 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409140 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:45:36.892491 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409143 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:45:36.892491 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409145 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:45:36.892491 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409148 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:45:36.892491 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409151 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:45:36.892491 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409153 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:45:37.136892 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409156 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:45:37.136892 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409158 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:45:37.136892 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409161 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:45:37.136892 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409163 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:45:37.136892 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409166 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:45:37.136892 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409170 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:45:37.136892 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409172 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:45:37.136892 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.409176 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:45:37.136892 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.409802 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 18:45:37.136892 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.417428 2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 18:45:37.136892 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.417445 2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 18:45:37.136892 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.418191 2572 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 18:45:37.136892 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.418201 2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 18:45:37.136892 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418296 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:45:37.136892 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418301 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:45:37.138704 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418305 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:45:37.138704 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418308 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:45:37.138704 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418311 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:45:37.138704 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418314 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:45:37.138704 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418317 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:45:37.138704 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418319 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:45:37.138704 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418322 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:45:37.138704 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418324 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:45:37.138704 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418327 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:45:37.138704 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418330 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:45:37.138704 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418333 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:45:37.138704 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418335 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:45:37.138704 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418338 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:45:37.138704 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418340 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:45:37.138704 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418343 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:45:37.138704 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418345 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:45:37.138704 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418348 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:45:37.138704 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418350 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:45:37.138704 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418353 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:45:37.138704 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418358 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:45:37.139450 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418361 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:45:37.139450 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418364 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:45:37.139450 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418368 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:45:37.139450 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418372 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:45:37.139450 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418376 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:45:37.139450 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418379 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:45:37.139450 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418383 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:45:37.139450 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418386 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:45:37.139450 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418389 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:45:37.139450 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418392 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:45:37.139450 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418395 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:45:37.139450 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418398 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:45:37.139450 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418400 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:45:37.139450 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418403 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:45:37.139450 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418405 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:45:37.139450 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418408 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:45:37.139450 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418410 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:45:37.139450 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418413 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:45:37.139450 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418416 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:45:37.140053 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418418 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:45:37.140053 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418421 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:45:37.140053 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418424 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:45:37.140053 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418427 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:45:37.140053 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418429 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:45:37.140053 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418432 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:45:37.140053 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418434 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:45:37.140053 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418440 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:45:37.140053 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418443 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:45:37.140053 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418446 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:45:37.140053 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418449 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:45:37.140053 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418451 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:45:37.140053 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418454 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:45:37.140053 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418457 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:45:37.140053 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418459 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:45:37.140053 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418462 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:45:37.140053 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418471 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:45:37.140053 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418474 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:45:37.140053 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418476 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:45:37.140053 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418479 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:45:37.140832 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418482 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:45:37.140832 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418484 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:45:37.140832 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418487 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:45:37.140832 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418490 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:45:37.140832 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418492 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:45:37.140832 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418495 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:45:37.140832 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418497 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:45:37.140832 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418500 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:45:37.140832 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418503 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:45:37.140832 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418506 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:45:37.140832 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418509 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:45:37.140832 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418511 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:45:37.140832 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418514 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:45:37.140832 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418516 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:45:37.140832 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418519 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:45:37.140832 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418521 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:45:37.140832 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418524 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:45:37.140832 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418527 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:45:37.140832 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418529 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:45:37.140832 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418536 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:45:37.141426 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418540 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:45:37.141426 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418544 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:45:37.141426 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418547 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:45:37.141426 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418550 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:45:37.141426 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418552 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:45:37.141426 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418555 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:45:37.141426 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418557 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:45:37.141426 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418560 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:45:37.141426 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418562 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:45:37.141426 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418565 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:45:37.141426 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418568 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:45:37.141426 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418571 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:45:37.141426 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418573 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:45:37.141426 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418576 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:45:37.141426 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418578 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:45:37.141426 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418581 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:45:37.141426 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418583 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:45:37.141426 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418599 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:45:37.142262 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.418614 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 18:45:37.142262 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418756 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:45:37.142262 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418760 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:45:37.142262 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418763 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:45:37.142262 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418766 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:45:37.142262 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418769 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:45:37.142262 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418773 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:45:37.142262 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418777 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:45:37.142262 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418780 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:45:37.142262 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418783 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:45:37.142262 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418786 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:45:37.142262 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418789 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:45:37.142262 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418791 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:45:37.142262 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418796 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:45:37.142262 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418798 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:45:37.142755 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418801 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:45:37.142755 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418805 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:45:37.142755 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418807 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:45:37.142755 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418810 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:45:37.142755 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418813 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:45:37.142755 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418815 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:45:37.142755 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418818 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:45:37.142755 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418821 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:45:37.142755 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418823 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:45:37.142755 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418827 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:45:37.142755 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418829 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:45:37.142755 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418832 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:45:37.142755 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418835 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:45:37.142755 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418837 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:45:37.142755 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418840 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:45:37.142755 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418842 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:45:37.142755 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418845 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:45:37.142755 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418847 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:45:37.142755 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418850 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:45:37.142755 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418852 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:45:37.143569 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418855 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:45:37.143569 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418857 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:45:37.143569 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418860 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:45:37.143569 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418864 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:45:37.143569 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418867 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:45:37.143569 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418870 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:45:37.143569 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418873 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:45:37.143569 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418875 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:45:37.143569 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418878 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:45:37.143569 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418880 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:45:37.143569 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418884 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:45:37.143569 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418886 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:45:37.143569 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418889 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:45:37.143569 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418892 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:45:37.143569 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418895 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:45:37.143569 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418898 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:45:37.143569 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418900 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:45:37.143569 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418903 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:45:37.143569 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418905 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:45:37.144313 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418908 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:45:37.144313 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418910 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:45:37.144313 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418913 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:45:37.144313 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418916 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:45:37.144313 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418918 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:45:37.144313 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418921 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:45:37.144313 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418923 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:45:37.144313 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418926 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:45:37.144313 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418928 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:45:37.144313 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418931 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:45:37.144313 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418935 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:45:37.144313 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418938 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:45:37.144313 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418941 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:45:37.144313 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418944 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:45:37.144313 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418947 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:45:37.144313 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418950 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:45:37.144313 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418952 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:45:37.144313 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418956 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:45:37.144313 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418958 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:45:37.145078 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418961 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:45:37.145078 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418964 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:45:37.145078 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418967 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:45:37.145078 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418970 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:45:37.145078 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418973 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:45:37.145078 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418976 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:45:37.145078 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418978 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:45:37.145078 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418982 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:45:37.145078 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418985 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:45:37.145078 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418987 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:45:37.145078 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418990 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:45:37.145078 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418993 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:45:37.145078 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418995 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:45:37.145078 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.418998 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:45:37.145078 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.419000 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:45:37.145078 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.419003 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:45:37.145078 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.419006 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:45:37.145078 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.419009 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:45:37.145078 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.419012 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:45:37.145078 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.419014 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:45:37.372357 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.419017 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:45:37.372357 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.419019 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:45:37.372357 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.419022 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:45:37.372357 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.419024 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:45:37.372357 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.419027 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:45:37.372357 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.419029 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:45:37.372357 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:36.419032 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:45:37.372357 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.419037 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 18:45:37.372357 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.419141 2572 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 18:45:37.372357 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.421270 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 18:45:37.372357 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.422568 2572 server.go:1019] "Starting client certificate rotation" Jul 08 18:45:37.372357 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.422688 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 18:45:37.372357 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.422732 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 18:45:37.373031 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.425018 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 18:45:37.373031 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.429922 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 18:45:37.373031 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.446234 2572 log.go:25] "Validated CRI v1 runtime API" Jul 08 18:45:37.373031 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.448065 2572 log.go:25] "Validated CRI v1 image API" Jul 08 18:45:37.373031 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.448830 2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 18:45:37.373031 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.451140 2572 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9c4242bd-5e67-4301-b5ca-ea4f0455ee3e:/dev/nvme0n1p4 9e2f11a9-dcee-4d9c-bc8a-fe32e9ac8fb5:/dev/nvme0n1p3] Jul 08 18:45:37.373031 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.451157 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 18:45:37.373647 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.456065 2572 manager.go:216] Machine: {Timestamp:2026-07-08 18:45:36.454833524 +0000 UTC m=+0.325248648 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3137447 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec287968df539b69b61f7a7e7c0ee4c3 SystemUUID:ec287968-df53-9b69-b61f-7a7e7c0ee4c3 BootID:bb5567b3-4cbb-4d00-bae8-f3c399cc0d46 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b9:f8:89:12:73 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b9:f8:89:12:73 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:68:fa:2e:ae:77 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 18:45:37.373647 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.456178 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 18:45:37.373647 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.456257 2572 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 18:45:37.373647 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.459099 2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 18:45:37.373647 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.459125 2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-239.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 18:45:37.373647 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.459775 2572 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 18:45:37.373647 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.459786 2572 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 18:45:37.373647 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.459795 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 18:45:37.373647 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.461322 2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 18:45:37.373647 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.462563 2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 18:45:37.373647 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.465226 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 08 18:45:37.373647 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.465336 2572 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 18:45:37.373647 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.465363 2572 kubelet.go:486] "Attempting to sync node with API server" Jul 08 18:45:37.373647 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.465373 2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 18:45:37.373647 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.465387 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 18:45:37.373647 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.465396 2572 kubelet.go:398] "Adding apiserver pod source" Jul 08 18:45:37.373647 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.465405 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 18:45:37.373647 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.465743 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.465761 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.466925 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.467752 2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.469572 2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.469620 2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.470841 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.470854 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.470860 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.470865 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.470873 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.470880 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.470888 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.470894 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.470900 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.470906 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.470914 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.470919 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.471707 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.471717 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.475061 2572 server.go:1268] "Started kubelet" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.475173 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.475167 2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.475414 2572 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.477034 2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.477542 2572 server.go:310] "Adding debug handlers to kubelet server" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:36.479277 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-239.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:36.479936 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:36.480355 2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.481487 2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-239.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.484014 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.484023 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:36.484086 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-239.ec2.internal\" not found" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.484816 2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.484825 2572 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.485117 2572 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.485404 2572 reconstruct.go:97] "Volume reconstruction finished" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.485431 2572 reconciler.go:29] "Reconciler: start to sync state" Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.486095 2572 factory.go:55] Registering systemd factory Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.486113 2572 factory.go:223] Registration of the systemd container factory successfully Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.486416 2572 factory.go:153] Registering CRI-O factory Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.486432 2572 factory.go:223] Registration of the crio container factory successfully Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.486581 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.486650 2572 factory.go:103] Registering Raw factory Jul 08 18:45:37.374264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.486714 2572 manager.go:1196] Started watching for new ooms in manager Jul 08 18:45:37.375860 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:36.485794 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-239.ec2.internal.18c064d933988fac default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-239.ec2.internal,UID:ip-10-0-143-239.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-239.ec2.internal,},FirstTimestamp:2026-07-08 18:45:36.475033516 +0000 UTC m=+0.345448640,LastTimestamp:2026-07-08 18:45:36.475033516 +0000 UTC m=+0.345448640,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-239.ec2.internal,}" Jul 08 18:45:37.375860 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.487762 2572 manager.go:349] Starting recovery of all containers Jul 08 18:45:37.375860 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:36.492339 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 08 18:45:37.375860 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:36.492340 2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-239.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 08 18:45:37.375860 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.500954 2572 manager.go:354] Recovery completed Jul 08 18:45:37.375860 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.505179 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:45:37.375860 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.507305 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-239.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:45:37.375860 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.507339 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-239.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:45:37.375860 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.507349 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-239.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:45:37.375860 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.507859 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 18:45:37.375860 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.507868 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 18:45:37.375860 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.507885 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 08 18:45:37.375860 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.507889 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:45:37.375860 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.508632 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-239.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:45:37.375860 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.508661 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-239.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:45:37.375860 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.508674 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-239.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:45:37.375860 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.509065 2572 policy_none.go:49] "None policy: Start" Jul 08 18:45:37.375860 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.509078 2572 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 18:45:37.375860 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.509088 2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 18:45:37.375860 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:36.509499 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-239.ec2.internal.18c064d935854995 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-239.ec2.internal,UID:ip-10-0-143-239.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-239.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-239.ec2.internal,},FirstTimestamp:2026-07-08 18:45:36.507324821 +0000 UTC m=+0.377739946,LastTimestamp:2026-07-08 18:45:36.507324821 +0000 UTC m=+0.377739946,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-239.ec2.internal,}" Jul 08 18:45:37.375860 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.510079 2572 policy_none.go:47] "Start" Jul 08 18:45:37.375860 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:36.521999 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-239.ec2.internal.18c064d935859483 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-239.ec2.internal,UID:ip-10-0-143-239.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-239.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-239.ec2.internal,},FirstTimestamp:2026-07-08 18:45:36.507344003 +0000 UTC m=+0.377759126,LastTimestamp:2026-07-08 18:45:36.507344003 +0000 UTC m=+0.377759126,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-239.ec2.internal,}" Jul 08 18:45:37.376535 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:36.530527 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-239.ec2.internal.18c064d93585b72e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-239.ec2.internal,UID:ip-10-0-143-239.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-239.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-239.ec2.internal,},FirstTimestamp:2026-07-08 18:45:36.507352878 +0000 UTC m=+0.377768002,LastTimestamp:2026-07-08 18:45:36.507352878 +0000 UTC m=+0.377768002,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-239.ec2.internal,}" Jul 08 18:45:37.376535 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.544137 2572 manager.go:337] "Starting Device Plugin manager" Jul 08 18:45:37.376535 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:36.544167 2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 18:45:37.376535 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.544181 2572 server.go:87] "Starting device plugin registration server" Jul 08 18:45:37.376535 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.544440 2572 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 18:45:37.376535 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.544450 2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 18:45:37.376535 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.544582 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 18:45:37.376535 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.544720 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 18:45:37.376535 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.544727 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 18:45:37.376535 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:36.545030 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 18:45:37.376535 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:36.545072 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-239.ec2.internal\" not found" Jul 08 18:45:37.376535 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:36.547020 2572 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-239.ec2.internal.18c064d935854995\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-239.ec2.internal.18c064d935854995 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-239.ec2.internal,UID:ip-10-0-143-239.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-239.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-239.ec2.internal,},FirstTimestamp:2026-07-08 18:45:36.507324821 +0000 UTC m=+0.377739946,LastTimestamp:2026-07-08 18:45:36.508644913 +0000 UTC m=+0.379060038,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-239.ec2.internal,}" Jul 08 18:45:37.376535 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:36.560680 2572 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-239.ec2.internal.18c064d935859483\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-239.ec2.internal.18c064d935859483 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-239.ec2.internal,UID:ip-10-0-143-239.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-239.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-239.ec2.internal,},FirstTimestamp:2026-07-08 18:45:36.507344003 +0000 UTC m=+0.377759126,LastTimestamp:2026-07-08 18:45:36.508667264 +0000 UTC m=+0.379082390,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-239.ec2.internal,}" Jul 08 18:45:37.376535 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.564390 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lqdz8" Jul 08 18:45:37.376535 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:36.569563 2572 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-239.ec2.internal.18c064d93585b72e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-239.ec2.internal.18c064d93585b72e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-239.ec2.internal,UID:ip-10-0-143-239.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-239.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-239.ec2.internal,},FirstTimestamp:2026-07-08 18:45:36.507352878 +0000 UTC m=+0.377768002,LastTimestamp:2026-07-08 18:45:36.508680988 +0000 UTC m=+0.379096114,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-239.ec2.internal,}" Jul 08 18:45:37.376535 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.575634 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lqdz8" Jul 08 18:45:37.376535 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.644806 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:45:37.376535 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.646749 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-239.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.646780 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-239.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.646793 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-239.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.646817 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-239.ec2.internal" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.659318 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-239.ec2.internal" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:36.659337 2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-239.ec2.internal\": node \"ip-10-0-143-239.ec2.internal\" not found" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.682815 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.684073 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.684104 2572 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.684123 2572 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:36.684157 2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.699003 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:36.733689 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-239.ec2.internal\" not found" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.784867 2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-239.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-239.ec2.internal"] Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.784966 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.785996 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-239.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.786025 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-239.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.786035 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-239.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.787132 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/54e728ac007c2f27d86d66e70b625247-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-239.ec2.internal\" (UID: \"54e728ac007c2f27d86d66e70b625247\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-239.ec2.internal" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.787154 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54e728ac007c2f27d86d66e70b625247-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-239.ec2.internal\" (UID: \"54e728ac007c2f27d86d66e70b625247\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-239.ec2.internal" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.787235 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.787382 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-239.ec2.internal" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.787411 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.787990 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-239.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.788015 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-239.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.788029 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-239.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.788042 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-239.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.788059 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-239.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.788070 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-239.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.789147 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-239.ec2.internal" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.789169 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.789804 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-239.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.789829 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-239.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.789843 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-239.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:36.826327 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-239.ec2.internal\" not found" node="ip-10-0-143-239.ec2.internal" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:36.830780 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-239.ec2.internal\" not found" node="ip-10-0-143-239.ec2.internal" Jul 08 18:45:37.377108 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:36.833748 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-239.ec2.internal\" not found" Jul 08 18:45:37.378471 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.887237 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54e728ac007c2f27d86d66e70b625247-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-239.ec2.internal\" (UID: \"54e728ac007c2f27d86d66e70b625247\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-239.ec2.internal" Jul 08 18:45:37.378471 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.887271 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cad17b2cf3c8d2eb0553c09417436945-config\") pod \"kube-apiserver-proxy-ip-10-0-143-239.ec2.internal\" (UID: \"cad17b2cf3c8d2eb0553c09417436945\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-239.ec2.internal" Jul 08 18:45:37.378471 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.887292 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/54e728ac007c2f27d86d66e70b625247-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-239.ec2.internal\" (UID: \"54e728ac007c2f27d86d66e70b625247\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-239.ec2.internal" Jul 08 18:45:37.378471 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.887336 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54e728ac007c2f27d86d66e70b625247-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-239.ec2.internal\" (UID: \"54e728ac007c2f27d86d66e70b625247\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-239.ec2.internal" Jul 08 18:45:37.378471 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.887341 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/54e728ac007c2f27d86d66e70b625247-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-239.ec2.internal\" (UID: \"54e728ac007c2f27d86d66e70b625247\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-239.ec2.internal" Jul 08 18:45:37.378471 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:36.934103 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-239.ec2.internal\" not found" Jul 08 18:45:37.378471 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.988223 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cad17b2cf3c8d2eb0553c09417436945-config\") pod \"kube-apiserver-proxy-ip-10-0-143-239.ec2.internal\" (UID: \"cad17b2cf3c8d2eb0553c09417436945\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-239.ec2.internal" Jul 08 18:45:37.378471 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:36.988285 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cad17b2cf3c8d2eb0553c09417436945-config\") pod \"kube-apiserver-proxy-ip-10-0-143-239.ec2.internal\" (UID: \"cad17b2cf3c8d2eb0553c09417436945\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-239.ec2.internal" Jul 08 18:45:37.378471 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:37.034135 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-239.ec2.internal\" not found" Jul 08 18:45:37.378471 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:37.130226 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-239.ec2.internal" Jul 08 18:45:37.378471 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:37.133897 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-239.ec2.internal" Jul 08 18:45:37.378471 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:37.135076 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-239.ec2.internal\" not found" Jul 08 18:45:37.378471 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:37.235982 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-239.ec2.internal\" not found" Jul 08 18:45:37.378471 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:37.336679 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-239.ec2.internal\" not found" Jul 08 18:45:37.662857 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:37.421977 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 18:45:37.662857 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:37.422135 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 18:45:37.662857 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:37.437536 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-239.ec2.internal\" not found" Jul 08 18:45:37.662857 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:37.512198 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 18:45:37.662857 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:37.578476 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 18:40:36 +0000 UTC" deadline="2028-03-26 04:03:04.399069644 +0000 UTC" Jul 08 18:45:37.662857 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:37.578509 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15033h17m26.820563941s" Jul 08 18:45:37.662857 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:37.584762 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-239.ec2.internal" Jul 08 18:45:37.662857 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:37.606077 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 18:45:37.662857 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:37.607954 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-239.ec2.internal" Jul 08 18:45:37.662857 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:37.632284 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 18:45:37.841776 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:37.673044 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 18:45:37.841776 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:37.699150 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 18:45:37.841776 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:37.810052 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcad17b2cf3c8d2eb0553c09417436945.slice/crio-befc5ed58df7b8a762907502abb8bacdacd51a7477776b5378c04a85419ba212 WatchSource:0}: Error finding container befc5ed58df7b8a762907502abb8bacdacd51a7477776b5378c04a85419ba212: Status 404 returned error can't find the container with id befc5ed58df7b8a762907502abb8bacdacd51a7477776b5378c04a85419ba212 Jul 08 18:45:37.841776 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:37.810583 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54e728ac007c2f27d86d66e70b625247.slice/crio-dd08835597d46a68767154b5346fa08e33fbc6db2a912cfecb520699145d8d9e WatchSource:0}: Error finding container dd08835597d46a68767154b5346fa08e33fbc6db2a912cfecb520699145d8d9e: Status 404 returned error can't find the container with id dd08835597d46a68767154b5346fa08e33fbc6db2a912cfecb520699145d8d9e Jul 08 18:45:37.841776 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:37.814749 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 18:45:38.389489 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.389449 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 18:45:38.467207 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.467175 2572 apiserver.go:52] "Watching apiserver" Jul 08 18:45:38.474298 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.474269 2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 18:45:38.475682 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.475654 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-7dbjh","openshift-dns/node-resolver-sz4t6","openshift-network-diagnostics/network-check-target-snhnd","openshift-network-operator/iptables-alerter-hzxck","openshift-ovn-kubernetes/ovnkube-node-85lsf","kube-system/kube-apiserver-proxy-ip-10-0-143-239.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7vl5","openshift-cluster-node-tuning-operator/tuned-rsndx","openshift-image-registry/node-ca-8vn8j","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-239.ec2.internal","openshift-multus/multus-4jdfl","openshift-multus/multus-additional-cni-plugins-t4fzl","openshift-multus/network-metrics-daemon-gtkjp","kube-system/global-pull-secret-syncer-mxddc"] Jul 08 18:45:38.477123 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.477102 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7vl5" Jul 08 18:45:38.478517 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.478268 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:45:38.478517 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:38.478346 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtkjp" podUID="73c6d7ff-a154-4b84-9d4f-023fa34c19d0" Jul 08 18:45:38.479605 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.479508 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snhnd" Jul 08 18:45:38.479701 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:38.479576 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snhnd" podUID="18bcf614-22b3-4603-b011-1ad2cef794ab" Jul 08 18:45:38.481052 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.481027 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 18:45:38.481135 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.481059 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tmwpx\"" Jul 08 18:45:38.481172 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.481035 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 18:45:38.482486 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.482466 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hzxck" Jul 08 18:45:38.484653 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.484627 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 18:45:38.487908 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.484694 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 18:45:38.487908 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.486197 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-k5xft\"" Jul 08 18:45:38.487908 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.486311 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 18:45:38.487908 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.485415 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.487908 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.487490 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t4fzl" Jul 08 18:45:38.489185 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.489148 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.490343 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.490321 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7dbjh" Jul 08 18:45:38.491497 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.491373 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 18:45:38.491617 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.491604 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sz4t6" Jul 08 18:45:38.493008 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.492991 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8vn8j" Jul 08 18:45:38.494395 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.494377 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.494483 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.494464 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-etc-openvswitch\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.494539 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.494498 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-env-overrides\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.494539 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.494523 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-ovnkube-script-lib\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.494787 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.494547 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxh59\" (UniqueName: \"kubernetes.io/projected/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-kube-api-access-zxh59\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.494787 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.494580 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee07801f-ee9c-4ab6-b8d9-356a635e96ed-host-slash\") pod \"iptables-alerter-hzxck\" (UID: \"ee07801f-ee9c-4ab6-b8d9-356a635e96ed\") " pod="openshift-network-operator/iptables-alerter-hzxck" Jul 08 18:45:38.494787 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.494620 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-host-slash\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.494787 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.494641 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-var-lib-openvswitch\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.494787 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.494666 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hntr5\" (UniqueName: \"kubernetes.io/projected/ee07801f-ee9c-4ab6-b8d9-356a635e96ed-kube-api-access-hntr5\") pod \"iptables-alerter-hzxck\" (UID: \"ee07801f-ee9c-4ab6-b8d9-356a635e96ed\") " pod="openshift-network-operator/iptables-alerter-hzxck" Jul 08 18:45:38.494787 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.494689 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-ovn-node-metrics-cert\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.494787 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.494713 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t7vl5\" (UID: \"b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7vl5" Jul 08 18:45:38.494787 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.494737 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.494787 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.494760 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-ovnkube-config\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.494787 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.494781 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-node-log\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.495254 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.494802 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-log-socket\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.495254 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.494873 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-host-run-ovn-kubernetes\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.495254 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.494904 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3-device-dir\") pod \"aws-ebs-csi-driver-node-t7vl5\" (UID: \"b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7vl5" Jul 08 18:45:38.495254 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.494930 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ee07801f-ee9c-4ab6-b8d9-356a635e96ed-iptables-alerter-script\") pod \"iptables-alerter-hzxck\" (UID: \"ee07801f-ee9c-4ab6-b8d9-356a635e96ed\") " pod="openshift-network-operator/iptables-alerter-hzxck" Jul 08 18:45:38.495254 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.494954 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-systemd-units\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.495254 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.495002 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-host-run-netns\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.495254 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.495040 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-run-ovn\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.495254 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.495066 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-host-cni-netd\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.495254 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.495132 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3-etc-selinux\") pod \"aws-ebs-csi-driver-node-t7vl5\" (UID: \"b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7vl5" Jul 08 18:45:38.495254 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.495162 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrzm8\" (UniqueName: \"kubernetes.io/projected/b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3-kube-api-access-wrzm8\") pod \"aws-ebs-csi-driver-node-t7vl5\" (UID: \"b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7vl5" Jul 08 18:45:38.495254 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.495188 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5mcv\" (UniqueName: \"kubernetes.io/projected/18bcf614-22b3-4603-b011-1ad2cef794ab-kube-api-access-m5mcv\") pod \"network-check-target-snhnd\" (UID: \"18bcf614-22b3-4603-b011-1ad2cef794ab\") " pod="openshift-network-diagnostics/network-check-target-snhnd" Jul 08 18:45:38.495254 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.495227 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-run-openvswitch\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.495254 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.495260 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3-socket-dir\") pod \"aws-ebs-csi-driver-node-t7vl5\" (UID: \"b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7vl5" Jul 08 18:45:38.495874 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.495284 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3-registration-dir\") pod \"aws-ebs-csi-driver-node-t7vl5\" (UID: \"b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7vl5" Jul 08 18:45:38.495874 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.495308 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3-sys-fs\") pod \"aws-ebs-csi-driver-node-t7vl5\" (UID: \"b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7vl5" Jul 08 18:45:38.495874 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.495354 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73c6d7ff-a154-4b84-9d4f-023fa34c19d0-metrics-certs\") pod \"network-metrics-daemon-gtkjp\" (UID: \"73c6d7ff-a154-4b84-9d4f-023fa34c19d0\") " pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:45:38.495874 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.495378 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j74vh\" (UniqueName: \"kubernetes.io/projected/73c6d7ff-a154-4b84-9d4f-023fa34c19d0-kube-api-access-j74vh\") pod \"network-metrics-daemon-gtkjp\" (UID: \"73c6d7ff-a154-4b84-9d4f-023fa34c19d0\") " pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:45:38.495874 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.495401 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-host-kubelet\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.495874 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.495425 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-host-cni-bin\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.495874 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.495446 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-run-systemd\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.495874 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.495724 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:45:38.495874 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:38.495778 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxddc" podUID="913b02f9-f3cb-4873-a4f7-0fb411ebec5f" Jul 08 18:45:38.498834 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.498734 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 18:45:38.500742 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.500683 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 18:45:38.500832 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.500685 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 18:45:38.501040 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.501018 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 18:45:38.501455 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.501154 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 18:45:38.501455 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.501222 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 18:45:38.501455 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.501275 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lph9l\"" Jul 08 18:45:38.501455 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.501306 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 18:45:38.501455 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.501378 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 18:45:38.501455 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.501438 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 18:45:38.501455 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.501450 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 18:45:38.501840 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.501492 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 18:45:38.501840 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.501779 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 18:45:38.502170 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.501959 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 18:45:38.502254 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.502181 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 18:45:38.502504 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.502389 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 18:45:38.502504 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.502400 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 18:45:38.502662 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.502562 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-62hzz\"" Jul 08 18:45:38.502662 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.502628 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 18:45:38.503030 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.503012 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 18:45:38.503202 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.503187 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 18:45:38.503353 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.503339 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nkrbf\"" Jul 08 18:45:38.503410 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.503386 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8h6vb\"" Jul 08 18:45:38.503604 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.503565 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 18:45:38.503919 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.503834 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lm64s\"" Jul 08 18:45:38.503919 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.503851 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8rg6t\"" Jul 08 18:45:38.504044 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.504018 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 18:45:38.504132 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.504115 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4l8nw\"" Jul 08 18:45:38.507906 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.507888 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 18:45:38.513920 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.513899 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 18:45:38.544796 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.544768 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2tndv" Jul 08 18:45:38.556710 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.556684 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2tndv" Jul 08 18:45:38.586779 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.586745 2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 18:45:38.596262 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.596233 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/913b02f9-f3cb-4873-a4f7-0fb411ebec5f-dbus\") pod \"global-pull-secret-syncer-mxddc\" (UID: \"913b02f9-f3cb-4873-a4f7-0fb411ebec5f\") " pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:45:38.596406 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.596270 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-system-cni-dir\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.596406 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.596296 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-multus-socket-dir-parent\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.596406 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.596313 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-host-var-lib-cni-multus\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.596406 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.596336 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-host-cni-netd\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.596406 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.596354 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-etc-sysctl-conf\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.596406 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.596370 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-run\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.596406 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.596392 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d4f95e26-ebfa-4527-a31b-785d477f5329-agent-certs\") pod \"konnectivity-agent-7dbjh\" (UID: \"d4f95e26-ebfa-4527-a31b-785d477f5329\") " pod="kube-system/konnectivity-agent-7dbjh" Jul 08 18:45:38.596769 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.596415 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-multus-conf-dir\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.596769 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.596422 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-host-cni-netd\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.596769 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.596453 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-host-run-multus-certs\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.596769 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.596486 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3-etc-selinux\") pod \"aws-ebs-csi-driver-node-t7vl5\" (UID: \"b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7vl5" Jul 08 18:45:38.596769 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.596513 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrzm8\" (UniqueName: \"kubernetes.io/projected/b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3-kube-api-access-wrzm8\") pod \"aws-ebs-csi-driver-node-t7vl5\" (UID: \"b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7vl5" Jul 08 18:45:38.596769 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.596542 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5mcv\" (UniqueName: \"kubernetes.io/projected/18bcf614-22b3-4603-b011-1ad2cef794ab-kube-api-access-m5mcv\") pod \"network-check-target-snhnd\" (UID: \"18bcf614-22b3-4603-b011-1ad2cef794ab\") " pod="openshift-network-diagnostics/network-check-target-snhnd" Jul 08 18:45:38.596769 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.596566 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-etc-systemd\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.596769 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.596604 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d4f95e26-ebfa-4527-a31b-785d477f5329-konnectivity-ca\") pod \"konnectivity-agent-7dbjh\" (UID: \"d4f95e26-ebfa-4527-a31b-785d477f5329\") " pod="kube-system/konnectivity-agent-7dbjh" Jul 08 18:45:38.596769 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.596627 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/193b4501-08cc-4ad0-97e4-9e3277d52c7b-cni-binary-copy\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.596769 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.596635 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3-etc-selinux\") pod \"aws-ebs-csi-driver-node-t7vl5\" (UID: \"b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7vl5" Jul 08 18:45:38.596769 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.596665 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3-sys-fs\") pod \"aws-ebs-csi-driver-node-t7vl5\" (UID: \"b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7vl5" Jul 08 18:45:38.596769 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.596689 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73c6d7ff-a154-4b84-9d4f-023fa34c19d0-metrics-certs\") pod \"network-metrics-daemon-gtkjp\" (UID: \"73c6d7ff-a154-4b84-9d4f-023fa34c19d0\") " pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:45:38.596769 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.596713 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-host-kubelet\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.596769 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.596738 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/15f04361-bd04-449b-9cce-d46b7ba27368-os-release\") pod \"multus-additional-cni-plugins-t4fzl\" (UID: \"15f04361-bd04-449b-9cce-d46b7ba27368\") " pod="openshift-multus/multus-additional-cni-plugins-t4fzl" Jul 08 18:45:38.596769 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.596767 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/15f04361-bd04-449b-9cce-d46b7ba27368-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t4fzl\" (UID: \"15f04361-bd04-449b-9cce-d46b7ba27368\") " pod="openshift-multus/multus-additional-cni-plugins-t4fzl" Jul 08 18:45:38.597460 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.596800 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqzrf\" (UniqueName: \"kubernetes.io/projected/642e2d30-24f7-4997-b730-bb037276ff1b-kube-api-access-sqzrf\") pod \"node-resolver-sz4t6\" (UID: \"642e2d30-24f7-4997-b730-bb037276ff1b\") " pod="openshift-dns/node-resolver-sz4t6" Jul 08 18:45:38.597460 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.596824 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/913b02f9-f3cb-4873-a4f7-0fb411ebec5f-kubelet-config\") pod \"global-pull-secret-syncer-mxddc\" (UID: \"913b02f9-f3cb-4873-a4f7-0fb411ebec5f\") " pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:45:38.597460 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.596848 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-etc-openvswitch\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.597460 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.596875 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-etc-sysconfig\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.597460 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.596898 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn58l\" (UniqueName: \"kubernetes.io/projected/15f04361-bd04-449b-9cce-d46b7ba27368-kube-api-access-gn58l\") pod \"multus-additional-cni-plugins-t4fzl\" (UID: \"15f04361-bd04-449b-9cce-d46b7ba27368\") " pod="openshift-multus/multus-additional-cni-plugins-t4fzl" Jul 08 18:45:38.597460 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.596984 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-os-release\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.597460 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.597104 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-etc-openvswitch\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.597460 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.597126 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/193b4501-08cc-4ad0-97e4-9e3277d52c7b-multus-daemon-config\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.597460 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.597146 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-host-kubelet\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.597460 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.597127 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3-sys-fs\") pod \"aws-ebs-csi-driver-node-t7vl5\" (UID: \"b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7vl5" Jul 08 18:45:38.597460 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.597157 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-etc-kubernetes\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.598035 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:38.597965 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:45:38.598085 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.598040 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-host-slash\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.598176 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:38.598098 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73c6d7ff-a154-4b84-9d4f-023fa34c19d0-metrics-certs podName:73c6d7ff-a154-4b84-9d4f-023fa34c19d0 nodeName:}" failed. No retries permitted until 2026-07-08 18:45:39.098049248 +0000 UTC m=+2.968464373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73c6d7ff-a154-4b84-9d4f-023fa34c19d0-metrics-certs") pod "network-metrics-daemon-gtkjp" (UID: "73c6d7ff-a154-4b84-9d4f-023fa34c19d0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:45:38.598176 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.598109 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-host-slash\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.598176 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.598152 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-sys\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.598318 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.598208 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15f04361-bd04-449b-9cce-d46b7ba27368-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t4fzl\" (UID: \"15f04361-bd04-449b-9cce-d46b7ba27368\") " pod="openshift-multus/multus-additional-cni-plugins-t4fzl" Jul 08 18:45:38.598318 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.598254 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/642e2d30-24f7-4997-b730-bb037276ff1b-tmp-dir\") pod \"node-resolver-sz4t6\" (UID: \"642e2d30-24f7-4997-b730-bb037276ff1b\") " pod="openshift-dns/node-resolver-sz4t6" Jul 08 18:45:38.598318 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.598311 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-multus-cni-dir\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.598487 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.598470 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-cnibin\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.598538 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.598509 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-host-run-k8s-cni-cncf-io\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.598640 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.598621 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.598700 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.598677 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-ovnkube-config\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.598749 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.598723 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-etc-tuned\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.598749 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.598680 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.598836 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.598757 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/642e2d30-24f7-4997-b730-bb037276ff1b-hosts-file\") pod \"node-resolver-sz4t6\" (UID: \"642e2d30-24f7-4997-b730-bb037276ff1b\") " pod="openshift-dns/node-resolver-sz4t6" Jul 08 18:45:38.598836 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.598794 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/913b02f9-f3cb-4873-a4f7-0fb411ebec5f-original-pull-secret\") pod \"global-pull-secret-syncer-mxddc\" (UID: \"913b02f9-f3cb-4873-a4f7-0fb411ebec5f\") " pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:45:38.598929 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.598861 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-host-var-lib-cni-bin\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.598929 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.598895 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-host-var-lib-kubelet\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.599020 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.598930 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-node-log\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.599020 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.598958 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-log-socket\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.599106 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.599030 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-host-run-ovn-kubernetes\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.599106 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.599062 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15f04361-bd04-449b-9cce-d46b7ba27368-cnibin\") pod \"multus-additional-cni-plugins-t4fzl\" (UID: \"15f04361-bd04-449b-9cce-d46b7ba27368\") " pod="openshift-multus/multus-additional-cni-plugins-t4fzl" Jul 08 18:45:38.599106 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.599095 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3-device-dir\") pod \"aws-ebs-csi-driver-node-t7vl5\" (UID: \"b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7vl5" Jul 08 18:45:38.599232 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.599133 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ee07801f-ee9c-4ab6-b8d9-356a635e96ed-iptables-alerter-script\") pod \"iptables-alerter-hzxck\" (UID: \"ee07801f-ee9c-4ab6-b8d9-356a635e96ed\") " pod="openshift-network-operator/iptables-alerter-hzxck" Jul 08 18:45:38.599232 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.599163 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-systemd-units\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.599232 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.599197 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-host-run-netns\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.599232 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.599223 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-run-ovn\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.599403 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.599258 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngm7r\" (UniqueName: \"kubernetes.io/projected/4b4dd87a-0d97-4dd0-826d-b422ca31c60c-kube-api-access-ngm7r\") pod \"node-ca-8vn8j\" (UID: \"4b4dd87a-0d97-4dd0-826d-b422ca31c60c\") " pod="openshift-image-registry/node-ca-8vn8j" Jul 08 18:45:38.599403 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.599328 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-ovnkube-config\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.599403 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.599367 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/15f04361-bd04-449b-9cce-d46b7ba27368-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t4fzl\" (UID: \"15f04361-bd04-449b-9cce-d46b7ba27368\") " pod="openshift-multus/multus-additional-cni-plugins-t4fzl" Jul 08 18:45:38.599403 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.599398 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-run-openvswitch\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.599577 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.599417 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4b4dd87a-0d97-4dd0-826d-b422ca31c60c-serviceca\") pod \"node-ca-8vn8j\" (UID: \"4b4dd87a-0d97-4dd0-826d-b422ca31c60c\") " pod="openshift-image-registry/node-ca-8vn8j" Jul 08 18:45:38.599577 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.599418 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-host-run-ovn-kubernetes\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.599577 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.599457 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-host\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.599577 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.599507 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3-device-dir\") pod \"aws-ebs-csi-driver-node-t7vl5\" (UID: \"b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7vl5" Jul 08 18:45:38.600001 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.599983 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ee07801f-ee9c-4ab6-b8d9-356a635e96ed-iptables-alerter-script\") pod \"iptables-alerter-hzxck\" (UID: \"ee07801f-ee9c-4ab6-b8d9-356a635e96ed\") " pod="openshift-network-operator/iptables-alerter-hzxck" Jul 08 18:45:38.600063 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.600030 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-systemd-units\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.600108 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.600071 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-host-run-netns\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.600108 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.600094 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-run-ovn\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.600190 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.600137 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-log-socket\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.600241 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.600169 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-node-log\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.600241 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.600225 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-run-openvswitch\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.600326 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.600252 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3-socket-dir\") pod \"aws-ebs-csi-driver-node-t7vl5\" (UID: \"b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7vl5" Jul 08 18:45:38.600326 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.600274 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3-registration-dir\") pod \"aws-ebs-csi-driver-node-t7vl5\" (UID: \"b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7vl5" Jul 08 18:45:38.600326 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.600316 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j74vh\" (UniqueName: \"kubernetes.io/projected/73c6d7ff-a154-4b84-9d4f-023fa34c19d0-kube-api-access-j74vh\") pod \"network-metrics-daemon-gtkjp\" (UID: \"73c6d7ff-a154-4b84-9d4f-023fa34c19d0\") " pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:45:38.600456 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.600335 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-host-cni-bin\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.600456 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.600356 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-ovnkube-script-lib\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.600456 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.600381 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxh59\" (UniqueName: \"kubernetes.io/projected/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-kube-api-access-zxh59\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.600617 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.600480 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-host-run-netns\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.600617 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.600525 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-run-systemd\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.600617 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.600554 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-env-overrides\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.600617 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.600608 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-etc-kubernetes\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.600799 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.600659 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-var-lib-kubelet\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.600799 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.600689 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15f04361-bd04-449b-9cce-d46b7ba27368-cni-binary-copy\") pod \"multus-additional-cni-plugins-t4fzl\" (UID: \"15f04361-bd04-449b-9cce-d46b7ba27368\") " pod="openshift-multus/multus-additional-cni-plugins-t4fzl" Jul 08 18:45:38.600799 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.600722 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee07801f-ee9c-4ab6-b8d9-356a635e96ed-host-slash\") pod \"iptables-alerter-hzxck\" (UID: \"ee07801f-ee9c-4ab6-b8d9-356a635e96ed\") " pod="openshift-network-operator/iptables-alerter-hzxck" Jul 08 18:45:38.600930 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.600812 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-ovnkube-script-lib\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.600930 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.600821 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-var-lib-openvswitch\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.600930 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.600855 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hntr5\" (UniqueName: \"kubernetes.io/projected/ee07801f-ee9c-4ab6-b8d9-356a635e96ed-kube-api-access-hntr5\") pod \"iptables-alerter-hzxck\" (UID: \"ee07801f-ee9c-4ab6-b8d9-356a635e96ed\") " pod="openshift-network-operator/iptables-alerter-hzxck" Jul 08 18:45:38.600930 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.600890 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3-socket-dir\") pod \"aws-ebs-csi-driver-node-t7vl5\" (UID: \"b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7vl5" Jul 08 18:45:38.600930 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.600904 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-ovn-node-metrics-cert\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.600930 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.600925 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee07801f-ee9c-4ab6-b8d9-356a635e96ed-host-slash\") pod \"iptables-alerter-hzxck\" (UID: \"ee07801f-ee9c-4ab6-b8d9-356a635e96ed\") " pod="openshift-network-operator/iptables-alerter-hzxck" Jul 08 18:45:38.601212 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.600933 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4b4dd87a-0d97-4dd0-826d-b422ca31c60c-host\") pod \"node-ca-8vn8j\" (UID: \"4b4dd87a-0d97-4dd0-826d-b422ca31c60c\") " pod="openshift-image-registry/node-ca-8vn8j" Jul 08 18:45:38.601212 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.600961 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-etc-sysctl-d\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.601212 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.600988 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-hostroot\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.601212 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.601018 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t7vl5\" (UID: \"b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7vl5" Jul 08 18:45:38.601212 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.601046 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-etc-modprobe-d\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.601212 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.601070 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-lib-modules\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.601212 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.601098 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15f04361-bd04-449b-9cce-d46b7ba27368-system-cni-dir\") pod \"multus-additional-cni-plugins-t4fzl\" (UID: \"15f04361-bd04-449b-9cce-d46b7ba27368\") " pod="openshift-multus/multus-additional-cni-plugins-t4fzl" Jul 08 18:45:38.601212 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.601129 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgbkb\" (UniqueName: \"kubernetes.io/projected/193b4501-08cc-4ad0-97e4-9e3277d52c7b-kube-api-access-mgbkb\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.601555 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.601369 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3-registration-dir\") pod \"aws-ebs-csi-driver-node-t7vl5\" (UID: \"b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7vl5" Jul 08 18:45:38.601555 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.601408 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-host-cni-bin\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.601664 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.601578 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-tmp\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.601664 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.601615 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4bgx\" (UniqueName: \"kubernetes.io/projected/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-kube-api-access-l4bgx\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.601745 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.601699 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-run-systemd\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.601898 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.601826 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t7vl5\" (UID: \"b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7vl5" Jul 08 18:45:38.601985 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.601961 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-var-lib-openvswitch\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.602181 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.602159 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 18:45:38.602309 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.602280 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-env-overrides\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.606090 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.606068 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-ovn-node-metrics-cert\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.614935 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:38.614888 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:45:38.614935 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:38.614909 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:45:38.614935 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:38.614922 2572 projected.go:196] Error preparing data for projected volume kube-api-access-m5mcv for pod openshift-network-diagnostics/network-check-target-snhnd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:45:38.615151 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:38.614998 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/18bcf614-22b3-4603-b011-1ad2cef794ab-kube-api-access-m5mcv podName:18bcf614-22b3-4603-b011-1ad2cef794ab nodeName:}" failed. No retries permitted until 2026-07-08 18:45:39.114964897 +0000 UTC m=+2.985380008 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-m5mcv" (UniqueName: "kubernetes.io/projected/18bcf614-22b3-4603-b011-1ad2cef794ab-kube-api-access-m5mcv") pod "network-check-target-snhnd" (UID: "18bcf614-22b3-4603-b011-1ad2cef794ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:45:38.617241 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.617218 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hntr5\" (UniqueName: \"kubernetes.io/projected/ee07801f-ee9c-4ab6-b8d9-356a635e96ed-kube-api-access-hntr5\") pod \"iptables-alerter-hzxck\" (UID: \"ee07801f-ee9c-4ab6-b8d9-356a635e96ed\") " pod="openshift-network-operator/iptables-alerter-hzxck" Jul 08 18:45:38.617349 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.617323 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxh59\" (UniqueName: \"kubernetes.io/projected/b31ad1bb-311a-4b3c-9360-311dbf2d18f0-kube-api-access-zxh59\") pod \"ovnkube-node-85lsf\" (UID: \"b31ad1bb-311a-4b3c-9360-311dbf2d18f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.617799 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.617778 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j74vh\" (UniqueName: \"kubernetes.io/projected/73c6d7ff-a154-4b84-9d4f-023fa34c19d0-kube-api-access-j74vh\") pod \"network-metrics-daemon-gtkjp\" (UID: \"73c6d7ff-a154-4b84-9d4f-023fa34c19d0\") " pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:45:38.618970 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.618949 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrzm8\" (UniqueName: \"kubernetes.io/projected/b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3-kube-api-access-wrzm8\") pod \"aws-ebs-csi-driver-node-t7vl5\" (UID: \"b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7vl5" Jul 08 18:45:38.688782 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.688743 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-239.ec2.internal" event={"ID":"cad17b2cf3c8d2eb0553c09417436945","Type":"ContainerStarted","Data":"befc5ed58df7b8a762907502abb8bacdacd51a7477776b5378c04a85419ba212"} Jul 08 18:45:38.690028 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.690004 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-239.ec2.internal" event={"ID":"54e728ac007c2f27d86d66e70b625247","Type":"ContainerStarted","Data":"dd08835597d46a68767154b5346fa08e33fbc6db2a912cfecb520699145d8d9e"} Jul 08 18:45:38.702076 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702052 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-etc-tuned\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.702212 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702081 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/642e2d30-24f7-4997-b730-bb037276ff1b-hosts-file\") pod \"node-resolver-sz4t6\" (UID: \"642e2d30-24f7-4997-b730-bb037276ff1b\") " pod="openshift-dns/node-resolver-sz4t6" Jul 08 18:45:38.702212 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702115 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/913b02f9-f3cb-4873-a4f7-0fb411ebec5f-original-pull-secret\") pod \"global-pull-secret-syncer-mxddc\" (UID: \"913b02f9-f3cb-4873-a4f7-0fb411ebec5f\") " pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:45:38.702212 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702142 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-host-var-lib-cni-bin\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.702212 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702166 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-host-var-lib-kubelet\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.702212 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702191 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15f04361-bd04-449b-9cce-d46b7ba27368-cnibin\") pod \"multus-additional-cni-plugins-t4fzl\" (UID: \"15f04361-bd04-449b-9cce-d46b7ba27368\") " pod="openshift-multus/multus-additional-cni-plugins-t4fzl" Jul 08 18:45:38.702414 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702225 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngm7r\" (UniqueName: \"kubernetes.io/projected/4b4dd87a-0d97-4dd0-826d-b422ca31c60c-kube-api-access-ngm7r\") pod \"node-ca-8vn8j\" (UID: \"4b4dd87a-0d97-4dd0-826d-b422ca31c60c\") " pod="openshift-image-registry/node-ca-8vn8j" Jul 08 18:45:38.702414 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702265 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/15f04361-bd04-449b-9cce-d46b7ba27368-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t4fzl\" (UID: \"15f04361-bd04-449b-9cce-d46b7ba27368\") " pod="openshift-multus/multus-additional-cni-plugins-t4fzl" Jul 08 18:45:38.702414 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702292 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4b4dd87a-0d97-4dd0-826d-b422ca31c60c-serviceca\") pod \"node-ca-8vn8j\" (UID: \"4b4dd87a-0d97-4dd0-826d-b422ca31c60c\") " pod="openshift-image-registry/node-ca-8vn8j" Jul 08 18:45:38.702414 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702291 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-host-var-lib-cni-bin\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.702414 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702313 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-host\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.702414 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702357 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-host\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.702414 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702361 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-host-run-netns\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.702414 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702395 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-etc-kubernetes\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.702414 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702399 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-host-run-netns\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.702414 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702302 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/642e2d30-24f7-4997-b730-bb037276ff1b-hosts-file\") pod \"node-resolver-sz4t6\" (UID: \"642e2d30-24f7-4997-b730-bb037276ff1b\") " pod="openshift-dns/node-resolver-sz4t6" Jul 08 18:45:38.702975 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702419 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-var-lib-kubelet\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.702975 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702446 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15f04361-bd04-449b-9cce-d46b7ba27368-cni-binary-copy\") pod \"multus-additional-cni-plugins-t4fzl\" (UID: \"15f04361-bd04-449b-9cce-d46b7ba27368\") " pod="openshift-multus/multus-additional-cni-plugins-t4fzl" Jul 08 18:45:38.702975 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:38.702462 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:45:38.702975 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702473 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4b4dd87a-0d97-4dd0-826d-b422ca31c60c-host\") pod \"node-ca-8vn8j\" (UID: \"4b4dd87a-0d97-4dd0-826d-b422ca31c60c\") " pod="openshift-image-registry/node-ca-8vn8j" Jul 08 18:45:38.702975 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702489 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-etc-kubernetes\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.702975 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702494 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-etc-sysctl-d\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.702975 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:38.702539 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/913b02f9-f3cb-4873-a4f7-0fb411ebec5f-original-pull-secret podName:913b02f9-f3cb-4873-a4f7-0fb411ebec5f nodeName:}" failed. No retries permitted until 2026-07-08 18:45:39.202515252 +0000 UTC m=+3.072930376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/913b02f9-f3cb-4873-a4f7-0fb411ebec5f-original-pull-secret") pod "global-pull-secret-syncer-mxddc" (UID: "913b02f9-f3cb-4873-a4f7-0fb411ebec5f") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:45:38.702975 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702548 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15f04361-bd04-449b-9cce-d46b7ba27368-cnibin\") pod \"multus-additional-cni-plugins-t4fzl\" (UID: \"15f04361-bd04-449b-9cce-d46b7ba27368\") " pod="openshift-multus/multus-additional-cni-plugins-t4fzl" Jul 08 18:45:38.702975 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702571 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-hostroot\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.702975 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702447 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-host-var-lib-kubelet\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.702975 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702617 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-etc-modprobe-d\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.702975 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702674 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-etc-sysctl-d\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.702975 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702673 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-lib-modules\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.702975 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702697 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-etc-modprobe-d\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.702975 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702731 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-hostroot\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.702975 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702762 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15f04361-bd04-449b-9cce-d46b7ba27368-system-cni-dir\") pod \"multus-additional-cni-plugins-t4fzl\" (UID: \"15f04361-bd04-449b-9cce-d46b7ba27368\") " pod="openshift-multus/multus-additional-cni-plugins-t4fzl" Jul 08 18:45:38.702975 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702774 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4b4dd87a-0d97-4dd0-826d-b422ca31c60c-host\") pod \"node-ca-8vn8j\" (UID: \"4b4dd87a-0d97-4dd0-826d-b422ca31c60c\") " pod="openshift-image-registry/node-ca-8vn8j" Jul 08 18:45:38.703787 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702791 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgbkb\" (UniqueName: \"kubernetes.io/projected/193b4501-08cc-4ad0-97e4-9e3277d52c7b-kube-api-access-mgbkb\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.703787 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702812 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15f04361-bd04-449b-9cce-d46b7ba27368-system-cni-dir\") pod \"multus-additional-cni-plugins-t4fzl\" (UID: \"15f04361-bd04-449b-9cce-d46b7ba27368\") " pod="openshift-multus/multus-additional-cni-plugins-t4fzl" Jul 08 18:45:38.703787 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702816 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-tmp\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.703787 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702826 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-lib-modules\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.703787 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702851 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4bgx\" (UniqueName: \"kubernetes.io/projected/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-kube-api-access-l4bgx\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.703787 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702877 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/913b02f9-f3cb-4873-a4f7-0fb411ebec5f-dbus\") pod \"global-pull-secret-syncer-mxddc\" (UID: \"913b02f9-f3cb-4873-a4f7-0fb411ebec5f\") " pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:45:38.703787 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702887 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-var-lib-kubelet\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.703787 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702905 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-system-cni-dir\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.703787 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702932 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-multus-socket-dir-parent\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.703787 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702956 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-host-var-lib-cni-multus\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.703787 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.702983 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-etc-sysctl-conf\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.703787 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703006 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-run\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.703787 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703037 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d4f95e26-ebfa-4527-a31b-785d477f5329-agent-certs\") pod \"konnectivity-agent-7dbjh\" (UID: \"d4f95e26-ebfa-4527-a31b-785d477f5329\") " pod="kube-system/konnectivity-agent-7dbjh" Jul 08 18:45:38.703787 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703060 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/15f04361-bd04-449b-9cce-d46b7ba27368-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t4fzl\" (UID: \"15f04361-bd04-449b-9cce-d46b7ba27368\") " pod="openshift-multus/multus-additional-cni-plugins-t4fzl" Jul 08 18:45:38.703787 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703064 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-multus-conf-dir\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.703787 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703110 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-multus-conf-dir\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.703787 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703108 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-host-run-multus-certs\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.703787 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703129 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-multus-socket-dir-parent\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.704623 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703140 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4b4dd87a-0d97-4dd0-826d-b422ca31c60c-serviceca\") pod \"node-ca-8vn8j\" (UID: \"4b4dd87a-0d97-4dd0-826d-b422ca31c60c\") " pod="openshift-image-registry/node-ca-8vn8j" Jul 08 18:45:38.704623 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703141 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-host-run-multus-certs\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.704623 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703187 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-host-var-lib-cni-multus\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.704623 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703226 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-run\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.704623 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703232 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-etc-systemd\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.704623 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703189 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-etc-systemd\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.704623 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703261 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/913b02f9-f3cb-4873-a4f7-0fb411ebec5f-dbus\") pod \"global-pull-secret-syncer-mxddc\" (UID: \"913b02f9-f3cb-4873-a4f7-0fb411ebec5f\") " pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:45:38.704623 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703267 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d4f95e26-ebfa-4527-a31b-785d477f5329-konnectivity-ca\") pod \"konnectivity-agent-7dbjh\" (UID: \"d4f95e26-ebfa-4527-a31b-785d477f5329\") " pod="kube-system/konnectivity-agent-7dbjh" Jul 08 18:45:38.704623 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703276 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-system-cni-dir\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.704623 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703303 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/193b4501-08cc-4ad0-97e4-9e3277d52c7b-cni-binary-copy\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.704623 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703375 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/15f04361-bd04-449b-9cce-d46b7ba27368-os-release\") pod \"multus-additional-cni-plugins-t4fzl\" (UID: \"15f04361-bd04-449b-9cce-d46b7ba27368\") " pod="openshift-multus/multus-additional-cni-plugins-t4fzl" Jul 08 18:45:38.704623 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703404 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/15f04361-bd04-449b-9cce-d46b7ba27368-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t4fzl\" (UID: \"15f04361-bd04-449b-9cce-d46b7ba27368\") " pod="openshift-multus/multus-additional-cni-plugins-t4fzl" Jul 08 18:45:38.704623 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703431 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqzrf\" (UniqueName: \"kubernetes.io/projected/642e2d30-24f7-4997-b730-bb037276ff1b-kube-api-access-sqzrf\") pod \"node-resolver-sz4t6\" (UID: \"642e2d30-24f7-4997-b730-bb037276ff1b\") " pod="openshift-dns/node-resolver-sz4t6" Jul 08 18:45:38.704623 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703454 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/913b02f9-f3cb-4873-a4f7-0fb411ebec5f-kubelet-config\") pod \"global-pull-secret-syncer-mxddc\" (UID: \"913b02f9-f3cb-4873-a4f7-0fb411ebec5f\") " pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:45:38.704623 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703480 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-etc-sysconfig\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.704623 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703504 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/15f04361-bd04-449b-9cce-d46b7ba27368-os-release\") pod \"multus-additional-cni-plugins-t4fzl\" (UID: \"15f04361-bd04-449b-9cce-d46b7ba27368\") " pod="openshift-multus/multus-additional-cni-plugins-t4fzl" Jul 08 18:45:38.704623 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703506 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn58l\" (UniqueName: \"kubernetes.io/projected/15f04361-bd04-449b-9cce-d46b7ba27368-kube-api-access-gn58l\") pod \"multus-additional-cni-plugins-t4fzl\" (UID: \"15f04361-bd04-449b-9cce-d46b7ba27368\") " pod="openshift-multus/multus-additional-cni-plugins-t4fzl" Jul 08 18:45:38.705400 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703547 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-os-release\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.705400 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703572 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/193b4501-08cc-4ad0-97e4-9e3277d52c7b-multus-daemon-config\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.705400 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703611 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-etc-kubernetes\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.705400 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703637 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-sys\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.705400 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703643 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15f04361-bd04-449b-9cce-d46b7ba27368-cni-binary-copy\") pod \"multus-additional-cni-plugins-t4fzl\" (UID: \"15f04361-bd04-449b-9cce-d46b7ba27368\") " pod="openshift-multus/multus-additional-cni-plugins-t4fzl" Jul 08 18:45:38.705400 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703660 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15f04361-bd04-449b-9cce-d46b7ba27368-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t4fzl\" (UID: \"15f04361-bd04-449b-9cce-d46b7ba27368\") " pod="openshift-multus/multus-additional-cni-plugins-t4fzl" Jul 08 18:45:38.705400 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703669 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-etc-sysctl-conf\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.705400 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703688 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/642e2d30-24f7-4997-b730-bb037276ff1b-tmp-dir\") pod \"node-resolver-sz4t6\" (UID: \"642e2d30-24f7-4997-b730-bb037276ff1b\") " pod="openshift-dns/node-resolver-sz4t6" Jul 08 18:45:38.705400 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703740 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/913b02f9-f3cb-4873-a4f7-0fb411ebec5f-kubelet-config\") pod \"global-pull-secret-syncer-mxddc\" (UID: \"913b02f9-f3cb-4873-a4f7-0fb411ebec5f\") " pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:45:38.705400 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703763 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-etc-sysconfig\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.705400 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703787 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-sys\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.705400 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703827 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-etc-kubernetes\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.705400 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.703967 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15f04361-bd04-449b-9cce-d46b7ba27368-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t4fzl\" (UID: \"15f04361-bd04-449b-9cce-d46b7ba27368\") " pod="openshift-multus/multus-additional-cni-plugins-t4fzl" Jul 08 18:45:38.705400 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.704000 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-multus-cni-dir\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.705400 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.704017 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/642e2d30-24f7-4997-b730-bb037276ff1b-tmp-dir\") pod \"node-resolver-sz4t6\" (UID: \"642e2d30-24f7-4997-b730-bb037276ff1b\") " pod="openshift-dns/node-resolver-sz4t6" Jul 08 18:45:38.705400 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.704025 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-cnibin\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.705400 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.704050 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-host-run-k8s-cni-cncf-io\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.705400 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.704106 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-multus-cni-dir\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.706217 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.704123 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-host-run-k8s-cni-cncf-io\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.706217 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.704161 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-cnibin\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.706217 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.704218 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/193b4501-08cc-4ad0-97e4-9e3277d52c7b-os-release\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.706217 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.704291 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/193b4501-08cc-4ad0-97e4-9e3277d52c7b-multus-daemon-config\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.706217 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.704573 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/193b4501-08cc-4ad0-97e4-9e3277d52c7b-cni-binary-copy\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.706217 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.704657 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/15f04361-bd04-449b-9cce-d46b7ba27368-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t4fzl\" (UID: \"15f04361-bd04-449b-9cce-d46b7ba27368\") " pod="openshift-multus/multus-additional-cni-plugins-t4fzl" Jul 08 18:45:38.706217 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.704698 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d4f95e26-ebfa-4527-a31b-785d477f5329-konnectivity-ca\") pod \"konnectivity-agent-7dbjh\" (UID: \"d4f95e26-ebfa-4527-a31b-785d477f5329\") " pod="kube-system/konnectivity-agent-7dbjh" Jul 08 18:45:38.706217 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.705676 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-etc-tuned\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.706484 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.706348 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-tmp\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.706889 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.706868 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d4f95e26-ebfa-4527-a31b-785d477f5329-agent-certs\") pod \"konnectivity-agent-7dbjh\" (UID: \"d4f95e26-ebfa-4527-a31b-785d477f5329\") " pod="kube-system/konnectivity-agent-7dbjh" Jul 08 18:45:38.717093 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.717071 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4bgx\" (UniqueName: \"kubernetes.io/projected/2569a83d-86bb-4ed4-a2e3-f93cb0e3e398-kube-api-access-l4bgx\") pod \"tuned-rsndx\" (UID: \"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398\") " pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.717345 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.717317 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngm7r\" (UniqueName: \"kubernetes.io/projected/4b4dd87a-0d97-4dd0-826d-b422ca31c60c-kube-api-access-ngm7r\") pod \"node-ca-8vn8j\" (UID: \"4b4dd87a-0d97-4dd0-826d-b422ca31c60c\") " pod="openshift-image-registry/node-ca-8vn8j" Jul 08 18:45:38.719204 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.719162 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgbkb\" (UniqueName: \"kubernetes.io/projected/193b4501-08cc-4ad0-97e4-9e3277d52c7b-kube-api-access-mgbkb\") pod \"multus-4jdfl\" (UID: \"193b4501-08cc-4ad0-97e4-9e3277d52c7b\") " pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.719380 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.719358 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqzrf\" (UniqueName: \"kubernetes.io/projected/642e2d30-24f7-4997-b730-bb037276ff1b-kube-api-access-sqzrf\") pod \"node-resolver-sz4t6\" (UID: \"642e2d30-24f7-4997-b730-bb037276ff1b\") " pod="openshift-dns/node-resolver-sz4t6" Jul 08 18:45:38.719655 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.719635 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn58l\" (UniqueName: \"kubernetes.io/projected/15f04361-bd04-449b-9cce-d46b7ba27368-kube-api-access-gn58l\") pod \"multus-additional-cni-plugins-t4fzl\" (UID: \"15f04361-bd04-449b-9cce-d46b7ba27368\") " pod="openshift-multus/multus-additional-cni-plugins-t4fzl" Jul 08 18:45:38.791299 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.791271 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7vl5" Jul 08 18:45:38.799188 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.799162 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hzxck" Jul 08 18:45:38.801231 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:38.801204 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7d1bffc_f2ea_4e4a_9206_aee1ccd869e3.slice/crio-6b259eabc8016dbc9c0a93a1999b2cd9a86edc8f9713fce5a8fa85fb50f18374 WatchSource:0}: Error finding container 6b259eabc8016dbc9c0a93a1999b2cd9a86edc8f9713fce5a8fa85fb50f18374: Status 404 returned error can't find the container with id 6b259eabc8016dbc9c0a93a1999b2cd9a86edc8f9713fce5a8fa85fb50f18374 Jul 08 18:45:38.807989 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.807969 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:45:38.808421 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:38.808398 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee07801f_ee9c_4ab6_b8d9_356a635e96ed.slice/crio-1596ad3367315b9d008fee250146fc2332b1dd2193508cebb1c23b1d1f510bf7 WatchSource:0}: Error finding container 1596ad3367315b9d008fee250146fc2332b1dd2193508cebb1c23b1d1f510bf7: Status 404 returned error can't find the container with id 1596ad3367315b9d008fee250146fc2332b1dd2193508cebb1c23b1d1f510bf7 Jul 08 18:45:38.814722 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.814700 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t4fzl" Jul 08 18:45:38.817359 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:38.817325 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb31ad1bb_311a_4b3c_9360_311dbf2d18f0.slice/crio-d10e2f7d797f7e94c38b7a2e31dcd95a3f96f0ad50fb4b93425590a3a2dd90f8 WatchSource:0}: Error finding container d10e2f7d797f7e94c38b7a2e31dcd95a3f96f0ad50fb4b93425590a3a2dd90f8: Status 404 returned error can't find the container with id d10e2f7d797f7e94c38b7a2e31dcd95a3f96f0ad50fb4b93425590a3a2dd90f8 Jul 08 18:45:38.822222 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.822137 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4jdfl" Jul 08 18:45:38.824866 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:38.824845 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15f04361_bd04_449b_9cce_d46b7ba27368.slice/crio-4619b21d158dbbe6d93599746ffa60669cf275cf8d11bfa4bd9f23d44c0c5d44 WatchSource:0}: Error finding container 4619b21d158dbbe6d93599746ffa60669cf275cf8d11bfa4bd9f23d44c0c5d44: Status 404 returned error can't find the container with id 4619b21d158dbbe6d93599746ffa60669cf275cf8d11bfa4bd9f23d44c0c5d44 Jul 08 18:45:38.829605 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.829572 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7dbjh" Jul 08 18:45:38.832108 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:38.832076 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod193b4501_08cc_4ad0_97e4_9e3277d52c7b.slice/crio-7aea93b06f32ef82dd3134d112a450eb1829624be7df8f2b0e8ad91ef4ae3003 WatchSource:0}: Error finding container 7aea93b06f32ef82dd3134d112a450eb1829624be7df8f2b0e8ad91ef4ae3003: Status 404 returned error can't find the container with id 7aea93b06f32ef82dd3134d112a450eb1829624be7df8f2b0e8ad91ef4ae3003 Jul 08 18:45:38.838275 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.838255 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sz4t6" Jul 08 18:45:38.838399 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:38.838378 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4f95e26_ebfa_4527_a31b_785d477f5329.slice/crio-30e8a78287af86d7c9699e8ea1533bfae3cb77e908962b4e10c7d101d9ce279b WatchSource:0}: Error finding container 30e8a78287af86d7c9699e8ea1533bfae3cb77e908962b4e10c7d101d9ce279b: Status 404 returned error can't find the container with id 30e8a78287af86d7c9699e8ea1533bfae3cb77e908962b4e10c7d101d9ce279b Jul 08 18:45:38.845749 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.845729 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8vn8j" Jul 08 18:45:38.847694 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:38.847650 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod642e2d30_24f7_4997_b730_bb037276ff1b.slice/crio-352195f204950b3fb5b67ffab243e8d1ca785ee0f9537dffff36d26eff62e8c6 WatchSource:0}: Error finding container 352195f204950b3fb5b67ffab243e8d1ca785ee0f9537dffff36d26eff62e8c6: Status 404 returned error can't find the container with id 352195f204950b3fb5b67ffab243e8d1ca785ee0f9537dffff36d26eff62e8c6 Jul 08 18:45:38.851764 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:38.851558 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rsndx" Jul 08 18:45:38.855114 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:38.855087 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b4dd87a_0d97_4dd0_826d_b422ca31c60c.slice/crio-860f5d3cd8f5566f316e809a42d9f0727aaa0c3226b818883e1c2f87bb7c2974 WatchSource:0}: Error finding container 860f5d3cd8f5566f316e809a42d9f0727aaa0c3226b818883e1c2f87bb7c2974: Status 404 returned error can't find the container with id 860f5d3cd8f5566f316e809a42d9f0727aaa0c3226b818883e1c2f87bb7c2974 Jul 08 18:45:38.861617 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:45:38.861577 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2569a83d_86bb_4ed4_a2e3_f93cb0e3e398.slice/crio-9db095ee9532452adf2e9155a9d15517bd47a4ab097b9fd26a9f1202d4b4c601 WatchSource:0}: Error finding container 9db095ee9532452adf2e9155a9d15517bd47a4ab097b9fd26a9f1202d4b4c601: Status 404 returned error can't find the container with id 9db095ee9532452adf2e9155a9d15517bd47a4ab097b9fd26a9f1202d4b4c601 Jul 08 18:45:39.106321 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:39.106243 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73c6d7ff-a154-4b84-9d4f-023fa34c19d0-metrics-certs\") pod \"network-metrics-daemon-gtkjp\" (UID: \"73c6d7ff-a154-4b84-9d4f-023fa34c19d0\") " pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:45:39.106477 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:39.106383 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:45:39.106477 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:39.106453 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73c6d7ff-a154-4b84-9d4f-023fa34c19d0-metrics-certs podName:73c6d7ff-a154-4b84-9d4f-023fa34c19d0 nodeName:}" failed. No retries permitted until 2026-07-08 18:45:40.106432604 +0000 UTC m=+3.976847735 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73c6d7ff-a154-4b84-9d4f-023fa34c19d0-metrics-certs") pod "network-metrics-daemon-gtkjp" (UID: "73c6d7ff-a154-4b84-9d4f-023fa34c19d0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:45:39.207114 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:39.207077 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5mcv\" (UniqueName: \"kubernetes.io/projected/18bcf614-22b3-4603-b011-1ad2cef794ab-kube-api-access-m5mcv\") pod \"network-check-target-snhnd\" (UID: \"18bcf614-22b3-4603-b011-1ad2cef794ab\") " pod="openshift-network-diagnostics/network-check-target-snhnd" Jul 08 18:45:39.207271 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:39.207141 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/913b02f9-f3cb-4873-a4f7-0fb411ebec5f-original-pull-secret\") pod \"global-pull-secret-syncer-mxddc\" (UID: \"913b02f9-f3cb-4873-a4f7-0fb411ebec5f\") " pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:45:39.207271 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:39.207233 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:45:39.207271 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:39.207246 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:45:39.207271 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:39.207270 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:45:39.207455 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:39.207285 2572 projected.go:196] Error preparing data for projected volume kube-api-access-m5mcv for pod openshift-network-diagnostics/network-check-target-snhnd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:45:39.207455 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:39.207291 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/913b02f9-f3cb-4873-a4f7-0fb411ebec5f-original-pull-secret podName:913b02f9-f3cb-4873-a4f7-0fb411ebec5f nodeName:}" failed. No retries permitted until 2026-07-08 18:45:40.207273776 +0000 UTC m=+4.077688886 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/913b02f9-f3cb-4873-a4f7-0fb411ebec5f-original-pull-secret") pod "global-pull-secret-syncer-mxddc" (UID: "913b02f9-f3cb-4873-a4f7-0fb411ebec5f") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:45:39.207455 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:39.207335 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/18bcf614-22b3-4603-b011-1ad2cef794ab-kube-api-access-m5mcv podName:18bcf614-22b3-4603-b011-1ad2cef794ab nodeName:}" failed. No retries permitted until 2026-07-08 18:45:40.207319504 +0000 UTC m=+4.077734615 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-m5mcv" (UniqueName: "kubernetes.io/projected/18bcf614-22b3-4603-b011-1ad2cef794ab-kube-api-access-m5mcv") pod "network-check-target-snhnd" (UID: "18bcf614-22b3-4603-b011-1ad2cef794ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:45:39.559379 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:39.559297 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 18:40:38 +0000 UTC" deadline="2028-03-09 02:03:38.483082688 +0000 UTC" Jul 08 18:45:39.559379 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:39.559365 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14623h17m58.923722271s" Jul 08 18:45:39.684833 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:39.684804 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:45:39.685008 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:39.684986 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtkjp" podUID="73c6d7ff-a154-4b84-9d4f-023fa34c19d0" Jul 08 18:45:39.693788 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:39.693724 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8vn8j" event={"ID":"4b4dd87a-0d97-4dd0-826d-b422ca31c60c","Type":"ContainerStarted","Data":"860f5d3cd8f5566f316e809a42d9f0727aaa0c3226b818883e1c2f87bb7c2974"} Jul 08 18:45:39.695421 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:39.695358 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7dbjh" event={"ID":"d4f95e26-ebfa-4527-a31b-785d477f5329","Type":"ContainerStarted","Data":"30e8a78287af86d7c9699e8ea1533bfae3cb77e908962b4e10c7d101d9ce279b"} Jul 08 18:45:39.696923 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:39.696900 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4jdfl" event={"ID":"193b4501-08cc-4ad0-97e4-9e3277d52c7b","Type":"ContainerStarted","Data":"7aea93b06f32ef82dd3134d112a450eb1829624be7df8f2b0e8ad91ef4ae3003"} Jul 08 18:45:39.698114 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:39.698094 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t4fzl" event={"ID":"15f04361-bd04-449b-9cce-d46b7ba27368","Type":"ContainerStarted","Data":"4619b21d158dbbe6d93599746ffa60669cf275cf8d11bfa4bd9f23d44c0c5d44"} Jul 08 18:45:39.700129 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:39.700106 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" event={"ID":"b31ad1bb-311a-4b3c-9360-311dbf2d18f0","Type":"ContainerStarted","Data":"d10e2f7d797f7e94c38b7a2e31dcd95a3f96f0ad50fb4b93425590a3a2dd90f8"} Jul 08 18:45:39.701302 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:39.701282 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hzxck" event={"ID":"ee07801f-ee9c-4ab6-b8d9-356a635e96ed","Type":"ContainerStarted","Data":"1596ad3367315b9d008fee250146fc2332b1dd2193508cebb1c23b1d1f510bf7"} Jul 08 18:45:39.702754 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:39.702731 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rsndx" event={"ID":"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398","Type":"ContainerStarted","Data":"9db095ee9532452adf2e9155a9d15517bd47a4ab097b9fd26a9f1202d4b4c601"} Jul 08 18:45:39.704066 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:39.704047 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sz4t6" event={"ID":"642e2d30-24f7-4997-b730-bb037276ff1b","Type":"ContainerStarted","Data":"352195f204950b3fb5b67ffab243e8d1ca785ee0f9537dffff36d26eff62e8c6"} Jul 08 18:45:39.705480 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:39.705457 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7vl5" event={"ID":"b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3","Type":"ContainerStarted","Data":"6b259eabc8016dbc9c0a93a1999b2cd9a86edc8f9713fce5a8fa85fb50f18374"} Jul 08 18:45:40.114252 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:40.114216 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73c6d7ff-a154-4b84-9d4f-023fa34c19d0-metrics-certs\") pod \"network-metrics-daemon-gtkjp\" (UID: \"73c6d7ff-a154-4b84-9d4f-023fa34c19d0\") " pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:45:40.114444 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:40.114390 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:45:40.114521 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:40.114450 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73c6d7ff-a154-4b84-9d4f-023fa34c19d0-metrics-certs podName:73c6d7ff-a154-4b84-9d4f-023fa34c19d0 nodeName:}" failed. No retries permitted until 2026-07-08 18:45:42.114432134 +0000 UTC m=+5.984847249 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73c6d7ff-a154-4b84-9d4f-023fa34c19d0-metrics-certs") pod "network-metrics-daemon-gtkjp" (UID: "73c6d7ff-a154-4b84-9d4f-023fa34c19d0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:45:40.215485 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:40.215122 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5mcv\" (UniqueName: \"kubernetes.io/projected/18bcf614-22b3-4603-b011-1ad2cef794ab-kube-api-access-m5mcv\") pod \"network-check-target-snhnd\" (UID: \"18bcf614-22b3-4603-b011-1ad2cef794ab\") " pod="openshift-network-diagnostics/network-check-target-snhnd" Jul 08 18:45:40.215485 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:40.215188 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/913b02f9-f3cb-4873-a4f7-0fb411ebec5f-original-pull-secret\") pod \"global-pull-secret-syncer-mxddc\" (UID: \"913b02f9-f3cb-4873-a4f7-0fb411ebec5f\") " pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:45:40.215485 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:40.215307 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:45:40.215485 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:40.215368 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/913b02f9-f3cb-4873-a4f7-0fb411ebec5f-original-pull-secret podName:913b02f9-f3cb-4873-a4f7-0fb411ebec5f nodeName:}" failed. No retries permitted until 2026-07-08 18:45:42.215350935 +0000 UTC m=+6.085766048 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/913b02f9-f3cb-4873-a4f7-0fb411ebec5f-original-pull-secret") pod "global-pull-secret-syncer-mxddc" (UID: "913b02f9-f3cb-4873-a4f7-0fb411ebec5f") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:45:40.215882 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:40.215806 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:45:40.215882 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:40.215825 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:45:40.215882 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:40.215838 2572 projected.go:196] Error preparing data for projected volume kube-api-access-m5mcv for pod openshift-network-diagnostics/network-check-target-snhnd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:45:40.216026 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:40.215885 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/18bcf614-22b3-4603-b011-1ad2cef794ab-kube-api-access-m5mcv podName:18bcf614-22b3-4603-b011-1ad2cef794ab nodeName:}" failed. No retries permitted until 2026-07-08 18:45:42.21586908 +0000 UTC m=+6.086284195 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-m5mcv" (UniqueName: "kubernetes.io/projected/18bcf614-22b3-4603-b011-1ad2cef794ab-kube-api-access-m5mcv") pod "network-check-target-snhnd" (UID: "18bcf614-22b3-4603-b011-1ad2cef794ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:45:40.560140 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:40.560090 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 18:40:38 +0000 UTC" deadline="2028-01-18 13:03:28.566105305 +0000 UTC" Jul 08 18:45:40.560140 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:40.560127 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13410h17m48.005982548s" Jul 08 18:45:40.685745 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:40.685715 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:45:40.685922 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:40.685870 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxddc" podUID="913b02f9-f3cb-4873-a4f7-0fb411ebec5f" Jul 08 18:45:40.686524 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:40.686500 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snhnd" Jul 08 18:45:40.686635 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:40.686621 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snhnd" podUID="18bcf614-22b3-4603-b011-1ad2cef794ab" Jul 08 18:45:41.685167 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:41.684656 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:45:41.685167 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:41.684805 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtkjp" podUID="73c6d7ff-a154-4b84-9d4f-023fa34c19d0" Jul 08 18:45:42.131600 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:42.130922 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73c6d7ff-a154-4b84-9d4f-023fa34c19d0-metrics-certs\") pod \"network-metrics-daemon-gtkjp\" (UID: \"73c6d7ff-a154-4b84-9d4f-023fa34c19d0\") " pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:45:42.131600 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:42.131110 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:45:42.131600 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:42.131175 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73c6d7ff-a154-4b84-9d4f-023fa34c19d0-metrics-certs podName:73c6d7ff-a154-4b84-9d4f-023fa34c19d0 nodeName:}" failed. No retries permitted until 2026-07-08 18:45:46.131154139 +0000 UTC m=+10.001569250 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73c6d7ff-a154-4b84-9d4f-023fa34c19d0-metrics-certs") pod "network-metrics-daemon-gtkjp" (UID: "73c6d7ff-a154-4b84-9d4f-023fa34c19d0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:45:42.232082 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:42.232023 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/913b02f9-f3cb-4873-a4f7-0fb411ebec5f-original-pull-secret\") pod \"global-pull-secret-syncer-mxddc\" (UID: \"913b02f9-f3cb-4873-a4f7-0fb411ebec5f\") " pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:45:42.232259 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:42.232103 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5mcv\" (UniqueName: \"kubernetes.io/projected/18bcf614-22b3-4603-b011-1ad2cef794ab-kube-api-access-m5mcv\") pod \"network-check-target-snhnd\" (UID: \"18bcf614-22b3-4603-b011-1ad2cef794ab\") " pod="openshift-network-diagnostics/network-check-target-snhnd" Jul 08 18:45:42.232259 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:42.232250 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:45:42.232370 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:42.232267 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:45:42.232370 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:42.232279 2572 projected.go:196] Error preparing data for projected volume kube-api-access-m5mcv for pod openshift-network-diagnostics/network-check-target-snhnd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:45:42.232370 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:42.232334 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/18bcf614-22b3-4603-b011-1ad2cef794ab-kube-api-access-m5mcv podName:18bcf614-22b3-4603-b011-1ad2cef794ab nodeName:}" failed. No retries permitted until 2026-07-08 18:45:46.232317103 +0000 UTC m=+10.102732219 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-m5mcv" (UniqueName: "kubernetes.io/projected/18bcf614-22b3-4603-b011-1ad2cef794ab-kube-api-access-m5mcv") pod "network-check-target-snhnd" (UID: "18bcf614-22b3-4603-b011-1ad2cef794ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:45:42.232813 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:42.232718 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:45:42.232813 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:42.232763 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/913b02f9-f3cb-4873-a4f7-0fb411ebec5f-original-pull-secret podName:913b02f9-f3cb-4873-a4f7-0fb411ebec5f nodeName:}" failed. No retries permitted until 2026-07-08 18:45:46.232749003 +0000 UTC m=+10.103164117 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/913b02f9-f3cb-4873-a4f7-0fb411ebec5f-original-pull-secret") pod "global-pull-secret-syncer-mxddc" (UID: "913b02f9-f3cb-4873-a4f7-0fb411ebec5f") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:45:42.685399 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:42.685357 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:45:42.685871 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:42.685501 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxddc" podUID="913b02f9-f3cb-4873-a4f7-0fb411ebec5f" Jul 08 18:45:42.685871 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:42.685556 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snhnd" Jul 08 18:45:42.685871 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:42.685678 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snhnd" podUID="18bcf614-22b3-4603-b011-1ad2cef794ab" Jul 08 18:45:43.685008 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:43.684923 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:45:43.685184 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:43.685102 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtkjp" podUID="73c6d7ff-a154-4b84-9d4f-023fa34c19d0" Jul 08 18:45:44.684556 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:44.684526 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:45:44.685146 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:44.684683 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxddc" podUID="913b02f9-f3cb-4873-a4f7-0fb411ebec5f" Jul 08 18:45:44.685146 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:44.684755 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snhnd" Jul 08 18:45:44.685146 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:44.684862 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snhnd" podUID="18bcf614-22b3-4603-b011-1ad2cef794ab" Jul 08 18:45:45.685215 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:45.685175 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:45:45.685853 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:45.685339 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtkjp" podUID="73c6d7ff-a154-4b84-9d4f-023fa34c19d0" Jul 08 18:45:46.163585 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:46.163542 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73c6d7ff-a154-4b84-9d4f-023fa34c19d0-metrics-certs\") pod \"network-metrics-daemon-gtkjp\" (UID: \"73c6d7ff-a154-4b84-9d4f-023fa34c19d0\") " pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:45:46.163762 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:46.163681 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:45:46.163821 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:46.163765 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73c6d7ff-a154-4b84-9d4f-023fa34c19d0-metrics-certs podName:73c6d7ff-a154-4b84-9d4f-023fa34c19d0 nodeName:}" failed. No retries permitted until 2026-07-08 18:45:54.163743664 +0000 UTC m=+18.034158781 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73c6d7ff-a154-4b84-9d4f-023fa34c19d0-metrics-certs") pod "network-metrics-daemon-gtkjp" (UID: "73c6d7ff-a154-4b84-9d4f-023fa34c19d0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:45:46.264608 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:46.264554 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5mcv\" (UniqueName: \"kubernetes.io/projected/18bcf614-22b3-4603-b011-1ad2cef794ab-kube-api-access-m5mcv\") pod \"network-check-target-snhnd\" (UID: \"18bcf614-22b3-4603-b011-1ad2cef794ab\") " pod="openshift-network-diagnostics/network-check-target-snhnd" Jul 08 18:45:46.264784 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:46.264646 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/913b02f9-f3cb-4873-a4f7-0fb411ebec5f-original-pull-secret\") pod \"global-pull-secret-syncer-mxddc\" (UID: \"913b02f9-f3cb-4873-a4f7-0fb411ebec5f\") " pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:45:46.264784 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:46.264773 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:45:46.264891 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:46.264830 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/913b02f9-f3cb-4873-a4f7-0fb411ebec5f-original-pull-secret podName:913b02f9-f3cb-4873-a4f7-0fb411ebec5f nodeName:}" failed. No retries permitted until 2026-07-08 18:45:54.264810556 +0000 UTC m=+18.135225690 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/913b02f9-f3cb-4873-a4f7-0fb411ebec5f-original-pull-secret") pod "global-pull-secret-syncer-mxddc" (UID: "913b02f9-f3cb-4873-a4f7-0fb411ebec5f") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:45:46.264982 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:46.264960 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:45:46.265034 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:46.264992 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:45:46.265034 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:46.265006 2572 projected.go:196] Error preparing data for projected volume kube-api-access-m5mcv for pod openshift-network-diagnostics/network-check-target-snhnd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:45:46.265135 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:46.265066 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/18bcf614-22b3-4603-b011-1ad2cef794ab-kube-api-access-m5mcv podName:18bcf614-22b3-4603-b011-1ad2cef794ab nodeName:}" failed. No retries permitted until 2026-07-08 18:45:54.265049057 +0000 UTC m=+18.135464188 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-m5mcv" (UniqueName: "kubernetes.io/projected/18bcf614-22b3-4603-b011-1ad2cef794ab-kube-api-access-m5mcv") pod "network-check-target-snhnd" (UID: "18bcf614-22b3-4603-b011-1ad2cef794ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:45:46.686514 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:46.686159 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snhnd" Jul 08 18:45:46.686514 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:46.686287 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snhnd" podUID="18bcf614-22b3-4603-b011-1ad2cef794ab" Jul 08 18:45:46.686514 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:46.686330 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:45:46.686514 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:46.686454 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxddc" podUID="913b02f9-f3cb-4873-a4f7-0fb411ebec5f" Jul 08 18:45:47.684883 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:47.684850 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:45:47.685035 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:47.684998 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtkjp" podUID="73c6d7ff-a154-4b84-9d4f-023fa34c19d0" Jul 08 18:45:48.684927 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:48.684679 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snhnd" Jul 08 18:45:48.685432 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:48.684704 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:45:48.685432 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:48.685156 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snhnd" podUID="18bcf614-22b3-4603-b011-1ad2cef794ab" Jul 08 18:45:48.685432 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:48.685225 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxddc" podUID="913b02f9-f3cb-4873-a4f7-0fb411ebec5f" Jul 08 18:45:48.725949 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:48.725914 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-239.ec2.internal" event={"ID":"cad17b2cf3c8d2eb0553c09417436945","Type":"ContainerStarted","Data":"01339bd3e20e9b5b56be9bc386320a5f327a234475781f5b1a48893f6085732a"} Jul 08 18:45:48.728350 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:48.728311 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rsndx" event={"ID":"2569a83d-86bb-4ed4-a2e3-f93cb0e3e398","Type":"ContainerStarted","Data":"17a2322e2b860fdbad2f88ffa47705847bd19e8ab311a8959a1740936e4d195a"} Jul 08 18:45:48.742292 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:48.742232 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-239.ec2.internal" podStartSLOduration=11.742215036 podStartE2EDuration="11.742215036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:45:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:45:48.741181848 +0000 UTC m=+12.611596982" watchObservedRunningTime="2026-07-08 18:45:48.742215036 +0000 UTC m=+12.612630170" Jul 08 18:45:48.762996 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:48.762948 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rsndx" podStartSLOduration=2.200710411 podStartE2EDuration="11.762929222s" totalImagesPullingTime="9.562218811s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:45:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:45:48.762242896 +0000 UTC m=+12.632658030" watchObservedRunningTime="2026-07-08 18:45:48.762929222 +0000 UTC m=+12.633344355" Jul 08 18:45:49.684488 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:49.684464 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:45:49.684633 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:49.684562 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtkjp" podUID="73c6d7ff-a154-4b84-9d4f-023fa34c19d0" Jul 08 18:45:49.731102 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:49.731072 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8vn8j" event={"ID":"4b4dd87a-0d97-4dd0-826d-b422ca31c60c","Type":"ContainerStarted","Data":"211da098a052c77a2232cb31554f354e786cfb488dda8b1f1ca21dbeb1680d8c"} Jul 08 18:45:49.732442 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:49.732417 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7dbjh" event={"ID":"d4f95e26-ebfa-4527-a31b-785d477f5329","Type":"ContainerStarted","Data":"7caeaf6c877ac1bd897f9d000ce1d5d484704ae86607ade8554de4679b4e1c70"} Jul 08 18:45:49.733861 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:49.733839 2572 generic.go:356] "Generic (PLEG): container finished" podID="15f04361-bd04-449b-9cce-d46b7ba27368" containerID="c6a17f552d6391da1efd964e5004ef4d906e0e31ff85609a78788b5e9338d09f" exitCode=0 Jul 08 18:45:49.733926 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:49.733908 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t4fzl" event={"ID":"15f04361-bd04-449b-9cce-d46b7ba27368","Type":"ContainerDied","Data":"c6a17f552d6391da1efd964e5004ef4d906e0e31ff85609a78788b5e9338d09f"} Jul 08 18:45:49.735356 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:49.735333 2572 generic.go:356] "Generic (PLEG): container finished" podID="54e728ac007c2f27d86d66e70b625247" containerID="df285f28e937ce16209e74914b6ec1f8a831161bbdccdc955965f9321d7456cb" exitCode=0 Jul 08 18:45:49.735420 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:49.735404 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-239.ec2.internal" event={"ID":"54e728ac007c2f27d86d66e70b625247","Type":"ContainerDied","Data":"df285f28e937ce16209e74914b6ec1f8a831161bbdccdc955965f9321d7456cb"} Jul 08 18:45:49.736911 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:49.736892 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sz4t6" event={"ID":"642e2d30-24f7-4997-b730-bb037276ff1b","Type":"ContainerStarted","Data":"8cff3b7cb35b35806fc01da73c8add095f9f93c6f7c904c64d230093e941843a"} Jul 08 18:45:49.738321 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:49.738296 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7vl5" event={"ID":"b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3","Type":"ContainerStarted","Data":"6191d336b679c29bcce71669d3151f2ed90c9bc2d00589f4dd44da2c06c916dd"} Jul 08 18:45:49.812018 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:49.811863 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8vn8j" podStartSLOduration=3.2654684339999998 podStartE2EDuration="12.811848165s" totalImagesPullingTime="9.546379731s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:45:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:45:49.778987532 +0000 UTC m=+13.649402666" watchObservedRunningTime="2026-07-08 18:45:49.811848165 +0000 UTC m=+13.682263297" Jul 08 18:45:49.868784 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:49.868439 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7dbjh" podStartSLOduration=4.312031352 podStartE2EDuration="13.868423669s" totalImagesPullingTime="9.556392317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:45:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:45:49.840373505 +0000 UTC m=+13.710788638" watchObservedRunningTime="2026-07-08 18:45:49.868423669 +0000 UTC m=+13.738838802" Jul 08 18:45:49.868784 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:49.868540 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-sz4t6" podStartSLOduration=4.313475124 podStartE2EDuration="13.868535674s" totalImagesPullingTime="9.55506055s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:45:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:45:49.868389705 +0000 UTC m=+13.738804838" watchObservedRunningTime="2026-07-08 18:45:49.868535674 +0000 UTC m=+13.738950808" Jul 08 18:45:50.408670 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:50.408635 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7dbjh" Jul 08 18:45:50.409485 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:50.409465 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7dbjh" Jul 08 18:45:50.685123 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:50.685092 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snhnd" Jul 08 18:45:50.685312 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:50.685106 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:45:50.685312 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:50.685239 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snhnd" podUID="18bcf614-22b3-4603-b011-1ad2cef794ab" Jul 08 18:45:50.685416 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:50.685325 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxddc" podUID="913b02f9-f3cb-4873-a4f7-0fb411ebec5f" Jul 08 18:45:50.742393 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:50.742353 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hzxck" event={"ID":"ee07801f-ee9c-4ab6-b8d9-356a635e96ed","Type":"ContainerStarted","Data":"f04cd8652e7f3212699c0572bc679cb131c04168d52aedcac60ceb1def2cb4c3"} Jul 08 18:45:50.744497 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:50.744465 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-239.ec2.internal" event={"ID":"54e728ac007c2f27d86d66e70b625247","Type":"ContainerStarted","Data":"1766fe9af05b33b19e3a97bc7ab20f8e43af5ee7577d9081e4bbafc7241779c9"} Jul 08 18:45:50.779098 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:50.779038 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hzxck" podStartSLOduration=5.183894861 podStartE2EDuration="14.779017399s" totalImagesPullingTime="9.595122538s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:45:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:45:50.761126993 +0000 UTC m=+14.631542162" watchObservedRunningTime="2026-07-08 18:45:50.779017399 +0000 UTC m=+14.649432534" Jul 08 18:45:51.684734 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:51.684618 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:45:51.684936 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:51.684770 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtkjp" podUID="73c6d7ff-a154-4b84-9d4f-023fa34c19d0" Jul 08 18:45:51.746699 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:51.746670 2572 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 08 18:45:52.685161 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:52.685125 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:45:52.685354 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:52.685270 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxddc" podUID="913b02f9-f3cb-4873-a4f7-0fb411ebec5f" Jul 08 18:45:52.685354 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:52.685309 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snhnd" Jul 08 18:45:52.685469 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:52.685375 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snhnd" podUID="18bcf614-22b3-4603-b011-1ad2cef794ab" Jul 08 18:45:53.684728 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:53.684580 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:45:53.685425 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:53.685090 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtkjp" podUID="73c6d7ff-a154-4b84-9d4f-023fa34c19d0" Jul 08 18:45:54.222808 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:54.222775 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73c6d7ff-a154-4b84-9d4f-023fa34c19d0-metrics-certs\") pod \"network-metrics-daemon-gtkjp\" (UID: \"73c6d7ff-a154-4b84-9d4f-023fa34c19d0\") " pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:45:54.222971 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:54.222942 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:45:54.223041 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:54.223022 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73c6d7ff-a154-4b84-9d4f-023fa34c19d0-metrics-certs podName:73c6d7ff-a154-4b84-9d4f-023fa34c19d0 nodeName:}" failed. No retries permitted until 2026-07-08 18:46:10.223000187 +0000 UTC m=+34.093415327 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73c6d7ff-a154-4b84-9d4f-023fa34c19d0-metrics-certs") pod "network-metrics-daemon-gtkjp" (UID: "73c6d7ff-a154-4b84-9d4f-023fa34c19d0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:45:54.324013 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:54.323974 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5mcv\" (UniqueName: \"kubernetes.io/projected/18bcf614-22b3-4603-b011-1ad2cef794ab-kube-api-access-m5mcv\") pod \"network-check-target-snhnd\" (UID: \"18bcf614-22b3-4603-b011-1ad2cef794ab\") " pod="openshift-network-diagnostics/network-check-target-snhnd" Jul 08 18:45:54.324170 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:54.324047 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/913b02f9-f3cb-4873-a4f7-0fb411ebec5f-original-pull-secret\") pod \"global-pull-secret-syncer-mxddc\" (UID: \"913b02f9-f3cb-4873-a4f7-0fb411ebec5f\") " pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:45:54.324170 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:54.324150 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:45:54.324287 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:54.324211 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/913b02f9-f3cb-4873-a4f7-0fb411ebec5f-original-pull-secret podName:913b02f9-f3cb-4873-a4f7-0fb411ebec5f nodeName:}" failed. No retries permitted until 2026-07-08 18:46:10.324191581 +0000 UTC m=+34.194606707 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/913b02f9-f3cb-4873-a4f7-0fb411ebec5f-original-pull-secret") pod "global-pull-secret-syncer-mxddc" (UID: "913b02f9-f3cb-4873-a4f7-0fb411ebec5f") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:45:54.324287 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:54.324152 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:45:54.324287 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:54.324249 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:45:54.324287 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:54.324263 2572 projected.go:196] Error preparing data for projected volume kube-api-access-m5mcv for pod openshift-network-diagnostics/network-check-target-snhnd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:45:54.324484 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:54.324310 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/18bcf614-22b3-4603-b011-1ad2cef794ab-kube-api-access-m5mcv podName:18bcf614-22b3-4603-b011-1ad2cef794ab nodeName:}" failed. No retries permitted until 2026-07-08 18:46:10.324297283 +0000 UTC m=+34.194712403 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-m5mcv" (UniqueName: "kubernetes.io/projected/18bcf614-22b3-4603-b011-1ad2cef794ab-kube-api-access-m5mcv") pod "network-check-target-snhnd" (UID: "18bcf614-22b3-4603-b011-1ad2cef794ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:45:54.538890 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:54.538812 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7dbjh" Jul 08 18:45:54.539052 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:54.538990 2572 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 08 18:45:54.539564 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:54.539495 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7dbjh" Jul 08 18:45:54.556330 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:54.556275 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-239.ec2.internal" podStartSLOduration=17.556258857 podStartE2EDuration="17.556258857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:45:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:45:50.778546735 +0000 UTC m=+14.648961870" watchObservedRunningTime="2026-07-08 18:45:54.556258857 +0000 UTC m=+18.426673993" Jul 08 18:45:54.684409 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:54.684373 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:45:54.684566 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:54.684373 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snhnd" Jul 08 18:45:54.684566 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:54.684506 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxddc" podUID="913b02f9-f3cb-4873-a4f7-0fb411ebec5f" Jul 08 18:45:54.684689 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:54.684606 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snhnd" podUID="18bcf614-22b3-4603-b011-1ad2cef794ab" Jul 08 18:45:55.685040 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:55.685010 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:45:55.685510 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:55.685136 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtkjp" podUID="73c6d7ff-a154-4b84-9d4f-023fa34c19d0" Jul 08 18:45:56.686089 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:56.685978 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:45:56.686089 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:56.686097 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snhnd" Jul 08 18:45:56.686650 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:56.686142 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxddc" podUID="913b02f9-f3cb-4873-a4f7-0fb411ebec5f" Jul 08 18:45:56.686650 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:56.686174 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snhnd" podUID="18bcf614-22b3-4603-b011-1ad2cef794ab" Jul 08 18:45:57.684373 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:57.684335 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:45:57.684536 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:57.684467 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtkjp" podUID="73c6d7ff-a154-4b84-9d4f-023fa34c19d0" Jul 08 18:45:58.685113 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:58.685082 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:45:58.685573 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:58.685082 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snhnd" Jul 08 18:45:58.685573 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:58.685196 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxddc" podUID="913b02f9-f3cb-4873-a4f7-0fb411ebec5f" Jul 08 18:45:58.685573 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:58.685314 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snhnd" podUID="18bcf614-22b3-4603-b011-1ad2cef794ab" Jul 08 18:45:59.685186 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:45:59.685153 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:45:59.685703 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:45:59.685290 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtkjp" podUID="73c6d7ff-a154-4b84-9d4f-023fa34c19d0" Jul 08 18:46:00.684906 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:00.684881 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snhnd" Jul 08 18:46:00.685046 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:00.684981 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snhnd" podUID="18bcf614-22b3-4603-b011-1ad2cef794ab" Jul 08 18:46:00.685046 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:00.685019 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:46:00.685156 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:00.685075 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxddc" podUID="913b02f9-f3cb-4873-a4f7-0fb411ebec5f" Jul 08 18:46:00.855933 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:00.855785 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 18:46:01.558811 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:01.558529 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T18:46:00.855928275Z","UUID":"0d0a3eac-e159-445b-851d-03fa2dc3bf93","Handler":null,"Name":"","Endpoint":""} Jul 08 18:46:01.559894 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:01.559875 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 18:46:01.560022 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:01.559906 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 18:46:01.685154 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:01.685118 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:46:01.685327 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:01.685233 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtkjp" podUID="73c6d7ff-a154-4b84-9d4f-023fa34c19d0" Jul 08 18:46:01.770237 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:01.770200 2572 generic.go:356] "Generic (PLEG): container finished" podID="15f04361-bd04-449b-9cce-d46b7ba27368" containerID="29d308f6ddb05df5a58e02413adc2e64b96e89238d868e63c7542db9846775fe" exitCode=0 Jul 08 18:46:01.770427 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:01.770296 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t4fzl" event={"ID":"15f04361-bd04-449b-9cce-d46b7ba27368","Type":"ContainerDied","Data":"29d308f6ddb05df5a58e02413adc2e64b96e89238d868e63c7542db9846775fe"} Jul 08 18:46:01.774071 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:01.773967 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" event={"ID":"b31ad1bb-311a-4b3c-9360-311dbf2d18f0","Type":"ContainerStarted","Data":"271a5b1388a752daaf820bc19f03037cadf968a7b9efc77e97d7021a929e92fb"} Jul 08 18:46:01.774071 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:01.774052 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" event={"ID":"b31ad1bb-311a-4b3c-9360-311dbf2d18f0","Type":"ContainerStarted","Data":"aeeba25fbf33d414d486680af9bec134623f085332102599180b8f96b9031b29"} Jul 08 18:46:01.774267 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:01.774106 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" event={"ID":"b31ad1bb-311a-4b3c-9360-311dbf2d18f0","Type":"ContainerStarted","Data":"64a55e2cac46803a7026084fbde397449fdb121558839ad53d90b6f7bc44baf0"} Jul 08 18:46:01.774267 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:01.774153 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" event={"ID":"b31ad1bb-311a-4b3c-9360-311dbf2d18f0","Type":"ContainerStarted","Data":"7f3e57c3c156cc158bc78bedf7b52b8eb161a0c863e2b3f0675a54f52186c131"} Jul 08 18:46:01.774267 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:01.774203 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" event={"ID":"b31ad1bb-311a-4b3c-9360-311dbf2d18f0","Type":"ContainerStarted","Data":"190b70bd66a77e9dd52808a0a1c6c08084afd798f14447e0ca09416241113566"} Jul 08 18:46:01.774267 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:01.774250 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" event={"ID":"b31ad1bb-311a-4b3c-9360-311dbf2d18f0","Type":"ContainerStarted","Data":"ee3cf541331c8f9c0c8d3853a1bd5eff83e64e37cedb3e95ffccbc2a5d5e83b4"} Jul 08 18:46:01.775885 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:01.775862 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7vl5" event={"ID":"b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3","Type":"ContainerStarted","Data":"5881a0003beaf3c297ea9c5ab484747b450ca058d486d774bc4ffb4221bce83c"} Jul 08 18:46:01.777309 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:01.777284 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4jdfl" event={"ID":"193b4501-08cc-4ad0-97e4-9e3277d52c7b","Type":"ContainerStarted","Data":"08338c47daf99c0b0a6452a42e426b02820b1095c8d85864a0095db139b83c5c"} Jul 08 18:46:01.807348 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:01.807307 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4jdfl" podStartSLOduration=3.965286991 podStartE2EDuration="25.807294786s" totalImagesPullingTime="21.842007795s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:45:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:01.806948707 +0000 UTC m=+25.677363841" watchObservedRunningTime="2026-07-08 18:46:01.807294786 +0000 UTC m=+25.677709918" Jul 08 18:46:02.684448 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:02.684419 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snhnd" Jul 08 18:46:02.684923 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:02.684530 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snhnd" podUID="18bcf614-22b3-4603-b011-1ad2cef794ab" Jul 08 18:46:02.684923 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:02.684583 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:46:02.684923 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:02.684696 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxddc" podUID="913b02f9-f3cb-4873-a4f7-0fb411ebec5f" Jul 08 18:46:02.782174 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:02.782140 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7vl5" event={"ID":"b7d1bffc-f2ea-4e4a-9206-aee1ccd869e3","Type":"ContainerStarted","Data":"b6fb1d0c9b63f1f9486db07b27fadc1bfe2d963b635b780cf432fc22ec7f8784"} Jul 08 18:46:02.808777 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:02.808735 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t7vl5" podStartSLOduration=4.230318076 podStartE2EDuration="26.808719318s" totalImagesPullingTime="22.578401242s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:45:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:02.808521518 +0000 UTC m=+26.678936652" watchObservedRunningTime="2026-07-08 18:46:02.808719318 +0000 UTC m=+26.679134450" Jul 08 18:46:03.684785 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:03.684750 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:46:03.685125 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:03.684861 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtkjp" podUID="73c6d7ff-a154-4b84-9d4f-023fa34c19d0" Jul 08 18:46:03.786869 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:03.786792 2572 generic.go:356] "Generic (PLEG): container finished" podID="15f04361-bd04-449b-9cce-d46b7ba27368" containerID="d6cdff8791ca2537b1dd24b810cb67b3d5c441d2a84db6d642bee0b8a66808d7" exitCode=0 Jul 08 18:46:03.787007 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:03.786875 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t4fzl" event={"ID":"15f04361-bd04-449b-9cce-d46b7ba27368","Type":"ContainerDied","Data":"d6cdff8791ca2537b1dd24b810cb67b3d5c441d2a84db6d642bee0b8a66808d7"} Jul 08 18:46:03.790309 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:03.790243 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" event={"ID":"b31ad1bb-311a-4b3c-9360-311dbf2d18f0","Type":"ContainerStarted","Data":"3d44aaf07d8ac41e5d2709f0944d5a32b7a89b405b752dfa88fa68719620d57c"} Jul 08 18:46:04.685368 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:04.685339 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snhnd" Jul 08 18:46:04.685791 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:04.685440 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snhnd" podUID="18bcf614-22b3-4603-b011-1ad2cef794ab" Jul 08 18:46:04.685791 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:04.685507 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:46:04.685791 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:04.685642 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxddc" podUID="913b02f9-f3cb-4873-a4f7-0fb411ebec5f" Jul 08 18:46:05.684994 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:05.684970 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:46:05.685092 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:05.685075 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtkjp" podUID="73c6d7ff-a154-4b84-9d4f-023fa34c19d0" Jul 08 18:46:05.797863 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:05.797503 2572 generic.go:356] "Generic (PLEG): container finished" podID="15f04361-bd04-449b-9cce-d46b7ba27368" containerID="e2f8db89d127cb559832856b2a5a3b44f22fbd64c4a778982dd296a32361e9c0" exitCode=0 Jul 08 18:46:05.797863 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:05.797607 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t4fzl" event={"ID":"15f04361-bd04-449b-9cce-d46b7ba27368","Type":"ContainerDied","Data":"e2f8db89d127cb559832856b2a5a3b44f22fbd64c4a778982dd296a32361e9c0"} Jul 08 18:46:05.802216 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:05.802185 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" event={"ID":"b31ad1bb-311a-4b3c-9360-311dbf2d18f0","Type":"ContainerStarted","Data":"6abcb119161d9e8a34cf6b8aafa4779dcb7bac3b350658f1e0d0bd8d2d48f159"} Jul 08 18:46:05.802469 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:05.802450 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:46:05.802574 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:05.802526 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:46:05.802574 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:05.802567 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:46:05.816703 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:05.816682 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:46:05.816823 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:05.816811 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:46:05.848824 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:05.848784 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" podStartSLOduration=7.991235551 podStartE2EDuration="29.848773104s" totalImagesPullingTime="21.857537553s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:45:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:05.847578256 +0000 UTC m=+29.717993390" watchObservedRunningTime="2026-07-08 18:46:05.848773104 +0000 UTC m=+29.719188237" Jul 08 18:46:06.685411 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:06.685378 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:46:06.685618 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:06.685470 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxddc" podUID="913b02f9-f3cb-4873-a4f7-0fb411ebec5f" Jul 08 18:46:06.685618 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:06.685562 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snhnd" Jul 08 18:46:06.685743 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:06.685666 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snhnd" podUID="18bcf614-22b3-4603-b011-1ad2cef794ab" Jul 08 18:46:07.684604 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:07.684561 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:46:07.685059 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:07.684688 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtkjp" podUID="73c6d7ff-a154-4b84-9d4f-023fa34c19d0" Jul 08 18:46:07.728937 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:07.728905 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-snhnd"] Jul 08 18:46:07.729153 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:07.729011 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snhnd" Jul 08 18:46:07.729153 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:07.729111 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snhnd" podUID="18bcf614-22b3-4603-b011-1ad2cef794ab" Jul 08 18:46:07.731796 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:07.731755 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mxddc"] Jul 08 18:46:07.731911 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:07.731842 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:46:07.731980 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:07.731915 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxddc" podUID="913b02f9-f3cb-4873-a4f7-0fb411ebec5f" Jul 08 18:46:07.747072 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:07.747048 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gtkjp"] Jul 08 18:46:07.808662 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:07.808633 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:46:07.808823 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:07.808739 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtkjp" podUID="73c6d7ff-a154-4b84-9d4f-023fa34c19d0" Jul 08 18:46:09.685056 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:09.685027 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snhnd" Jul 08 18:46:09.685646 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:09.685070 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:46:09.685646 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:09.685122 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:46:09.685646 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:09.685139 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snhnd" podUID="18bcf614-22b3-4603-b011-1ad2cef794ab" Jul 08 18:46:09.685646 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:09.685206 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtkjp" podUID="73c6d7ff-a154-4b84-9d4f-023fa34c19d0" Jul 08 18:46:09.685646 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:09.685283 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxddc" podUID="913b02f9-f3cb-4873-a4f7-0fb411ebec5f" Jul 08 18:46:10.239086 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:10.239056 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73c6d7ff-a154-4b84-9d4f-023fa34c19d0-metrics-certs\") pod \"network-metrics-daemon-gtkjp\" (UID: \"73c6d7ff-a154-4b84-9d4f-023fa34c19d0\") " pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:46:10.239225 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:10.239167 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:46:10.239295 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:10.239226 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73c6d7ff-a154-4b84-9d4f-023fa34c19d0-metrics-certs podName:73c6d7ff-a154-4b84-9d4f-023fa34c19d0 nodeName:}" failed. No retries permitted until 2026-07-08 18:46:42.239211734 +0000 UTC m=+66.109626844 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73c6d7ff-a154-4b84-9d4f-023fa34c19d0-metrics-certs") pod "network-metrics-daemon-gtkjp" (UID: "73c6d7ff-a154-4b84-9d4f-023fa34c19d0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:46:10.339833 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:10.339806 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/913b02f9-f3cb-4873-a4f7-0fb411ebec5f-original-pull-secret\") pod \"global-pull-secret-syncer-mxddc\" (UID: \"913b02f9-f3cb-4873-a4f7-0fb411ebec5f\") " pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:46:10.339981 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:10.339853 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5mcv\" (UniqueName: \"kubernetes.io/projected/18bcf614-22b3-4603-b011-1ad2cef794ab-kube-api-access-m5mcv\") pod \"network-check-target-snhnd\" (UID: \"18bcf614-22b3-4603-b011-1ad2cef794ab\") " pod="openshift-network-diagnostics/network-check-target-snhnd" Jul 08 18:46:10.339981 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:10.339942 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:46:10.340050 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:10.340004 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/913b02f9-f3cb-4873-a4f7-0fb411ebec5f-original-pull-secret podName:913b02f9-f3cb-4873-a4f7-0fb411ebec5f nodeName:}" failed. No retries permitted until 2026-07-08 18:46:42.339988958 +0000 UTC m=+66.210404069 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/913b02f9-f3cb-4873-a4f7-0fb411ebec5f-original-pull-secret") pod "global-pull-secret-syncer-mxddc" (UID: "913b02f9-f3cb-4873-a4f7-0fb411ebec5f") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:46:10.340050 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:10.339946 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:46:10.340050 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:10.340042 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:46:10.340050 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:10.340051 2572 projected.go:196] Error preparing data for projected volume kube-api-access-m5mcv for pod openshift-network-diagnostics/network-check-target-snhnd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:46:10.340185 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:10.340091 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/18bcf614-22b3-4603-b011-1ad2cef794ab-kube-api-access-m5mcv podName:18bcf614-22b3-4603-b011-1ad2cef794ab nodeName:}" failed. No retries permitted until 2026-07-08 18:46:42.340081002 +0000 UTC m=+66.210496130 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-m5mcv" (UniqueName: "kubernetes.io/projected/18bcf614-22b3-4603-b011-1ad2cef794ab-kube-api-access-m5mcv") pod "network-check-target-snhnd" (UID: "18bcf614-22b3-4603-b011-1ad2cef794ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:46:11.685342 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:11.685308 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snhnd" Jul 08 18:46:11.685342 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:11.685327 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:46:11.685342 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:11.685331 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:46:11.685880 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:11.685426 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snhnd" podUID="18bcf614-22b3-4603-b011-1ad2cef794ab" Jul 08 18:46:11.685880 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:11.685497 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxddc" podUID="913b02f9-f3cb-4873-a4f7-0fb411ebec5f" Jul 08 18:46:11.685880 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:11.685568 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtkjp" podUID="73c6d7ff-a154-4b84-9d4f-023fa34c19d0" Jul 08 18:46:13.442747 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.442578 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-239.ec2.internal" event="NodeReady" Jul 08 18:46:13.443094 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.442851 2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 18:46:13.484534 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.484506 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t8cls"] Jul 08 18:46:13.501913 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.501887 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5twjz"] Jul 08 18:46:13.502045 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.502030 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t8cls" Jul 08 18:46:13.504755 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.504731 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 08 18:46:13.504872 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.504797 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7tbnm\"" Jul 08 18:46:13.505878 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.505859 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 18:46:13.505878 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.505870 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 18:46:13.506032 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.505892 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 08 18:46:13.516008 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.515981 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-86b55bc475-2qk57"] Jul 08 18:46:13.516123 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.516106 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5twjz" Jul 08 18:46:13.518886 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.518858 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-gkm9k\"" Jul 08 18:46:13.519318 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.519052 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 08 18:46:13.519318 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.519184 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 08 18:46:13.519469 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.519334 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 08 18:46:13.534064 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.534042 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-j5tkz"] Jul 08 18:46:13.534164 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.534145 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-86b55bc475-2qk57" Jul 08 18:46:13.536362 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.536340 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 08 18:46:13.536444 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.536420 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 08 18:46:13.537086 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.536768 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ljx7c\"" Jul 08 18:46:13.537086 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.536804 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 08 18:46:13.537086 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.536794 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 08 18:46:13.537086 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.536901 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 08 18:46:13.537086 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.536911 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 08 18:46:13.557329 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.557309 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-xg4bh"] Jul 08 18:46:13.557439 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.557425 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-j5tkz" Jul 08 18:46:13.560015 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.559982 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 08 18:46:13.560124 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.559989 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-mc7ft\"" Jul 08 18:46:13.560247 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.560233 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 08 18:46:13.577411 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.577391 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-9hx2g"] Jul 08 18:46:13.577528 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.577513 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-xg4bh" Jul 08 18:46:13.581579 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.581563 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 08 18:46:13.581689 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.581624 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-q7gl7\"" Jul 08 18:46:13.581801 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.581786 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 18:46:13.581860 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.581824 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 08 18:46:13.582218 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.582202 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 18:46:13.587104 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.587082 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 08 18:46:13.600348 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.600332 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-55cd4459fc-xnws9"] Jul 08 18:46:13.600451 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.600438 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-9hx2g" Jul 08 18:46:13.604079 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.604058 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 08 18:46:13.604172 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.604147 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 08 18:46:13.604172 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.604151 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 08 18:46:13.604275 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.604171 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-fhnjs\"" Jul 08 18:46:13.604275 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.604211 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 08 18:46:13.609004 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.608988 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 08 18:46:13.624365 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.624348 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t8cls"] Jul 08 18:46:13.624454 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.624377 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5twjz"] Jul 08 18:46:13.624454 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.624393 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-xg4bh"] Jul 08 18:46:13.624454 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.624407 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-j5tkz"] Jul 08 18:46:13.624454 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.624424 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-9hx2g"] Jul 08 18:46:13.624454 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.624438 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hd7xd"] Jul 08 18:46:13.624665 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.624456 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:46:13.626646 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.626622 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sbfpk\"" Jul 08 18:46:13.626898 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.626883 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 08 18:46:13.626989 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.626936 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 08 18:46:13.627193 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.627176 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 08 18:46:13.640422 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.640404 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4b26j"] Jul 08 18:46:13.640516 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.640502 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hd7xd" Jul 08 18:46:13.640697 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.640677 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 08 18:46:13.644665 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.644631 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 08 18:46:13.644771 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.644692 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 08 18:46:13.644771 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.644638 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 08 18:46:13.645681 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.645668 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 08 18:46:13.645753 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.645696 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-bt8qn\"" Jul 08 18:46:13.656533 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.656506 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55cd4459fc-xnws9"] Jul 08 18:46:13.656533 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.656535 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-86b55bc475-2qk57"] Jul 08 18:46:13.656673 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.656556 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-zbn2x"] Jul 08 18:46:13.656673 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.656652 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4b26j" Jul 08 18:46:13.658795 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.658780 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 08 18:46:13.659081 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.659066 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 08 18:46:13.659310 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.659296 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-rhnqq\"" Jul 08 18:46:13.659390 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.659299 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 08 18:46:13.659602 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.659572 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 08 18:46:13.660757 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.660730 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5f1b40e8-bee3-441d-bd78-9a6aacc76949-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-t8cls\" (UID: \"5f1b40e8-bee3-441d-bd78-9a6aacc76949\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t8cls" Jul 08 18:46:13.660854 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.660758 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk4jg\" (UniqueName: \"kubernetes.io/projected/dd1908b4-810a-4f1d-b172-47ddfe11befe-kube-api-access-kk4jg\") pod \"router-default-86b55bc475-2qk57\" (UID: \"dd1908b4-810a-4f1d-b172-47ddfe11befe\") " pod="openshift-ingress/router-default-86b55bc475-2qk57" Jul 08 18:46:13.660854 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.660789 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx59v\" (UniqueName: \"kubernetes.io/projected/5f1b40e8-bee3-441d-bd78-9a6aacc76949-kube-api-access-xx59v\") pod \"cluster-monitoring-operator-64786d9cbb-t8cls\" (UID: \"5f1b40e8-bee3-441d-bd78-9a6aacc76949\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t8cls" Jul 08 18:46:13.660854 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.660836 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdbrz\" (UniqueName: \"kubernetes.io/projected/5d609d76-9788-408f-8ca7-8d6090301785-kube-api-access-pdbrz\") pod \"volume-data-source-validator-5d456fdbcd-j5tkz\" (UID: \"5d609d76-9788-408f-8ca7-8d6090301785\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-j5tkz" Jul 08 18:46:13.661012 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.660883 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7b5def05-a0ed-4512-b1a2-140a051040cf-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5twjz\" (UID: \"7b5def05-a0ed-4512-b1a2-140a051040cf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5twjz" Jul 08 18:46:13.661012 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.660907 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd1908b4-810a-4f1d-b172-47ddfe11befe-service-ca-bundle\") pod \"router-default-86b55bc475-2qk57\" (UID: \"dd1908b4-810a-4f1d-b172-47ddfe11befe\") " pod="openshift-ingress/router-default-86b55bc475-2qk57" Jul 08 18:46:13.661012 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.660926 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4a9979b4-f241-4964-a20f-b42514a3f700-snapshots\") pod \"insights-operator-5c847dcfc4-xg4bh\" (UID: \"4a9979b4-f241-4964-a20f-b42514a3f700\") " pod="openshift-insights/insights-operator-5c847dcfc4-xg4bh" Jul 08 18:46:13.661012 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.660944 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a9979b4-f241-4964-a20f-b42514a3f700-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-xg4bh\" (UID: \"4a9979b4-f241-4964-a20f-b42514a3f700\") " pod="openshift-insights/insights-operator-5c847dcfc4-xg4bh" Jul 08 18:46:13.661012 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.660958 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a9979b4-f241-4964-a20f-b42514a3f700-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-xg4bh\" (UID: \"4a9979b4-f241-4964-a20f-b42514a3f700\") " pod="openshift-insights/insights-operator-5c847dcfc4-xg4bh" Jul 08 18:46:13.661012 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.660982 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/dd1908b4-810a-4f1d-b172-47ddfe11befe-default-certificate\") pod \"router-default-86b55bc475-2qk57\" (UID: \"dd1908b4-810a-4f1d-b172-47ddfe11befe\") " pod="openshift-ingress/router-default-86b55bc475-2qk57" Jul 08 18:46:13.661275 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.661020 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f1b40e8-bee3-441d-bd78-9a6aacc76949-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-t8cls\" (UID: \"5f1b40e8-bee3-441d-bd78-9a6aacc76949\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t8cls" Jul 08 18:46:13.661275 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.661040 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sc6r\" (UniqueName: \"kubernetes.io/projected/4a9979b4-f241-4964-a20f-b42514a3f700-kube-api-access-2sc6r\") pod \"insights-operator-5c847dcfc4-xg4bh\" (UID: \"4a9979b4-f241-4964-a20f-b42514a3f700\") " pod="openshift-insights/insights-operator-5c847dcfc4-xg4bh" Jul 08 18:46:13.661275 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.661069 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/dd1908b4-810a-4f1d-b172-47ddfe11befe-stats-auth\") pod \"router-default-86b55bc475-2qk57\" (UID: \"dd1908b4-810a-4f1d-b172-47ddfe11befe\") " pod="openshift-ingress/router-default-86b55bc475-2qk57" Jul 08 18:46:13.661275 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.661102 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd1908b4-810a-4f1d-b172-47ddfe11befe-metrics-certs\") pod \"router-default-86b55bc475-2qk57\" (UID: \"dd1908b4-810a-4f1d-b172-47ddfe11befe\") " pod="openshift-ingress/router-default-86b55bc475-2qk57" Jul 08 18:46:13.661275 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.661197 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a9979b4-f241-4964-a20f-b42514a3f700-tmp\") pod \"insights-operator-5c847dcfc4-xg4bh\" (UID: \"4a9979b4-f241-4964-a20f-b42514a3f700\") " pod="openshift-insights/insights-operator-5c847dcfc4-xg4bh" Jul 08 18:46:13.661275 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.661267 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp2s7\" (UniqueName: \"kubernetes.io/projected/7b5def05-a0ed-4512-b1a2-140a051040cf-kube-api-access-tp2s7\") pod \"cluster-samples-operator-56fcf86bf-5twjz\" (UID: \"7b5def05-a0ed-4512-b1a2-140a051040cf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5twjz" Jul 08 18:46:13.661558 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.661298 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4a9979b4-f241-4964-a20f-b42514a3f700-serving-cert\") pod \"insights-operator-5c847dcfc4-xg4bh\" (UID: \"4a9979b4-f241-4964-a20f-b42514a3f700\") " pod="openshift-insights/insights-operator-5c847dcfc4-xg4bh" Jul 08 18:46:13.669667 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.669651 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-q4grn"] Jul 08 18:46:13.669767 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.669754 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zbn2x" Jul 08 18:46:13.672199 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.672180 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 18:46:13.672199 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.672193 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-xbmqc\"" Jul 08 18:46:13.672302 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.672198 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 18:46:13.687981 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.687962 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fj77w"] Jul 08 18:46:13.688076 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.688062 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-q4grn" Jul 08 18:46:13.690453 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.690436 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 18:46:13.690541 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.690434 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 18:46:13.690541 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.690527 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 18:46:13.690752 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.690552 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2cgrn\"" Jul 08 18:46:13.708158 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.708139 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hd7xd"] Jul 08 18:46:13.708247 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.708162 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4b26j"] Jul 08 18:46:13.708247 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.708190 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-q4grn"] Jul 08 18:46:13.708247 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.708208 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fj77w"] Jul 08 18:46:13.708247 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.708215 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:46:13.708247 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.708233 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-zbn2x"] Jul 08 18:46:13.708247 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.708236 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fj77w" Jul 08 18:46:13.708470 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.708314 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snhnd" Jul 08 18:46:13.708519 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.708487 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:46:13.711094 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.711077 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 18:46:13.711202 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.711187 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k5jtp\"" Jul 08 18:46:13.711286 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.711268 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 18:46:13.711417 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.711297 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5bv4l\"" Jul 08 18:46:13.711417 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.711329 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zrdnt\"" Jul 08 18:46:13.711538 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.711452 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 18:46:13.711618 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.711579 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 18:46:13.762261 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.762242 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7b5def05-a0ed-4512-b1a2-140a051040cf-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5twjz\" (UID: \"7b5def05-a0ed-4512-b1a2-140a051040cf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5twjz" Jul 08 18:46:13.762359 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.762270 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd1908b4-810a-4f1d-b172-47ddfe11befe-service-ca-bundle\") pod \"router-default-86b55bc475-2qk57\" (UID: \"dd1908b4-810a-4f1d-b172-47ddfe11befe\") " pod="openshift-ingress/router-default-86b55bc475-2qk57" Jul 08 18:46:13.762359 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.762294 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4a9979b4-f241-4964-a20f-b42514a3f700-snapshots\") pod \"insights-operator-5c847dcfc4-xg4bh\" (UID: \"4a9979b4-f241-4964-a20f-b42514a3f700\") " pod="openshift-insights/insights-operator-5c847dcfc4-xg4bh" Jul 08 18:46:13.762359 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.762318 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd1908b4-810a-4f1d-b172-47ddfe11befe-metrics-certs\") pod \"router-default-86b55bc475-2qk57\" (UID: \"dd1908b4-810a-4f1d-b172-47ddfe11befe\") " pod="openshift-ingress/router-default-86b55bc475-2qk57" Jul 08 18:46:13.762359 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.762337 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdhck\" (UniqueName: \"kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-kube-api-access-kdhck\") pod \"image-registry-55cd4459fc-xnws9\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:46:13.762539 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:13.762381 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 18:46:13.762539 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:13.762425 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 18:46:13.762539 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:13.762439 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd1908b4-810a-4f1d-b172-47ddfe11befe-service-ca-bundle podName:dd1908b4-810a-4f1d-b172-47ddfe11befe nodeName:}" failed. No retries permitted until 2026-07-08 18:46:14.262418259 +0000 UTC m=+38.132833393 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dd1908b4-810a-4f1d-b172-47ddfe11befe-service-ca-bundle") pod "router-default-86b55bc475-2qk57" (UID: "dd1908b4-810a-4f1d-b172-47ddfe11befe") : configmap references non-existent config key: service-ca.crt Jul 08 18:46:13.762539 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.762425 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/56065d42-401f-45fb-bf49-8885f262ad6f-serving-cert\") pod \"console-operator-68b757fb67-9hx2g\" (UID: \"56065d42-401f-45fb-bf49-8885f262ad6f\") " pod="openshift-console-operator/console-operator-68b757fb67-9hx2g" Jul 08 18:46:13.762539 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:13.762466 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b5def05-a0ed-4512-b1a2-140a051040cf-samples-operator-tls podName:7b5def05-a0ed-4512-b1a2-140a051040cf nodeName:}" failed. No retries permitted until 2026-07-08 18:46:14.26245374 +0000 UTC m=+38.132868854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7b5def05-a0ed-4512-b1a2-140a051040cf-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-5twjz" (UID: "7b5def05-a0ed-4512-b1a2-140a051040cf") : secret "samples-operator-tls" not found Jul 08 18:46:13.762539 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:13.762491 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd1908b4-810a-4f1d-b172-47ddfe11befe-metrics-certs podName:dd1908b4-810a-4f1d-b172-47ddfe11befe nodeName:}" failed. No retries permitted until 2026-07-08 18:46:14.262477597 +0000 UTC m=+38.132892707 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd1908b4-810a-4f1d-b172-47ddfe11befe-metrics-certs") pod "router-default-86b55bc475-2qk57" (UID: "dd1908b4-810a-4f1d-b172-47ddfe11befe") : secret "router-metrics-certs-default" not found Jul 08 18:46:13.762539 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.762510 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sc6r\" (UniqueName: \"kubernetes.io/projected/4a9979b4-f241-4964-a20f-b42514a3f700-kube-api-access-2sc6r\") pod \"insights-operator-5c847dcfc4-xg4bh\" (UID: \"4a9979b4-f241-4964-a20f-b42514a3f700\") " pod="openshift-insights/insights-operator-5c847dcfc4-xg4bh" Jul 08 18:46:13.762539 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.762536 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtwcc\" (UniqueName: \"kubernetes.io/projected/0270e288-835b-4d75-b0ba-4f2670684646-kube-api-access-rtwcc\") pod \"service-ca-operator-5d46d9ffd4-hd7xd\" (UID: \"0270e288-835b-4d75-b0ba-4f2670684646\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hd7xd" Jul 08 18:46:13.762927 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.762554 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fdbe9304-92f1-492d-a5de-88d4cba079dd-ca-trust-extracted\") pod \"image-registry-55cd4459fc-xnws9\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:46:13.762927 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.762572 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp2s7\" (UniqueName: \"kubernetes.io/projected/7b5def05-a0ed-4512-b1a2-140a051040cf-kube-api-access-tp2s7\") pod \"cluster-samples-operator-56fcf86bf-5twjz\" (UID: \"7b5def05-a0ed-4512-b1a2-140a051040cf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5twjz" Jul 08 18:46:13.762927 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.762617 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4a9979b4-f241-4964-a20f-b42514a3f700-serving-cert\") pod \"insights-operator-5c847dcfc4-xg4bh\" (UID: \"4a9979b4-f241-4964-a20f-b42514a3f700\") " pod="openshift-insights/insights-operator-5c847dcfc4-xg4bh" Jul 08 18:46:13.762927 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.762640 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fdbe9304-92f1-492d-a5de-88d4cba079dd-registry-certificates\") pod \"image-registry-55cd4459fc-xnws9\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:46:13.762927 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.762748 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fdbe9304-92f1-492d-a5de-88d4cba079dd-installation-pull-secrets\") pod \"image-registry-55cd4459fc-xnws9\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:46:13.762927 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.762782 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krgsf\" (UniqueName: \"kubernetes.io/projected/5122d514-65f7-4423-8010-51bdee3932bd-kube-api-access-krgsf\") pod \"kube-storage-version-migrator-operator-846bf668f7-4b26j\" (UID: \"5122d514-65f7-4423-8010-51bdee3932bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4b26j" Jul 08 18:46:13.762927 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.762801 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fdbe9304-92f1-492d-a5de-88d4cba079dd-trusted-ca\") pod \"image-registry-55cd4459fc-xnws9\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:46:13.762927 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.762829 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk4jg\" (UniqueName: \"kubernetes.io/projected/dd1908b4-810a-4f1d-b172-47ddfe11befe-kube-api-access-kk4jg\") pod \"router-default-86b55bc475-2qk57\" (UID: \"dd1908b4-810a-4f1d-b172-47ddfe11befe\") " pod="openshift-ingress/router-default-86b55bc475-2qk57" Jul 08 18:46:13.762927 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.762864 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-registry-tls\") pod \"image-registry-55cd4459fc-xnws9\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:46:13.762927 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.762894 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4a9979b4-f241-4964-a20f-b42514a3f700-snapshots\") pod \"insights-operator-5c847dcfc4-xg4bh\" (UID: \"4a9979b4-f241-4964-a20f-b42514a3f700\") " pod="openshift-insights/insights-operator-5c847dcfc4-xg4bh" Jul 08 18:46:13.762927 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.762897 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-bound-sa-token\") pod \"image-registry-55cd4459fc-xnws9\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:46:13.763373 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.762964 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx59v\" (UniqueName: \"kubernetes.io/projected/5f1b40e8-bee3-441d-bd78-9a6aacc76949-kube-api-access-xx59v\") pod \"cluster-monitoring-operator-64786d9cbb-t8cls\" (UID: \"5f1b40e8-bee3-441d-bd78-9a6aacc76949\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t8cls" Jul 08 18:46:13.763373 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.763000 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdbrz\" (UniqueName: \"kubernetes.io/projected/5d609d76-9788-408f-8ca7-8d6090301785-kube-api-access-pdbrz\") pod \"volume-data-source-validator-5d456fdbcd-j5tkz\" (UID: \"5d609d76-9788-408f-8ca7-8d6090301785\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-j5tkz" Jul 08 18:46:13.763373 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.763021 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsbhp\" (UniqueName: \"kubernetes.io/projected/56065d42-401f-45fb-bf49-8885f262ad6f-kube-api-access-rsbhp\") pod \"console-operator-68b757fb67-9hx2g\" (UID: \"56065d42-401f-45fb-bf49-8885f262ad6f\") " pod="openshift-console-operator/console-operator-68b757fb67-9hx2g" Jul 08 18:46:13.763373 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.763040 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5122d514-65f7-4423-8010-51bdee3932bd-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-4b26j\" (UID: \"5122d514-65f7-4423-8010-51bdee3932bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4b26j" Jul 08 18:46:13.763373 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.763077 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a9979b4-f241-4964-a20f-b42514a3f700-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-xg4bh\" (UID: \"4a9979b4-f241-4964-a20f-b42514a3f700\") " pod="openshift-insights/insights-operator-5c847dcfc4-xg4bh" Jul 08 18:46:13.763373 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.763102 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a9979b4-f241-4964-a20f-b42514a3f700-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-xg4bh\" (UID: \"4a9979b4-f241-4964-a20f-b42514a3f700\") " pod="openshift-insights/insights-operator-5c847dcfc4-xg4bh" Jul 08 18:46:13.763373 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.763124 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/dd1908b4-810a-4f1d-b172-47ddfe11befe-default-certificate\") pod \"router-default-86b55bc475-2qk57\" (UID: \"dd1908b4-810a-4f1d-b172-47ddfe11befe\") " pod="openshift-ingress/router-default-86b55bc475-2qk57" Jul 08 18:46:13.763373 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.763143 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/dd1908b4-810a-4f1d-b172-47ddfe11befe-stats-auth\") pod \"router-default-86b55bc475-2qk57\" (UID: \"dd1908b4-810a-4f1d-b172-47ddfe11befe\") " pod="openshift-ingress/router-default-86b55bc475-2qk57" Jul 08 18:46:13.763373 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.763168 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dbsj\" (UniqueName: \"kubernetes.io/projected/aaf0fb98-4f0a-4b19-b5b7-3c57e45d7157-kube-api-access-4dbsj\") pod \"network-check-source-989f8b8dc-zbn2x\" (UID: \"aaf0fb98-4f0a-4b19-b5b7-3c57e45d7157\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zbn2x" Jul 08 18:46:13.763373 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.763194 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f1b40e8-bee3-441d-bd78-9a6aacc76949-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-t8cls\" (UID: \"5f1b40e8-bee3-441d-bd78-9a6aacc76949\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t8cls" Jul 08 18:46:13.763373 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.763221 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a9979b4-f241-4964-a20f-b42514a3f700-tmp\") pod \"insights-operator-5c847dcfc4-xg4bh\" (UID: \"4a9979b4-f241-4964-a20f-b42514a3f700\") " pod="openshift-insights/insights-operator-5c847dcfc4-xg4bh" Jul 08 18:46:13.763373 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.763244 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5122d514-65f7-4423-8010-51bdee3932bd-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-4b26j\" (UID: \"5122d514-65f7-4423-8010-51bdee3932bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4b26j" Jul 08 18:46:13.763373 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.763279 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fdbe9304-92f1-492d-a5de-88d4cba079dd-image-registry-private-configuration\") pod \"image-registry-55cd4459fc-xnws9\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:46:13.763373 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.763303 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0270e288-835b-4d75-b0ba-4f2670684646-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-hd7xd\" (UID: \"0270e288-835b-4d75-b0ba-4f2670684646\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hd7xd" Jul 08 18:46:13.763373 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.763328 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0270e288-835b-4d75-b0ba-4f2670684646-config\") pod \"service-ca-operator-5d46d9ffd4-hd7xd\" (UID: \"0270e288-835b-4d75-b0ba-4f2670684646\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hd7xd" Jul 08 18:46:13.764091 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.763353 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56065d42-401f-45fb-bf49-8885f262ad6f-trusted-ca\") pod \"console-operator-68b757fb67-9hx2g\" (UID: \"56065d42-401f-45fb-bf49-8885f262ad6f\") " pod="openshift-console-operator/console-operator-68b757fb67-9hx2g" Jul 08 18:46:13.764091 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.763401 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/56065d42-401f-45fb-bf49-8885f262ad6f-config\") pod \"console-operator-68b757fb67-9hx2g\" (UID: \"56065d42-401f-45fb-bf49-8885f262ad6f\") " pod="openshift-console-operator/console-operator-68b757fb67-9hx2g" Jul 08 18:46:13.764091 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.763435 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5f1b40e8-bee3-441d-bd78-9a6aacc76949-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-t8cls\" (UID: \"5f1b40e8-bee3-441d-bd78-9a6aacc76949\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t8cls" Jul 08 18:46:13.764091 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:13.763538 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 18:46:13.764091 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.763564 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a9979b4-f241-4964-a20f-b42514a3f700-tmp\") pod \"insights-operator-5c847dcfc4-xg4bh\" (UID: \"4a9979b4-f241-4964-a20f-b42514a3f700\") " pod="openshift-insights/insights-operator-5c847dcfc4-xg4bh" Jul 08 18:46:13.764091 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:13.763583 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f1b40e8-bee3-441d-bd78-9a6aacc76949-cluster-monitoring-operator-tls podName:5f1b40e8-bee3-441d-bd78-9a6aacc76949 nodeName:}" failed. No retries permitted until 2026-07-08 18:46:14.263567332 +0000 UTC m=+38.133982449 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5f1b40e8-bee3-441d-bd78-9a6aacc76949-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-t8cls" (UID: "5f1b40e8-bee3-441d-bd78-9a6aacc76949") : secret "cluster-monitoring-operator-tls" not found Jul 08 18:46:13.764091 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.763702 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a9979b4-f241-4964-a20f-b42514a3f700-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-xg4bh\" (UID: \"4a9979b4-f241-4964-a20f-b42514a3f700\") " pod="openshift-insights/insights-operator-5c847dcfc4-xg4bh" Jul 08 18:46:13.764091 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.764062 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a9979b4-f241-4964-a20f-b42514a3f700-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-xg4bh\" (UID: \"4a9979b4-f241-4964-a20f-b42514a3f700\") " pod="openshift-insights/insights-operator-5c847dcfc4-xg4bh" Jul 08 18:46:13.764351 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.764126 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5f1b40e8-bee3-441d-bd78-9a6aacc76949-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-t8cls\" (UID: \"5f1b40e8-bee3-441d-bd78-9a6aacc76949\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t8cls" Jul 08 18:46:13.766708 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.766685 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/dd1908b4-810a-4f1d-b172-47ddfe11befe-default-certificate\") pod \"router-default-86b55bc475-2qk57\" (UID: \"dd1908b4-810a-4f1d-b172-47ddfe11befe\") " pod="openshift-ingress/router-default-86b55bc475-2qk57" Jul 08 18:46:13.766708 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.766705 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4a9979b4-f241-4964-a20f-b42514a3f700-serving-cert\") pod \"insights-operator-5c847dcfc4-xg4bh\" (UID: \"4a9979b4-f241-4964-a20f-b42514a3f700\") " pod="openshift-insights/insights-operator-5c847dcfc4-xg4bh" Jul 08 18:46:13.766857 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.766792 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/dd1908b4-810a-4f1d-b172-47ddfe11befe-stats-auth\") pod \"router-default-86b55bc475-2qk57\" (UID: \"dd1908b4-810a-4f1d-b172-47ddfe11befe\") " pod="openshift-ingress/router-default-86b55bc475-2qk57" Jul 08 18:46:13.776914 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.776890 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx59v\" (UniqueName: \"kubernetes.io/projected/5f1b40e8-bee3-441d-bd78-9a6aacc76949-kube-api-access-xx59v\") pod \"cluster-monitoring-operator-64786d9cbb-t8cls\" (UID: \"5f1b40e8-bee3-441d-bd78-9a6aacc76949\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t8cls" Jul 08 18:46:13.777790 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.777765 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp2s7\" (UniqueName: \"kubernetes.io/projected/7b5def05-a0ed-4512-b1a2-140a051040cf-kube-api-access-tp2s7\") pod \"cluster-samples-operator-56fcf86bf-5twjz\" (UID: \"7b5def05-a0ed-4512-b1a2-140a051040cf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5twjz" Jul 08 18:46:13.779169 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.779144 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sc6r\" (UniqueName: \"kubernetes.io/projected/4a9979b4-f241-4964-a20f-b42514a3f700-kube-api-access-2sc6r\") pod \"insights-operator-5c847dcfc4-xg4bh\" (UID: \"4a9979b4-f241-4964-a20f-b42514a3f700\") " pod="openshift-insights/insights-operator-5c847dcfc4-xg4bh" Jul 08 18:46:13.779245 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.779150 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk4jg\" (UniqueName: \"kubernetes.io/projected/dd1908b4-810a-4f1d-b172-47ddfe11befe-kube-api-access-kk4jg\") pod \"router-default-86b55bc475-2qk57\" (UID: \"dd1908b4-810a-4f1d-b172-47ddfe11befe\") " pod="openshift-ingress/router-default-86b55bc475-2qk57" Jul 08 18:46:13.779938 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.779914 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdbrz\" (UniqueName: \"kubernetes.io/projected/5d609d76-9788-408f-8ca7-8d6090301785-kube-api-access-pdbrz\") pod \"volume-data-source-validator-5d456fdbcd-j5tkz\" (UID: \"5d609d76-9788-408f-8ca7-8d6090301785\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-j5tkz" Jul 08 18:46:13.824729 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.824705 2572 generic.go:356] "Generic (PLEG): container finished" podID="15f04361-bd04-449b-9cce-d46b7ba27368" containerID="9b9b17ad271488cf66145fa327740d190bdfb252d4af3c1203b0e666a99bdcd1" exitCode=0 Jul 08 18:46:13.824829 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.824746 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t4fzl" event={"ID":"15f04361-bd04-449b-9cce-d46b7ba27368","Type":"ContainerDied","Data":"9b9b17ad271488cf66145fa327740d190bdfb252d4af3c1203b0e666a99bdcd1"} Jul 08 18:46:13.864090 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.864070 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dbsj\" (UniqueName: \"kubernetes.io/projected/aaf0fb98-4f0a-4b19-b5b7-3c57e45d7157-kube-api-access-4dbsj\") pod \"network-check-source-989f8b8dc-zbn2x\" (UID: \"aaf0fb98-4f0a-4b19-b5b7-3c57e45d7157\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zbn2x" Jul 08 18:46:13.864171 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.864109 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4x84\" (UniqueName: \"kubernetes.io/projected/62f90ec3-f829-4be2-a4c0-1064e0f564e4-kube-api-access-q4x84\") pod \"ingress-canary-q4grn\" (UID: \"62f90ec3-f829-4be2-a4c0-1064e0f564e4\") " pod="openshift-ingress-canary/ingress-canary-q4grn" Jul 08 18:46:13.864171 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.864128 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5122d514-65f7-4423-8010-51bdee3932bd-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-4b26j\" (UID: \"5122d514-65f7-4423-8010-51bdee3932bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4b26j" Jul 08 18:46:13.864171 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.864148 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/964fa98c-bf64-4b37-9253-444e9cde8899-metrics-tls\") pod \"dns-default-fj77w\" (UID: \"964fa98c-bf64-4b37-9253-444e9cde8899\") " pod="openshift-dns/dns-default-fj77w" Jul 08 18:46:13.864298 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.864168 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fdbe9304-92f1-492d-a5de-88d4cba079dd-image-registry-private-configuration\") pod \"image-registry-55cd4459fc-xnws9\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:46:13.864298 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.864195 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0270e288-835b-4d75-b0ba-4f2670684646-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-hd7xd\" (UID: \"0270e288-835b-4d75-b0ba-4f2670684646\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hd7xd" Jul 08 18:46:13.864412 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.864297 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0270e288-835b-4d75-b0ba-4f2670684646-config\") pod \"service-ca-operator-5d46d9ffd4-hd7xd\" (UID: \"0270e288-835b-4d75-b0ba-4f2670684646\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hd7xd" Jul 08 18:46:13.864412 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.864335 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56065d42-401f-45fb-bf49-8885f262ad6f-trusted-ca\") pod \"console-operator-68b757fb67-9hx2g\" (UID: \"56065d42-401f-45fb-bf49-8885f262ad6f\") " pod="openshift-console-operator/console-operator-68b757fb67-9hx2g" Jul 08 18:46:13.864412 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.864388 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/56065d42-401f-45fb-bf49-8885f262ad6f-config\") pod \"console-operator-68b757fb67-9hx2g\" (UID: \"56065d42-401f-45fb-bf49-8885f262ad6f\") " pod="openshift-console-operator/console-operator-68b757fb67-9hx2g" Jul 08 18:46:13.864559 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.864421 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/964fa98c-bf64-4b37-9253-444e9cde8899-tmp-dir\") pod \"dns-default-fj77w\" (UID: \"964fa98c-bf64-4b37-9253-444e9cde8899\") " pod="openshift-dns/dns-default-fj77w" Jul 08 18:46:13.864559 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.864450 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhmbb\" (UniqueName: \"kubernetes.io/projected/964fa98c-bf64-4b37-9253-444e9cde8899-kube-api-access-fhmbb\") pod \"dns-default-fj77w\" (UID: \"964fa98c-bf64-4b37-9253-444e9cde8899\") " pod="openshift-dns/dns-default-fj77w" Jul 08 18:46:13.864559 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.864550 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdhck\" (UniqueName: \"kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-kube-api-access-kdhck\") pod \"image-registry-55cd4459fc-xnws9\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:46:13.864728 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.864574 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/56065d42-401f-45fb-bf49-8885f262ad6f-serving-cert\") pod \"console-operator-68b757fb67-9hx2g\" (UID: \"56065d42-401f-45fb-bf49-8885f262ad6f\") " pod="openshift-console-operator/console-operator-68b757fb67-9hx2g" Jul 08 18:46:13.864728 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.864618 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtwcc\" (UniqueName: \"kubernetes.io/projected/0270e288-835b-4d75-b0ba-4f2670684646-kube-api-access-rtwcc\") pod \"service-ca-operator-5d46d9ffd4-hd7xd\" (UID: \"0270e288-835b-4d75-b0ba-4f2670684646\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hd7xd" Jul 08 18:46:13.864728 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.864645 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fdbe9304-92f1-492d-a5de-88d4cba079dd-ca-trust-extracted\") pod \"image-registry-55cd4459fc-xnws9\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:46:13.864728 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.864680 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fdbe9304-92f1-492d-a5de-88d4cba079dd-registry-certificates\") pod \"image-registry-55cd4459fc-xnws9\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:46:13.864728 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.864719 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fdbe9304-92f1-492d-a5de-88d4cba079dd-installation-pull-secrets\") pod \"image-registry-55cd4459fc-xnws9\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:46:13.864960 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.864752 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krgsf\" (UniqueName: \"kubernetes.io/projected/5122d514-65f7-4423-8010-51bdee3932bd-kube-api-access-krgsf\") pod \"kube-storage-version-migrator-operator-846bf668f7-4b26j\" (UID: \"5122d514-65f7-4423-8010-51bdee3932bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4b26j" Jul 08 18:46:13.864960 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.864778 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fdbe9304-92f1-492d-a5de-88d4cba079dd-trusted-ca\") pod \"image-registry-55cd4459fc-xnws9\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:46:13.864960 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.864800 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62f90ec3-f829-4be2-a4c0-1064e0f564e4-cert\") pod \"ingress-canary-q4grn\" (UID: \"62f90ec3-f829-4be2-a4c0-1064e0f564e4\") " pod="openshift-ingress-canary/ingress-canary-q4grn" Jul 08 18:46:13.864960 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.864816 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5122d514-65f7-4423-8010-51bdee3932bd-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-4b26j\" (UID: \"5122d514-65f7-4423-8010-51bdee3932bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4b26j" Jul 08 18:46:13.864960 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.864826 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-registry-tls\") pod \"image-registry-55cd4459fc-xnws9\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:46:13.864960 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.864851 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-bound-sa-token\") pod \"image-registry-55cd4459fc-xnws9\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:46:13.864960 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.864876 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/964fa98c-bf64-4b37-9253-444e9cde8899-config-volume\") pod \"dns-default-fj77w\" (UID: \"964fa98c-bf64-4b37-9253-444e9cde8899\") " pod="openshift-dns/dns-default-fj77w" Jul 08 18:46:13.864960 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.864905 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsbhp\" (UniqueName: \"kubernetes.io/projected/56065d42-401f-45fb-bf49-8885f262ad6f-kube-api-access-rsbhp\") pod \"console-operator-68b757fb67-9hx2g\" (UID: \"56065d42-401f-45fb-bf49-8885f262ad6f\") " pod="openshift-console-operator/console-operator-68b757fb67-9hx2g" Jul 08 18:46:13.864960 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.864931 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5122d514-65f7-4423-8010-51bdee3932bd-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-4b26j\" (UID: \"5122d514-65f7-4423-8010-51bdee3932bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4b26j" Jul 08 18:46:13.865451 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.864986 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-j5tkz" Jul 08 18:46:13.865506 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.865474 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56065d42-401f-45fb-bf49-8885f262ad6f-trusted-ca\") pod \"console-operator-68b757fb67-9hx2g\" (UID: \"56065d42-401f-45fb-bf49-8885f262ad6f\") " pod="openshift-console-operator/console-operator-68b757fb67-9hx2g" Jul 08 18:46:13.865696 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.865670 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/56065d42-401f-45fb-bf49-8885f262ad6f-config\") pod \"console-operator-68b757fb67-9hx2g\" (UID: \"56065d42-401f-45fb-bf49-8885f262ad6f\") " pod="openshift-console-operator/console-operator-68b757fb67-9hx2g" Jul 08 18:46:13.865840 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.865818 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0270e288-835b-4d75-b0ba-4f2670684646-config\") pod \"service-ca-operator-5d46d9ffd4-hd7xd\" (UID: \"0270e288-835b-4d75-b0ba-4f2670684646\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hd7xd" Jul 08 18:46:13.865931 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:13.865849 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 18:46:13.866006 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:13.865995 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55cd4459fc-xnws9: secret "image-registry-tls" not found Jul 08 18:46:13.866255 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.866073 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fdbe9304-92f1-492d-a5de-88d4cba079dd-trusted-ca\") pod \"image-registry-55cd4459fc-xnws9\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:46:13.866255 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.865915 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fdbe9304-92f1-492d-a5de-88d4cba079dd-ca-trust-extracted\") pod \"image-registry-55cd4459fc-xnws9\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:46:13.866420 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:13.866406 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-registry-tls podName:fdbe9304-92f1-492d-a5de-88d4cba079dd nodeName:}" failed. No retries permitted until 2026-07-08 18:46:14.366381541 +0000 UTC m=+38.236796671 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-registry-tls") pod "image-registry-55cd4459fc-xnws9" (UID: "fdbe9304-92f1-492d-a5de-88d4cba079dd") : secret "image-registry-tls" not found Jul 08 18:46:13.866660 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.866635 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fdbe9304-92f1-492d-a5de-88d4cba079dd-registry-certificates\") pod \"image-registry-55cd4459fc-xnws9\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:46:13.867090 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.867053 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fdbe9304-92f1-492d-a5de-88d4cba079dd-image-registry-private-configuration\") pod \"image-registry-55cd4459fc-xnws9\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:46:13.867464 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.867445 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0270e288-835b-4d75-b0ba-4f2670684646-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-hd7xd\" (UID: \"0270e288-835b-4d75-b0ba-4f2670684646\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hd7xd" Jul 08 18:46:13.867939 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.867921 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5122d514-65f7-4423-8010-51bdee3932bd-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-4b26j\" (UID: \"5122d514-65f7-4423-8010-51bdee3932bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4b26j" Jul 08 18:46:13.868634 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.868611 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fdbe9304-92f1-492d-a5de-88d4cba079dd-installation-pull-secrets\") pod \"image-registry-55cd4459fc-xnws9\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:46:13.869200 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.868933 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/56065d42-401f-45fb-bf49-8885f262ad6f-serving-cert\") pod \"console-operator-68b757fb67-9hx2g\" (UID: \"56065d42-401f-45fb-bf49-8885f262ad6f\") " pod="openshift-console-operator/console-operator-68b757fb67-9hx2g" Jul 08 18:46:13.876961 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.876921 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dbsj\" (UniqueName: \"kubernetes.io/projected/aaf0fb98-4f0a-4b19-b5b7-3c57e45d7157-kube-api-access-4dbsj\") pod \"network-check-source-989f8b8dc-zbn2x\" (UID: \"aaf0fb98-4f0a-4b19-b5b7-3c57e45d7157\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zbn2x" Jul 08 18:46:13.878114 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.878097 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdhck\" (UniqueName: \"kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-kube-api-access-kdhck\") pod \"image-registry-55cd4459fc-xnws9\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:46:13.882545 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.882523 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-bound-sa-token\") pod \"image-registry-55cd4459fc-xnws9\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:46:13.883192 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.883036 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsbhp\" (UniqueName: \"kubernetes.io/projected/56065d42-401f-45fb-bf49-8885f262ad6f-kube-api-access-rsbhp\") pod \"console-operator-68b757fb67-9hx2g\" (UID: \"56065d42-401f-45fb-bf49-8885f262ad6f\") " pod="openshift-console-operator/console-operator-68b757fb67-9hx2g" Jul 08 18:46:13.883384 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.883360 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krgsf\" (UniqueName: \"kubernetes.io/projected/5122d514-65f7-4423-8010-51bdee3932bd-kube-api-access-krgsf\") pod \"kube-storage-version-migrator-operator-846bf668f7-4b26j\" (UID: \"5122d514-65f7-4423-8010-51bdee3932bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4b26j" Jul 08 18:46:13.884841 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.884822 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtwcc\" (UniqueName: \"kubernetes.io/projected/0270e288-835b-4d75-b0ba-4f2670684646-kube-api-access-rtwcc\") pod \"service-ca-operator-5d46d9ffd4-hd7xd\" (UID: \"0270e288-835b-4d75-b0ba-4f2670684646\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hd7xd" Jul 08 18:46:13.885629 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.885609 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-xg4bh" Jul 08 18:46:13.908445 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.908421 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-9hx2g" Jul 08 18:46:13.948615 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.948455 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hd7xd" Jul 08 18:46:13.964858 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.964801 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4b26j" Jul 08 18:46:13.966469 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.966098 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4x84\" (UniqueName: \"kubernetes.io/projected/62f90ec3-f829-4be2-a4c0-1064e0f564e4-kube-api-access-q4x84\") pod \"ingress-canary-q4grn\" (UID: \"62f90ec3-f829-4be2-a4c0-1064e0f564e4\") " pod="openshift-ingress-canary/ingress-canary-q4grn" Jul 08 18:46:13.966469 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.966149 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/964fa98c-bf64-4b37-9253-444e9cde8899-metrics-tls\") pod \"dns-default-fj77w\" (UID: \"964fa98c-bf64-4b37-9253-444e9cde8899\") " pod="openshift-dns/dns-default-fj77w" Jul 08 18:46:13.966469 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:13.966322 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 18:46:13.966842 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.966439 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/964fa98c-bf64-4b37-9253-444e9cde8899-tmp-dir\") pod \"dns-default-fj77w\" (UID: \"964fa98c-bf64-4b37-9253-444e9cde8899\") " pod="openshift-dns/dns-default-fj77w" Jul 08 18:46:13.966842 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:13.966767 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/964fa98c-bf64-4b37-9253-444e9cde8899-metrics-tls podName:964fa98c-bf64-4b37-9253-444e9cde8899 nodeName:}" failed. No retries permitted until 2026-07-08 18:46:14.466564096 +0000 UTC m=+38.336979222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/964fa98c-bf64-4b37-9253-444e9cde8899-metrics-tls") pod "dns-default-fj77w" (UID: "964fa98c-bf64-4b37-9253-444e9cde8899") : secret "dns-default-metrics-tls" not found Jul 08 18:46:13.966842 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.966826 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhmbb\" (UniqueName: \"kubernetes.io/projected/964fa98c-bf64-4b37-9253-444e9cde8899-kube-api-access-fhmbb\") pod \"dns-default-fj77w\" (UID: \"964fa98c-bf64-4b37-9253-444e9cde8899\") " pod="openshift-dns/dns-default-fj77w" Jul 08 18:46:13.967014 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.966988 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62f90ec3-f829-4be2-a4c0-1064e0f564e4-cert\") pod \"ingress-canary-q4grn\" (UID: \"62f90ec3-f829-4be2-a4c0-1064e0f564e4\") " pod="openshift-ingress-canary/ingress-canary-q4grn" Jul 08 18:46:13.967070 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.967028 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/964fa98c-bf64-4b37-9253-444e9cde8899-config-volume\") pod \"dns-default-fj77w\" (UID: \"964fa98c-bf64-4b37-9253-444e9cde8899\") " pod="openshift-dns/dns-default-fj77w" Jul 08 18:46:13.967167 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.967143 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/964fa98c-bf64-4b37-9253-444e9cde8899-tmp-dir\") pod \"dns-default-fj77w\" (UID: \"964fa98c-bf64-4b37-9253-444e9cde8899\") " pod="openshift-dns/dns-default-fj77w" Jul 08 18:46:13.967647 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.967605 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/964fa98c-bf64-4b37-9253-444e9cde8899-config-volume\") pod \"dns-default-fj77w\" (UID: \"964fa98c-bf64-4b37-9253-444e9cde8899\") " pod="openshift-dns/dns-default-fj77w" Jul 08 18:46:13.970475 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.970393 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62f90ec3-f829-4be2-a4c0-1064e0f564e4-cert\") pod \"ingress-canary-q4grn\" (UID: \"62f90ec3-f829-4be2-a4c0-1064e0f564e4\") " pod="openshift-ingress-canary/ingress-canary-q4grn" Jul 08 18:46:13.977574 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.977097 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zbn2x" Jul 08 18:46:13.986846 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.986819 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4x84\" (UniqueName: \"kubernetes.io/projected/62f90ec3-f829-4be2-a4c0-1064e0f564e4-kube-api-access-q4x84\") pod \"ingress-canary-q4grn\" (UID: \"62f90ec3-f829-4be2-a4c0-1064e0f564e4\") " pod="openshift-ingress-canary/ingress-canary-q4grn" Jul 08 18:46:13.988352 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.988306 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhmbb\" (UniqueName: \"kubernetes.io/projected/964fa98c-bf64-4b37-9253-444e9cde8899-kube-api-access-fhmbb\") pod \"dns-default-fj77w\" (UID: \"964fa98c-bf64-4b37-9253-444e9cde8899\") " pod="openshift-dns/dns-default-fj77w" Jul 08 18:46:13.998400 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:13.998145 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-q4grn" Jul 08 18:46:14.082471 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:14.082442 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-xg4bh"] Jul 08 18:46:14.085341 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:14.085317 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-j5tkz"] Jul 08 18:46:14.103112 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:14.103090 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-9hx2g"] Jul 08 18:46:14.106898 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:46:14.106838 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d609d76_9788_408f_8ca7_8d6090301785.slice/crio-599b196adaedf60943d8317e583aba53678c94972913b2a7c93d8b72314fad4f WatchSource:0}: Error finding container 599b196adaedf60943d8317e583aba53678c94972913b2a7c93d8b72314fad4f: Status 404 returned error can't find the container with id 599b196adaedf60943d8317e583aba53678c94972913b2a7c93d8b72314fad4f Jul 08 18:46:14.249538 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:14.249512 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hd7xd"] Jul 08 18:46:14.252725 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:46:14.252695 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0270e288_835b_4d75_b0ba_4f2670684646.slice/crio-89f277ec4a1fcc589f2177d2cb45aed10cf6dbde3210bf378defe3daf17ddd46 WatchSource:0}: Error finding container 89f277ec4a1fcc589f2177d2cb45aed10cf6dbde3210bf378defe3daf17ddd46: Status 404 returned error can't find the container with id 89f277ec4a1fcc589f2177d2cb45aed10cf6dbde3210bf378defe3daf17ddd46 Jul 08 18:46:14.254722 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:14.254690 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-q4grn"] Jul 08 18:46:14.257263 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:46:14.257237 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62f90ec3_f829_4be2_a4c0_1064e0f564e4.slice/crio-d1b6eeda8e56f64054b2c1c6dcb1cdfd832755701fcd91840fde66229c7313af WatchSource:0}: Error finding container d1b6eeda8e56f64054b2c1c6dcb1cdfd832755701fcd91840fde66229c7313af: Status 404 returned error can't find the container with id d1b6eeda8e56f64054b2c1c6dcb1cdfd832755701fcd91840fde66229c7313af Jul 08 18:46:14.260267 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:14.260248 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4b26j"] Jul 08 18:46:14.262844 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:46:14.262819 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5122d514_65f7_4423_8010_51bdee3932bd.slice/crio-c941014353d954a9d952f113725cf0dabe8ae4e58ba6b092bf02da5fec612d3e WatchSource:0}: Error finding container c941014353d954a9d952f113725cf0dabe8ae4e58ba6b092bf02da5fec612d3e: Status 404 returned error can't find the container with id c941014353d954a9d952f113725cf0dabe8ae4e58ba6b092bf02da5fec612d3e Jul 08 18:46:14.268774 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:14.268756 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-zbn2x"] Jul 08 18:46:14.271015 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:14.270996 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7b5def05-a0ed-4512-b1a2-140a051040cf-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5twjz\" (UID: \"7b5def05-a0ed-4512-b1a2-140a051040cf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5twjz" Jul 08 18:46:14.271096 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:14.271032 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd1908b4-810a-4f1d-b172-47ddfe11befe-service-ca-bundle\") pod \"router-default-86b55bc475-2qk57\" (UID: \"dd1908b4-810a-4f1d-b172-47ddfe11befe\") " pod="openshift-ingress/router-default-86b55bc475-2qk57" Jul 08 18:46:14.271096 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:14.271062 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd1908b4-810a-4f1d-b172-47ddfe11befe-metrics-certs\") pod \"router-default-86b55bc475-2qk57\" (UID: \"dd1908b4-810a-4f1d-b172-47ddfe11befe\") " pod="openshift-ingress/router-default-86b55bc475-2qk57" Jul 08 18:46:14.271160 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:14.271096 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 18:46:14.271198 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:14.271184 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b5def05-a0ed-4512-b1a2-140a051040cf-samples-operator-tls podName:7b5def05-a0ed-4512-b1a2-140a051040cf nodeName:}" failed. No retries permitted until 2026-07-08 18:46:15.271163183 +0000 UTC m=+39.141578306 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7b5def05-a0ed-4512-b1a2-140a051040cf-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-5twjz" (UID: "7b5def05-a0ed-4512-b1a2-140a051040cf") : secret "samples-operator-tls" not found Jul 08 18:46:14.271237 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:14.271186 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 18:46:14.271269 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:14.271234 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd1908b4-810a-4f1d-b172-47ddfe11befe-service-ca-bundle podName:dd1908b4-810a-4f1d-b172-47ddfe11befe nodeName:}" failed. No retries permitted until 2026-07-08 18:46:15.271218764 +0000 UTC m=+39.141633879 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dd1908b4-810a-4f1d-b172-47ddfe11befe-service-ca-bundle") pod "router-default-86b55bc475-2qk57" (UID: "dd1908b4-810a-4f1d-b172-47ddfe11befe") : configmap references non-existent config key: service-ca.crt Jul 08 18:46:14.271269 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:14.271260 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd1908b4-810a-4f1d-b172-47ddfe11befe-metrics-certs podName:dd1908b4-810a-4f1d-b172-47ddfe11befe nodeName:}" failed. No retries permitted until 2026-07-08 18:46:15.271245641 +0000 UTC m=+39.141660753 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd1908b4-810a-4f1d-b172-47ddfe11befe-metrics-certs") pod "router-default-86b55bc475-2qk57" (UID: "dd1908b4-810a-4f1d-b172-47ddfe11befe") : secret "router-metrics-certs-default" not found Jul 08 18:46:14.271334 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:14.271288 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f1b40e8-bee3-441d-bd78-9a6aacc76949-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-t8cls\" (UID: \"5f1b40e8-bee3-441d-bd78-9a6aacc76949\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t8cls" Jul 08 18:46:14.271384 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:14.271374 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 18:46:14.271414 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:14.271408 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f1b40e8-bee3-441d-bd78-9a6aacc76949-cluster-monitoring-operator-tls podName:5f1b40e8-bee3-441d-bd78-9a6aacc76949 nodeName:}" failed. No retries permitted until 2026-07-08 18:46:15.271401808 +0000 UTC m=+39.141816920 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5f1b40e8-bee3-441d-bd78-9a6aacc76949-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-t8cls" (UID: "5f1b40e8-bee3-441d-bd78-9a6aacc76949") : secret "cluster-monitoring-operator-tls" not found Jul 08 18:46:14.281882 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:46:14.281864 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaf0fb98_4f0a_4b19_b5b7_3c57e45d7157.slice/crio-fd31300c52c7c62c7500b0aca53f51343ca80731e0acec96545c6bba091a2fc5 WatchSource:0}: Error finding container fd31300c52c7c62c7500b0aca53f51343ca80731e0acec96545c6bba091a2fc5: Status 404 returned error can't find the container with id fd31300c52c7c62c7500b0aca53f51343ca80731e0acec96545c6bba091a2fc5 Jul 08 18:46:14.372473 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:14.372447 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-registry-tls\") pod \"image-registry-55cd4459fc-xnws9\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:46:14.372621 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:14.372601 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 18:46:14.372621 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:14.372616 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55cd4459fc-xnws9: secret "image-registry-tls" not found Jul 08 18:46:14.372697 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:14.372660 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-registry-tls podName:fdbe9304-92f1-492d-a5de-88d4cba079dd nodeName:}" failed. No retries permitted until 2026-07-08 18:46:15.372646558 +0000 UTC m=+39.243061669 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-registry-tls") pod "image-registry-55cd4459fc-xnws9" (UID: "fdbe9304-92f1-492d-a5de-88d4cba079dd") : secret "image-registry-tls" not found Jul 08 18:46:14.473443 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:14.473374 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/964fa98c-bf64-4b37-9253-444e9cde8899-metrics-tls\") pod \"dns-default-fj77w\" (UID: \"964fa98c-bf64-4b37-9253-444e9cde8899\") " pod="openshift-dns/dns-default-fj77w" Jul 08 18:46:14.474147 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:14.473486 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 18:46:14.474147 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:14.473531 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/964fa98c-bf64-4b37-9253-444e9cde8899-metrics-tls podName:964fa98c-bf64-4b37-9253-444e9cde8899 nodeName:}" failed. No retries permitted until 2026-07-08 18:46:15.473519069 +0000 UTC m=+39.343934179 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/964fa98c-bf64-4b37-9253-444e9cde8899-metrics-tls") pod "dns-default-fj77w" (UID: "964fa98c-bf64-4b37-9253-444e9cde8899") : secret "dns-default-metrics-tls" not found Jul 08 18:46:14.828847 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:14.828771 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-q4grn" event={"ID":"62f90ec3-f829-4be2-a4c0-1064e0f564e4","Type":"ContainerStarted","Data":"d1b6eeda8e56f64054b2c1c6dcb1cdfd832755701fcd91840fde66229c7313af"} Jul 08 18:46:14.830069 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:14.830040 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4b26j" event={"ID":"5122d514-65f7-4423-8010-51bdee3932bd","Type":"ContainerStarted","Data":"c941014353d954a9d952f113725cf0dabe8ae4e58ba6b092bf02da5fec612d3e"} Jul 08 18:46:14.833724 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:14.833695 2572 generic.go:356] "Generic (PLEG): container finished" podID="15f04361-bd04-449b-9cce-d46b7ba27368" containerID="4f3a384c4dd3c351b184281426b19026890b977492c74b7ca2b38b1415f7d388" exitCode=0 Jul 08 18:46:14.833856 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:14.833768 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t4fzl" event={"ID":"15f04361-bd04-449b-9cce-d46b7ba27368","Type":"ContainerDied","Data":"4f3a384c4dd3c351b184281426b19026890b977492c74b7ca2b38b1415f7d388"} Jul 08 18:46:14.835310 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:14.835263 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zbn2x" event={"ID":"aaf0fb98-4f0a-4b19-b5b7-3c57e45d7157","Type":"ContainerStarted","Data":"fd31300c52c7c62c7500b0aca53f51343ca80731e0acec96545c6bba091a2fc5"} Jul 08 18:46:14.836473 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:14.836444 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hd7xd" event={"ID":"0270e288-835b-4d75-b0ba-4f2670684646","Type":"ContainerStarted","Data":"89f277ec4a1fcc589f2177d2cb45aed10cf6dbde3210bf378defe3daf17ddd46"} Jul 08 18:46:14.837688 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:14.837664 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-xg4bh" event={"ID":"4a9979b4-f241-4964-a20f-b42514a3f700","Type":"ContainerStarted","Data":"ce59b36209fc2ae42885cb810a65128d0a531649677ea0499a82129dfb9692bc"} Jul 08 18:46:14.838847 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:14.838821 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-j5tkz" event={"ID":"5d609d76-9788-408f-8ca7-8d6090301785","Type":"ContainerStarted","Data":"599b196adaedf60943d8317e583aba53678c94972913b2a7c93d8b72314fad4f"} Jul 08 18:46:14.839932 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:14.839912 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-9hx2g" event={"ID":"56065d42-401f-45fb-bf49-8885f262ad6f","Type":"ContainerStarted","Data":"e21f22e54c06630c8b8ae20e88054621918511160c5d123d5b2b7ae50d50ae35"} Jul 08 18:46:15.282925 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:15.281894 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f1b40e8-bee3-441d-bd78-9a6aacc76949-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-t8cls\" (UID: \"5f1b40e8-bee3-441d-bd78-9a6aacc76949\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t8cls" Jul 08 18:46:15.282925 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:15.282000 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7b5def05-a0ed-4512-b1a2-140a051040cf-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5twjz\" (UID: \"7b5def05-a0ed-4512-b1a2-140a051040cf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5twjz" Jul 08 18:46:15.282925 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:15.282032 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd1908b4-810a-4f1d-b172-47ddfe11befe-service-ca-bundle\") pod \"router-default-86b55bc475-2qk57\" (UID: \"dd1908b4-810a-4f1d-b172-47ddfe11befe\") " pod="openshift-ingress/router-default-86b55bc475-2qk57" Jul 08 18:46:15.282925 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:15.282066 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd1908b4-810a-4f1d-b172-47ddfe11befe-metrics-certs\") pod \"router-default-86b55bc475-2qk57\" (UID: \"dd1908b4-810a-4f1d-b172-47ddfe11befe\") " pod="openshift-ingress/router-default-86b55bc475-2qk57" Jul 08 18:46:15.282925 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:15.282246 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 18:46:15.282925 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:15.282306 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd1908b4-810a-4f1d-b172-47ddfe11befe-metrics-certs podName:dd1908b4-810a-4f1d-b172-47ddfe11befe nodeName:}" failed. No retries permitted until 2026-07-08 18:46:17.282287115 +0000 UTC m=+41.152702235 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd1908b4-810a-4f1d-b172-47ddfe11befe-metrics-certs") pod "router-default-86b55bc475-2qk57" (UID: "dd1908b4-810a-4f1d-b172-47ddfe11befe") : secret "router-metrics-certs-default" not found Jul 08 18:46:15.282925 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:15.282394 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 18:46:15.282925 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:15.282429 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f1b40e8-bee3-441d-bd78-9a6aacc76949-cluster-monitoring-operator-tls podName:5f1b40e8-bee3-441d-bd78-9a6aacc76949 nodeName:}" failed. No retries permitted until 2026-07-08 18:46:17.282417905 +0000 UTC m=+41.152833019 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5f1b40e8-bee3-441d-bd78-9a6aacc76949-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-t8cls" (UID: "5f1b40e8-bee3-441d-bd78-9a6aacc76949") : secret "cluster-monitoring-operator-tls" not found Jul 08 18:46:15.282925 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:15.282484 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 18:46:15.282925 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:15.282514 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b5def05-a0ed-4512-b1a2-140a051040cf-samples-operator-tls podName:7b5def05-a0ed-4512-b1a2-140a051040cf nodeName:}" failed. No retries permitted until 2026-07-08 18:46:17.28250464 +0000 UTC m=+41.152919756 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7b5def05-a0ed-4512-b1a2-140a051040cf-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-5twjz" (UID: "7b5def05-a0ed-4512-b1a2-140a051040cf") : secret "samples-operator-tls" not found Jul 08 18:46:15.282925 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:15.282576 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd1908b4-810a-4f1d-b172-47ddfe11befe-service-ca-bundle podName:dd1908b4-810a-4f1d-b172-47ddfe11befe nodeName:}" failed. No retries permitted until 2026-07-08 18:46:17.28256596 +0000 UTC m=+41.152981074 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dd1908b4-810a-4f1d-b172-47ddfe11befe-service-ca-bundle") pod "router-default-86b55bc475-2qk57" (UID: "dd1908b4-810a-4f1d-b172-47ddfe11befe") : configmap references non-existent config key: service-ca.crt Jul 08 18:46:15.383545 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:15.383505 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-registry-tls\") pod \"image-registry-55cd4459fc-xnws9\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:46:15.383713 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:15.383682 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 18:46:15.383713 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:15.383699 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55cd4459fc-xnws9: secret "image-registry-tls" not found Jul 08 18:46:15.383827 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:15.383754 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-registry-tls podName:fdbe9304-92f1-492d-a5de-88d4cba079dd nodeName:}" failed. No retries permitted until 2026-07-08 18:46:17.383736991 +0000 UTC m=+41.254152117 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-registry-tls") pod "image-registry-55cd4459fc-xnws9" (UID: "fdbe9304-92f1-492d-a5de-88d4cba079dd") : secret "image-registry-tls" not found Jul 08 18:46:15.484803 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:15.484771 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/964fa98c-bf64-4b37-9253-444e9cde8899-metrics-tls\") pod \"dns-default-fj77w\" (UID: \"964fa98c-bf64-4b37-9253-444e9cde8899\") " pod="openshift-dns/dns-default-fj77w" Jul 08 18:46:15.485212 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:15.484902 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 18:46:15.485212 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:15.484949 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/964fa98c-bf64-4b37-9253-444e9cde8899-metrics-tls podName:964fa98c-bf64-4b37-9253-444e9cde8899 nodeName:}" failed. No retries permitted until 2026-07-08 18:46:17.484936024 +0000 UTC m=+41.355351135 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/964fa98c-bf64-4b37-9253-444e9cde8899-metrics-tls") pod "dns-default-fj77w" (UID: "964fa98c-bf64-4b37-9253-444e9cde8899") : secret "dns-default-metrics-tls" not found Jul 08 18:46:15.856583 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:15.855735 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t4fzl" event={"ID":"15f04361-bd04-449b-9cce-d46b7ba27368","Type":"ContainerStarted","Data":"c7e592ed86a9f6856ee60737248f039dec5519c45d484d75e93827cbe0dd8cbc"} Jul 08 18:46:15.904634 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:15.903404 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-t4fzl" podStartSLOduration=9.271132356 podStartE2EDuration="39.903382293s" totalImagesPullingTime="30.632249937s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:45:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:15.899998942 +0000 UTC m=+39.770414076" watchObservedRunningTime="2026-07-08 18:46:15.903382293 +0000 UTC m=+39.773797432" Jul 08 18:46:16.151227 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:16.151140 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:16.374155 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:16.373963 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:17.304793 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:17.304558 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7b5def05-a0ed-4512-b1a2-140a051040cf-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5twjz\" (UID: \"7b5def05-a0ed-4512-b1a2-140a051040cf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5twjz" Jul 08 18:46:17.305197 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:17.304820 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd1908b4-810a-4f1d-b172-47ddfe11befe-service-ca-bundle\") pod \"router-default-86b55bc475-2qk57\" (UID: \"dd1908b4-810a-4f1d-b172-47ddfe11befe\") " pod="openshift-ingress/router-default-86b55bc475-2qk57" Jul 08 18:46:17.305197 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:17.304858 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd1908b4-810a-4f1d-b172-47ddfe11befe-metrics-certs\") pod \"router-default-86b55bc475-2qk57\" (UID: \"dd1908b4-810a-4f1d-b172-47ddfe11befe\") " pod="openshift-ingress/router-default-86b55bc475-2qk57" Jul 08 18:46:17.305197 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:17.304747 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 18:46:17.305197 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:17.304952 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b5def05-a0ed-4512-b1a2-140a051040cf-samples-operator-tls podName:7b5def05-a0ed-4512-b1a2-140a051040cf nodeName:}" failed. No retries permitted until 2026-07-08 18:46:21.30492961 +0000 UTC m=+45.175344742 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7b5def05-a0ed-4512-b1a2-140a051040cf-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-5twjz" (UID: "7b5def05-a0ed-4512-b1a2-140a051040cf") : secret "samples-operator-tls" not found Jul 08 18:46:17.305197 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:17.305011 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 18:46:17.305197 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:17.305011 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f1b40e8-bee3-441d-bd78-9a6aacc76949-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-t8cls\" (UID: \"5f1b40e8-bee3-441d-bd78-9a6aacc76949\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t8cls" Jul 08 18:46:17.305197 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:17.305065 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd1908b4-810a-4f1d-b172-47ddfe11befe-metrics-certs podName:dd1908b4-810a-4f1d-b172-47ddfe11befe nodeName:}" failed. No retries permitted until 2026-07-08 18:46:21.305048931 +0000 UTC m=+45.175464066 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd1908b4-810a-4f1d-b172-47ddfe11befe-metrics-certs") pod "router-default-86b55bc475-2qk57" (UID: "dd1908b4-810a-4f1d-b172-47ddfe11befe") : secret "router-metrics-certs-default" not found Jul 08 18:46:17.305197 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:17.305131 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd1908b4-810a-4f1d-b172-47ddfe11befe-service-ca-bundle podName:dd1908b4-810a-4f1d-b172-47ddfe11befe nodeName:}" failed. No retries permitted until 2026-07-08 18:46:21.305120485 +0000 UTC m=+45.175535610 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dd1908b4-810a-4f1d-b172-47ddfe11befe-service-ca-bundle") pod "router-default-86b55bc475-2qk57" (UID: "dd1908b4-810a-4f1d-b172-47ddfe11befe") : configmap references non-existent config key: service-ca.crt Jul 08 18:46:17.305197 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:17.305134 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 18:46:17.305197 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:17.305177 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f1b40e8-bee3-441d-bd78-9a6aacc76949-cluster-monitoring-operator-tls podName:5f1b40e8-bee3-441d-bd78-9a6aacc76949 nodeName:}" failed. No retries permitted until 2026-07-08 18:46:21.305162569 +0000 UTC m=+45.175577681 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5f1b40e8-bee3-441d-bd78-9a6aacc76949-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-t8cls" (UID: "5f1b40e8-bee3-441d-bd78-9a6aacc76949") : secret "cluster-monitoring-operator-tls" not found Jul 08 18:46:17.405557 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:17.405518 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-registry-tls\") pod \"image-registry-55cd4459fc-xnws9\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:46:17.405737 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:17.405675 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 18:46:17.405737 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:17.405693 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55cd4459fc-xnws9: secret "image-registry-tls" not found Jul 08 18:46:17.405830 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:17.405754 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-registry-tls podName:fdbe9304-92f1-492d-a5de-88d4cba079dd nodeName:}" failed. No retries permitted until 2026-07-08 18:46:21.405739177 +0000 UTC m=+45.276154288 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-registry-tls") pod "image-registry-55cd4459fc-xnws9" (UID: "fdbe9304-92f1-492d-a5de-88d4cba079dd") : secret "image-registry-tls" not found Jul 08 18:46:17.506864 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:17.506788 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/964fa98c-bf64-4b37-9253-444e9cde8899-metrics-tls\") pod \"dns-default-fj77w\" (UID: \"964fa98c-bf64-4b37-9253-444e9cde8899\") " pod="openshift-dns/dns-default-fj77w" Jul 08 18:46:17.506989 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:17.506940 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 18:46:17.507042 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:17.507003 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/964fa98c-bf64-4b37-9253-444e9cde8899-metrics-tls podName:964fa98c-bf64-4b37-9253-444e9cde8899 nodeName:}" failed. No retries permitted until 2026-07-08 18:46:21.50698662 +0000 UTC m=+45.377401754 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/964fa98c-bf64-4b37-9253-444e9cde8899-metrics-tls") pod "dns-default-fj77w" (UID: "964fa98c-bf64-4b37-9253-444e9cde8899") : secret "dns-default-metrics-tls" not found Jul 08 18:46:19.733347 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:19.733311 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:19.834644 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:19.834610 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:20.428256 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:20.428218 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:20.487419 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:20.487391 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:21.028078 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:21.028040 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:21.127444 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:21.127408 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:21.341990 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:21.341965 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7b5def05-a0ed-4512-b1a2-140a051040cf-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5twjz\" (UID: \"7b5def05-a0ed-4512-b1a2-140a051040cf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5twjz" Jul 08 18:46:21.342114 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:21.341997 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd1908b4-810a-4f1d-b172-47ddfe11befe-service-ca-bundle\") pod \"router-default-86b55bc475-2qk57\" (UID: \"dd1908b4-810a-4f1d-b172-47ddfe11befe\") " pod="openshift-ingress/router-default-86b55bc475-2qk57" Jul 08 18:46:21.342114 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:21.342019 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd1908b4-810a-4f1d-b172-47ddfe11befe-metrics-certs\") pod \"router-default-86b55bc475-2qk57\" (UID: \"dd1908b4-810a-4f1d-b172-47ddfe11befe\") " pod="openshift-ingress/router-default-86b55bc475-2qk57" Jul 08 18:46:21.342114 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:21.342109 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 18:46:21.342239 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:21.342125 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 18:46:21.342239 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:21.342150 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd1908b4-810a-4f1d-b172-47ddfe11befe-service-ca-bundle podName:dd1908b4-810a-4f1d-b172-47ddfe11befe nodeName:}" failed. No retries permitted until 2026-07-08 18:46:29.342126952 +0000 UTC m=+53.212542088 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dd1908b4-810a-4f1d-b172-47ddfe11befe-service-ca-bundle") pod "router-default-86b55bc475-2qk57" (UID: "dd1908b4-810a-4f1d-b172-47ddfe11befe") : configmap references non-existent config key: service-ca.crt Jul 08 18:46:21.342239 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:21.342181 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b5def05-a0ed-4512-b1a2-140a051040cf-samples-operator-tls podName:7b5def05-a0ed-4512-b1a2-140a051040cf nodeName:}" failed. No retries permitted until 2026-07-08 18:46:29.342162228 +0000 UTC m=+53.212577356 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7b5def05-a0ed-4512-b1a2-140a051040cf-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-5twjz" (UID: "7b5def05-a0ed-4512-b1a2-140a051040cf") : secret "samples-operator-tls" not found Jul 08 18:46:21.342392 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:21.342299 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd1908b4-810a-4f1d-b172-47ddfe11befe-metrics-certs podName:dd1908b4-810a-4f1d-b172-47ddfe11befe nodeName:}" failed. No retries permitted until 2026-07-08 18:46:29.342261882 +0000 UTC m=+53.212677002 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd1908b4-810a-4f1d-b172-47ddfe11befe-metrics-certs") pod "router-default-86b55bc475-2qk57" (UID: "dd1908b4-810a-4f1d-b172-47ddfe11befe") : secret "router-metrics-certs-default" not found Jul 08 18:46:21.342392 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:21.342350 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f1b40e8-bee3-441d-bd78-9a6aacc76949-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-t8cls\" (UID: \"5f1b40e8-bee3-441d-bd78-9a6aacc76949\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t8cls" Jul 08 18:46:21.342483 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:21.342435 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 18:46:21.342483 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:21.342466 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f1b40e8-bee3-441d-bd78-9a6aacc76949-cluster-monitoring-operator-tls podName:5f1b40e8-bee3-441d-bd78-9a6aacc76949 nodeName:}" failed. No retries permitted until 2026-07-08 18:46:29.342456963 +0000 UTC m=+53.212872079 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5f1b40e8-bee3-441d-bd78-9a6aacc76949-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-t8cls" (UID: "5f1b40e8-bee3-441d-bd78-9a6aacc76949") : secret "cluster-monitoring-operator-tls" not found Jul 08 18:46:21.446011 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:21.445978 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-registry-tls\") pod \"image-registry-55cd4459fc-xnws9\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:46:21.446657 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:21.446231 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 18:46:21.446657 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:21.446248 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55cd4459fc-xnws9: secret "image-registry-tls" not found Jul 08 18:46:21.446657 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:21.446300 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-registry-tls podName:fdbe9304-92f1-492d-a5de-88d4cba079dd nodeName:}" failed. No retries permitted until 2026-07-08 18:46:29.446282285 +0000 UTC m=+53.316697421 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-registry-tls") pod "image-registry-55cd4459fc-xnws9" (UID: "fdbe9304-92f1-492d-a5de-88d4cba079dd") : secret "image-registry-tls" not found Jul 08 18:46:21.547035 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:21.546784 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/964fa98c-bf64-4b37-9253-444e9cde8899-metrics-tls\") pod \"dns-default-fj77w\" (UID: \"964fa98c-bf64-4b37-9253-444e9cde8899\") " pod="openshift-dns/dns-default-fj77w" Jul 08 18:46:21.547035 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:21.547034 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 18:46:21.547301 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:21.547111 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/964fa98c-bf64-4b37-9253-444e9cde8899-metrics-tls podName:964fa98c-bf64-4b37-9253-444e9cde8899 nodeName:}" failed. No retries permitted until 2026-07-08 18:46:29.547090616 +0000 UTC m=+53.417505749 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/964fa98c-bf64-4b37-9253-444e9cde8899-metrics-tls") pod "dns-default-fj77w" (UID: "964fa98c-bf64-4b37-9253-444e9cde8899") : secret "dns-default-metrics-tls" not found Jul 08 18:46:21.875407 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:21.875310 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-q4grn" event={"ID":"62f90ec3-f829-4be2-a4c0-1064e0f564e4","Type":"ContainerStarted","Data":"48bb3770527f69653dcb805970debf1c0e0c41274298191676381fc72c137acc"} Jul 08 18:46:21.877156 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:21.877106 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4b26j" event={"ID":"5122d514-65f7-4423-8010-51bdee3932bd","Type":"ContainerStarted","Data":"28d54156651d22b9374cbd3530ce9f24b9093b71fd0eab32f5116f2f61556a2b"} Jul 08 18:46:21.885805 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:21.885775 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zbn2x" event={"ID":"aaf0fb98-4f0a-4b19-b5b7-3c57e45d7157","Type":"ContainerStarted","Data":"cc45583452f47079c1abcd90015eedeee0fb7e7c280a3fb7655b4d2aaab4c4c0"} Jul 08 18:46:21.887481 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:21.887447 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hd7xd" event={"ID":"0270e288-835b-4d75-b0ba-4f2670684646","Type":"ContainerStarted","Data":"a9877e2c7b66312a988060918428936b004d2bac5c309b9225b4a7e1dacb4af7"} Jul 08 18:46:21.889165 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:21.889123 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-xg4bh" event={"ID":"4a9979b4-f241-4964-a20f-b42514a3f700","Type":"ContainerStarted","Data":"73259396ed2b2a402e5cf004cb8fcc866b53eadfa87a18ff239deebe7358595f"} Jul 08 18:46:21.890637 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:21.890616 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-j5tkz" event={"ID":"5d609d76-9788-408f-8ca7-8d6090301785","Type":"ContainerStarted","Data":"eb5ffcf244f9b7ac74818e68d7fa36157449e2ccb46c8c25e339ae8d8bb658cf"} Jul 08 18:46:21.892309 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:21.892289 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9hx2g_56065d42-401f-45fb-bf49-8885f262ad6f/console-operator/0.log" Jul 08 18:46:21.892395 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:21.892327 2572 generic.go:356] "Generic (PLEG): container finished" podID="56065d42-401f-45fb-bf49-8885f262ad6f" containerID="b0f41e23ddee9351db4fd4bb1233826f05a362abaed4d5f3e0c0a6edf70569b8" exitCode=255 Jul 08 18:46:21.892395 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:21.892353 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-9hx2g" event={"ID":"56065d42-401f-45fb-bf49-8885f262ad6f","Type":"ContainerDied","Data":"b0f41e23ddee9351db4fd4bb1233826f05a362abaed4d5f3e0c0a6edf70569b8"} Jul 08 18:46:21.892610 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:21.892578 2572 scope.go:117] "RemoveContainer" containerID="b0f41e23ddee9351db4fd4bb1233826f05a362abaed4d5f3e0c0a6edf70569b8" Jul 08 18:46:21.912396 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:21.911801 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-q4grn" podStartSLOduration=1.813174855 podStartE2EDuration="8.911785253s" totalImagesPullingTime="7.098610398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:46:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:21.894335836 +0000 UTC m=+45.764750970" watchObservedRunningTime="2026-07-08 18:46:21.911785253 +0000 UTC m=+45.782200387" Jul 08 18:46:21.934623 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:21.934499 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4b26j" podStartSLOduration=18.843348824 podStartE2EDuration="25.934478884s" totalImagesPullingTime="7.09113006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:45:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:21.912201245 +0000 UTC m=+45.782616379" watchObservedRunningTime="2026-07-08 18:46:21.934478884 +0000 UTC m=+45.804893999" Jul 08 18:46:21.935104 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:21.935072 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-xg4bh" podStartSLOduration=20.688017024 podStartE2EDuration="27.935060353s" totalImagesPullingTime="7.247043329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:45:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:21.934940432 +0000 UTC m=+45.805355565" watchObservedRunningTime="2026-07-08 18:46:21.935060353 +0000 UTC m=+45.805475488" Jul 08 18:46:21.970136 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:21.970090 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-j5tkz" podStartSLOduration=20.754626554 podStartE2EDuration="27.970059479s" totalImagesPullingTime="7.215432925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:45:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:21.969430221 +0000 UTC m=+45.839845352" watchObservedRunningTime="2026-07-08 18:46:21.970059479 +0000 UTC m=+45.840474612" Jul 08 18:46:21.989226 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:21.989163 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hd7xd" podStartSLOduration=16.886094334 podStartE2EDuration="23.989143748s" totalImagesPullingTime="7.103049414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:45:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:21.987735279 +0000 UTC m=+45.858150412" watchObservedRunningTime="2026-07-08 18:46:21.989143748 +0000 UTC m=+45.859558884" Jul 08 18:46:22.058242 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:22.058218 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:22.119923 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:22.119891 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:22.633998 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:22.633894 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:22.745103 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:22.745066 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:22.799732 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:22.799675 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zbn2x" podStartSLOduration=16.714499731 podStartE2EDuration="23.79965331s" totalImagesPullingTime="7.085153579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:45:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:22.009924421 +0000 UTC m=+45.880339556" watchObservedRunningTime="2026-07-08 18:46:22.79965331 +0000 UTC m=+46.670068445" Jul 08 18:46:22.799923 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:22.799895 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-frvqm"] Jul 08 18:46:22.816615 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:22.816567 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-frvqm" Jul 08 18:46:22.820165 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:22.820135 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-frvqm"] Jul 08 18:46:22.820617 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:22.820579 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4nhln\"" Jul 08 18:46:22.820857 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:22.820838 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 18:46:22.821073 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:22.821056 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 18:46:22.840937 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:22.840914 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:22.860002 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:22.859979 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f0ed88e-5743-4e3a-af43-458dd2a94180-data-volume\") pod \"insights-runtime-extractor-frvqm\" (UID: \"3f0ed88e-5743-4e3a-af43-458dd2a94180\") " pod="openshift-insights/insights-runtime-extractor-frvqm" Jul 08 18:46:22.860153 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:22.860038 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f0ed88e-5743-4e3a-af43-458dd2a94180-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frvqm\" (UID: \"3f0ed88e-5743-4e3a-af43-458dd2a94180\") " pod="openshift-insights/insights-runtime-extractor-frvqm" Jul 08 18:46:22.860153 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:22.860111 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdxq9\" (UniqueName: \"kubernetes.io/projected/3f0ed88e-5743-4e3a-af43-458dd2a94180-kube-api-access-hdxq9\") pod \"insights-runtime-extractor-frvqm\" (UID: \"3f0ed88e-5743-4e3a-af43-458dd2a94180\") " pod="openshift-insights/insights-runtime-extractor-frvqm" Jul 08 18:46:22.860285 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:22.860197 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3f0ed88e-5743-4e3a-af43-458dd2a94180-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frvqm\" (UID: \"3f0ed88e-5743-4e3a-af43-458dd2a94180\") " pod="openshift-insights/insights-runtime-extractor-frvqm" Jul 08 18:46:22.860285 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:22.860227 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3f0ed88e-5743-4e3a-af43-458dd2a94180-crio-socket\") pod \"insights-runtime-extractor-frvqm\" (UID: \"3f0ed88e-5743-4e3a-af43-458dd2a94180\") " pod="openshift-insights/insights-runtime-extractor-frvqm" Jul 08 18:46:22.900304 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:22.900251 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9hx2g_56065d42-401f-45fb-bf49-8885f262ad6f/console-operator/1.log" Jul 08 18:46:22.900784 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:22.900765 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9hx2g_56065d42-401f-45fb-bf49-8885f262ad6f/console-operator/0.log" Jul 08 18:46:22.900867 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:22.900800 2572 generic.go:356] "Generic (PLEG): container finished" podID="56065d42-401f-45fb-bf49-8885f262ad6f" containerID="e100dff979a8a9da666c68b2e36c32c8b37e5ae3e3180a62e3e9e8467bbbad07" exitCode=255 Jul 08 18:46:22.900930 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:22.900902 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-9hx2g" event={"ID":"56065d42-401f-45fb-bf49-8885f262ad6f","Type":"ContainerDied","Data":"e100dff979a8a9da666c68b2e36c32c8b37e5ae3e3180a62e3e9e8467bbbad07"} Jul 08 18:46:22.900973 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:22.900952 2572 scope.go:117] "RemoveContainer" containerID="b0f41e23ddee9351db4fd4bb1233826f05a362abaed4d5f3e0c0a6edf70569b8" Jul 08 18:46:22.902500 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:22.902186 2572 scope.go:117] "RemoveContainer" containerID="e100dff979a8a9da666c68b2e36c32c8b37e5ae3e3180a62e3e9e8467bbbad07" Jul 08 18:46:22.902500 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:22.902334 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-9hx2g_openshift-console-operator(56065d42-401f-45fb-bf49-8885f262ad6f)\"" pod="openshift-console-operator/console-operator-68b757fb67-9hx2g" podUID="56065d42-401f-45fb-bf49-8885f262ad6f" Jul 08 18:46:22.913612 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:22.913579 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:22.960963 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:22.960939 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3f0ed88e-5743-4e3a-af43-458dd2a94180-crio-socket\") pod \"insights-runtime-extractor-frvqm\" (UID: \"3f0ed88e-5743-4e3a-af43-458dd2a94180\") " pod="openshift-insights/insights-runtime-extractor-frvqm" Jul 08 18:46:22.961114 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:22.961093 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3f0ed88e-5743-4e3a-af43-458dd2a94180-crio-socket\") pod \"insights-runtime-extractor-frvqm\" (UID: \"3f0ed88e-5743-4e3a-af43-458dd2a94180\") " pod="openshift-insights/insights-runtime-extractor-frvqm" Jul 08 18:46:22.961468 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:22.961228 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f0ed88e-5743-4e3a-af43-458dd2a94180-data-volume\") pod \"insights-runtime-extractor-frvqm\" (UID: \"3f0ed88e-5743-4e3a-af43-458dd2a94180\") " pod="openshift-insights/insights-runtime-extractor-frvqm" Jul 08 18:46:22.961657 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:22.961638 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f0ed88e-5743-4e3a-af43-458dd2a94180-data-volume\") pod \"insights-runtime-extractor-frvqm\" (UID: \"3f0ed88e-5743-4e3a-af43-458dd2a94180\") " pod="openshift-insights/insights-runtime-extractor-frvqm" Jul 08 18:46:22.962009 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:22.961890 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f0ed88e-5743-4e3a-af43-458dd2a94180-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frvqm\" (UID: \"3f0ed88e-5743-4e3a-af43-458dd2a94180\") " pod="openshift-insights/insights-runtime-extractor-frvqm" Jul 08 18:46:22.962009 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:22.961989 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 18:46:22.962178 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:22.962047 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f0ed88e-5743-4e3a-af43-458dd2a94180-insights-runtime-extractor-tls podName:3f0ed88e-5743-4e3a-af43-458dd2a94180 nodeName:}" failed. No retries permitted until 2026-07-08 18:46:23.462024449 +0000 UTC m=+47.332439566 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3f0ed88e-5743-4e3a-af43-458dd2a94180-insights-runtime-extractor-tls") pod "insights-runtime-extractor-frvqm" (UID: "3f0ed88e-5743-4e3a-af43-458dd2a94180") : secret "insights-runtime-extractor-tls" not found Jul 08 18:46:22.962262 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:22.962236 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdxq9\" (UniqueName: \"kubernetes.io/projected/3f0ed88e-5743-4e3a-af43-458dd2a94180-kube-api-access-hdxq9\") pod \"insights-runtime-extractor-frvqm\" (UID: \"3f0ed88e-5743-4e3a-af43-458dd2a94180\") " pod="openshift-insights/insights-runtime-extractor-frvqm" Jul 08 18:46:22.962470 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:22.962447 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3f0ed88e-5743-4e3a-af43-458dd2a94180-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frvqm\" (UID: \"3f0ed88e-5743-4e3a-af43-458dd2a94180\") " pod="openshift-insights/insights-runtime-extractor-frvqm" Jul 08 18:46:22.962555 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:22.962539 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 18:46:22.962644 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:22.962629 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3f0ed88e-5743-4e3a-af43-458dd2a94180-kube-rbac-proxy-cm podName:3f0ed88e-5743-4e3a-af43-458dd2a94180 nodeName:}" failed. No retries permitted until 2026-07-08 18:46:23.46260879 +0000 UTC m=+47.333023915 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3f0ed88e-5743-4e3a-af43-458dd2a94180-kube-rbac-proxy-cm") pod "insights-runtime-extractor-frvqm" (UID: "3f0ed88e-5743-4e3a-af43-458dd2a94180") : configmap "kube-rbac-proxy" not found Jul 08 18:46:22.973858 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:22.973841 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdxq9\" (UniqueName: \"kubernetes.io/projected/3f0ed88e-5743-4e3a-af43-458dd2a94180-kube-api-access-hdxq9\") pod \"insights-runtime-extractor-frvqm\" (UID: \"3f0ed88e-5743-4e3a-af43-458dd2a94180\") " pod="openshift-insights/insights-runtime-extractor-frvqm" Jul 08 18:46:23.467257 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:23.467218 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f0ed88e-5743-4e3a-af43-458dd2a94180-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frvqm\" (UID: \"3f0ed88e-5743-4e3a-af43-458dd2a94180\") " pod="openshift-insights/insights-runtime-extractor-frvqm" Jul 08 18:46:23.467691 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:23.467347 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3f0ed88e-5743-4e3a-af43-458dd2a94180-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frvqm\" (UID: \"3f0ed88e-5743-4e3a-af43-458dd2a94180\") " pod="openshift-insights/insights-runtime-extractor-frvqm" Jul 08 18:46:23.467691 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:23.467401 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 18:46:23.467691 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:23.467471 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 18:46:23.467691 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:23.467491 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f0ed88e-5743-4e3a-af43-458dd2a94180-insights-runtime-extractor-tls podName:3f0ed88e-5743-4e3a-af43-458dd2a94180 nodeName:}" failed. No retries permitted until 2026-07-08 18:46:24.467470638 +0000 UTC m=+48.337885754 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3f0ed88e-5743-4e3a-af43-458dd2a94180-insights-runtime-extractor-tls") pod "insights-runtime-extractor-frvqm" (UID: "3f0ed88e-5743-4e3a-af43-458dd2a94180") : secret "insights-runtime-extractor-tls" not found Jul 08 18:46:23.467691 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:23.467528 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3f0ed88e-5743-4e3a-af43-458dd2a94180-kube-rbac-proxy-cm podName:3f0ed88e-5743-4e3a-af43-458dd2a94180 nodeName:}" failed. No retries permitted until 2026-07-08 18:46:24.467515484 +0000 UTC m=+48.337930594 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3f0ed88e-5743-4e3a-af43-458dd2a94180-kube-rbac-proxy-cm") pod "insights-runtime-extractor-frvqm" (UID: "3f0ed88e-5743-4e3a-af43-458dd2a94180") : configmap "kube-rbac-proxy" not found Jul 08 18:46:23.905549 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:23.905473 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9hx2g_56065d42-401f-45fb-bf49-8885f262ad6f/console-operator/1.log" Jul 08 18:46:23.905799 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:23.905784 2572 scope.go:117] "RemoveContainer" containerID="e100dff979a8a9da666c68b2e36c32c8b37e5ae3e3180a62e3e9e8467bbbad07" Jul 08 18:46:23.905942 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:23.905925 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-9hx2g_openshift-console-operator(56065d42-401f-45fb-bf49-8885f262ad6f)\"" pod="openshift-console-operator/console-operator-68b757fb67-9hx2g" podUID="56065d42-401f-45fb-bf49-8885f262ad6f" Jul 08 18:46:23.908577 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:23.908563 2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-9hx2g" Jul 08 18:46:23.908645 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:23.908636 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-9hx2g" Jul 08 18:46:24.348892 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:24.348859 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:24.476044 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:24.476012 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f0ed88e-5743-4e3a-af43-458dd2a94180-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frvqm\" (UID: \"3f0ed88e-5743-4e3a-af43-458dd2a94180\") " pod="openshift-insights/insights-runtime-extractor-frvqm" Jul 08 18:46:24.476464 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:24.476115 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3f0ed88e-5743-4e3a-af43-458dd2a94180-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frvqm\" (UID: \"3f0ed88e-5743-4e3a-af43-458dd2a94180\") " pod="openshift-insights/insights-runtime-extractor-frvqm" Jul 08 18:46:24.476464 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:24.476151 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 18:46:24.476464 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:24.476218 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f0ed88e-5743-4e3a-af43-458dd2a94180-insights-runtime-extractor-tls podName:3f0ed88e-5743-4e3a-af43-458dd2a94180 nodeName:}" failed. No retries permitted until 2026-07-08 18:46:26.476203186 +0000 UTC m=+50.346618296 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3f0ed88e-5743-4e3a-af43-458dd2a94180-insights-runtime-extractor-tls") pod "insights-runtime-extractor-frvqm" (UID: "3f0ed88e-5743-4e3a-af43-458dd2a94180") : secret "insights-runtime-extractor-tls" not found Jul 08 18:46:24.476464 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:24.476246 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 18:46:24.476464 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:24.476311 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3f0ed88e-5743-4e3a-af43-458dd2a94180-kube-rbac-proxy-cm podName:3f0ed88e-5743-4e3a-af43-458dd2a94180 nodeName:}" failed. No retries permitted until 2026-07-08 18:46:26.47629246 +0000 UTC m=+50.346707592 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3f0ed88e-5743-4e3a-af43-458dd2a94180-kube-rbac-proxy-cm") pod "insights-runtime-extractor-frvqm" (UID: "3f0ed88e-5743-4e3a-af43-458dd2a94180") : configmap "kube-rbac-proxy" not found Jul 08 18:46:24.785504 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:24.785467 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:24.857312 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:24.857289 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:24.909118 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:24.909089 2572 scope.go:117] "RemoveContainer" containerID="e100dff979a8a9da666c68b2e36c32c8b37e5ae3e3180a62e3e9e8467bbbad07" Jul 08 18:46:24.909294 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:24.909274 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-9hx2g_openshift-console-operator(56065d42-401f-45fb-bf49-8885f262ad6f)\"" pod="openshift-console-operator/console-operator-68b757fb67-9hx2g" podUID="56065d42-401f-45fb-bf49-8885f262ad6f" Jul 08 18:46:25.055987 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:25.055898 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:25.156161 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:25.156119 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:25.600467 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:25.600441 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sz4t6_642e2d30-24f7-4997-b730-bb037276ff1b/dns-node-resolver/0.log" Jul 08 18:46:26.410560 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:26.410521 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:26.484052 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:26.484007 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:26.491124 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:26.491098 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3f0ed88e-5743-4e3a-af43-458dd2a94180-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frvqm\" (UID: \"3f0ed88e-5743-4e3a-af43-458dd2a94180\") " pod="openshift-insights/insights-runtime-extractor-frvqm" Jul 08 18:46:26.491214 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:26.491179 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f0ed88e-5743-4e3a-af43-458dd2a94180-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frvqm\" (UID: \"3f0ed88e-5743-4e3a-af43-458dd2a94180\") " pod="openshift-insights/insights-runtime-extractor-frvqm" Jul 08 18:46:26.491214 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:26.491208 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 18:46:26.491284 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:26.491260 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3f0ed88e-5743-4e3a-af43-458dd2a94180-kube-rbac-proxy-cm podName:3f0ed88e-5743-4e3a-af43-458dd2a94180 nodeName:}" failed. No retries permitted until 2026-07-08 18:46:30.491243734 +0000 UTC m=+54.361658848 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3f0ed88e-5743-4e3a-af43-458dd2a94180-kube-rbac-proxy-cm") pod "insights-runtime-extractor-frvqm" (UID: "3f0ed88e-5743-4e3a-af43-458dd2a94180") : configmap "kube-rbac-proxy" not found Jul 08 18:46:26.491327 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:26.491303 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 18:46:26.491359 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:26.491340 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f0ed88e-5743-4e3a-af43-458dd2a94180-insights-runtime-extractor-tls podName:3f0ed88e-5743-4e3a-af43-458dd2a94180 nodeName:}" failed. No retries permitted until 2026-07-08 18:46:30.491330171 +0000 UTC m=+54.361745286 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3f0ed88e-5743-4e3a-af43-458dd2a94180-insights-runtime-extractor-tls") pod "insights-runtime-extractor-frvqm" (UID: "3f0ed88e-5743-4e3a-af43-458dd2a94180") : secret "insights-runtime-extractor-tls" not found Jul 08 18:46:26.600301 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:26.600282 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8vn8j_4b4dd87a-0d97-4dd0-826d-b422ca31c60c/node-ca/0.log" Jul 08 18:46:26.732477 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:26.732436 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:26.808529 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:26.808461 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:27.615914 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:27.615891 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-q4grn_62f90ec3-f829-4be2-a4c0-1064e0f564e4/serve-healthcheck-canary/0.log" Jul 08 18:46:27.956007 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:27.955978 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:28.202837 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:28.202807 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-4b26j_5122d514-65f7-4423-8010-51bdee3932bd/kube-storage-version-migrator-operator/0.log" Jul 08 18:46:29.416087 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:29.416055 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7b5def05-a0ed-4512-b1a2-140a051040cf-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5twjz\" (UID: \"7b5def05-a0ed-4512-b1a2-140a051040cf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5twjz" Jul 08 18:46:29.416087 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:29.416088 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd1908b4-810a-4f1d-b172-47ddfe11befe-service-ca-bundle\") pod \"router-default-86b55bc475-2qk57\" (UID: \"dd1908b4-810a-4f1d-b172-47ddfe11befe\") " pod="openshift-ingress/router-default-86b55bc475-2qk57" Jul 08 18:46:29.416507 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:29.416112 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd1908b4-810a-4f1d-b172-47ddfe11befe-metrics-certs\") pod \"router-default-86b55bc475-2qk57\" (UID: \"dd1908b4-810a-4f1d-b172-47ddfe11befe\") " pod="openshift-ingress/router-default-86b55bc475-2qk57" Jul 08 18:46:29.416507 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:29.416186 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f1b40e8-bee3-441d-bd78-9a6aacc76949-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-t8cls\" (UID: \"5f1b40e8-bee3-441d-bd78-9a6aacc76949\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t8cls" Jul 08 18:46:29.416507 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:29.416203 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 18:46:29.416507 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:29.416276 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b5def05-a0ed-4512-b1a2-140a051040cf-samples-operator-tls podName:7b5def05-a0ed-4512-b1a2-140a051040cf nodeName:}" failed. No retries permitted until 2026-07-08 18:46:45.416247228 +0000 UTC m=+69.286662351 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7b5def05-a0ed-4512-b1a2-140a051040cf-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-5twjz" (UID: "7b5def05-a0ed-4512-b1a2-140a051040cf") : secret "samples-operator-tls" not found Jul 08 18:46:29.416507 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:29.416287 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 18:46:29.416507 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:29.416296 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd1908b4-810a-4f1d-b172-47ddfe11befe-service-ca-bundle podName:dd1908b4-810a-4f1d-b172-47ddfe11befe nodeName:}" failed. No retries permitted until 2026-07-08 18:46:45.416286241 +0000 UTC m=+69.286701359 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dd1908b4-810a-4f1d-b172-47ddfe11befe-service-ca-bundle") pod "router-default-86b55bc475-2qk57" (UID: "dd1908b4-810a-4f1d-b172-47ddfe11befe") : configmap references non-existent config key: service-ca.crt Jul 08 18:46:29.416507 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:29.416319 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 18:46:29.416507 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:29.416331 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd1908b4-810a-4f1d-b172-47ddfe11befe-metrics-certs podName:dd1908b4-810a-4f1d-b172-47ddfe11befe nodeName:}" failed. No retries permitted until 2026-07-08 18:46:45.416313685 +0000 UTC m=+69.286728799 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd1908b4-810a-4f1d-b172-47ddfe11befe-metrics-certs") pod "router-default-86b55bc475-2qk57" (UID: "dd1908b4-810a-4f1d-b172-47ddfe11befe") : secret "router-metrics-certs-default" not found Jul 08 18:46:29.416507 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:29.416355 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f1b40e8-bee3-441d-bd78-9a6aacc76949-cluster-monitoring-operator-tls podName:5f1b40e8-bee3-441d-bd78-9a6aacc76949 nodeName:}" failed. No retries permitted until 2026-07-08 18:46:45.4163442 +0000 UTC m=+69.286759316 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5f1b40e8-bee3-441d-bd78-9a6aacc76949-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-t8cls" (UID: "5f1b40e8-bee3-441d-bd78-9a6aacc76949") : secret "cluster-monitoring-operator-tls" not found Jul 08 18:46:29.517095 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:29.517058 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-registry-tls\") pod \"image-registry-55cd4459fc-xnws9\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:46:29.517213 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:29.517205 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 18:46:29.517258 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:29.517228 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55cd4459fc-xnws9: secret "image-registry-tls" not found Jul 08 18:46:29.517291 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:29.517282 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-registry-tls podName:fdbe9304-92f1-492d-a5de-88d4cba079dd nodeName:}" failed. No retries permitted until 2026-07-08 18:46:45.517264961 +0000 UTC m=+69.387680089 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-registry-tls") pod "image-registry-55cd4459fc-xnws9" (UID: "fdbe9304-92f1-492d-a5de-88d4cba079dd") : secret "image-registry-tls" not found Jul 08 18:46:29.618148 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:29.618099 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/964fa98c-bf64-4b37-9253-444e9cde8899-metrics-tls\") pod \"dns-default-fj77w\" (UID: \"964fa98c-bf64-4b37-9253-444e9cde8899\") " pod="openshift-dns/dns-default-fj77w" Jul 08 18:46:29.618301 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:29.618250 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 18:46:29.618364 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:29.618320 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/964fa98c-bf64-4b37-9253-444e9cde8899-metrics-tls podName:964fa98c-bf64-4b37-9253-444e9cde8899 nodeName:}" failed. No retries permitted until 2026-07-08 18:46:45.618304652 +0000 UTC m=+69.488719763 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/964fa98c-bf64-4b37-9253-444e9cde8899-metrics-tls") pod "dns-default-fj77w" (UID: "964fa98c-bf64-4b37-9253-444e9cde8899") : secret "dns-default-metrics-tls" not found Jul 08 18:46:30.525110 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:30.525074 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3f0ed88e-5743-4e3a-af43-458dd2a94180-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frvqm\" (UID: \"3f0ed88e-5743-4e3a-af43-458dd2a94180\") " pod="openshift-insights/insights-runtime-extractor-frvqm" Jul 08 18:46:30.525556 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:30.525178 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f0ed88e-5743-4e3a-af43-458dd2a94180-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frvqm\" (UID: \"3f0ed88e-5743-4e3a-af43-458dd2a94180\") " pod="openshift-insights/insights-runtime-extractor-frvqm" Jul 08 18:46:30.525556 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:30.525198 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 18:46:30.525556 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:30.525269 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3f0ed88e-5743-4e3a-af43-458dd2a94180-kube-rbac-proxy-cm podName:3f0ed88e-5743-4e3a-af43-458dd2a94180 nodeName:}" failed. No retries permitted until 2026-07-08 18:46:38.525252209 +0000 UTC m=+62.395667338 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3f0ed88e-5743-4e3a-af43-458dd2a94180-kube-rbac-proxy-cm") pod "insights-runtime-extractor-frvqm" (UID: "3f0ed88e-5743-4e3a-af43-458dd2a94180") : configmap "kube-rbac-proxy" not found Jul 08 18:46:30.525556 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:30.525328 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 18:46:30.525556 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:30.525395 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f0ed88e-5743-4e3a-af43-458dd2a94180-insights-runtime-extractor-tls podName:3f0ed88e-5743-4e3a-af43-458dd2a94180 nodeName:}" failed. No retries permitted until 2026-07-08 18:46:38.525380497 +0000 UTC m=+62.395795607 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3f0ed88e-5743-4e3a-af43-458dd2a94180-insights-runtime-extractor-tls") pod "insights-runtime-extractor-frvqm" (UID: "3f0ed88e-5743-4e3a-af43-458dd2a94180") : secret "insights-runtime-extractor-tls" not found Jul 08 18:46:31.608958 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:31.608920 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:31.744707 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:31.744679 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:31.927014 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:31.926936 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:32.062778 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:32.062722 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:32.148076 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:32.148044 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:32.284500 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:32.284429 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:32.382790 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:32.382758 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:32.484852 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:32.484822 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:32.719949 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:32.719918 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:33.733541 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:33.733510 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:34.110733 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:34.110664 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:34.315940 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:34.315909 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:34.505495 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:34.505467 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:34.611144 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:34.611116 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:34.711510 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:34.711481 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:34.789968 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:34.789905 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:35.302519 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:35.302489 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:35.684524 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:35.684497 2572 scope.go:117] "RemoveContainer" containerID="e100dff979a8a9da666c68b2e36c32c8b37e5ae3e3180a62e3e9e8467bbbad07" Jul 08 18:46:35.723481 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:35.723458 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:35.867123 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:35.867094 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:35.942549 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:35.942478 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9hx2g_56065d42-401f-45fb-bf49-8885f262ad6f/console-operator/1.log" Jul 08 18:46:35.942713 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:35.942561 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-9hx2g" event={"ID":"56065d42-401f-45fb-bf49-8885f262ad6f","Type":"ContainerStarted","Data":"1ae6e913883ce1f6c272b9515aafab57962cf5ad215278e9c0b257ca58ed7f23"} Jul 08 18:46:35.942960 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:35.942943 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-9hx2g" Jul 08 18:46:35.963812 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:35.963772 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-9hx2g" podStartSLOduration=34.720096226 podStartE2EDuration="41.963758593s" totalImagesPullingTime="7.243662367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:45:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:35.962381726 +0000 UTC m=+59.832796860" watchObservedRunningTime="2026-07-08 18:46:35.963758593 +0000 UTC m=+59.834173726" Jul 08 18:46:36.120166 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:36.120084 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:36.216399 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:36.216330 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:36.316617 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:36.316575 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:36.518167 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:36.518077 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:36.519262 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:36.519240 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-9hx2g" Jul 08 18:46:36.720704 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:36.720665 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:36.820957 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:36.820874 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:36.925582 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:36.925549 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:37.023719 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:37.023691 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:37.124115 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:37.124040 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:37.224911 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:37.224887 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:37.327863 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:37.327836 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:37.590357 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:37.590325 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:37.691211 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:37.691180 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:37.794708 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:37.794680 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:37.819553 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:37.819534 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-85lsf" Jul 08 18:46:37.895160 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:37.895101 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:37.996102 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:37.996078 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:38.096797 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:38.096767 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:38.200406 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:38.200376 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:38.300922 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:38.300893 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:38.412795 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:38.412762 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:38.592400 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:38.592326 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f0ed88e-5743-4e3a-af43-458dd2a94180-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frvqm\" (UID: \"3f0ed88e-5743-4e3a-af43-458dd2a94180\") " pod="openshift-insights/insights-runtime-extractor-frvqm" Jul 08 18:46:38.592537 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:38.592418 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3f0ed88e-5743-4e3a-af43-458dd2a94180-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frvqm\" (UID: \"3f0ed88e-5743-4e3a-af43-458dd2a94180\") " pod="openshift-insights/insights-runtime-extractor-frvqm" Jul 08 18:46:38.592537 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:38.592471 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 18:46:38.592537 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:46:38.592529 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f0ed88e-5743-4e3a-af43-458dd2a94180-insights-runtime-extractor-tls podName:3f0ed88e-5743-4e3a-af43-458dd2a94180 nodeName:}" failed. No retries permitted until 2026-07-08 18:46:54.592514203 +0000 UTC m=+78.462929314 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3f0ed88e-5743-4e3a-af43-458dd2a94180-insights-runtime-extractor-tls") pod "insights-runtime-extractor-frvqm" (UID: "3f0ed88e-5743-4e3a-af43-458dd2a94180") : secret "insights-runtime-extractor-tls" not found Jul 08 18:46:38.592905 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:38.592889 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3f0ed88e-5743-4e3a-af43-458dd2a94180-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frvqm\" (UID: \"3f0ed88e-5743-4e3a-af43-458dd2a94180\") " pod="openshift-insights/insights-runtime-extractor-frvqm" Jul 08 18:46:38.700013 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:38.699985 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:38.912739 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:38.912666 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:39.111144 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:39.111113 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:39.514325 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:39.514298 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:39.622765 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:39.622735 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:39.723454 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:39.723419 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:39.918213 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:39.918187 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:40.008711 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:40.008682 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:40.298859 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:40.298775 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:40.728985 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:40.728955 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:40.901703 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:40.901674 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:41.501215 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:41.501186 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:42.104007 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:42.103976 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:42.302979 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:42.302949 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:42.323231 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:42.323209 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73c6d7ff-a154-4b84-9d4f-023fa34c19d0-metrics-certs\") pod \"network-metrics-daemon-gtkjp\" (UID: \"73c6d7ff-a154-4b84-9d4f-023fa34c19d0\") " pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:46:42.325641 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:42.325624 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 18:46:42.335883 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:42.335864 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73c6d7ff-a154-4b84-9d4f-023fa34c19d0-metrics-certs\") pod \"network-metrics-daemon-gtkjp\" (UID: \"73c6d7ff-a154-4b84-9d4f-023fa34c19d0\") " pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:46:42.424117 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:42.424087 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5mcv\" (UniqueName: \"kubernetes.io/projected/18bcf614-22b3-4603-b011-1ad2cef794ab-kube-api-access-m5mcv\") pod \"network-check-target-snhnd\" (UID: \"18bcf614-22b3-4603-b011-1ad2cef794ab\") " pod="openshift-network-diagnostics/network-check-target-snhnd" Jul 08 18:46:42.424265 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:42.424147 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/913b02f9-f3cb-4873-a4f7-0fb411ebec5f-original-pull-secret\") pod \"global-pull-secret-syncer-mxddc\" (UID: \"913b02f9-f3cb-4873-a4f7-0fb411ebec5f\") " pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:46:42.426541 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:42.426525 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5mcv\" (UniqueName: \"kubernetes.io/projected/18bcf614-22b3-4603-b011-1ad2cef794ab-kube-api-access-m5mcv\") pod \"network-check-target-snhnd\" (UID: \"18bcf614-22b3-4603-b011-1ad2cef794ab\") " pod="openshift-network-diagnostics/network-check-target-snhnd" Jul 08 18:46:42.426929 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:42.426904 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 18:46:42.436764 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:42.436743 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/913b02f9-f3cb-4873-a4f7-0fb411ebec5f-original-pull-secret\") pod \"global-pull-secret-syncer-mxddc\" (UID: \"913b02f9-f3cb-4873-a4f7-0fb411ebec5f\") " pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:46:42.498033 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:42.498004 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:42.520183 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:42.520156 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5bv4l\"" Jul 08 18:46:42.528517 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:42.528504 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtkjp" Jul 08 18:46:42.531837 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:42.531823 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zrdnt\"" Jul 08 18:46:42.533727 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:42.533715 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxddc" Jul 08 18:46:42.540650 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:42.540627 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snhnd" Jul 08 18:46:42.690933 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:42.690904 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mxddc"] Jul 08 18:46:42.694836 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:46:42.694805 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod913b02f9_f3cb_4873_a4f7_0fb411ebec5f.slice/crio-f46194910b7f0fa120edd28a67574b3709fcdaa2fac297489b1928939f8170b9 WatchSource:0}: Error finding container f46194910b7f0fa120edd28a67574b3709fcdaa2fac297489b1928939f8170b9: Status 404 returned error can't find the container with id f46194910b7f0fa120edd28a67574b3709fcdaa2fac297489b1928939f8170b9 Jul 08 18:46:42.697851 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:42.697831 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:42.706290 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:42.706263 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gtkjp"] Jul 08 18:46:42.708867 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:46:42.708841 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73c6d7ff_a154_4b84_9d4f_023fa34c19d0.slice/crio-f3bd9dfd92fc50ed4b513a7dcda6e94f13b73a1fa4f63171eff043348ae5046f WatchSource:0}: Error finding container f3bd9dfd92fc50ed4b513a7dcda6e94f13b73a1fa4f63171eff043348ae5046f: Status 404 returned error can't find the container with id f3bd9dfd92fc50ed4b513a7dcda6e94f13b73a1fa4f63171eff043348ae5046f Jul 08 18:46:42.725180 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:42.725159 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-snhnd"] Jul 08 18:46:42.728014 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:46:42.727997 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18bcf614_22b3_4603_b011_1ad2cef794ab.slice/crio-afe2baf9690a35f8bd5f95280674dcd5ef288c66de768fcfce22a32cfc598d50 WatchSource:0}: Error finding container afe2baf9690a35f8bd5f95280674dcd5ef288c66de768fcfce22a32cfc598d50: Status 404 returned error can't find the container with id afe2baf9690a35f8bd5f95280674dcd5ef288c66de768fcfce22a32cfc598d50 Jul 08 18:46:42.962449 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:42.962371 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gtkjp" event={"ID":"73c6d7ff-a154-4b84-9d4f-023fa34c19d0","Type":"ContainerStarted","Data":"f3bd9dfd92fc50ed4b513a7dcda6e94f13b73a1fa4f63171eff043348ae5046f"} Jul 08 18:46:42.963820 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:42.963761 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-snhnd" event={"ID":"18bcf614-22b3-4603-b011-1ad2cef794ab","Type":"ContainerStarted","Data":"3039c0dab442287eff562c603574be66b076d2868b2abd9212a75b00fac40e5e"} Jul 08 18:46:42.963945 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:42.963826 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-snhnd" event={"ID":"18bcf614-22b3-4603-b011-1ad2cef794ab","Type":"ContainerStarted","Data":"afe2baf9690a35f8bd5f95280674dcd5ef288c66de768fcfce22a32cfc598d50"} Jul 08 18:46:42.963945 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:42.963876 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-snhnd" Jul 08 18:46:42.964851 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:42.964834 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mxddc" event={"ID":"913b02f9-f3cb-4873-a4f7-0fb411ebec5f","Type":"ContainerStarted","Data":"f46194910b7f0fa120edd28a67574b3709fcdaa2fac297489b1928939f8170b9"} Jul 08 18:46:42.982845 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:42.982800 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-snhnd" podStartSLOduration=66.98278673 podStartE2EDuration="1m6.98278673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:45:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:42.981779996 +0000 UTC m=+66.852195131" watchObservedRunningTime="2026-07-08 18:46:42.98278673 +0000 UTC m=+66.853201863" Jul 08 18:46:44.221874 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:44.221838 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:44.974396 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:44.974361 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gtkjp" event={"ID":"73c6d7ff-a154-4b84-9d4f-023fa34c19d0","Type":"ContainerStarted","Data":"f7869bceb34910289af7226f339bd461d87a68eff4fa0e21357b7cba39b3adb1"} Jul 08 18:46:44.974577 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:44.974419 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gtkjp" event={"ID":"73c6d7ff-a154-4b84-9d4f-023fa34c19d0","Type":"ContainerStarted","Data":"780b5c63b51c3d746f6832511f76ca62c28246e76659dae4306f812d4591c819"} Jul 08 18:46:45.005748 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:45.005703 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gtkjp" podStartSLOduration=67.84678202 podStartE2EDuration="1m9.005687335s" totalImagesPullingTime="1.158905315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:45:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:45.004020978 +0000 UTC m=+68.874436113" watchObservedRunningTime="2026-07-08 18:46:45.005687335 +0000 UTC m=+68.876102468" Jul 08 18:46:45.450859 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:45.450809 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f1b40e8-bee3-441d-bd78-9a6aacc76949-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-t8cls\" (UID: \"5f1b40e8-bee3-441d-bd78-9a6aacc76949\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t8cls" Jul 08 18:46:45.451302 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:45.450918 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7b5def05-a0ed-4512-b1a2-140a051040cf-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5twjz\" (UID: \"7b5def05-a0ed-4512-b1a2-140a051040cf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5twjz" Jul 08 18:46:45.451302 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:45.450947 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd1908b4-810a-4f1d-b172-47ddfe11befe-service-ca-bundle\") pod \"router-default-86b55bc475-2qk57\" (UID: \"dd1908b4-810a-4f1d-b172-47ddfe11befe\") " pod="openshift-ingress/router-default-86b55bc475-2qk57" Jul 08 18:46:45.451302 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:45.450975 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd1908b4-810a-4f1d-b172-47ddfe11befe-metrics-certs\") pod \"router-default-86b55bc475-2qk57\" (UID: \"dd1908b4-810a-4f1d-b172-47ddfe11befe\") " pod="openshift-ingress/router-default-86b55bc475-2qk57" Jul 08 18:46:45.451775 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:45.451745 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd1908b4-810a-4f1d-b172-47ddfe11befe-service-ca-bundle\") pod \"router-default-86b55bc475-2qk57\" (UID: \"dd1908b4-810a-4f1d-b172-47ddfe11befe\") " pod="openshift-ingress/router-default-86b55bc475-2qk57" Jul 08 18:46:45.453755 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:45.453725 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f1b40e8-bee3-441d-bd78-9a6aacc76949-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-t8cls\" (UID: \"5f1b40e8-bee3-441d-bd78-9a6aacc76949\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t8cls" Jul 08 18:46:45.453860 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:45.453807 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7b5def05-a0ed-4512-b1a2-140a051040cf-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-5twjz\" (UID: \"7b5def05-a0ed-4512-b1a2-140a051040cf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5twjz" Jul 08 18:46:45.453923 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:45.453852 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd1908b4-810a-4f1d-b172-47ddfe11befe-metrics-certs\") pod \"router-default-86b55bc475-2qk57\" (UID: \"dd1908b4-810a-4f1d-b172-47ddfe11befe\") " pod="openshift-ingress/router-default-86b55bc475-2qk57" Jul 08 18:46:45.551987 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:45.551955 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-registry-tls\") pod \"image-registry-55cd4459fc-xnws9\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:46:45.554177 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:45.554157 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-registry-tls\") pod \"image-registry-55cd4459fc-xnws9\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:46:45.615627 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:45.615602 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7tbnm\"" Jul 08 18:46:45.623580 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:45.623555 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t8cls" Jul 08 18:46:45.628426 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:45.628402 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-gkm9k\"" Jul 08 18:46:45.637327 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:45.637309 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5twjz" Jul 08 18:46:45.646204 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:45.646187 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ljx7c\"" Jul 08 18:46:45.652620 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:45.652582 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/964fa98c-bf64-4b37-9253-444e9cde8899-metrics-tls\") pod \"dns-default-fj77w\" (UID: \"964fa98c-bf64-4b37-9253-444e9cde8899\") " pod="openshift-dns/dns-default-fj77w" Jul 08 18:46:45.654025 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:45.654006 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-86b55bc475-2qk57" Jul 08 18:46:45.654885 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:45.654862 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/964fa98c-bf64-4b37-9253-444e9cde8899-metrics-tls\") pod \"dns-default-fj77w\" (UID: \"964fa98c-bf64-4b37-9253-444e9cde8899\") " pod="openshift-dns/dns-default-fj77w" Jul 08 18:46:45.739177 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:45.738395 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sbfpk\"" Jul 08 18:46:45.746921 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:45.746887 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:46:45.778843 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:45.778752 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t8cls"] Jul 08 18:46:45.797909 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:45.797884 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5twjz"] Jul 08 18:46:45.826102 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:45.826057 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k5jtp\"" Jul 08 18:46:45.831568 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:45.831449 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-86b55bc475-2qk57"] Jul 08 18:46:45.834638 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:45.834613 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fj77w" Jul 08 18:46:47.192050 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:46:47.192013 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1b40e8_bee3_441d_bd78_9a6aacc76949.slice/crio-d7538950e0f5de7a36a6aa5cf7a179c5378a5e2987f35f628f04e25ec6d1ad1b WatchSource:0}: Error finding container d7538950e0f5de7a36a6aa5cf7a179c5378a5e2987f35f628f04e25ec6d1ad1b: Status 404 returned error can't find the container with id d7538950e0f5de7a36a6aa5cf7a179c5378a5e2987f35f628f04e25ec6d1ad1b Jul 08 18:46:47.193162 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:46:47.192969 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd1908b4_810a_4f1d_b172_47ddfe11befe.slice/crio-29b0e19db3964cf7c700d90d8bd36444c0078a4972838482e4f14f04098c4521 WatchSource:0}: Error finding container 29b0e19db3964cf7c700d90d8bd36444c0078a4972838482e4f14f04098c4521: Status 404 returned error can't find the container with id 29b0e19db3964cf7c700d90d8bd36444c0078a4972838482e4f14f04098c4521 Jul 08 18:46:47.334091 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:47.334062 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55cd4459fc-xnws9"] Jul 08 18:46:47.336751 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:46:47.336710 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdbe9304_92f1_492d_a5de_88d4cba079dd.slice/crio-88bf1e6fea1236467bb6c354df7b2747e6a048f07e6a22fe3cfe07011a76bc88 WatchSource:0}: Error finding container 88bf1e6fea1236467bb6c354df7b2747e6a048f07e6a22fe3cfe07011a76bc88: Status 404 returned error can't find the container with id 88bf1e6fea1236467bb6c354df7b2747e6a048f07e6a22fe3cfe07011a76bc88 Jul 08 18:46:47.348211 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:47.348188 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fj77w"] Jul 08 18:46:47.350948 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:46:47.350928 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod964fa98c_bf64_4b37_9253_444e9cde8899.slice/crio-c337464c97c600a8de4c9aadee650d0cdd13d3b3a1ec18db1b5723ba9cecbc5a WatchSource:0}: Error finding container c337464c97c600a8de4c9aadee650d0cdd13d3b3a1ec18db1b5723ba9cecbc5a: Status 404 returned error can't find the container with id c337464c97c600a8de4c9aadee650d0cdd13d3b3a1ec18db1b5723ba9cecbc5a Jul 08 18:46:47.988801 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:47.988265 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mxddc" event={"ID":"913b02f9-f3cb-4873-a4f7-0fb411ebec5f","Type":"ContainerStarted","Data":"c7f9c40cce912a81a7904f2f4a86304b5de454c446ead9b409594e1d1a1780a8"} Jul 08 18:46:47.990340 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:47.990260 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fj77w" event={"ID":"964fa98c-bf64-4b37-9253-444e9cde8899","Type":"ContainerStarted","Data":"c337464c97c600a8de4c9aadee650d0cdd13d3b3a1ec18db1b5723ba9cecbc5a"} Jul 08 18:46:47.994476 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:47.994446 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" event={"ID":"fdbe9304-92f1-492d-a5de-88d4cba079dd","Type":"ContainerStarted","Data":"e7f88c85541f191a2ccc93cf8df84a934b7b45fca447faf2932d433c7e700472"} Jul 08 18:46:47.994605 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:47.994490 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" event={"ID":"fdbe9304-92f1-492d-a5de-88d4cba079dd","Type":"ContainerStarted","Data":"88bf1e6fea1236467bb6c354df7b2747e6a048f07e6a22fe3cfe07011a76bc88"} Jul 08 18:46:47.994946 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:47.994892 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:46:47.996848 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:47.996626 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-86b55bc475-2qk57" event={"ID":"dd1908b4-810a-4f1d-b172-47ddfe11befe","Type":"ContainerStarted","Data":"cab2dcb637ca8584081f97832fe37d2f8c229deb5a4c83f8f14d7c5697d57e94"} Jul 08 18:46:47.996848 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:47.996676 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-86b55bc475-2qk57" event={"ID":"dd1908b4-810a-4f1d-b172-47ddfe11befe","Type":"ContainerStarted","Data":"29b0e19db3964cf7c700d90d8bd36444c0078a4972838482e4f14f04098c4521"} Jul 08 18:46:47.999059 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:47.999034 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5twjz" event={"ID":"7b5def05-a0ed-4512-b1a2-140a051040cf","Type":"ContainerStarted","Data":"a0aaa7eabf2fbb50e3c2a8ede2d4d039e572af739761bb487ff0c8f3dbece456"} Jul 08 18:46:48.000267 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:48.000247 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t8cls" event={"ID":"5f1b40e8-bee3-441d-bd78-9a6aacc76949","Type":"ContainerStarted","Data":"d7538950e0f5de7a36a6aa5cf7a179c5378a5e2987f35f628f04e25ec6d1ad1b"} Jul 08 18:46:48.006126 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:48.006072 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mxddc" podStartSLOduration=66.062867658 podStartE2EDuration="1m11.006031345s" totalImagesPullingTime="4.943163687s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:45:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:48.005464859 +0000 UTC m=+71.875879993" watchObservedRunningTime="2026-07-08 18:46:48.006031345 +0000 UTC m=+71.876446478" Jul 08 18:46:48.026444 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:48.026389 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-86b55bc475-2qk57" podStartSLOduration=54.026372601 podStartE2EDuration="54.026372601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:45:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:48.025101116 +0000 UTC m=+71.895516251" watchObservedRunningTime="2026-07-08 18:46:48.026372601 +0000 UTC m=+71.896787734" Jul 08 18:46:48.044375 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:48.044334 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" podStartSLOduration=71.044322204 podStartE2EDuration="1m11.044322204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:45:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:48.04362256 +0000 UTC m=+71.914037693" watchObservedRunningTime="2026-07-08 18:46:48.044322204 +0000 UTC m=+71.914737338" Jul 08 18:46:48.654810 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:48.654776 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-86b55bc475-2qk57" Jul 08 18:46:48.657953 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:48.657908 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-86b55bc475-2qk57" Jul 08 18:46:49.004410 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:49.004380 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-86b55bc475-2qk57" Jul 08 18:46:49.005808 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:49.005785 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-86b55bc475-2qk57" Jul 08 18:46:50.339828 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.339735 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:50.438523 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.438487 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:50.583505 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.583475 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:50.688950 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.688928 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59cccb7d4b-cqwc6"] Jul 08 18:46:50.709123 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.709091 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:50.709860 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.709838 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59cccb7d4b-cqwc6"] Jul 08 18:46:50.709944 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.709937 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cccb7d4b-cqwc6" Jul 08 18:46:50.714353 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.714336 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 08 18:46:50.714561 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.714544 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 08 18:46:50.714818 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.714802 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 08 18:46:50.715370 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.715353 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 08 18:46:50.715370 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.715353 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 08 18:46:50.715497 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.715377 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 08 18:46:50.715663 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.715647 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 08 18:46:50.716688 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.716667 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wqtlv\"" Jul 08 18:46:50.720210 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.720194 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 08 18:46:50.795121 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.795096 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-service-ca\") pod \"console-59cccb7d4b-cqwc6\" (UID: \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\") " pod="openshift-console/console-59cccb7d4b-cqwc6" Jul 08 18:46:50.795216 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.795138 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-console-oauth-config\") pod \"console-59cccb7d4b-cqwc6\" (UID: \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\") " pod="openshift-console/console-59cccb7d4b-cqwc6" Jul 08 18:46:50.795216 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.795160 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n7ct\" (UniqueName: \"kubernetes.io/projected/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-kube-api-access-5n7ct\") pod \"console-59cccb7d4b-cqwc6\" (UID: \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\") " pod="openshift-console/console-59cccb7d4b-cqwc6" Jul 08 18:46:50.795303 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.795215 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-oauth-serving-cert\") pod \"console-59cccb7d4b-cqwc6\" (UID: \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\") " pod="openshift-console/console-59cccb7d4b-cqwc6" Jul 08 18:46:50.795303 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.795246 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-console-config\") pod \"console-59cccb7d4b-cqwc6\" (UID: \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\") " pod="openshift-console/console-59cccb7d4b-cqwc6" Jul 08 18:46:50.795303 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.795267 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-trusted-ca-bundle\") pod \"console-59cccb7d4b-cqwc6\" (UID: \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\") " pod="openshift-console/console-59cccb7d4b-cqwc6" Jul 08 18:46:50.795409 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.795320 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-console-serving-cert\") pod \"console-59cccb7d4b-cqwc6\" (UID: \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\") " pod="openshift-console/console-59cccb7d4b-cqwc6" Jul 08 18:46:50.809006 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.808979 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:50.896188 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.896166 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-console-serving-cert\") pod \"console-59cccb7d4b-cqwc6\" (UID: \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\") " pod="openshift-console/console-59cccb7d4b-cqwc6" Jul 08 18:46:50.896295 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.896215 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-service-ca\") pod \"console-59cccb7d4b-cqwc6\" (UID: \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\") " pod="openshift-console/console-59cccb7d4b-cqwc6" Jul 08 18:46:50.896295 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.896246 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-console-oauth-config\") pod \"console-59cccb7d4b-cqwc6\" (UID: \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\") " pod="openshift-console/console-59cccb7d4b-cqwc6" Jul 08 18:46:50.896295 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.896265 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n7ct\" (UniqueName: \"kubernetes.io/projected/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-kube-api-access-5n7ct\") pod \"console-59cccb7d4b-cqwc6\" (UID: \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\") " pod="openshift-console/console-59cccb7d4b-cqwc6" Jul 08 18:46:50.896295 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.896289 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-oauth-serving-cert\") pod \"console-59cccb7d4b-cqwc6\" (UID: \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\") " pod="openshift-console/console-59cccb7d4b-cqwc6" Jul 08 18:46:50.896821 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.896610 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-console-config\") pod \"console-59cccb7d4b-cqwc6\" (UID: \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\") " pod="openshift-console/console-59cccb7d4b-cqwc6" Jul 08 18:46:50.896821 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.896655 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-trusted-ca-bundle\") pod \"console-59cccb7d4b-cqwc6\" (UID: \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\") " pod="openshift-console/console-59cccb7d4b-cqwc6" Jul 08 18:46:50.897045 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.897022 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-oauth-serving-cert\") pod \"console-59cccb7d4b-cqwc6\" (UID: \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\") " pod="openshift-console/console-59cccb7d4b-cqwc6" Jul 08 18:46:50.897254 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.897230 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-service-ca\") pod \"console-59cccb7d4b-cqwc6\" (UID: \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\") " pod="openshift-console/console-59cccb7d4b-cqwc6" Jul 08 18:46:50.897580 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.897558 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-console-config\") pod \"console-59cccb7d4b-cqwc6\" (UID: \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\") " pod="openshift-console/console-59cccb7d4b-cqwc6" Jul 08 18:46:50.897903 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.897871 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-trusted-ca-bundle\") pod \"console-59cccb7d4b-cqwc6\" (UID: \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\") " pod="openshift-console/console-59cccb7d4b-cqwc6" Jul 08 18:46:50.899682 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.899641 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-console-oauth-config\") pod \"console-59cccb7d4b-cqwc6\" (UID: \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\") " pod="openshift-console/console-59cccb7d4b-cqwc6" Jul 08 18:46:50.900175 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.900151 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-console-serving-cert\") pod \"console-59cccb7d4b-cqwc6\" (UID: \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\") " pod="openshift-console/console-59cccb7d4b-cqwc6" Jul 08 18:46:50.905981 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:50.905956 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n7ct\" (UniqueName: \"kubernetes.io/projected/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-kube-api-access-5n7ct\") pod \"console-59cccb7d4b-cqwc6\" (UID: \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\") " pod="openshift-console/console-59cccb7d4b-cqwc6" Jul 08 18:46:51.014199 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:51.014163 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t8cls" event={"ID":"5f1b40e8-bee3-441d-bd78-9a6aacc76949","Type":"ContainerStarted","Data":"c6a30010d048a72c050396b529eab0705e900a1be0f344eb38b182ffb8083750"} Jul 08 18:46:51.015914 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:51.015821 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fj77w" event={"ID":"964fa98c-bf64-4b37-9253-444e9cde8899","Type":"ContainerStarted","Data":"982a43335069c819ed86110ced1d8e23e1335560e20289d62e1285e625d9edf9"} Jul 08 18:46:51.018346 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:51.018321 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5twjz" event={"ID":"7b5def05-a0ed-4512-b1a2-140a051040cf","Type":"ContainerStarted","Data":"9860e9c4adbe6e0b843dc71265e00cb414a2bb41c80729630d97c9c9dc32e939"} Jul 08 18:46:51.019651 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:51.019521 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cccb7d4b-cqwc6" Jul 08 18:46:51.225316 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:51.225280 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59cccb7d4b-cqwc6"] Jul 08 18:46:51.229759 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:46:51.229723 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67aac4c8_9fe8_4a0b_9e3f_439c497e03ad.slice/crio-38fdd3d691b904ec5389be281199208cfce07d75f7d1f4c1ac22189f769f43a1 WatchSource:0}: Error finding container 38fdd3d691b904ec5389be281199208cfce07d75f7d1f4c1ac22189f769f43a1: Status 404 returned error can't find the container with id 38fdd3d691b904ec5389be281199208cfce07d75f7d1f4c1ac22189f769f43a1 Jul 08 18:46:51.332680 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:51.332640 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:51.432681 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:51.432614 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:51.503577 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:51.503524 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:51.880140 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:51.880074 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:52.024240 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:52.024200 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5twjz" event={"ID":"7b5def05-a0ed-4512-b1a2-140a051040cf","Type":"ContainerStarted","Data":"ea33d480734d26ff36184a08d10319a7d10748f500353d2109338680d5eee7cf"} Jul 08 18:46:52.026471 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:52.026445 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fj77w" event={"ID":"964fa98c-bf64-4b37-9253-444e9cde8899","Type":"ContainerStarted","Data":"7e4d85456aef9e2aabc6d1c43c67c8c8ab618432e959058ee035b509361cdb98"} Jul 08 18:46:52.026630 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:52.026506 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fj77w" Jul 08 18:46:52.027841 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:52.027815 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cccb7d4b-cqwc6" event={"ID":"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad","Type":"ContainerStarted","Data":"38fdd3d691b904ec5389be281199208cfce07d75f7d1f4c1ac22189f769f43a1"} Jul 08 18:46:52.048008 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:52.047956 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-5twjz" podStartSLOduration=54.448016057 podStartE2EDuration="58.047939843s" totalImagesPullingTime="3.599923786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:45:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:52.046395266 +0000 UTC m=+75.916810400" watchObservedRunningTime="2026-07-08 18:46:52.047939843 +0000 UTC m=+75.918354976" Jul 08 18:46:52.069468 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:52.069415 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t8cls" podStartSLOduration=55.405524178 podStartE2EDuration="59.069397944s" totalImagesPullingTime="3.663873766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:45:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:52.06872395 +0000 UTC m=+75.939139088" watchObservedRunningTime="2026-07-08 18:46:52.069397944 +0000 UTC m=+75.939813079" Jul 08 18:46:52.095118 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:52.095079 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fj77w" podStartSLOduration=35.585837605 podStartE2EDuration="39.095066128s" totalImagesPullingTime="3.509228523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:46:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:52.093754087 +0000 UTC m=+75.964169221" watchObservedRunningTime="2026-07-08 18:46:52.095066128 +0000 UTC m=+75.965481268" Jul 08 18:46:54.627567 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:54.627528 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f0ed88e-5743-4e3a-af43-458dd2a94180-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frvqm\" (UID: \"3f0ed88e-5743-4e3a-af43-458dd2a94180\") " pod="openshift-insights/insights-runtime-extractor-frvqm" Jul 08 18:46:54.629718 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:54.629699 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f0ed88e-5743-4e3a-af43-458dd2a94180-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frvqm\" (UID: \"3f0ed88e-5743-4e3a-af43-458dd2a94180\") " pod="openshift-insights/insights-runtime-extractor-frvqm" Jul 08 18:46:54.886872 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:54.886802 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:54.930028 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:54.930005 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4nhln\"" Jul 08 18:46:54.938888 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:54.938870 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-frvqm" Jul 08 18:46:54.945326 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:54.945292 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:55.093500 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:55.093461 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-frvqm"] Jul 08 18:46:55.097319 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:46:55.097281 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f0ed88e_5743_4e3a_af43_458dd2a94180.slice/crio-ab5e5ddba96246d9772100f895b5c506d199dbbd27dde5c40f445346f7e6524f WatchSource:0}: Error finding container ab5e5ddba96246d9772100f895b5c506d199dbbd27dde5c40f445346f7e6524f: Status 404 returned error can't find the container with id ab5e5ddba96246d9772100f895b5c506d199dbbd27dde5c40f445346f7e6524f Jul 08 18:46:56.044991 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:56.044954 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-frvqm" event={"ID":"3f0ed88e-5743-4e3a-af43-458dd2a94180","Type":"ContainerStarted","Data":"ab5e5ddba96246d9772100f895b5c506d199dbbd27dde5c40f445346f7e6524f"} Jul 08 18:46:56.047290 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:56.047199 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cccb7d4b-cqwc6" event={"ID":"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad","Type":"ContainerStarted","Data":"ae486b52f487d2731e8d17665a98a6e4418652e5bf72e90edd7c0e9970c0ea85"} Jul 08 18:46:56.074247 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:56.073922 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59cccb7d4b-cqwc6" podStartSLOduration=2.356624029 podStartE2EDuration="6.073901136s" totalImagesPullingTime="3.717277107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:46:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:56.071436729 +0000 UTC m=+79.941851873" watchObservedRunningTime="2026-07-08 18:46:56.073901136 +0000 UTC m=+79.944316270" Jul 08 18:46:58.030569 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:58.030516 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:58.096977 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:58.096833 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:58.491024 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:58.490992 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:58.596272 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:58.596236 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:46:59.060893 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:59.060862 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-frvqm" event={"ID":"3f0ed88e-5743-4e3a-af43-458dd2a94180","Type":"ContainerStarted","Data":"84e29c821b5d6373073e329bda08ccc7031a7101d15e56caad6807c6da7ef914"} Jul 08 18:46:59.265876 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:46:59.265848 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:00.067103 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:00.067064 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-frvqm" event={"ID":"3f0ed88e-5743-4e3a-af43-458dd2a94180","Type":"ContainerStarted","Data":"e7b0d26d1e249c337f251fbe52db353994810ed4702459daf494100d7b30c9f3"} Jul 08 18:47:01.020059 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:01.020027 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59cccb7d4b-cqwc6" Jul 08 18:47:01.020271 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:01.020094 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59cccb7d4b-cqwc6" Jul 08 18:47:01.021756 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:01.021726 2572 patch_prober.go:28] interesting pod/console-59cccb7d4b-cqwc6 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" start-of-body= Jul 08 18:47:01.021874 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:01.021778 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-59cccb7d4b-cqwc6" podUID="67aac4c8-9fe8-4a0b-9e3f-439c497e03ad" containerName="console" probeResult="failure" output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" Jul 08 18:47:01.245969 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:01.245934 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:01.340321 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:01.340242 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:02.033649 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:02.033535 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fj77w" Jul 08 18:47:02.077448 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:02.077371 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-frvqm" event={"ID":"3f0ed88e-5743-4e3a-af43-458dd2a94180","Type":"ContainerStarted","Data":"85277ffacee5151a81780c95c09575356eb7bdb56306d83fadbbf7385cf825d5"} Jul 08 18:47:02.101629 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:02.101560 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-frvqm" podStartSLOduration=33.49200479 podStartE2EDuration="40.101544783s" totalImagesPullingTime="6.609539993s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:46:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:47:02.100197967 +0000 UTC m=+85.970613101" watchObservedRunningTime="2026-07-08 18:47:02.101544783 +0000 UTC m=+85.971959916" Jul 08 18:47:02.652778 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:02.652746 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:02.718489 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:02.718457 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:05.751607 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:05.751557 2572 patch_prober.go:28] interesting pod/image-registry-55cd4459fc-xnws9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 08 18:47:05.751973 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:05.751643 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" podUID="fdbe9304-92f1-492d-a5de-88d4cba079dd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 18:47:06.430827 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:06.430793 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:06.494850 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:06.494818 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:09.009213 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:09.009188 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:47:09.211242 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:09.211206 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:09.272041 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:09.271973 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:10.724734 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:10.724703 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:10.785333 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:10.785310 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:11.024262 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:11.024194 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59cccb7d4b-cqwc6" Jul 08 18:47:11.028715 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:11.028693 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59cccb7d4b-cqwc6" Jul 08 18:47:11.182509 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:11.182459 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:11.278522 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:11.278440 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:11.645573 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:11.645497 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:11.698560 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:11.698529 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:11.856983 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:11.856952 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:11.982042 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:11.982013 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:12.636316 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:12.636287 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:12.832522 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:12.832492 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:12.878451 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:12.878423 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxx9k"] Jul 08 18:47:12.881423 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:12.881407 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxx9k" Jul 08 18:47:12.884424 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:12.884401 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 08 18:47:12.884563 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:12.884436 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 18:47:12.884563 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:12.884437 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 08 18:47:12.884563 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:12.884440 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-wcwkq\"" Jul 08 18:47:12.885742 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:12.885723 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zz7rd"] Jul 08 18:47:12.888085 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:12.888024 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zz7rd" Jul 08 18:47:12.888842 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:12.888807 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pxlrd"] Jul 08 18:47:12.890117 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:12.890099 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 18:47:12.890642 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:12.890611 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 18:47:12.891477 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:12.891456 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pxlrd" Jul 08 18:47:12.891948 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:12.891927 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 18:47:12.892047 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:12.891964 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q7zvb\"" Jul 08 18:47:12.892047 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:12.891927 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxx9k"] Jul 08 18:47:12.893555 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:12.893535 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 08 18:47:12.893679 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:12.893576 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 08 18:47:12.893785 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:12.893767 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 08 18:47:12.893881 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:12.893856 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-m8q5l\"" Jul 08 18:47:12.903787 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:12.903763 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pxlrd"] Jul 08 18:47:12.938322 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:12.938288 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:13.020296 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.020262 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:13.069497 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.069472 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/44ccee63-46df-4ca2-b8c2-5ac4656a6812-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-pxlrd\" (UID: \"44ccee63-46df-4ca2-b8c2-5ac4656a6812\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pxlrd" Jul 08 18:47:13.069653 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.069503 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f4dad549-ed19-43bf-820d-8e87a0d8ec96-node-exporter-accelerators-collector-config\") pod \"node-exporter-zz7rd\" (UID: \"f4dad549-ed19-43bf-820d-8e87a0d8ec96\") " pod="openshift-monitoring/node-exporter-zz7rd" Jul 08 18:47:13.069653 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.069526 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f4dad549-ed19-43bf-820d-8e87a0d8ec96-node-exporter-textfile\") pod \"node-exporter-zz7rd\" (UID: \"f4dad549-ed19-43bf-820d-8e87a0d8ec96\") " pod="openshift-monitoring/node-exporter-zz7rd" Jul 08 18:47:13.069653 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.069550 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f4dad549-ed19-43bf-820d-8e87a0d8ec96-node-exporter-wtmp\") pod \"node-exporter-zz7rd\" (UID: \"f4dad549-ed19-43bf-820d-8e87a0d8ec96\") " pod="openshift-monitoring/node-exporter-zz7rd" Jul 08 18:47:13.069653 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.069634 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1949d81d-2d64-4ee1-a3f6-72de33b17eea-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-lxx9k\" (UID: \"1949d81d-2d64-4ee1-a3f6-72de33b17eea\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxx9k" Jul 08 18:47:13.069877 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.069668 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4dad549-ed19-43bf-820d-8e87a0d8ec96-metrics-client-ca\") pod \"node-exporter-zz7rd\" (UID: \"f4dad549-ed19-43bf-820d-8e87a0d8ec96\") " pod="openshift-monitoring/node-exporter-zz7rd" Jul 08 18:47:13.069877 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.069707 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1949d81d-2d64-4ee1-a3f6-72de33b17eea-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-lxx9k\" (UID: \"1949d81d-2d64-4ee1-a3f6-72de33b17eea\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxx9k" Jul 08 18:47:13.069877 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.069733 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqz52\" (UniqueName: \"kubernetes.io/projected/1949d81d-2d64-4ee1-a3f6-72de33b17eea-kube-api-access-kqz52\") pod \"openshift-state-metrics-54cf96dfcf-lxx9k\" (UID: \"1949d81d-2d64-4ee1-a3f6-72de33b17eea\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxx9k" Jul 08 18:47:13.069877 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.069765 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/44ccee63-46df-4ca2-b8c2-5ac4656a6812-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-pxlrd\" (UID: \"44ccee63-46df-4ca2-b8c2-5ac4656a6812\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pxlrd" Jul 08 18:47:13.069877 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.069788 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4dad549-ed19-43bf-820d-8e87a0d8ec96-sys\") pod \"node-exporter-zz7rd\" (UID: \"f4dad549-ed19-43bf-820d-8e87a0d8ec96\") " pod="openshift-monitoring/node-exporter-zz7rd" Jul 08 18:47:13.069877 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.069827 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc526\" (UniqueName: \"kubernetes.io/projected/f4dad549-ed19-43bf-820d-8e87a0d8ec96-kube-api-access-fc526\") pod \"node-exporter-zz7rd\" (UID: \"f4dad549-ed19-43bf-820d-8e87a0d8ec96\") " pod="openshift-monitoring/node-exporter-zz7rd" Jul 08 18:47:13.069877 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.069863 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z67cc\" (UniqueName: \"kubernetes.io/projected/44ccee63-46df-4ca2-b8c2-5ac4656a6812-kube-api-access-z67cc\") pod \"kube-state-metrics-7c9dbb8b7d-pxlrd\" (UID: \"44ccee63-46df-4ca2-b8c2-5ac4656a6812\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pxlrd" Jul 08 18:47:13.070158 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.069883 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f4dad549-ed19-43bf-820d-8e87a0d8ec96-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zz7rd\" (UID: \"f4dad549-ed19-43bf-820d-8e87a0d8ec96\") " pod="openshift-monitoring/node-exporter-zz7rd" Jul 08 18:47:13.070158 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.069903 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1949d81d-2d64-4ee1-a3f6-72de33b17eea-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-lxx9k\" (UID: \"1949d81d-2d64-4ee1-a3f6-72de33b17eea\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxx9k" Jul 08 18:47:13.070158 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.069978 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44ccee63-46df-4ca2-b8c2-5ac4656a6812-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-pxlrd\" (UID: \"44ccee63-46df-4ca2-b8c2-5ac4656a6812\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pxlrd" Jul 08 18:47:13.070158 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.070030 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/44ccee63-46df-4ca2-b8c2-5ac4656a6812-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-pxlrd\" (UID: \"44ccee63-46df-4ca2-b8c2-5ac4656a6812\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pxlrd" Jul 08 18:47:13.070158 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.070059 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f4dad549-ed19-43bf-820d-8e87a0d8ec96-node-exporter-tls\") pod \"node-exporter-zz7rd\" (UID: \"f4dad549-ed19-43bf-820d-8e87a0d8ec96\") " pod="openshift-monitoring/node-exporter-zz7rd" Jul 08 18:47:13.070158 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.070143 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f4dad549-ed19-43bf-820d-8e87a0d8ec96-root\") pod \"node-exporter-zz7rd\" (UID: \"f4dad549-ed19-43bf-820d-8e87a0d8ec96\") " pod="openshift-monitoring/node-exporter-zz7rd" Jul 08 18:47:13.070428 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.070173 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/44ccee63-46df-4ca2-b8c2-5ac4656a6812-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-pxlrd\" (UID: \"44ccee63-46df-4ca2-b8c2-5ac4656a6812\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pxlrd" Jul 08 18:47:13.111990 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.111969 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-55cd4459fc-xnws9"] Jul 08 18:47:13.171570 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.171539 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc526\" (UniqueName: \"kubernetes.io/projected/f4dad549-ed19-43bf-820d-8e87a0d8ec96-kube-api-access-fc526\") pod \"node-exporter-zz7rd\" (UID: \"f4dad549-ed19-43bf-820d-8e87a0d8ec96\") " pod="openshift-monitoring/node-exporter-zz7rd" Jul 08 18:47:13.171728 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.171583 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z67cc\" (UniqueName: \"kubernetes.io/projected/44ccee63-46df-4ca2-b8c2-5ac4656a6812-kube-api-access-z67cc\") pod \"kube-state-metrics-7c9dbb8b7d-pxlrd\" (UID: \"44ccee63-46df-4ca2-b8c2-5ac4656a6812\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pxlrd" Jul 08 18:47:13.171728 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.171625 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f4dad549-ed19-43bf-820d-8e87a0d8ec96-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zz7rd\" (UID: \"f4dad549-ed19-43bf-820d-8e87a0d8ec96\") " pod="openshift-monitoring/node-exporter-zz7rd" Jul 08 18:47:13.171728 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.171655 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1949d81d-2d64-4ee1-a3f6-72de33b17eea-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-lxx9k\" (UID: \"1949d81d-2d64-4ee1-a3f6-72de33b17eea\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxx9k" Jul 08 18:47:13.171728 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.171689 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44ccee63-46df-4ca2-b8c2-5ac4656a6812-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-pxlrd\" (UID: \"44ccee63-46df-4ca2-b8c2-5ac4656a6812\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pxlrd" Jul 08 18:47:13.171728 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.171717 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/44ccee63-46df-4ca2-b8c2-5ac4656a6812-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-pxlrd\" (UID: \"44ccee63-46df-4ca2-b8c2-5ac4656a6812\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pxlrd" Jul 08 18:47:13.171988 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.171779 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f4dad549-ed19-43bf-820d-8e87a0d8ec96-node-exporter-tls\") pod \"node-exporter-zz7rd\" (UID: \"f4dad549-ed19-43bf-820d-8e87a0d8ec96\") " pod="openshift-monitoring/node-exporter-zz7rd" Jul 08 18:47:13.171988 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.171826 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f4dad549-ed19-43bf-820d-8e87a0d8ec96-root\") pod \"node-exporter-zz7rd\" (UID: \"f4dad549-ed19-43bf-820d-8e87a0d8ec96\") " pod="openshift-monitoring/node-exporter-zz7rd" Jul 08 18:47:13.171988 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.171860 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/44ccee63-46df-4ca2-b8c2-5ac4656a6812-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-pxlrd\" (UID: \"44ccee63-46df-4ca2-b8c2-5ac4656a6812\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pxlrd" Jul 08 18:47:13.171988 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.171906 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/44ccee63-46df-4ca2-b8c2-5ac4656a6812-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-pxlrd\" (UID: \"44ccee63-46df-4ca2-b8c2-5ac4656a6812\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pxlrd" Jul 08 18:47:13.171988 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.171936 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f4dad549-ed19-43bf-820d-8e87a0d8ec96-node-exporter-accelerators-collector-config\") pod \"node-exporter-zz7rd\" (UID: \"f4dad549-ed19-43bf-820d-8e87a0d8ec96\") " pod="openshift-monitoring/node-exporter-zz7rd" Jul 08 18:47:13.171988 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.171968 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f4dad549-ed19-43bf-820d-8e87a0d8ec96-node-exporter-textfile\") pod \"node-exporter-zz7rd\" (UID: \"f4dad549-ed19-43bf-820d-8e87a0d8ec96\") " pod="openshift-monitoring/node-exporter-zz7rd" Jul 08 18:47:13.172404 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.171997 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f4dad549-ed19-43bf-820d-8e87a0d8ec96-node-exporter-wtmp\") pod \"node-exporter-zz7rd\" (UID: \"f4dad549-ed19-43bf-820d-8e87a0d8ec96\") " pod="openshift-monitoring/node-exporter-zz7rd" Jul 08 18:47:13.172404 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.172027 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1949d81d-2d64-4ee1-a3f6-72de33b17eea-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-lxx9k\" (UID: \"1949d81d-2d64-4ee1-a3f6-72de33b17eea\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxx9k" Jul 08 18:47:13.172404 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.172051 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4dad549-ed19-43bf-820d-8e87a0d8ec96-metrics-client-ca\") pod \"node-exporter-zz7rd\" (UID: \"f4dad549-ed19-43bf-820d-8e87a0d8ec96\") " pod="openshift-monitoring/node-exporter-zz7rd" Jul 08 18:47:13.172404 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.172079 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1949d81d-2d64-4ee1-a3f6-72de33b17eea-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-lxx9k\" (UID: \"1949d81d-2d64-4ee1-a3f6-72de33b17eea\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxx9k" Jul 08 18:47:13.172404 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.172106 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqz52\" (UniqueName: \"kubernetes.io/projected/1949d81d-2d64-4ee1-a3f6-72de33b17eea-kube-api-access-kqz52\") pod \"openshift-state-metrics-54cf96dfcf-lxx9k\" (UID: \"1949d81d-2d64-4ee1-a3f6-72de33b17eea\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxx9k" Jul 08 18:47:13.172404 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.172137 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/44ccee63-46df-4ca2-b8c2-5ac4656a6812-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-pxlrd\" (UID: \"44ccee63-46df-4ca2-b8c2-5ac4656a6812\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pxlrd" Jul 08 18:47:13.172404 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.172160 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4dad549-ed19-43bf-820d-8e87a0d8ec96-sys\") pod \"node-exporter-zz7rd\" (UID: \"f4dad549-ed19-43bf-820d-8e87a0d8ec96\") " pod="openshift-monitoring/node-exporter-zz7rd" Jul 08 18:47:13.172404 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.172212 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/44ccee63-46df-4ca2-b8c2-5ac4656a6812-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-pxlrd\" (UID: \"44ccee63-46df-4ca2-b8c2-5ac4656a6812\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pxlrd" Jul 08 18:47:13.172404 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.172239 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4dad549-ed19-43bf-820d-8e87a0d8ec96-sys\") pod \"node-exporter-zz7rd\" (UID: \"f4dad549-ed19-43bf-820d-8e87a0d8ec96\") " pod="openshift-monitoring/node-exporter-zz7rd" Jul 08 18:47:13.172404 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.172352 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f4dad549-ed19-43bf-820d-8e87a0d8ec96-node-exporter-wtmp\") pod \"node-exporter-zz7rd\" (UID: \"f4dad549-ed19-43bf-820d-8e87a0d8ec96\") " pod="openshift-monitoring/node-exporter-zz7rd" Jul 08 18:47:13.172911 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.172427 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f4dad549-ed19-43bf-820d-8e87a0d8ec96-node-exporter-textfile\") pod \"node-exporter-zz7rd\" (UID: \"f4dad549-ed19-43bf-820d-8e87a0d8ec96\") " pod="openshift-monitoring/node-exporter-zz7rd" Jul 08 18:47:13.172911 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.172882 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44ccee63-46df-4ca2-b8c2-5ac4656a6812-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-pxlrd\" (UID: \"44ccee63-46df-4ca2-b8c2-5ac4656a6812\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pxlrd" Jul 08 18:47:13.173614 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.173571 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1949d81d-2d64-4ee1-a3f6-72de33b17eea-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-lxx9k\" (UID: \"1949d81d-2d64-4ee1-a3f6-72de33b17eea\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxx9k" Jul 08 18:47:13.174315 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.174063 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4dad549-ed19-43bf-820d-8e87a0d8ec96-metrics-client-ca\") pod \"node-exporter-zz7rd\" (UID: \"f4dad549-ed19-43bf-820d-8e87a0d8ec96\") " pod="openshift-monitoring/node-exporter-zz7rd" Jul 08 18:47:13.174786 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.174762 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/44ccee63-46df-4ca2-b8c2-5ac4656a6812-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-pxlrd\" (UID: \"44ccee63-46df-4ca2-b8c2-5ac4656a6812\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pxlrd" Jul 08 18:47:13.174889 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.174830 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f4dad549-ed19-43bf-820d-8e87a0d8ec96-root\") pod \"node-exporter-zz7rd\" (UID: \"f4dad549-ed19-43bf-820d-8e87a0d8ec96\") " pod="openshift-monitoring/node-exporter-zz7rd" Jul 08 18:47:13.174889 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.174878 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f4dad549-ed19-43bf-820d-8e87a0d8ec96-node-exporter-accelerators-collector-config\") pod \"node-exporter-zz7rd\" (UID: \"f4dad549-ed19-43bf-820d-8e87a0d8ec96\") " pod="openshift-monitoring/node-exporter-zz7rd" Jul 08 18:47:13.176077 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.176049 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f4dad549-ed19-43bf-820d-8e87a0d8ec96-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zz7rd\" (UID: \"f4dad549-ed19-43bf-820d-8e87a0d8ec96\") " pod="openshift-monitoring/node-exporter-zz7rd" Jul 08 18:47:13.176187 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.176171 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1949d81d-2d64-4ee1-a3f6-72de33b17eea-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-lxx9k\" (UID: \"1949d81d-2d64-4ee1-a3f6-72de33b17eea\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxx9k" Jul 08 18:47:13.177289 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.177155 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1949d81d-2d64-4ee1-a3f6-72de33b17eea-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-lxx9k\" (UID: \"1949d81d-2d64-4ee1-a3f6-72de33b17eea\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxx9k" Jul 08 18:47:13.177717 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.177685 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/44ccee63-46df-4ca2-b8c2-5ac4656a6812-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-pxlrd\" (UID: \"44ccee63-46df-4ca2-b8c2-5ac4656a6812\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pxlrd" Jul 08 18:47:13.177798 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.177724 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/44ccee63-46df-4ca2-b8c2-5ac4656a6812-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-pxlrd\" (UID: \"44ccee63-46df-4ca2-b8c2-5ac4656a6812\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pxlrd" Jul 08 18:47:13.178670 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.178646 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f4dad549-ed19-43bf-820d-8e87a0d8ec96-node-exporter-tls\") pod \"node-exporter-zz7rd\" (UID: \"f4dad549-ed19-43bf-820d-8e87a0d8ec96\") " pod="openshift-monitoring/node-exporter-zz7rd" Jul 08 18:47:13.188410 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.188387 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqz52\" (UniqueName: \"kubernetes.io/projected/1949d81d-2d64-4ee1-a3f6-72de33b17eea-kube-api-access-kqz52\") pod \"openshift-state-metrics-54cf96dfcf-lxx9k\" (UID: \"1949d81d-2d64-4ee1-a3f6-72de33b17eea\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxx9k" Jul 08 18:47:13.189242 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.189219 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z67cc\" (UniqueName: \"kubernetes.io/projected/44ccee63-46df-4ca2-b8c2-5ac4656a6812-kube-api-access-z67cc\") pod \"kube-state-metrics-7c9dbb8b7d-pxlrd\" (UID: \"44ccee63-46df-4ca2-b8c2-5ac4656a6812\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pxlrd" Jul 08 18:47:13.189526 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.189509 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc526\" (UniqueName: \"kubernetes.io/projected/f4dad549-ed19-43bf-820d-8e87a0d8ec96-kube-api-access-fc526\") pod \"node-exporter-zz7rd\" (UID: \"f4dad549-ed19-43bf-820d-8e87a0d8ec96\") " pod="openshift-monitoring/node-exporter-zz7rd" Jul 08 18:47:13.191383 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.191362 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxx9k" Jul 08 18:47:13.200117 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.200101 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zz7rd" Jul 08 18:47:13.205621 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.205577 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pxlrd" Jul 08 18:47:13.213628 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:47:13.213601 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4dad549_ed19_43bf_820d_8e87a0d8ec96.slice/crio-e74877852960ada7e215e7f529a0c778a86bc858055b259eb8ada8a136d0cf1b WatchSource:0}: Error finding container e74877852960ada7e215e7f529a0c778a86bc858055b259eb8ada8a136d0cf1b: Status 404 returned error can't find the container with id e74877852960ada7e215e7f529a0c778a86bc858055b259eb8ada8a136d0cf1b Jul 08 18:47:13.216114 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.216094 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:13.317896 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.317862 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:13.350643 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.350584 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxx9k"] Jul 08 18:47:13.353113 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:47:13.353083 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1949d81d_2d64_4ee1_a3f6_72de33b17eea.slice/crio-707f1c1d90177f2cad61a47991c40462989116687a803e0c42acbdefedc2e4b0 WatchSource:0}: Error finding container 707f1c1d90177f2cad61a47991c40462989116687a803e0c42acbdefedc2e4b0: Status 404 returned error can't find the container with id 707f1c1d90177f2cad61a47991c40462989116687a803e0c42acbdefedc2e4b0 Jul 08 18:47:13.377328 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.377304 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pxlrd"] Jul 08 18:47:13.381505 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:47:13.381481 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44ccee63_46df_4ca2_b8c2_5ac4656a6812.slice/crio-4321d3cd1aa06b49f87cb1254063a984816ccca8ac16a58726e3875ab6aa2714 WatchSource:0}: Error finding container 4321d3cd1aa06b49f87cb1254063a984816ccca8ac16a58726e3875ab6aa2714: Status 404 returned error can't find the container with id 4321d3cd1aa06b49f87cb1254063a984816ccca8ac16a58726e3875ab6aa2714 Jul 08 18:47:13.415388 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.415364 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:13.517037 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.517010 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:13.854475 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.854399 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:13.944504 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.944471 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:13.952119 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.952090 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 18:47:13.955478 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.955455 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:13.958104 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.958081 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 08 18:47:13.958267 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.958084 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 08 18:47:13.959099 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.959076 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 08 18:47:13.959250 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.959187 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 08 18:47:13.959250 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.959187 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 08 18:47:13.959392 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.959326 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 08 18:47:13.959445 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.959389 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 08 18:47:13.959694 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.959674 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nw2bb\"" Jul 08 18:47:13.960031 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.960011 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 08 18:47:13.960134 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.960056 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 08 18:47:13.971416 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.971399 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-snhnd" Jul 08 18:47:13.975483 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:13.975461 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 18:47:14.079830 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.079796 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:14.082665 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.082473 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d25e162a-8084-419f-9cd2-fe18d069ea6a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.082665 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.082517 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d25e162a-8084-419f-9cd2-fe18d069ea6a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.082665 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.082544 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d25e162a-8084-419f-9cd2-fe18d069ea6a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.082665 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.082571 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d25e162a-8084-419f-9cd2-fe18d069ea6a-config-volume\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.082665 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.082626 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d25e162a-8084-419f-9cd2-fe18d069ea6a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.082665 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.082653 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d25e162a-8084-419f-9cd2-fe18d069ea6a-web-config\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.083071 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.082689 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d25e162a-8084-419f-9cd2-fe18d069ea6a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.083071 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.082772 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hvv9\" (UniqueName: \"kubernetes.io/projected/d25e162a-8084-419f-9cd2-fe18d069ea6a-kube-api-access-7hvv9\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.083071 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.082824 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d25e162a-8084-419f-9cd2-fe18d069ea6a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.083071 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.082864 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d25e162a-8084-419f-9cd2-fe18d069ea6a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.083071 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.082904 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d25e162a-8084-419f-9cd2-fe18d069ea6a-config-out\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.083071 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.082928 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d25e162a-8084-419f-9cd2-fe18d069ea6a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.083071 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.082968 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d25e162a-8084-419f-9cd2-fe18d069ea6a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.121762 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.120739 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zz7rd" event={"ID":"f4dad549-ed19-43bf-820d-8e87a0d8ec96","Type":"ContainerStarted","Data":"e74877852960ada7e215e7f529a0c778a86bc858055b259eb8ada8a136d0cf1b"} Jul 08 18:47:14.123999 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.123969 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxx9k" event={"ID":"1949d81d-2d64-4ee1-a3f6-72de33b17eea","Type":"ContainerStarted","Data":"ec4c18f5a2403c9a570af4fc86ac8ac699b0a201cf215a1a61f92d86e81a2345"} Jul 08 18:47:14.124114 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.124034 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxx9k" event={"ID":"1949d81d-2d64-4ee1-a3f6-72de33b17eea","Type":"ContainerStarted","Data":"7a641d9fc02f12d5ede6cef2eedf1c4402c00a8be255c2b64a7b4e955ba983b3"} Jul 08 18:47:14.124114 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.124088 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxx9k" event={"ID":"1949d81d-2d64-4ee1-a3f6-72de33b17eea","Type":"ContainerStarted","Data":"707f1c1d90177f2cad61a47991c40462989116687a803e0c42acbdefedc2e4b0"} Jul 08 18:47:14.125995 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.125967 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pxlrd" event={"ID":"44ccee63-46df-4ca2-b8c2-5ac4656a6812","Type":"ContainerStarted","Data":"4321d3cd1aa06b49f87cb1254063a984816ccca8ac16a58726e3875ab6aa2714"} Jul 08 18:47:14.145703 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.145612 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:14.184025 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.183394 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d25e162a-8084-419f-9cd2-fe18d069ea6a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.184025 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.183475 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d25e162a-8084-419f-9cd2-fe18d069ea6a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.184025 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.183500 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d25e162a-8084-419f-9cd2-fe18d069ea6a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.184025 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.183526 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d25e162a-8084-419f-9cd2-fe18d069ea6a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.184025 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.183554 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d25e162a-8084-419f-9cd2-fe18d069ea6a-config-volume\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.184025 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.183581 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d25e162a-8084-419f-9cd2-fe18d069ea6a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.184025 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.183618 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d25e162a-8084-419f-9cd2-fe18d069ea6a-web-config\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.184025 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:47:14.183648 2572 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 08 18:47:14.184025 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:47:14.183729 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d25e162a-8084-419f-9cd2-fe18d069ea6a-secret-alertmanager-main-tls podName:d25e162a-8084-419f-9cd2-fe18d069ea6a nodeName:}" failed. No retries permitted until 2026-07-08 18:47:14.683708396 +0000 UTC m=+98.554123523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/d25e162a-8084-419f-9cd2-fe18d069ea6a-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "d25e162a-8084-419f-9cd2-fe18d069ea6a") : secret "alertmanager-main-tls" not found Jul 08 18:47:14.184025 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.183651 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d25e162a-8084-419f-9cd2-fe18d069ea6a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.184025 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.183793 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hvv9\" (UniqueName: \"kubernetes.io/projected/d25e162a-8084-419f-9cd2-fe18d069ea6a-kube-api-access-7hvv9\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.184025 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.183831 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d25e162a-8084-419f-9cd2-fe18d069ea6a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.184025 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.183871 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d25e162a-8084-419f-9cd2-fe18d069ea6a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.184025 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.183907 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d25e162a-8084-419f-9cd2-fe18d069ea6a-config-out\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.184025 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.183929 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d25e162a-8084-419f-9cd2-fe18d069ea6a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.184809 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.184280 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d25e162a-8084-419f-9cd2-fe18d069ea6a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.185257 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:47:14.184982 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d25e162a-8084-419f-9cd2-fe18d069ea6a-alertmanager-trusted-ca-bundle podName:d25e162a-8084-419f-9cd2-fe18d069ea6a nodeName:}" failed. No retries permitted until 2026-07-08 18:47:14.684963743 +0000 UTC m=+98.555378869 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/d25e162a-8084-419f-9cd2-fe18d069ea6a-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "d25e162a-8084-419f-9cd2-fe18d069ea6a") : configmap references non-existent config key: ca-bundle.crt Jul 08 18:47:14.186077 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.185762 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d25e162a-8084-419f-9cd2-fe18d069ea6a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.188650 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.188554 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d25e162a-8084-419f-9cd2-fe18d069ea6a-web-config\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.195271 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.195213 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hvv9\" (UniqueName: \"kubernetes.io/projected/d25e162a-8084-419f-9cd2-fe18d069ea6a-kube-api-access-7hvv9\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.196185 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.196156 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d25e162a-8084-419f-9cd2-fe18d069ea6a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.196503 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.196479 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d25e162a-8084-419f-9cd2-fe18d069ea6a-config-out\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.197100 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.197056 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d25e162a-8084-419f-9cd2-fe18d069ea6a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.197693 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.197639 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d25e162a-8084-419f-9cd2-fe18d069ea6a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.197693 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.197667 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d25e162a-8084-419f-9cd2-fe18d069ea6a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.198217 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.198153 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d25e162a-8084-419f-9cd2-fe18d069ea6a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.198314 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.198239 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d25e162a-8084-419f-9cd2-fe18d069ea6a-config-volume\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.366999 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.366947 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:14.467494 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.467261 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:14.569296 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.569260 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:14.668482 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.668446 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:14.689665 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.689638 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d25e162a-8084-419f-9cd2-fe18d069ea6a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.689805 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.689703 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d25e162a-8084-419f-9cd2-fe18d069ea6a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.690535 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.690506 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d25e162a-8084-419f-9cd2-fe18d069ea6a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.692287 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.692263 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d25e162a-8084-419f-9cd2-fe18d069ea6a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d25e162a-8084-419f-9cd2-fe18d069ea6a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:14.868029 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:14.867930 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:47:15.086129 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:15.086027 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 18:47:15.096556 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:47:15.096525 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd25e162a_8084_419f_9cd2_fe18d069ea6a.slice/crio-4320b7a73c1d78d185729055358a6dc7ca1cd0913e2e9ee1f3602f712991f6b9 WatchSource:0}: Error finding container 4320b7a73c1d78d185729055358a6dc7ca1cd0913e2e9ee1f3602f712991f6b9: Status 404 returned error can't find the container with id 4320b7a73c1d78d185729055358a6dc7ca1cd0913e2e9ee1f3602f712991f6b9 Jul 08 18:47:15.133223 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:15.133193 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zz7rd" event={"ID":"f4dad549-ed19-43bf-820d-8e87a0d8ec96","Type":"ContainerStarted","Data":"fbfddfd7d708a4233bb5bbc564171be70dfcb3c4a3651cce0c745149a7854c5c"} Jul 08 18:47:15.135795 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:15.135772 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxx9k" event={"ID":"1949d81d-2d64-4ee1-a3f6-72de33b17eea","Type":"ContainerStarted","Data":"2362469d061141cfd33a3233d7a1d967c685545a2d2421c2f9baab852331c340"} Jul 08 18:47:15.137958 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:15.137935 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pxlrd" event={"ID":"44ccee63-46df-4ca2-b8c2-5ac4656a6812","Type":"ContainerStarted","Data":"63296cd9482a0327bbedabee4366cc5dc1fe67757997dcd7f82007dff38bb87c"} Jul 08 18:47:15.138027 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:15.137990 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pxlrd" event={"ID":"44ccee63-46df-4ca2-b8c2-5ac4656a6812","Type":"ContainerStarted","Data":"3872725c9df400e4e9f38fa4ebf3900ac6a10af1f8ea2442ea67ccbb23843fd5"} Jul 08 18:47:15.139077 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:15.139034 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d25e162a-8084-419f-9cd2-fe18d069ea6a","Type":"ContainerStarted","Data":"4320b7a73c1d78d185729055358a6dc7ca1cd0913e2e9ee1f3602f712991f6b9"} Jul 08 18:47:15.191627 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:15.191550 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lxx9k" podStartSLOduration=1.720868216 podStartE2EDuration="3.191532244s" totalImagesPullingTime="1.470664028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:47:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:47:15.190143568 +0000 UTC m=+99.060558701" watchObservedRunningTime="2026-07-08 18:47:15.191532244 +0000 UTC m=+99.061947378" Jul 08 18:47:15.812208 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:15.812175 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:15.914092 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:15.914061 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:16.036167 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:16.036134 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:16.145840 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:16.145755 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pxlrd" event={"ID":"44ccee63-46df-4ca2-b8c2-5ac4656a6812","Type":"ContainerStarted","Data":"902c8f5b05db9e0118eca77f17fc06355bd24f88677123cdb45eab40ec92e32c"} Jul 08 18:47:16.148559 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:16.148528 2572 generic.go:356] "Generic (PLEG): container finished" podID="f4dad549-ed19-43bf-820d-8e87a0d8ec96" containerID="fbfddfd7d708a4233bb5bbc564171be70dfcb3c4a3651cce0c745149a7854c5c" exitCode=0 Jul 08 18:47:16.148707 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:16.148622 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zz7rd" event={"ID":"f4dad549-ed19-43bf-820d-8e87a0d8ec96","Type":"ContainerDied","Data":"fbfddfd7d708a4233bb5bbc564171be70dfcb3c4a3651cce0c745149a7854c5c"} Jul 08 18:47:16.170980 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:16.170918 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pxlrd" podStartSLOduration=2.588417074 podStartE2EDuration="4.170898152s" totalImagesPullingTime="1.582481078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:47:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:47:16.169878949 +0000 UTC m=+100.040294082" watchObservedRunningTime="2026-07-08 18:47:16.170898152 +0000 UTC m=+100.041313285" Jul 08 18:47:16.514966 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:16.514944 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:17.154645 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:17.154607 2572 generic.go:356] "Generic (PLEG): container finished" podID="d25e162a-8084-419f-9cd2-fe18d069ea6a" containerID="4ba56c8c9ffe8707617d01be9f3bd591bf9e7f861df99e6e0938e651ed444c58" exitCode=0 Jul 08 18:47:17.155104 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:17.154695 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d25e162a-8084-419f-9cd2-fe18d069ea6a","Type":"ContainerDied","Data":"4ba56c8c9ffe8707617d01be9f3bd591bf9e7f861df99e6e0938e651ed444c58"} Jul 08 18:47:17.157000 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:17.156972 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zz7rd" event={"ID":"f4dad549-ed19-43bf-820d-8e87a0d8ec96","Type":"ContainerStarted","Data":"f6b34e3e41a7671819bf13bd525a14369389e7a78ec5c47eb1e3972e6fe69718"} Jul 08 18:47:17.157103 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:17.157021 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zz7rd" event={"ID":"f4dad549-ed19-43bf-820d-8e87a0d8ec96","Type":"ContainerStarted","Data":"808cb8ce5de3fc253ea0ef93adaa3334dddd123ef9c6366527cf5f58020cfea2"} Jul 08 18:47:17.206940 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:17.206897 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zz7rd" podStartSLOduration=3.413575886 podStartE2EDuration="5.206881071s" totalImagesPullingTime="1.711443417s" totalInitContainerRuntime="81.861768ms" isStatefulPod=true podCreationTimestamp="2026-07-08 18:47:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:47:17.205193489 +0000 UTC m=+101.075608621" watchObservedRunningTime="2026-07-08 18:47:17.206881071 +0000 UTC m=+101.077296203" Jul 08 18:47:17.735008 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:17.734973 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:17.895930 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:17.895888 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:17.995280 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:17.995182 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:18.080303 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.080266 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:18.080489 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.080460 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7cf5995bf4-227hv"] Jul 08 18:47:18.097115 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.096938 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7cf5995bf4-227hv" Jul 08 18:47:18.100651 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.099838 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7cf5995bf4-227hv"] Jul 08 18:47:18.100930 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.100855 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 08 18:47:18.101691 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.101090 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 08 18:47:18.101691 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.101232 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 08 18:47:18.101691 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.101284 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2582t\"" Jul 08 18:47:18.101691 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.101383 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 08 18:47:18.106887 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.106865 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 08 18:47:18.112071 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.112041 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 08 18:47:18.123507 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.123471 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fd5e3d0-b2c9-426e-a499-61d7178e7ac1-serving-certs-ca-bundle\") pod \"telemeter-client-7cf5995bf4-227hv\" (UID: \"7fd5e3d0-b2c9-426e-a499-61d7178e7ac1\") " pod="openshift-monitoring/telemeter-client-7cf5995bf4-227hv" Jul 08 18:47:18.123674 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.123531 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7fd5e3d0-b2c9-426e-a499-61d7178e7ac1-secret-telemeter-client\") pod \"telemeter-client-7cf5995bf4-227hv\" (UID: \"7fd5e3d0-b2c9-426e-a499-61d7178e7ac1\") " pod="openshift-monitoring/telemeter-client-7cf5995bf4-227hv" Jul 08 18:47:18.123674 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.123557 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7fd5e3d0-b2c9-426e-a499-61d7178e7ac1-telemeter-client-tls\") pod \"telemeter-client-7cf5995bf4-227hv\" (UID: \"7fd5e3d0-b2c9-426e-a499-61d7178e7ac1\") " pod="openshift-monitoring/telemeter-client-7cf5995bf4-227hv" Jul 08 18:47:18.123674 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.123609 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c6h9\" (UniqueName: \"kubernetes.io/projected/7fd5e3d0-b2c9-426e-a499-61d7178e7ac1-kube-api-access-2c6h9\") pod \"telemeter-client-7cf5995bf4-227hv\" (UID: \"7fd5e3d0-b2c9-426e-a499-61d7178e7ac1\") " pod="openshift-monitoring/telemeter-client-7cf5995bf4-227hv" Jul 08 18:47:18.123674 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.123636 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7fd5e3d0-b2c9-426e-a499-61d7178e7ac1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cf5995bf4-227hv\" (UID: \"7fd5e3d0-b2c9-426e-a499-61d7178e7ac1\") " pod="openshift-monitoring/telemeter-client-7cf5995bf4-227hv" Jul 08 18:47:18.123674 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.123672 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fd5e3d0-b2c9-426e-a499-61d7178e7ac1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cf5995bf4-227hv\" (UID: \"7fd5e3d0-b2c9-426e-a499-61d7178e7ac1\") " pod="openshift-monitoring/telemeter-client-7cf5995bf4-227hv" Jul 08 18:47:18.123959 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.123762 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7fd5e3d0-b2c9-426e-a499-61d7178e7ac1-federate-client-tls\") pod \"telemeter-client-7cf5995bf4-227hv\" (UID: \"7fd5e3d0-b2c9-426e-a499-61d7178e7ac1\") " pod="openshift-monitoring/telemeter-client-7cf5995bf4-227hv" Jul 08 18:47:18.123959 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.123798 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7fd5e3d0-b2c9-426e-a499-61d7178e7ac1-metrics-client-ca\") pod \"telemeter-client-7cf5995bf4-227hv\" (UID: \"7fd5e3d0-b2c9-426e-a499-61d7178e7ac1\") " pod="openshift-monitoring/telemeter-client-7cf5995bf4-227hv" Jul 08 18:47:18.224366 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.224331 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fd5e3d0-b2c9-426e-a499-61d7178e7ac1-serving-certs-ca-bundle\") pod \"telemeter-client-7cf5995bf4-227hv\" (UID: \"7fd5e3d0-b2c9-426e-a499-61d7178e7ac1\") " pod="openshift-monitoring/telemeter-client-7cf5995bf4-227hv" Jul 08 18:47:18.224864 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.224387 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7fd5e3d0-b2c9-426e-a499-61d7178e7ac1-secret-telemeter-client\") pod \"telemeter-client-7cf5995bf4-227hv\" (UID: \"7fd5e3d0-b2c9-426e-a499-61d7178e7ac1\") " pod="openshift-monitoring/telemeter-client-7cf5995bf4-227hv" Jul 08 18:47:18.224864 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.224418 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7fd5e3d0-b2c9-426e-a499-61d7178e7ac1-telemeter-client-tls\") pod \"telemeter-client-7cf5995bf4-227hv\" (UID: \"7fd5e3d0-b2c9-426e-a499-61d7178e7ac1\") " pod="openshift-monitoring/telemeter-client-7cf5995bf4-227hv" Jul 08 18:47:18.224864 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.224555 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c6h9\" (UniqueName: \"kubernetes.io/projected/7fd5e3d0-b2c9-426e-a499-61d7178e7ac1-kube-api-access-2c6h9\") pod \"telemeter-client-7cf5995bf4-227hv\" (UID: \"7fd5e3d0-b2c9-426e-a499-61d7178e7ac1\") " pod="openshift-monitoring/telemeter-client-7cf5995bf4-227hv" Jul 08 18:47:18.224864 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.224657 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7fd5e3d0-b2c9-426e-a499-61d7178e7ac1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cf5995bf4-227hv\" (UID: \"7fd5e3d0-b2c9-426e-a499-61d7178e7ac1\") " pod="openshift-monitoring/telemeter-client-7cf5995bf4-227hv" Jul 08 18:47:18.224864 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.224717 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fd5e3d0-b2c9-426e-a499-61d7178e7ac1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cf5995bf4-227hv\" (UID: \"7fd5e3d0-b2c9-426e-a499-61d7178e7ac1\") " pod="openshift-monitoring/telemeter-client-7cf5995bf4-227hv" Jul 08 18:47:18.224864 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.224783 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7fd5e3d0-b2c9-426e-a499-61d7178e7ac1-federate-client-tls\") pod \"telemeter-client-7cf5995bf4-227hv\" (UID: \"7fd5e3d0-b2c9-426e-a499-61d7178e7ac1\") " pod="openshift-monitoring/telemeter-client-7cf5995bf4-227hv" Jul 08 18:47:18.224864 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.224823 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7fd5e3d0-b2c9-426e-a499-61d7178e7ac1-metrics-client-ca\") pod \"telemeter-client-7cf5995bf4-227hv\" (UID: \"7fd5e3d0-b2c9-426e-a499-61d7178e7ac1\") " pod="openshift-monitoring/telemeter-client-7cf5995bf4-227hv" Jul 08 18:47:18.225238 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.225222 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fd5e3d0-b2c9-426e-a499-61d7178e7ac1-serving-certs-ca-bundle\") pod \"telemeter-client-7cf5995bf4-227hv\" (UID: \"7fd5e3d0-b2c9-426e-a499-61d7178e7ac1\") " pod="openshift-monitoring/telemeter-client-7cf5995bf4-227hv" Jul 08 18:47:18.225615 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.225554 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7fd5e3d0-b2c9-426e-a499-61d7178e7ac1-metrics-client-ca\") pod \"telemeter-client-7cf5995bf4-227hv\" (UID: \"7fd5e3d0-b2c9-426e-a499-61d7178e7ac1\") " pod="openshift-monitoring/telemeter-client-7cf5995bf4-227hv" Jul 08 18:47:18.225734 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.225686 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fd5e3d0-b2c9-426e-a499-61d7178e7ac1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cf5995bf4-227hv\" (UID: \"7fd5e3d0-b2c9-426e-a499-61d7178e7ac1\") " pod="openshift-monitoring/telemeter-client-7cf5995bf4-227hv" Jul 08 18:47:18.227276 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.227252 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7fd5e3d0-b2c9-426e-a499-61d7178e7ac1-federate-client-tls\") pod \"telemeter-client-7cf5995bf4-227hv\" (UID: \"7fd5e3d0-b2c9-426e-a499-61d7178e7ac1\") " pod="openshift-monitoring/telemeter-client-7cf5995bf4-227hv" Jul 08 18:47:18.227393 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.227331 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7fd5e3d0-b2c9-426e-a499-61d7178e7ac1-secret-telemeter-client\") pod \"telemeter-client-7cf5995bf4-227hv\" (UID: \"7fd5e3d0-b2c9-426e-a499-61d7178e7ac1\") " pod="openshift-monitoring/telemeter-client-7cf5995bf4-227hv" Jul 08 18:47:18.227648 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.227624 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7fd5e3d0-b2c9-426e-a499-61d7178e7ac1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cf5995bf4-227hv\" (UID: \"7fd5e3d0-b2c9-426e-a499-61d7178e7ac1\") " pod="openshift-monitoring/telemeter-client-7cf5995bf4-227hv" Jul 08 18:47:18.227709 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.227694 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7fd5e3d0-b2c9-426e-a499-61d7178e7ac1-telemeter-client-tls\") pod \"telemeter-client-7cf5995bf4-227hv\" (UID: \"7fd5e3d0-b2c9-426e-a499-61d7178e7ac1\") " pod="openshift-monitoring/telemeter-client-7cf5995bf4-227hv" Jul 08 18:47:18.232751 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.232719 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c6h9\" (UniqueName: \"kubernetes.io/projected/7fd5e3d0-b2c9-426e-a499-61d7178e7ac1-kube-api-access-2c6h9\") pod \"telemeter-client-7cf5995bf4-227hv\" (UID: \"7fd5e3d0-b2c9-426e-a499-61d7178e7ac1\") " pod="openshift-monitoring/telemeter-client-7cf5995bf4-227hv" Jul 08 18:47:18.408875 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.408806 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7cf5995bf4-227hv" Jul 08 18:47:18.555215 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:18.555194 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7cf5995bf4-227hv"] Jul 08 18:47:18.557008 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:47:18.556984 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fd5e3d0_b2c9_426e_a499_61d7178e7ac1.slice/crio-9ff156fccb2cfb503c783cad9e8e5c16ddb47d4440dec866dd8c4ef91cfcd922 WatchSource:0}: Error finding container 9ff156fccb2cfb503c783cad9e8e5c16ddb47d4440dec866dd8c4ef91cfcd922: Status 404 returned error can't find the container with id 9ff156fccb2cfb503c783cad9e8e5c16ddb47d4440dec866dd8c4ef91cfcd922 Jul 08 18:47:19.168633 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:19.168577 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cf5995bf4-227hv" event={"ID":"7fd5e3d0-b2c9-426e-a499-61d7178e7ac1","Type":"ContainerStarted","Data":"9ff156fccb2cfb503c783cad9e8e5c16ddb47d4440dec866dd8c4ef91cfcd922"} Jul 08 18:47:19.233121 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:19.233091 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:19.411526 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:19.411505 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:20.176928 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:20.176892 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d25e162a-8084-419f-9cd2-fe18d069ea6a","Type":"ContainerStarted","Data":"3bf84a1856a1b23f8b59c36f03ad098e6fd02488cc3144a79f97e19f37301938"} Jul 08 18:47:20.177080 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:20.176986 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d25e162a-8084-419f-9cd2-fe18d069ea6a","Type":"ContainerStarted","Data":"45a9647de1b388a353e4ec250ba787fba59239c089aa20990daa55cd510a0b52"} Jul 08 18:47:20.177080 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:20.177016 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d25e162a-8084-419f-9cd2-fe18d069ea6a","Type":"ContainerStarted","Data":"2ae8be1af8965863ded789aa1c6e0012ace6ce9d84197d0ba608ac26ad66f6ce"} Jul 08 18:47:20.177080 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:20.177042 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d25e162a-8084-419f-9cd2-fe18d069ea6a","Type":"ContainerStarted","Data":"e7c65cfefc13fe250d757a8e5f4a169b47a3b837a6e9b14f02266e68f6cbe512"} Jul 08 18:47:20.177080 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:20.177065 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d25e162a-8084-419f-9cd2-fe18d069ea6a","Type":"ContainerStarted","Data":"d0dd3e78dcec103beda9b555717050824fb790715760b9aa2683ec961ca7b01b"} Jul 08 18:47:20.222044 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:20.222013 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:20.322669 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:20.322632 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:21.184845 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:21.184810 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d25e162a-8084-419f-9cd2-fe18d069ea6a","Type":"ContainerStarted","Data":"34a5424cda9983e7649b706c79ad3e4230c22769ef192252f553d4540a66fa07"} Jul 08 18:47:21.186955 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:21.186931 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cf5995bf4-227hv" event={"ID":"7fd5e3d0-b2c9-426e-a499-61d7178e7ac1","Type":"ContainerStarted","Data":"5beeb5405fffeb45a46aa9d12db80a5d61dcd3f4fc9ceba14d3fdce6bb490e20"} Jul 08 18:47:21.187084 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:21.186973 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cf5995bf4-227hv" event={"ID":"7fd5e3d0-b2c9-426e-a499-61d7178e7ac1","Type":"ContainerStarted","Data":"aff06664f8f9549fcc8aae246180e979c6e0a239796d958100463360da454263"} Jul 08 18:47:21.187084 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:21.186993 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cf5995bf4-227hv" event={"ID":"7fd5e3d0-b2c9-426e-a499-61d7178e7ac1","Type":"ContainerStarted","Data":"d45afdc2ead1e56d511ee160dace8330e679863e70d7337ec16cf4f6759a186a"} Jul 08 18:47:21.213868 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:21.213821 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.473915813 podStartE2EDuration="8.213805736s" totalImagesPullingTime="4.711319631s" totalInitContainerRuntime="28.570292ms" isStatefulPod=false podCreationTimestamp="2026-07-08 18:47:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:47:21.213157127 +0000 UTC m=+105.083572261" watchObservedRunningTime="2026-07-08 18:47:21.213805736 +0000 UTC m=+105.084220869" Jul 08 18:47:21.235996 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:21.235953 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7cf5995bf4-227hv" podStartSLOduration=1.307690349 podStartE2EDuration="3.235937841s" totalImagesPullingTime="1.928247492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:47:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:47:21.235502159 +0000 UTC m=+105.105917294" watchObservedRunningTime="2026-07-08 18:47:21.235937841 +0000 UTC m=+105.106352974" Jul 08 18:47:23.437168 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:23.437127 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:23.534173 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:23.534136 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:33.235477 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:33.235444 2572 generic.go:356] "Generic (PLEG): container finished" podID="0270e288-835b-4d75-b0ba-4f2670684646" containerID="a9877e2c7b66312a988060918428936b004d2bac5c309b9225b4a7e1dacb4af7" exitCode=0 Jul 08 18:47:33.235921 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:33.235517 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hd7xd" event={"ID":"0270e288-835b-4d75-b0ba-4f2670684646","Type":"ContainerDied","Data":"a9877e2c7b66312a988060918428936b004d2bac5c309b9225b4a7e1dacb4af7"} Jul 08 18:47:33.235921 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:33.235889 2572 scope.go:117] "RemoveContainer" containerID="a9877e2c7b66312a988060918428936b004d2bac5c309b9225b4a7e1dacb4af7" Jul 08 18:47:33.237228 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:33.237209 2572 generic.go:356] "Generic (PLEG): container finished" podID="4a9979b4-f241-4964-a20f-b42514a3f700" containerID="73259396ed2b2a402e5cf004cb8fcc866b53eadfa87a18ff239deebe7358595f" exitCode=0 Jul 08 18:47:33.237313 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:33.237241 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-xg4bh" event={"ID":"4a9979b4-f241-4964-a20f-b42514a3f700","Type":"ContainerDied","Data":"73259396ed2b2a402e5cf004cb8fcc866b53eadfa87a18ff239deebe7358595f"} Jul 08 18:47:33.237497 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:33.237485 2572 scope.go:117] "RemoveContainer" containerID="73259396ed2b2a402e5cf004cb8fcc866b53eadfa87a18ff239deebe7358595f" Jul 08 18:47:33.302235 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:33.300872 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59cccb7d4b-cqwc6"] Jul 08 18:47:33.534786 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:33.534757 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:33.624796 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:33.624709 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:34.242846 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:34.242810 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hd7xd" event={"ID":"0270e288-835b-4d75-b0ba-4f2670684646","Type":"ContainerStarted","Data":"fb9756bfbc2d12e9444c59d79329e683b41b6c38213c553d65e780f3b08ffd7b"} Jul 08 18:47:34.244738 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:34.244708 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-xg4bh" event={"ID":"4a9979b4-f241-4964-a20f-b42514a3f700","Type":"ContainerStarted","Data":"178f70a98fbe771a3d7852a961a5d11151a8433b61aca8b4ad4849b9a2b8bf44"} Jul 08 18:47:37.062126 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:37.062084 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:37.129196 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:37.129165 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:38.131724 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:38.131674 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" podUID="fdbe9304-92f1-492d-a5de-88d4cba079dd" containerName="registry" containerID="cri-o://e7f88c85541f191a2ccc93cf8df84a934b7b45fca447faf2932d433c7e700472" gracePeriod=30 Jul 08 18:47:38.263829 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:38.263801 2572 generic.go:356] "Generic (PLEG): container finished" podID="fdbe9304-92f1-492d-a5de-88d4cba079dd" containerID="e7f88c85541f191a2ccc93cf8df84a934b7b45fca447faf2932d433c7e700472" exitCode=0 Jul 08 18:47:38.263942 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:38.263869 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" event={"ID":"fdbe9304-92f1-492d-a5de-88d4cba079dd","Type":"ContainerDied","Data":"e7f88c85541f191a2ccc93cf8df84a934b7b45fca447faf2932d433c7e700472"} Jul 08 18:47:38.381844 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:38.381787 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:47:38.510817 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:38.510786 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fdbe9304-92f1-492d-a5de-88d4cba079dd-trusted-ca\") pod \"fdbe9304-92f1-492d-a5de-88d4cba079dd\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " Jul 08 18:47:38.510817 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:38.510826 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fdbe9304-92f1-492d-a5de-88d4cba079dd-ca-trust-extracted\") pod \"fdbe9304-92f1-492d-a5de-88d4cba079dd\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " Jul 08 18:47:38.511060 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:38.510846 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fdbe9304-92f1-492d-a5de-88d4cba079dd-installation-pull-secrets\") pod \"fdbe9304-92f1-492d-a5de-88d4cba079dd\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " Jul 08 18:47:38.511060 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:38.510886 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fdbe9304-92f1-492d-a5de-88d4cba079dd-registry-certificates\") pod \"fdbe9304-92f1-492d-a5de-88d4cba079dd\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " Jul 08 18:47:38.511060 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:38.510923 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fdbe9304-92f1-492d-a5de-88d4cba079dd-image-registry-private-configuration\") pod \"fdbe9304-92f1-492d-a5de-88d4cba079dd\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " Jul 08 18:47:38.511060 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:38.510958 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-registry-tls\") pod \"fdbe9304-92f1-492d-a5de-88d4cba079dd\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " Jul 08 18:47:38.511060 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:38.511023 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-bound-sa-token\") pod \"fdbe9304-92f1-492d-a5de-88d4cba079dd\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " Jul 08 18:47:38.511308 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:38.511067 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdhck\" (UniqueName: \"kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-kube-api-access-kdhck\") pod \"fdbe9304-92f1-492d-a5de-88d4cba079dd\" (UID: \"fdbe9304-92f1-492d-a5de-88d4cba079dd\") " Jul 08 18:47:38.511392 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:38.511363 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdbe9304-92f1-492d-a5de-88d4cba079dd-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "fdbe9304-92f1-492d-a5de-88d4cba079dd" (UID: "fdbe9304-92f1-492d-a5de-88d4cba079dd"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:47:38.511456 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:38.511428 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdbe9304-92f1-492d-a5de-88d4cba079dd-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "fdbe9304-92f1-492d-a5de-88d4cba079dd" (UID: "fdbe9304-92f1-492d-a5de-88d4cba079dd"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:47:38.513606 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:38.513539 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fdbe9304-92f1-492d-a5de-88d4cba079dd" (UID: "fdbe9304-92f1-492d-a5de-88d4cba079dd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:47:38.513738 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:38.513717 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdbe9304-92f1-492d-a5de-88d4cba079dd-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "fdbe9304-92f1-492d-a5de-88d4cba079dd" (UID: "fdbe9304-92f1-492d-a5de-88d4cba079dd"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:47:38.513802 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:38.513766 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-kube-api-access-kdhck" (OuterVolumeSpecName: "kube-api-access-kdhck") pod "fdbe9304-92f1-492d-a5de-88d4cba079dd" (UID: "fdbe9304-92f1-492d-a5de-88d4cba079dd"). InnerVolumeSpecName "kube-api-access-kdhck". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:47:38.513879 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:38.513801 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdbe9304-92f1-492d-a5de-88d4cba079dd-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "fdbe9304-92f1-492d-a5de-88d4cba079dd" (UID: "fdbe9304-92f1-492d-a5de-88d4cba079dd"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:47:38.513917 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:38.513897 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "fdbe9304-92f1-492d-a5de-88d4cba079dd" (UID: "fdbe9304-92f1-492d-a5de-88d4cba079dd"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:47:38.519119 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:38.519095 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdbe9304-92f1-492d-a5de-88d4cba079dd-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "fdbe9304-92f1-492d-a5de-88d4cba079dd" (UID: "fdbe9304-92f1-492d-a5de-88d4cba079dd"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:47:38.612395 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:38.612362 2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fdbe9304-92f1-492d-a5de-88d4cba079dd-registry-certificates\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 18:47:38.612395 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:38.612388 2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fdbe9304-92f1-492d-a5de-88d4cba079dd-image-registry-private-configuration\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 18:47:38.612395 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:38.612398 2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-registry-tls\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 18:47:38.612640 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:38.612407 2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-bound-sa-token\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 18:47:38.612640 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:38.612415 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdhck\" (UniqueName: \"kubernetes.io/projected/fdbe9304-92f1-492d-a5de-88d4cba079dd-kube-api-access-kdhck\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 18:47:38.612640 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:38.612423 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fdbe9304-92f1-492d-a5de-88d4cba079dd-trusted-ca\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 18:47:38.612640 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:38.612431 2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fdbe9304-92f1-492d-a5de-88d4cba079dd-ca-trust-extracted\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 18:47:38.612640 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:38.612438 2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fdbe9304-92f1-492d-a5de-88d4cba079dd-installation-pull-secrets\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 18:47:39.269072 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:39.269029 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" event={"ID":"fdbe9304-92f1-492d-a5de-88d4cba079dd","Type":"ContainerDied","Data":"88bf1e6fea1236467bb6c354df7b2747e6a048f07e6a22fe3cfe07011a76bc88"} Jul 08 18:47:39.269500 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:39.269089 2572 scope.go:117] "RemoveContainer" containerID="e7f88c85541f191a2ccc93cf8df84a934b7b45fca447faf2932d433c7e700472" Jul 08 18:47:39.269500 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:39.269051 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55cd4459fc-xnws9" Jul 08 18:47:39.285840 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:39.285816 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-55cd4459fc-xnws9"] Jul 08 18:47:39.289706 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:39.289684 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-55cd4459fc-xnws9"] Jul 08 18:47:40.689686 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:40.689653 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdbe9304-92f1-492d-a5de-88d4cba079dd" path="/var/lib/kubelet/pods/fdbe9304-92f1-492d-a5de-88d4cba079dd/volumes" Jul 08 18:47:47.306145 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:47.306068 2572 generic.go:356] "Generic (PLEG): container finished" podID="5122d514-65f7-4423-8010-51bdee3932bd" containerID="28d54156651d22b9374cbd3530ce9f24b9093b71fd0eab32f5116f2f61556a2b" exitCode=0 Jul 08 18:47:47.306485 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:47.306153 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4b26j" event={"ID":"5122d514-65f7-4423-8010-51bdee3932bd","Type":"ContainerDied","Data":"28d54156651d22b9374cbd3530ce9f24b9093b71fd0eab32f5116f2f61556a2b"} Jul 08 18:47:47.306710 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:47.306689 2572 scope.go:117] "RemoveContainer" containerID="28d54156651d22b9374cbd3530ce9f24b9093b71fd0eab32f5116f2f61556a2b" Jul 08 18:47:48.312191 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:48.312162 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4b26j" event={"ID":"5122d514-65f7-4423-8010-51bdee3932bd","Type":"ContainerStarted","Data":"ffb20e92e5cc8ab4ee1a0f003710700a2a609f30e5e3e2a87d71f96250a4a5ca"} Jul 08 18:47:52.067697 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:52.067662 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:52.131576 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:52.131544 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:47:58.323975 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:58.323915 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-59cccb7d4b-cqwc6" podUID="67aac4c8-9fe8-4a0b-9e3f-439c497e03ad" containerName="console" containerID="cri-o://ae486b52f487d2731e8d17665a98a6e4418652e5bf72e90edd7c0e9970c0ea85" gracePeriod=15 Jul 08 18:47:58.559846 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:58.559821 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cccb7d4b-cqwc6" Jul 08 18:47:58.589725 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:58.589638 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-service-ca\") pod \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\" (UID: \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\") " Jul 08 18:47:58.589921 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:58.589741 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-trusted-ca-bundle\") pod \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\" (UID: \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\") " Jul 08 18:47:58.590046 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:58.590010 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-oauth-serving-cert\") pod \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\" (UID: \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\") " Jul 08 18:47:58.590498 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:58.590467 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-console-config\") pod \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\" (UID: \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\") " Jul 08 18:47:58.590631 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:58.590509 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-console-serving-cert\") pod \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\" (UID: \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\") " Jul 08 18:47:58.590631 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:58.590552 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5n7ct\" (UniqueName: \"kubernetes.io/projected/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-kube-api-access-5n7ct\") pod \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\" (UID: \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\") " Jul 08 18:47:58.590914 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:58.590025 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-service-ca" (OuterVolumeSpecName: "service-ca") pod "67aac4c8-9fe8-4a0b-9e3f-439c497e03ad" (UID: "67aac4c8-9fe8-4a0b-9e3f-439c497e03ad"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:47:58.591168 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:58.591124 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-console-oauth-config\") pod \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\" (UID: \"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad\") " Jul 08 18:47:58.591295 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:58.591274 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "67aac4c8-9fe8-4a0b-9e3f-439c497e03ad" (UID: "67aac4c8-9fe8-4a0b-9e3f-439c497e03ad"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:47:58.591426 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:58.591379 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-service-ca\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 18:47:58.591584 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:58.591409 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "67aac4c8-9fe8-4a0b-9e3f-439c497e03ad" (UID: "67aac4c8-9fe8-4a0b-9e3f-439c497e03ad"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:47:58.591704 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:58.591679 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-console-config" (OuterVolumeSpecName: "console-config") pod "67aac4c8-9fe8-4a0b-9e3f-439c497e03ad" (UID: "67aac4c8-9fe8-4a0b-9e3f-439c497e03ad"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:47:58.593280 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:58.593248 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-kube-api-access-5n7ct" (OuterVolumeSpecName: "kube-api-access-5n7ct") pod "67aac4c8-9fe8-4a0b-9e3f-439c497e03ad" (UID: "67aac4c8-9fe8-4a0b-9e3f-439c497e03ad"). InnerVolumeSpecName "kube-api-access-5n7ct". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:47:58.593400 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:58.593368 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "67aac4c8-9fe8-4a0b-9e3f-439c497e03ad" (UID: "67aac4c8-9fe8-4a0b-9e3f-439c497e03ad"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:47:58.593763 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:58.593748 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "67aac4c8-9fe8-4a0b-9e3f-439c497e03ad" (UID: "67aac4c8-9fe8-4a0b-9e3f-439c497e03ad"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:47:58.692537 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:58.692509 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-console-oauth-config\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 18:47:58.692537 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:58.692532 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-trusted-ca-bundle\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 18:47:58.692537 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:58.692541 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-oauth-serving-cert\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 18:47:58.692768 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:58.692550 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-console-config\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 18:47:58.692768 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:58.692560 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-console-serving-cert\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 18:47:58.692768 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:58.692568 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5n7ct\" (UniqueName: \"kubernetes.io/projected/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad-kube-api-access-5n7ct\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 18:47:59.364614 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:59.364563 2572 generic.go:356] "Generic (PLEG): container finished" podID="67aac4c8-9fe8-4a0b-9e3f-439c497e03ad" containerID="ae486b52f487d2731e8d17665a98a6e4418652e5bf72e90edd7c0e9970c0ea85" exitCode=0 Jul 08 18:47:59.365020 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:59.364627 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cccb7d4b-cqwc6" event={"ID":"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad","Type":"ContainerDied","Data":"ae486b52f487d2731e8d17665a98a6e4418652e5bf72e90edd7c0e9970c0ea85"} Jul 08 18:47:59.365020 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:59.364647 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cccb7d4b-cqwc6" Jul 08 18:47:59.365020 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:59.364695 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cccb7d4b-cqwc6" event={"ID":"67aac4c8-9fe8-4a0b-9e3f-439c497e03ad","Type":"ContainerDied","Data":"38fdd3d691b904ec5389be281199208cfce07d75f7d1f4c1ac22189f769f43a1"} Jul 08 18:47:59.365020 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:59.364708 2572 scope.go:117] "RemoveContainer" containerID="ae486b52f487d2731e8d17665a98a6e4418652e5bf72e90edd7c0e9970c0ea85" Jul 08 18:47:59.372850 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:59.372821 2572 scope.go:117] "RemoveContainer" containerID="ae486b52f487d2731e8d17665a98a6e4418652e5bf72e90edd7c0e9970c0ea85" Jul 08 18:47:59.373130 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:47:59.373106 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae486b52f487d2731e8d17665a98a6e4418652e5bf72e90edd7c0e9970c0ea85\": container with ID starting with ae486b52f487d2731e8d17665a98a6e4418652e5bf72e90edd7c0e9970c0ea85 not found: ID does not exist" containerID="ae486b52f487d2731e8d17665a98a6e4418652e5bf72e90edd7c0e9970c0ea85" Jul 08 18:47:59.373222 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:59.373137 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae486b52f487d2731e8d17665a98a6e4418652e5bf72e90edd7c0e9970c0ea85"} err="failed to get container status \"ae486b52f487d2731e8d17665a98a6e4418652e5bf72e90edd7c0e9970c0ea85\": rpc error: code = NotFound desc = could not find container \"ae486b52f487d2731e8d17665a98a6e4418652e5bf72e90edd7c0e9970c0ea85\": container with ID starting with ae486b52f487d2731e8d17665a98a6e4418652e5bf72e90edd7c0e9970c0ea85 not found: ID does not exist" Jul 08 18:47:59.382722 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:59.382697 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59cccb7d4b-cqwc6"] Jul 08 18:47:59.387021 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:47:59.386998 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59cccb7d4b-cqwc6"] Jul 08 18:48:00.689573 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:00.689534 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67aac4c8-9fe8-4a0b-9e3f-439c497e03ad" path="/var/lib/kubelet/pods/67aac4c8-9fe8-4a0b-9e3f-439c497e03ad/volumes" Jul 08 18:48:05.535454 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:05.535407 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:48:29.007212 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:29.007130 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:48:29.091040 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:29.091011 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:48:33.188384 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:33.188338 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:48:34.122271 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.122241 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bddf47748-788xh"] Jul 08 18:48:34.122601 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.122574 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67aac4c8-9fe8-4a0b-9e3f-439c497e03ad" containerName="console" Jul 08 18:48:34.122661 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.122613 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="67aac4c8-9fe8-4a0b-9e3f-439c497e03ad" containerName="console" Jul 08 18:48:34.122661 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.122627 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdbe9304-92f1-492d-a5de-88d4cba079dd" containerName="registry" Jul 08 18:48:34.122661 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.122633 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdbe9304-92f1-492d-a5de-88d4cba079dd" containerName="registry" Jul 08 18:48:34.122750 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.122713 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdbe9304-92f1-492d-a5de-88d4cba079dd" containerName="registry" Jul 08 18:48:34.122750 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.122722 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="67aac4c8-9fe8-4a0b-9e3f-439c497e03ad" containerName="console" Jul 08 18:48:34.124732 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.124707 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bddf47748-788xh" Jul 08 18:48:34.127723 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.127699 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 08 18:48:34.127836 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.127785 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 08 18:48:34.128549 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.128518 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 08 18:48:34.128549 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.128552 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 08 18:48:34.128764 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.128579 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 08 18:48:34.128764 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.128607 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wqtlv\"" Jul 08 18:48:34.128764 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.128628 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 08 18:48:34.128927 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.128891 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 08 18:48:34.137333 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.137307 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 08 18:48:34.146293 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.146271 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bddf47748-788xh"] Jul 08 18:48:34.190099 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.190071 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:48:34.252899 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.252876 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:48:34.259992 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.259975 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-console-oauth-config\") pod \"console-5bddf47748-788xh\" (UID: \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\") " pod="openshift-console/console-5bddf47748-788xh" Jul 08 18:48:34.260058 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.260000 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpkg8\" (UniqueName: \"kubernetes.io/projected/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-kube-api-access-qpkg8\") pod \"console-5bddf47748-788xh\" (UID: \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\") " pod="openshift-console/console-5bddf47748-788xh" Jul 08 18:48:34.260058 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.260021 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-console-config\") pod \"console-5bddf47748-788xh\" (UID: \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\") " pod="openshift-console/console-5bddf47748-788xh" Jul 08 18:48:34.260123 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.260070 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-oauth-serving-cert\") pod \"console-5bddf47748-788xh\" (UID: \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\") " pod="openshift-console/console-5bddf47748-788xh" Jul 08 18:48:34.260160 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.260118 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-trusted-ca-bundle\") pod \"console-5bddf47748-788xh\" (UID: \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\") " pod="openshift-console/console-5bddf47748-788xh" Jul 08 18:48:34.260160 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.260148 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-service-ca\") pod \"console-5bddf47748-788xh\" (UID: \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\") " pod="openshift-console/console-5bddf47748-788xh" Jul 08 18:48:34.260220 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.260170 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-console-serving-cert\") pod \"console-5bddf47748-788xh\" (UID: \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\") " pod="openshift-console/console-5bddf47748-788xh" Jul 08 18:48:34.360737 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.360711 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-console-oauth-config\") pod \"console-5bddf47748-788xh\" (UID: \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\") " pod="openshift-console/console-5bddf47748-788xh" Jul 08 18:48:34.360737 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.360743 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpkg8\" (UniqueName: \"kubernetes.io/projected/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-kube-api-access-qpkg8\") pod \"console-5bddf47748-788xh\" (UID: \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\") " pod="openshift-console/console-5bddf47748-788xh" Jul 08 18:48:34.360867 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.360764 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-console-config\") pod \"console-5bddf47748-788xh\" (UID: \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\") " pod="openshift-console/console-5bddf47748-788xh" Jul 08 18:48:34.360867 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.360784 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-oauth-serving-cert\") pod \"console-5bddf47748-788xh\" (UID: \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\") " pod="openshift-console/console-5bddf47748-788xh" Jul 08 18:48:34.360867 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.360815 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-trusted-ca-bundle\") pod \"console-5bddf47748-788xh\" (UID: \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\") " pod="openshift-console/console-5bddf47748-788xh" Jul 08 18:48:34.361006 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.360947 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-service-ca\") pod \"console-5bddf47748-788xh\" (UID: \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\") " pod="openshift-console/console-5bddf47748-788xh" Jul 08 18:48:34.361006 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.360999 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-console-serving-cert\") pod \"console-5bddf47748-788xh\" (UID: \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\") " pod="openshift-console/console-5bddf47748-788xh" Jul 08 18:48:34.361549 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.361527 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-console-config\") pod \"console-5bddf47748-788xh\" (UID: \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\") " pod="openshift-console/console-5bddf47748-788xh" Jul 08 18:48:34.361715 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.361693 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-trusted-ca-bundle\") pod \"console-5bddf47748-788xh\" (UID: \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\") " pod="openshift-console/console-5bddf47748-788xh" Jul 08 18:48:34.361715 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.361622 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-oauth-serving-cert\") pod \"console-5bddf47748-788xh\" (UID: \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\") " pod="openshift-console/console-5bddf47748-788xh" Jul 08 18:48:34.361715 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.361626 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-service-ca\") pod \"console-5bddf47748-788xh\" (UID: \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\") " pod="openshift-console/console-5bddf47748-788xh" Jul 08 18:48:34.363260 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.363239 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-console-oauth-config\") pod \"console-5bddf47748-788xh\" (UID: \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\") " pod="openshift-console/console-5bddf47748-788xh" Jul 08 18:48:34.363458 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.363440 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-console-serving-cert\") pod \"console-5bddf47748-788xh\" (UID: \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\") " pod="openshift-console/console-5bddf47748-788xh" Jul 08 18:48:34.368320 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.368303 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpkg8\" (UniqueName: \"kubernetes.io/projected/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-kube-api-access-qpkg8\") pod \"console-5bddf47748-788xh\" (UID: \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\") " pod="openshift-console/console-5bddf47748-788xh" Jul 08 18:48:34.439484 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.439462 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bddf47748-788xh" Jul 08 18:48:34.580681 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:34.580654 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bddf47748-788xh"] Jul 08 18:48:34.583362 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:48:34.583333 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58ce49e0_4e7e_469e_8e86_431a98f3cd6d.slice/crio-0533e00d9bcba8bea67898437b6d35bd5a33ef80aee76a027e26ed7e57d7cbe2 WatchSource:0}: Error finding container 0533e00d9bcba8bea67898437b6d35bd5a33ef80aee76a027e26ed7e57d7cbe2: Status 404 returned error can't find the container with id 0533e00d9bcba8bea67898437b6d35bd5a33ef80aee76a027e26ed7e57d7cbe2 Jul 08 18:48:35.512185 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:35.512147 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bddf47748-788xh" event={"ID":"58ce49e0-4e7e-469e-8e86-431a98f3cd6d","Type":"ContainerStarted","Data":"3a6ee871d0aaa111e59dbf77a1b05ddb9724b4567550f932275ca80aaafe79bc"} Jul 08 18:48:35.512553 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:35.512203 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bddf47748-788xh" event={"ID":"58ce49e0-4e7e-469e-8e86-431a98f3cd6d","Type":"ContainerStarted","Data":"0533e00d9bcba8bea67898437b6d35bd5a33ef80aee76a027e26ed7e57d7cbe2"} Jul 08 18:48:35.533666 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:35.533618 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bddf47748-788xh" podStartSLOduration=1.533602412 podStartE2EDuration="1.533602412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:48:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:48:35.532040979 +0000 UTC m=+179.402456112" watchObservedRunningTime="2026-07-08 18:48:35.533602412 +0000 UTC m=+179.404017536" Jul 08 18:48:40.868696 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:40.868659 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:48:40.982328 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:40.982301 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:48:44.440200 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:44.440160 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bddf47748-788xh" Jul 08 18:48:44.440727 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:44.440251 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bddf47748-788xh" Jul 08 18:48:44.444884 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:44.444860 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5bddf47748-788xh" Jul 08 18:48:44.552704 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:44.552679 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5bddf47748-788xh" Jul 08 18:48:44.698222 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:44.698148 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:48:44.764740 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:44.764716 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:48:44.822952 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:44.822927 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:48:52.077024 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:52.076987 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:48:52.175445 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:48:52.175415 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:49:04.276291 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:49:04.276262 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:49:04.334915 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:49:04.334889 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:49:46.797195 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:49:46.797158 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:49:46.853663 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:49:46.853638 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:49:59.984848 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:49:59.984772 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:50:00.081068 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:00.081039 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:50:26.695487 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:26.695455 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:50:27.671910 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:27.671878 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:50:30.310554 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:30.310514 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:50:30.413822 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:30.413791 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:50:32.004458 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:32.004423 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:50:32.447633 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:32.447583 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bmljc"] Jul 08 18:50:32.450565 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:32.450546 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-bmljc" Jul 08 18:50:32.454914 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:32.454893 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 08 18:50:32.455016 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:32.454949 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 08 18:50:32.455740 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:32.455708 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-gnbzj\"" Jul 08 18:50:32.467147 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:32.467127 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bmljc"] Jul 08 18:50:32.513171 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:32.513151 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7793a4d0-bd34-405d-9bb6-3828f841364d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bmljc\" (UID: \"7793a4d0-bd34-405d-9bb6-3828f841364d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bmljc" Jul 08 18:50:32.513287 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:32.513222 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxdfc\" (UniqueName: \"kubernetes.io/projected/7793a4d0-bd34-405d-9bb6-3828f841364d-kube-api-access-rxdfc\") pod \"cert-manager-webhook-6486ffd997-bmljc\" (UID: \"7793a4d0-bd34-405d-9bb6-3828f841364d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bmljc" Jul 08 18:50:32.614284 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:32.614265 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7793a4d0-bd34-405d-9bb6-3828f841364d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bmljc\" (UID: \"7793a4d0-bd34-405d-9bb6-3828f841364d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bmljc" Jul 08 18:50:32.614381 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:32.614308 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxdfc\" (UniqueName: \"kubernetes.io/projected/7793a4d0-bd34-405d-9bb6-3828f841364d-kube-api-access-rxdfc\") pod \"cert-manager-webhook-6486ffd997-bmljc\" (UID: \"7793a4d0-bd34-405d-9bb6-3828f841364d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bmljc" Jul 08 18:50:32.627249 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:32.627230 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7793a4d0-bd34-405d-9bb6-3828f841364d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bmljc\" (UID: \"7793a4d0-bd34-405d-9bb6-3828f841364d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bmljc" Jul 08 18:50:32.627334 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:32.627297 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxdfc\" (UniqueName: \"kubernetes.io/projected/7793a4d0-bd34-405d-9bb6-3828f841364d-kube-api-access-rxdfc\") pod \"cert-manager-webhook-6486ffd997-bmljc\" (UID: \"7793a4d0-bd34-405d-9bb6-3828f841364d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bmljc" Jul 08 18:50:32.772014 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:32.771963 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-bmljc" Jul 08 18:50:32.900206 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:32.900183 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bmljc"] Jul 08 18:50:32.902375 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:50:32.902351 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7793a4d0_bd34_405d_9bb6_3828f841364d.slice/crio-fa637404781c624c1875283bad1498d40128217bffedb7660bee03714dd0dd9e WatchSource:0}: Error finding container fa637404781c624c1875283bad1498d40128217bffedb7660bee03714dd0dd9e: Status 404 returned error can't find the container with id fa637404781c624c1875283bad1498d40128217bffedb7660bee03714dd0dd9e Jul 08 18:50:32.977881 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:32.977849 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-bmljc" event={"ID":"7793a4d0-bd34-405d-9bb6-3828f841364d","Type":"ContainerStarted","Data":"fa637404781c624c1875283bad1498d40128217bffedb7660bee03714dd0dd9e"} Jul 08 18:50:33.748364 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:33.748337 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:50:34.202767 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:34.202697 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:50:34.403964 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:34.403872 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:50:36.517867 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:36.517835 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9hx2g_56065d42-401f-45fb-bf49-8885f262ad6f/console-operator/1.log" Jul 08 18:50:36.518305 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:36.518022 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9hx2g_56065d42-401f-45fb-bf49-8885f262ad6f/console-operator/1.log" Jul 08 18:50:36.527401 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:36.527379 2572 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 18:50:37.000235 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:37.000202 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-bmljc" event={"ID":"7793a4d0-bd34-405d-9bb6-3828f841364d","Type":"ContainerStarted","Data":"5c1941451ca51baa6b19f0c8fd1a66135a95f824e1aafa757f5c874747bc29b7"} Jul 08 18:50:37.002275 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:37.000276 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-bmljc" Jul 08 18:50:37.016350 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:37.016299 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-bmljc" podStartSLOduration=1.357338184 podStartE2EDuration="5.016281095s" totalImagesPullingTime="3.658942911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:50:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:50:37.015677564 +0000 UTC m=+300.886092714" watchObservedRunningTime="2026-07-08 18:50:37.016281095 +0000 UTC m=+300.886696231" Jul 08 18:50:37.094953 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:37.094932 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:50:37.196108 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:37.196084 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:50:42.605803 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:42.605768 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:50:42.972182 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:42.972149 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:50:43.007580 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:43.007549 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-bmljc" Jul 08 18:50:43.039075 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:43.039047 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:50:44.589001 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:44.588969 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:50:44.689116 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:44.689085 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:50:51.011647 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:51.011580 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:50:51.111377 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:51.111337 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:50:52.580645 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:52.580614 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-bpbwg"] Jul 08 18:50:52.583821 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:52.583802 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-bpbwg" Jul 08 18:50:52.586692 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:52.586670 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-bgw9f\"" Jul 08 18:50:52.596972 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:52.596943 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-bpbwg"] Jul 08 18:50:52.662761 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:52.662725 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4def26b6-d9d6-4aae-92fb-a4d37de7f433-bound-sa-token\") pod \"cert-manager-55b4d954d5-bpbwg\" (UID: \"4def26b6-d9d6-4aae-92fb-a4d37de7f433\") " pod="cert-manager/cert-manager-55b4d954d5-bpbwg" Jul 08 18:50:52.662947 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:52.662806 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnbzc\" (UniqueName: \"kubernetes.io/projected/4def26b6-d9d6-4aae-92fb-a4d37de7f433-kube-api-access-tnbzc\") pod \"cert-manager-55b4d954d5-bpbwg\" (UID: \"4def26b6-d9d6-4aae-92fb-a4d37de7f433\") " pod="cert-manager/cert-manager-55b4d954d5-bpbwg" Jul 08 18:50:52.763908 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:52.763861 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnbzc\" (UniqueName: \"kubernetes.io/projected/4def26b6-d9d6-4aae-92fb-a4d37de7f433-kube-api-access-tnbzc\") pod \"cert-manager-55b4d954d5-bpbwg\" (UID: \"4def26b6-d9d6-4aae-92fb-a4d37de7f433\") " pod="cert-manager/cert-manager-55b4d954d5-bpbwg" Jul 08 18:50:52.764070 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:52.763942 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4def26b6-d9d6-4aae-92fb-a4d37de7f433-bound-sa-token\") pod \"cert-manager-55b4d954d5-bpbwg\" (UID: \"4def26b6-d9d6-4aae-92fb-a4d37de7f433\") " pod="cert-manager/cert-manager-55b4d954d5-bpbwg" Jul 08 18:50:52.775818 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:52.775784 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4def26b6-d9d6-4aae-92fb-a4d37de7f433-bound-sa-token\") pod \"cert-manager-55b4d954d5-bpbwg\" (UID: \"4def26b6-d9d6-4aae-92fb-a4d37de7f433\") " pod="cert-manager/cert-manager-55b4d954d5-bpbwg" Jul 08 18:50:52.776009 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:52.775985 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnbzc\" (UniqueName: \"kubernetes.io/projected/4def26b6-d9d6-4aae-92fb-a4d37de7f433-kube-api-access-tnbzc\") pod \"cert-manager-55b4d954d5-bpbwg\" (UID: \"4def26b6-d9d6-4aae-92fb-a4d37de7f433\") " pod="cert-manager/cert-manager-55b4d954d5-bpbwg" Jul 08 18:50:52.791386 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:52.791359 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:50:52.892178 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:52.892108 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-bpbwg" Jul 08 18:50:53.017220 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:53.017188 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-bpbwg"] Jul 08 18:50:53.019472 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:50:53.019447 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4def26b6_d9d6_4aae_92fb_a4d37de7f433.slice/crio-83b63fbfa477e810f2a272d4ce6b62731d5e8ee2aa39cf1cbc74b3b7f99d258c WatchSource:0}: Error finding container 83b63fbfa477e810f2a272d4ce6b62731d5e8ee2aa39cf1cbc74b3b7f99d258c: Status 404 returned error can't find the container with id 83b63fbfa477e810f2a272d4ce6b62731d5e8ee2aa39cf1cbc74b3b7f99d258c Jul 08 18:50:53.064963 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:53.064938 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-bpbwg" event={"ID":"4def26b6-d9d6-4aae-92fb-a4d37de7f433","Type":"ContainerStarted","Data":"83b63fbfa477e810f2a272d4ce6b62731d5e8ee2aa39cf1cbc74b3b7f99d258c"} Jul 08 18:50:54.071471 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:54.071437 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-bpbwg" event={"ID":"4def26b6-d9d6-4aae-92fb-a4d37de7f433","Type":"ContainerStarted","Data":"8d8dbe7d0ac99a219b2cbcf6532b94684c18c8eb779557c07a5ff942d5db0aa0"} Jul 08 18:50:54.095042 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:50:54.094997 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-bpbwg" podStartSLOduration=2.094981359 podStartE2EDuration="2.094981359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:50:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:50:54.094084183 +0000 UTC m=+317.964499337" watchObservedRunningTime="2026-07-08 18:50:54.094981359 +0000 UTC m=+317.965396491" Jul 08 18:51:06.801251 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:06.801212 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:07.969845 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:07.969808 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:08.060803 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:08.060770 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:08.615428 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:08.615395 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:08.984053 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:08.984011 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:09.091809 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:09.091765 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:09.161366 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:09.161334 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bb8746f75-mvmxk"] Jul 08 18:51:09.177332 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:09.177305 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-mvmxk" Jul 08 18:51:09.181056 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:09.181034 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 08 18:51:09.181215 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:09.181079 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 08 18:51:09.181336 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:09.181320 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 08 18:51:09.181687 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:09.181663 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4vdkb\"" Jul 08 18:51:09.181907 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:09.181885 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 08 18:51:09.188536 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:09.188510 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bb8746f75-mvmxk"] Jul 08 18:51:09.297681 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:09.297581 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/479c7884-121b-4edd-978c-08d86b7fbb96-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bb8746f75-mvmxk\" (UID: \"479c7884-121b-4edd-978c-08d86b7fbb96\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-mvmxk" Jul 08 18:51:09.297825 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:09.297686 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkdsq\" (UniqueName: \"kubernetes.io/projected/479c7884-121b-4edd-978c-08d86b7fbb96-kube-api-access-lkdsq\") pod \"opendatahub-operator-controller-manager-6bb8746f75-mvmxk\" (UID: \"479c7884-121b-4edd-978c-08d86b7fbb96\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-mvmxk" Jul 08 18:51:09.297825 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:09.297767 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/479c7884-121b-4edd-978c-08d86b7fbb96-manifests\") pod \"opendatahub-operator-controller-manager-6bb8746f75-mvmxk\" (UID: \"479c7884-121b-4edd-978c-08d86b7fbb96\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-mvmxk" Jul 08 18:51:09.297825 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:09.297796 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/479c7884-121b-4edd-978c-08d86b7fbb96-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bb8746f75-mvmxk\" (UID: \"479c7884-121b-4edd-978c-08d86b7fbb96\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-mvmxk" Jul 08 18:51:09.297964 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:09.297845 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/479c7884-121b-4edd-978c-08d86b7fbb96-tmp\") pod \"opendatahub-operator-controller-manager-6bb8746f75-mvmxk\" (UID: \"479c7884-121b-4edd-978c-08d86b7fbb96\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-mvmxk" Jul 08 18:51:09.398461 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:09.398433 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/479c7884-121b-4edd-978c-08d86b7fbb96-manifests\") pod \"opendatahub-operator-controller-manager-6bb8746f75-mvmxk\" (UID: \"479c7884-121b-4edd-978c-08d86b7fbb96\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-mvmxk" Jul 08 18:51:09.398461 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:09.398465 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/479c7884-121b-4edd-978c-08d86b7fbb96-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bb8746f75-mvmxk\" (UID: \"479c7884-121b-4edd-978c-08d86b7fbb96\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-mvmxk" Jul 08 18:51:09.398707 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:09.398488 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/479c7884-121b-4edd-978c-08d86b7fbb96-tmp\") pod \"opendatahub-operator-controller-manager-6bb8746f75-mvmxk\" (UID: \"479c7884-121b-4edd-978c-08d86b7fbb96\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-mvmxk" Jul 08 18:51:09.398707 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:09.398524 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/479c7884-121b-4edd-978c-08d86b7fbb96-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bb8746f75-mvmxk\" (UID: \"479c7884-121b-4edd-978c-08d86b7fbb96\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-mvmxk" Jul 08 18:51:09.398707 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:09.398572 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkdsq\" (UniqueName: \"kubernetes.io/projected/479c7884-121b-4edd-978c-08d86b7fbb96-kube-api-access-lkdsq\") pod \"opendatahub-operator-controller-manager-6bb8746f75-mvmxk\" (UID: \"479c7884-121b-4edd-978c-08d86b7fbb96\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-mvmxk" Jul 08 18:51:09.398894 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:09.398874 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/479c7884-121b-4edd-978c-08d86b7fbb96-manifests\") pod \"opendatahub-operator-controller-manager-6bb8746f75-mvmxk\" (UID: \"479c7884-121b-4edd-978c-08d86b7fbb96\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-mvmxk" Jul 08 18:51:09.400789 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:09.400760 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/479c7884-121b-4edd-978c-08d86b7fbb96-tmp\") pod \"opendatahub-operator-controller-manager-6bb8746f75-mvmxk\" (UID: \"479c7884-121b-4edd-978c-08d86b7fbb96\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-mvmxk" Jul 08 18:51:09.401226 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:09.401195 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/479c7884-121b-4edd-978c-08d86b7fbb96-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bb8746f75-mvmxk\" (UID: \"479c7884-121b-4edd-978c-08d86b7fbb96\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-mvmxk" Jul 08 18:51:09.401271 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:09.401195 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/479c7884-121b-4edd-978c-08d86b7fbb96-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bb8746f75-mvmxk\" (UID: \"479c7884-121b-4edd-978c-08d86b7fbb96\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-mvmxk" Jul 08 18:51:09.410385 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:09.410356 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkdsq\" (UniqueName: \"kubernetes.io/projected/479c7884-121b-4edd-978c-08d86b7fbb96-kube-api-access-lkdsq\") pod \"opendatahub-operator-controller-manager-6bb8746f75-mvmxk\" (UID: \"479c7884-121b-4edd-978c-08d86b7fbb96\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-mvmxk" Jul 08 18:51:09.410859 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:09.410839 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:09.492429 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:09.492401 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-mvmxk" Jul 08 18:51:09.600155 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:09.600120 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:09.644055 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:09.644030 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bb8746f75-mvmxk"] Jul 08 18:51:09.646473 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:51:09.646449 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod479c7884_121b_4edd_978c_08d86b7fbb96.slice/crio-a311a6c914f8855f097cf884dc30d93d33d5a88220232b38a97b6d2cb9053de9 WatchSource:0}: Error finding container a311a6c914f8855f097cf884dc30d93d33d5a88220232b38a97b6d2cb9053de9: Status 404 returned error can't find the container with id a311a6c914f8855f097cf884dc30d93d33d5a88220232b38a97b6d2cb9053de9 Jul 08 18:51:09.648270 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:09.648250 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 18:51:09.697824 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:09.697795 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:09.797843 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:09.797813 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:09.899731 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:09.899666 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:10.147768 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:10.147734 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-mvmxk" event={"ID":"479c7884-121b-4edd-978c-08d86b7fbb96","Type":"ContainerStarted","Data":"a311a6c914f8855f097cf884dc30d93d33d5a88220232b38a97b6d2cb9053de9"} Jul 08 18:51:13.166353 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:13.166319 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-mvmxk" event={"ID":"479c7884-121b-4edd-978c-08d86b7fbb96","Type":"ContainerStarted","Data":"a62329700b92f1edeabf0f270930227cadb7326f798c27d74663c694065e795f"} Jul 08 18:51:14.172143 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:14.172105 2572 generic.go:356] "Generic (PLEG): container finished" podID="479c7884-121b-4edd-978c-08d86b7fbb96" containerID="a62329700b92f1edeabf0f270930227cadb7326f798c27d74663c694065e795f" exitCode=0 Jul 08 18:51:14.172546 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:14.172181 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-mvmxk" event={"ID":"479c7884-121b-4edd-978c-08d86b7fbb96","Type":"ContainerDied","Data":"a62329700b92f1edeabf0f270930227cadb7326f798c27d74663c694065e795f"} Jul 08 18:51:15.178374 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:15.178340 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-mvmxk" event={"ID":"479c7884-121b-4edd-978c-08d86b7fbb96","Type":"ContainerStarted","Data":"8ec8f1af7dbf087d951796677ea9b00ad6ba72c65c3a11116d0f884d3c3f0439"} Jul 08 18:51:15.178797 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:15.178419 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-mvmxk" Jul 08 18:51:15.210026 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:15.209973 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-mvmxk" podStartSLOduration=1.8799296399999998 podStartE2EDuration="6.209956566s" totalImagesPullingTime="3.259677144s" totalInitContainerRuntime="1.070349782s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:51:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:51:15.208390581 +0000 UTC m=+339.078805715" watchObservedRunningTime="2026-07-08 18:51:15.209956566 +0000 UTC m=+339.080371699" Jul 08 18:51:21.308445 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:21.308408 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:21.410233 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:21.410202 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:26.184760 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:26.184730 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-mvmxk" Jul 08 18:51:28.102916 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:28.102837 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:28.227544 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:28.227498 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:28.811545 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:28.811496 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:28.820963 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:28.820930 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-64798db975-m9jct"] Jul 08 18:51:28.823280 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:28.823264 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-64798db975-m9jct" Jul 08 18:51:28.825737 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:28.825718 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 08 18:51:28.825956 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:28.825941 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 08 18:51:28.858312 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:28.858293 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-64798db975-m9jct"] Jul 08 18:51:28.875956 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:28.875937 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/884ab97a-0180-4260-90f0-2f946324d58a-tls-certs\") pod \"kube-auth-proxy-64798db975-m9jct\" (UID: \"884ab97a-0180-4260-90f0-2f946324d58a\") " pod="openshift-ingress/kube-auth-proxy-64798db975-m9jct" Jul 08 18:51:28.876053 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:28.875963 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj456\" (UniqueName: \"kubernetes.io/projected/884ab97a-0180-4260-90f0-2f946324d58a-kube-api-access-hj456\") pod \"kube-auth-proxy-64798db975-m9jct\" (UID: \"884ab97a-0180-4260-90f0-2f946324d58a\") " pod="openshift-ingress/kube-auth-proxy-64798db975-m9jct" Jul 08 18:51:28.876053 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:28.875993 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/884ab97a-0180-4260-90f0-2f946324d58a-tmp\") pod \"kube-auth-proxy-64798db975-m9jct\" (UID: \"884ab97a-0180-4260-90f0-2f946324d58a\") " pod="openshift-ingress/kube-auth-proxy-64798db975-m9jct" Jul 08 18:51:28.976692 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:28.976664 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/884ab97a-0180-4260-90f0-2f946324d58a-tls-certs\") pod \"kube-auth-proxy-64798db975-m9jct\" (UID: \"884ab97a-0180-4260-90f0-2f946324d58a\") " pod="openshift-ingress/kube-auth-proxy-64798db975-m9jct" Jul 08 18:51:28.976692 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:28.976691 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj456\" (UniqueName: \"kubernetes.io/projected/884ab97a-0180-4260-90f0-2f946324d58a-kube-api-access-hj456\") pod \"kube-auth-proxy-64798db975-m9jct\" (UID: \"884ab97a-0180-4260-90f0-2f946324d58a\") " pod="openshift-ingress/kube-auth-proxy-64798db975-m9jct" Jul 08 18:51:28.976863 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:28.976727 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/884ab97a-0180-4260-90f0-2f946324d58a-tmp\") pod \"kube-auth-proxy-64798db975-m9jct\" (UID: \"884ab97a-0180-4260-90f0-2f946324d58a\") " pod="openshift-ingress/kube-auth-proxy-64798db975-m9jct" Jul 08 18:51:28.976863 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:51:28.976798 2572 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 08 18:51:28.976863 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:51:28.976863 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/884ab97a-0180-4260-90f0-2f946324d58a-tls-certs podName:884ab97a-0180-4260-90f0-2f946324d58a nodeName:}" failed. No retries permitted until 2026-07-08 18:51:29.476847363 +0000 UTC m=+353.347262479 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/884ab97a-0180-4260-90f0-2f946324d58a-tls-certs") pod "kube-auth-proxy-64798db975-m9jct" (UID: "884ab97a-0180-4260-90f0-2f946324d58a") : secret "kube-auth-proxy-tls" not found Jul 08 18:51:28.978796 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:28.978776 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/884ab97a-0180-4260-90f0-2f946324d58a-tmp\") pod \"kube-auth-proxy-64798db975-m9jct\" (UID: \"884ab97a-0180-4260-90f0-2f946324d58a\") " pod="openshift-ingress/kube-auth-proxy-64798db975-m9jct" Jul 08 18:51:28.999760 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:28.999734 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj456\" (UniqueName: \"kubernetes.io/projected/884ab97a-0180-4260-90f0-2f946324d58a-kube-api-access-hj456\") pod \"kube-auth-proxy-64798db975-m9jct\" (UID: \"884ab97a-0180-4260-90f0-2f946324d58a\") " pod="openshift-ingress/kube-auth-proxy-64798db975-m9jct" Jul 08 18:51:29.207821 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:29.207793 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:29.310176 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:29.310136 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:29.410884 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:29.410852 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:29.481515 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:29.481452 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/884ab97a-0180-4260-90f0-2f946324d58a-tls-certs\") pod \"kube-auth-proxy-64798db975-m9jct\" (UID: \"884ab97a-0180-4260-90f0-2f946324d58a\") " pod="openshift-ingress/kube-auth-proxy-64798db975-m9jct" Jul 08 18:51:29.483797 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:29.483777 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/884ab97a-0180-4260-90f0-2f946324d58a-tls-certs\") pod \"kube-auth-proxy-64798db975-m9jct\" (UID: \"884ab97a-0180-4260-90f0-2f946324d58a\") " pod="openshift-ingress/kube-auth-proxy-64798db975-m9jct" Jul 08 18:51:29.506730 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:29.506705 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:29.732947 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:29.732893 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-64798db975-m9jct" Jul 08 18:51:29.870689 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:29.870556 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-64798db975-m9jct"] Jul 08 18:51:29.873347 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:51:29.873321 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod884ab97a_0180_4260_90f0_2f946324d58a.slice/crio-d21203fa1e03f811fc00dd0bf29f589a830f3ea026647af96062bd6380bfb3ec WatchSource:0}: Error finding container d21203fa1e03f811fc00dd0bf29f589a830f3ea026647af96062bd6380bfb3ec: Status 404 returned error can't find the container with id d21203fa1e03f811fc00dd0bf29f589a830f3ea026647af96062bd6380bfb3ec Jul 08 18:51:30.247283 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:30.247239 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-64798db975-m9jct" event={"ID":"884ab97a-0180-4260-90f0-2f946324d58a","Type":"ContainerStarted","Data":"d21203fa1e03f811fc00dd0bf29f589a830f3ea026647af96062bd6380bfb3ec"} Jul 08 18:51:30.289305 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:30.289273 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:30.372185 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:30.372155 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pqqpp"] Jul 08 18:51:30.375469 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:30.375451 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-pqqpp" Jul 08 18:51:30.378951 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:30.378930 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-4pw89\"" Jul 08 18:51:30.379079 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:30.378975 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 08 18:51:30.389337 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:30.389312 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pqqpp"] Jul 08 18:51:30.403102 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:30.403078 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:30.490749 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:30.490725 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc4vd\" (UniqueName: \"kubernetes.io/projected/21a82610-8edb-4a37-a8ed-1a396de7437f-kube-api-access-xc4vd\") pod \"model-serving-api-54d89bd5fc-pqqpp\" (UID: \"21a82610-8edb-4a37-a8ed-1a396de7437f\") " pod="opendatahub/model-serving-api-54d89bd5fc-pqqpp" Jul 08 18:51:30.490854 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:30.490759 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21a82610-8edb-4a37-a8ed-1a396de7437f-tls-certs\") pod \"model-serving-api-54d89bd5fc-pqqpp\" (UID: \"21a82610-8edb-4a37-a8ed-1a396de7437f\") " pod="opendatahub/model-serving-api-54d89bd5fc-pqqpp" Jul 08 18:51:30.492311 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:30.492288 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:30.591779 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:30.591726 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc4vd\" (UniqueName: \"kubernetes.io/projected/21a82610-8edb-4a37-a8ed-1a396de7437f-kube-api-access-xc4vd\") pod \"model-serving-api-54d89bd5fc-pqqpp\" (UID: \"21a82610-8edb-4a37-a8ed-1a396de7437f\") " pod="opendatahub/model-serving-api-54d89bd5fc-pqqpp" Jul 08 18:51:30.591779 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:30.591756 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21a82610-8edb-4a37-a8ed-1a396de7437f-tls-certs\") pod \"model-serving-api-54d89bd5fc-pqqpp\" (UID: \"21a82610-8edb-4a37-a8ed-1a396de7437f\") " pod="opendatahub/model-serving-api-54d89bd5fc-pqqpp" Jul 08 18:51:30.594179 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:30.594152 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21a82610-8edb-4a37-a8ed-1a396de7437f-tls-certs\") pod \"model-serving-api-54d89bd5fc-pqqpp\" (UID: \"21a82610-8edb-4a37-a8ed-1a396de7437f\") " pod="opendatahub/model-serving-api-54d89bd5fc-pqqpp" Jul 08 18:51:30.600769 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:30.600750 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc4vd\" (UniqueName: \"kubernetes.io/projected/21a82610-8edb-4a37-a8ed-1a396de7437f-kube-api-access-xc4vd\") pod \"model-serving-api-54d89bd5fc-pqqpp\" (UID: \"21a82610-8edb-4a37-a8ed-1a396de7437f\") " pod="opendatahub/model-serving-api-54d89bd5fc-pqqpp" Jul 08 18:51:30.685409 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:30.685386 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-pqqpp" Jul 08 18:51:30.831850 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:30.831823 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pqqpp"] Jul 08 18:51:30.835379 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:51:30.835356 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21a82610_8edb_4a37_a8ed_1a396de7437f.slice/crio-b39f1bf23c0dea15253783e4bc2678fd9c6411296ff8e5a79302436b1b8a3ba0 WatchSource:0}: Error finding container b39f1bf23c0dea15253783e4bc2678fd9c6411296ff8e5a79302436b1b8a3ba0: Status 404 returned error can't find the container with id b39f1bf23c0dea15253783e4bc2678fd9c6411296ff8e5a79302436b1b8a3ba0 Jul 08 18:51:31.252412 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:31.252380 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-pqqpp" event={"ID":"21a82610-8edb-4a37-a8ed-1a396de7437f","Type":"ContainerStarted","Data":"b39f1bf23c0dea15253783e4bc2678fd9c6411296ff8e5a79302436b1b8a3ba0"} Jul 08 18:51:31.459377 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:31.459341 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:34.267148 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:34.267110 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-64798db975-m9jct" event={"ID":"884ab97a-0180-4260-90f0-2f946324d58a","Type":"ContainerStarted","Data":"4748a7ae992c6dd2b501e641ba5bc9590a6eec5a07dfeff848196856c89ce1b5"} Jul 08 18:51:34.268577 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:34.268556 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-pqqpp" event={"ID":"21a82610-8edb-4a37-a8ed-1a396de7437f","Type":"ContainerStarted","Data":"54e7b0d9715822d69a6473de22e62fea2c232fd66406ae8ec8508540268c6615"} Jul 08 18:51:34.268703 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:34.268638 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-pqqpp" Jul 08 18:51:34.289289 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:34.289248 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-64798db975-m9jct" podStartSLOduration=2.546113133 podStartE2EDuration="6.289234671s" totalImagesPullingTime="3.743121538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:51:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:51:34.287233027 +0000 UTC m=+358.157648159" watchObservedRunningTime="2026-07-08 18:51:34.289234671 +0000 UTC m=+358.159649837" Jul 08 18:51:34.306689 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:34.306641 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-pqqpp" podStartSLOduration=1.526773078 podStartE2EDuration="4.306623464s" totalImagesPullingTime="2.779850386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:51:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:51:34.306268735 +0000 UTC m=+358.176683869" watchObservedRunningTime="2026-07-08 18:51:34.306623464 +0000 UTC m=+358.177038598" Jul 08 18:51:36.170845 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:36.170809 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:36.290808 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:36.290773 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:37.284702 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.284673 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h"] Jul 08 18:51:37.287995 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.287977 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" Jul 08 18:51:37.290714 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.290693 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-xqsm8\"" Jul 08 18:51:37.291085 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.291065 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 08 18:51:37.301890 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.301868 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h"] Jul 08 18:51:37.333617 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.333568 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:37.347342 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.347321 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24b126ec-2b07-407a-9e43-93ded4c6fd79-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qg54h\" (UID: \"24b126ec-2b07-407a-9e43-93ded4c6fd79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" Jul 08 18:51:37.347443 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.347353 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24b126ec-2b07-407a-9e43-93ded4c6fd79-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qg54h\" (UID: \"24b126ec-2b07-407a-9e43-93ded4c6fd79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" Jul 08 18:51:37.347443 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.347383 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24b126ec-2b07-407a-9e43-93ded4c6fd79-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qg54h\" (UID: \"24b126ec-2b07-407a-9e43-93ded4c6fd79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" Jul 08 18:51:37.347443 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.347422 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24b126ec-2b07-407a-9e43-93ded4c6fd79-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qg54h\" (UID: \"24b126ec-2b07-407a-9e43-93ded4c6fd79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" Jul 08 18:51:37.347542 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.347453 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24b126ec-2b07-407a-9e43-93ded4c6fd79-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qg54h\" (UID: \"24b126ec-2b07-407a-9e43-93ded4c6fd79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" Jul 08 18:51:37.347542 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.347480 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjlmk\" (UniqueName: \"kubernetes.io/projected/24b126ec-2b07-407a-9e43-93ded4c6fd79-kube-api-access-mjlmk\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qg54h\" (UID: \"24b126ec-2b07-407a-9e43-93ded4c6fd79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" Jul 08 18:51:37.347542 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.347500 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24b126ec-2b07-407a-9e43-93ded4c6fd79-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qg54h\" (UID: \"24b126ec-2b07-407a-9e43-93ded4c6fd79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" Jul 08 18:51:37.347542 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.347514 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24b126ec-2b07-407a-9e43-93ded4c6fd79-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qg54h\" (UID: \"24b126ec-2b07-407a-9e43-93ded4c6fd79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" Jul 08 18:51:37.347542 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.347533 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24b126ec-2b07-407a-9e43-93ded4c6fd79-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qg54h\" (UID: \"24b126ec-2b07-407a-9e43-93ded4c6fd79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" Jul 08 18:51:37.448558 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.448536 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24b126ec-2b07-407a-9e43-93ded4c6fd79-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qg54h\" (UID: \"24b126ec-2b07-407a-9e43-93ded4c6fd79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" Jul 08 18:51:37.448653 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.448564 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjlmk\" (UniqueName: \"kubernetes.io/projected/24b126ec-2b07-407a-9e43-93ded4c6fd79-kube-api-access-mjlmk\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qg54h\" (UID: \"24b126ec-2b07-407a-9e43-93ded4c6fd79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" Jul 08 18:51:37.448653 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.448585 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24b126ec-2b07-407a-9e43-93ded4c6fd79-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qg54h\" (UID: \"24b126ec-2b07-407a-9e43-93ded4c6fd79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" Jul 08 18:51:37.448653 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.448622 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24b126ec-2b07-407a-9e43-93ded4c6fd79-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qg54h\" (UID: \"24b126ec-2b07-407a-9e43-93ded4c6fd79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" Jul 08 18:51:37.448653 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.448650 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24b126ec-2b07-407a-9e43-93ded4c6fd79-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qg54h\" (UID: \"24b126ec-2b07-407a-9e43-93ded4c6fd79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" Jul 08 18:51:37.448801 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.448697 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24b126ec-2b07-407a-9e43-93ded4c6fd79-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qg54h\" (UID: \"24b126ec-2b07-407a-9e43-93ded4c6fd79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" Jul 08 18:51:37.448801 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.448728 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24b126ec-2b07-407a-9e43-93ded4c6fd79-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qg54h\" (UID: \"24b126ec-2b07-407a-9e43-93ded4c6fd79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" Jul 08 18:51:37.448801 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.448762 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24b126ec-2b07-407a-9e43-93ded4c6fd79-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qg54h\" (UID: \"24b126ec-2b07-407a-9e43-93ded4c6fd79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" Jul 08 18:51:37.448801 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.448790 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24b126ec-2b07-407a-9e43-93ded4c6fd79-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qg54h\" (UID: \"24b126ec-2b07-407a-9e43-93ded4c6fd79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" Jul 08 18:51:37.449023 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.449000 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24b126ec-2b07-407a-9e43-93ded4c6fd79-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qg54h\" (UID: \"24b126ec-2b07-407a-9e43-93ded4c6fd79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" Jul 08 18:51:37.449330 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.449303 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24b126ec-2b07-407a-9e43-93ded4c6fd79-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qg54h\" (UID: \"24b126ec-2b07-407a-9e43-93ded4c6fd79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" Jul 08 18:51:37.449422 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.449341 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24b126ec-2b07-407a-9e43-93ded4c6fd79-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qg54h\" (UID: \"24b126ec-2b07-407a-9e43-93ded4c6fd79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" Jul 08 18:51:37.449422 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.449345 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24b126ec-2b07-407a-9e43-93ded4c6fd79-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qg54h\" (UID: \"24b126ec-2b07-407a-9e43-93ded4c6fd79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" Jul 08 18:51:37.449422 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.449410 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24b126ec-2b07-407a-9e43-93ded4c6fd79-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qg54h\" (UID: \"24b126ec-2b07-407a-9e43-93ded4c6fd79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" Jul 08 18:51:37.451168 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.451138 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24b126ec-2b07-407a-9e43-93ded4c6fd79-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qg54h\" (UID: \"24b126ec-2b07-407a-9e43-93ded4c6fd79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" Jul 08 18:51:37.451271 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.451255 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24b126ec-2b07-407a-9e43-93ded4c6fd79-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qg54h\" (UID: \"24b126ec-2b07-407a-9e43-93ded4c6fd79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" Jul 08 18:51:37.458650 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.458631 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24b126ec-2b07-407a-9e43-93ded4c6fd79-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qg54h\" (UID: \"24b126ec-2b07-407a-9e43-93ded4c6fd79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" Jul 08 18:51:37.459114 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.459092 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjlmk\" (UniqueName: \"kubernetes.io/projected/24b126ec-2b07-407a-9e43-93ded4c6fd79-kube-api-access-mjlmk\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qg54h\" (UID: \"24b126ec-2b07-407a-9e43-93ded4c6fd79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" Jul 08 18:51:37.580489 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.580421 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:37.598316 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.598298 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" Jul 08 18:51:37.752685 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.752654 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:37.766401 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:51:37.766376 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24b126ec_2b07_407a_9e43_93ded4c6fd79.slice/crio-b1c98f6fba47562ea66be9ce124635a60b66883ff4f49c3211a7620a883f7d72 WatchSource:0}: Error finding container b1c98f6fba47562ea66be9ce124635a60b66883ff4f49c3211a7620a883f7d72: Status 404 returned error can't find the container with id b1c98f6fba47562ea66be9ce124635a60b66883ff4f49c3211a7620a883f7d72 Jul 08 18:51:37.769362 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.769294 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h"] Jul 08 18:51:37.831073 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.831018 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7578f4df-wwsfs"] Jul 08 18:51:37.835877 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.835858 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7578f4df-wwsfs" Jul 08 18:51:37.838361 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.838339 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 08 18:51:37.838510 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.838491 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 08 18:51:37.838736 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.838718 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 08 18:51:37.840799 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.840783 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 08 18:51:37.840891 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.840842 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8lq4c\"" Jul 08 18:51:37.841050 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.841036 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 08 18:51:37.869087 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.869051 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7578f4df-wwsfs"] Jul 08 18:51:37.953637 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.953611 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dc13221e-2af9-4e71-82e0-3a100f7c679f-manager-config\") pod \"lws-controller-manager-7578f4df-wwsfs\" (UID: \"dc13221e-2af9-4e71-82e0-3a100f7c679f\") " pod="openshift-lws-operator/lws-controller-manager-7578f4df-wwsfs" Jul 08 18:51:37.953732 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.953653 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjp97\" (UniqueName: \"kubernetes.io/projected/dc13221e-2af9-4e71-82e0-3a100f7c679f-kube-api-access-rjp97\") pod \"lws-controller-manager-7578f4df-wwsfs\" (UID: \"dc13221e-2af9-4e71-82e0-3a100f7c679f\") " pod="openshift-lws-operator/lws-controller-manager-7578f4df-wwsfs" Jul 08 18:51:37.953783 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.953732 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc13221e-2af9-4e71-82e0-3a100f7c679f-cert\") pod \"lws-controller-manager-7578f4df-wwsfs\" (UID: \"dc13221e-2af9-4e71-82e0-3a100f7c679f\") " pod="openshift-lws-operator/lws-controller-manager-7578f4df-wwsfs" Jul 08 18:51:37.953837 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:37.953825 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dc13221e-2af9-4e71-82e0-3a100f7c679f-metrics-cert\") pod \"lws-controller-manager-7578f4df-wwsfs\" (UID: \"dc13221e-2af9-4e71-82e0-3a100f7c679f\") " pod="openshift-lws-operator/lws-controller-manager-7578f4df-wwsfs" Jul 08 18:51:38.054899 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:38.054871 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc13221e-2af9-4e71-82e0-3a100f7c679f-cert\") pod \"lws-controller-manager-7578f4df-wwsfs\" (UID: \"dc13221e-2af9-4e71-82e0-3a100f7c679f\") " pod="openshift-lws-operator/lws-controller-manager-7578f4df-wwsfs" Jul 08 18:51:38.055008 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:38.054977 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dc13221e-2af9-4e71-82e0-3a100f7c679f-metrics-cert\") pod \"lws-controller-manager-7578f4df-wwsfs\" (UID: \"dc13221e-2af9-4e71-82e0-3a100f7c679f\") " pod="openshift-lws-operator/lws-controller-manager-7578f4df-wwsfs" Jul 08 18:51:38.055072 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:38.055015 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dc13221e-2af9-4e71-82e0-3a100f7c679f-manager-config\") pod \"lws-controller-manager-7578f4df-wwsfs\" (UID: \"dc13221e-2af9-4e71-82e0-3a100f7c679f\") " pod="openshift-lws-operator/lws-controller-manager-7578f4df-wwsfs" Jul 08 18:51:38.055072 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:38.055043 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjp97\" (UniqueName: \"kubernetes.io/projected/dc13221e-2af9-4e71-82e0-3a100f7c679f-kube-api-access-rjp97\") pod \"lws-controller-manager-7578f4df-wwsfs\" (UID: \"dc13221e-2af9-4e71-82e0-3a100f7c679f\") " pod="openshift-lws-operator/lws-controller-manager-7578f4df-wwsfs" Jul 08 18:51:38.055626 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:38.055585 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dc13221e-2af9-4e71-82e0-3a100f7c679f-manager-config\") pod \"lws-controller-manager-7578f4df-wwsfs\" (UID: \"dc13221e-2af9-4e71-82e0-3a100f7c679f\") " pod="openshift-lws-operator/lws-controller-manager-7578f4df-wwsfs" Jul 08 18:51:38.057175 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:38.057159 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc13221e-2af9-4e71-82e0-3a100f7c679f-cert\") pod \"lws-controller-manager-7578f4df-wwsfs\" (UID: \"dc13221e-2af9-4e71-82e0-3a100f7c679f\") " pod="openshift-lws-operator/lws-controller-manager-7578f4df-wwsfs" Jul 08 18:51:38.057269 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:38.057252 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dc13221e-2af9-4e71-82e0-3a100f7c679f-metrics-cert\") pod \"lws-controller-manager-7578f4df-wwsfs\" (UID: \"dc13221e-2af9-4e71-82e0-3a100f7c679f\") " pod="openshift-lws-operator/lws-controller-manager-7578f4df-wwsfs" Jul 08 18:51:38.062873 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:38.062853 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjp97\" (UniqueName: \"kubernetes.io/projected/dc13221e-2af9-4e71-82e0-3a100f7c679f-kube-api-access-rjp97\") pod \"lws-controller-manager-7578f4df-wwsfs\" (UID: \"dc13221e-2af9-4e71-82e0-3a100f7c679f\") " pod="openshift-lws-operator/lws-controller-manager-7578f4df-wwsfs" Jul 08 18:51:38.145747 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:38.145692 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7578f4df-wwsfs" Jul 08 18:51:38.287270 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:38.287241 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" event={"ID":"24b126ec-2b07-407a-9e43-93ded4c6fd79","Type":"ContainerStarted","Data":"b1c98f6fba47562ea66be9ce124635a60b66883ff4f49c3211a7620a883f7d72"} Jul 08 18:51:38.296355 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:38.296334 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7578f4df-wwsfs"] Jul 08 18:51:38.298533 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:51:38.298508 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc13221e_2af9_4e71_82e0_3a100f7c679f.slice/crio-98b9c8eeaa5531af11a79493fb34eb0df9d3a3d581d1113099be6c7d99fc523a WatchSource:0}: Error finding container 98b9c8eeaa5531af11a79493fb34eb0df9d3a3d581d1113099be6c7d99fc523a: Status 404 returned error can't find the container with id 98b9c8eeaa5531af11a79493fb34eb0df9d3a3d581d1113099be6c7d99fc523a Jul 08 18:51:39.295728 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:39.295651 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7578f4df-wwsfs" event={"ID":"dc13221e-2af9-4e71-82e0-3a100f7c679f","Type":"ContainerStarted","Data":"98b9c8eeaa5531af11a79493fb34eb0df9d3a3d581d1113099be6c7d99fc523a"} Jul 08 18:51:40.787341 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:40.787281 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 18:51:40.787724 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:40.787399 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 18:51:40.787724 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:40.787460 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 18:51:41.306739 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:41.306656 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:41.312377 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:41.312341 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" event={"ID":"24b126ec-2b07-407a-9e43-93ded4c6fd79","Type":"ContainerStarted","Data":"3f6ff6e57ff6f4d958cf80b7f884ed7a3c54f25eb199c77ee782f426b6fdf92d"} Jul 08 18:51:41.374642 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:41.374547 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" podStartSLOduration=1.357067857 podStartE2EDuration="4.374525265s" totalImagesPullingTime="3.017457408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:51:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:51:41.372661345 +0000 UTC m=+365.243076479" watchObservedRunningTime="2026-07-08 18:51:41.374525265 +0000 UTC m=+365.244940399" Jul 08 18:51:41.432648 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:41.432610 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:41.541179 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:41.541148 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:41.599272 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:41.599191 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" Jul 08 18:51:41.600937 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:41.600911 2572 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6576859cf4qg54h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body= Jul 08 18:51:41.601048 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:41.600967 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" podUID="24b126ec-2b07-407a-9e43-93ded4c6fd79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" Jul 08 18:51:41.692462 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:41.692431 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:41.790439 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:41.790405 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:42.003263 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:42.003232 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:42.244974 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:42.244941 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:42.603222 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:42.603195 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" Jul 08 18:51:43.199444 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:43.199414 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:51:43.324945 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:43.324904 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7578f4df-wwsfs" event={"ID":"dc13221e-2af9-4e71-82e0-3a100f7c679f","Type":"ContainerStarted","Data":"68c595e2974b5b470aceb65efd9c208512a9b0b05359d39d3cb4e819f853cf3a"} Jul 08 18:51:43.325126 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:43.325028 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" Jul 08 18:51:43.325126 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:43.325075 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7578f4df-wwsfs" Jul 08 18:51:43.331843 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:43.331821 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qg54h" Jul 08 18:51:43.447325 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:43.447278 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7578f4df-wwsfs" podStartSLOduration=2.080635637 podStartE2EDuration="6.447259751s" totalImagesPullingTime="4.366624114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:51:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:51:43.389150026 +0000 UTC m=+367.259565158" watchObservedRunningTime="2026-07-08 18:51:43.447259751 +0000 UTC m=+367.317674884" Jul 08 18:51:45.276822 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:45.276796 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-pqqpp" Jul 08 18:51:54.332536 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:51:54.332507 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7578f4df-wwsfs" Jul 08 18:52:03.166359 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:52:03.166321 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:52:03.224819 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:52:03.224789 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:52:05.012057 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:52:05.012020 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:52:29.576289 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:52:29.576224 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:52:29.673705 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:52:29.673679 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:52:29.775293 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:52:29.775266 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:52:37.453464 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:52:37.453435 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:52:37.554006 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:52:37.553967 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:52:37.616612 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:52:37.616565 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:52:38.171294 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:52:38.171258 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:52:38.272805 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:52:38.272767 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:52:48.735456 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:52:48.735416 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bddf47748-788xh"] Jul 08 18:52:48.971061 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:52:48.971013 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:52:49.102632 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:52:49.102515 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:52:56.599536 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:52:56.599497 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:00.942185 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:00.942093 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:08.068659 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:08.068624 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:11.467703 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:11.467668 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:12.375903 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:12.375869 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:13.755966 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:13.755899 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5bddf47748-788xh" podUID="58ce49e0-4e7e-469e-8e86-431a98f3cd6d" containerName="console" containerID="cri-o://3a6ee871d0aaa111e59dbf77a1b05ddb9724b4567550f932275ca80aaafe79bc" gracePeriod=15 Jul 08 18:53:13.997411 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:13.997386 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bddf47748-788xh" Jul 08 18:53:14.119557 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:14.119498 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-console-oauth-config\") pod \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\" (UID: \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\") " Jul 08 18:53:14.119557 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:14.119537 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpkg8\" (UniqueName: \"kubernetes.io/projected/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-kube-api-access-qpkg8\") pod \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\" (UID: \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\") " Jul 08 18:53:14.119774 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:14.119567 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-oauth-serving-cert\") pod \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\" (UID: \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\") " Jul 08 18:53:14.119774 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:14.119604 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-console-config\") pod \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\" (UID: \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\") " Jul 08 18:53:14.119774 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:14.119638 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-console-serving-cert\") pod \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\" (UID: \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\") " Jul 08 18:53:14.119774 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:14.119671 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-trusted-ca-bundle\") pod \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\" (UID: \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\") " Jul 08 18:53:14.119774 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:14.119716 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-service-ca\") pod \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\" (UID: \"58ce49e0-4e7e-469e-8e86-431a98f3cd6d\") " Jul 08 18:53:14.120036 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:14.119964 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "58ce49e0-4e7e-469e-8e86-431a98f3cd6d" (UID: "58ce49e0-4e7e-469e-8e86-431a98f3cd6d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:53:14.120164 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:14.120109 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "58ce49e0-4e7e-469e-8e86-431a98f3cd6d" (UID: "58ce49e0-4e7e-469e-8e86-431a98f3cd6d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:53:14.120164 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:14.120138 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-console-config" (OuterVolumeSpecName: "console-config") pod "58ce49e0-4e7e-469e-8e86-431a98f3cd6d" (UID: "58ce49e0-4e7e-469e-8e86-431a98f3cd6d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:53:14.120292 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:14.120201 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-service-ca" (OuterVolumeSpecName: "service-ca") pod "58ce49e0-4e7e-469e-8e86-431a98f3cd6d" (UID: "58ce49e0-4e7e-469e-8e86-431a98f3cd6d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:53:14.121642 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:14.121623 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-kube-api-access-qpkg8" (OuterVolumeSpecName: "kube-api-access-qpkg8") pod "58ce49e0-4e7e-469e-8e86-431a98f3cd6d" (UID: "58ce49e0-4e7e-469e-8e86-431a98f3cd6d"). InnerVolumeSpecName "kube-api-access-qpkg8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:53:14.122064 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:14.122045 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "58ce49e0-4e7e-469e-8e86-431a98f3cd6d" (UID: "58ce49e0-4e7e-469e-8e86-431a98f3cd6d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:53:14.122110 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:14.122058 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "58ce49e0-4e7e-469e-8e86-431a98f3cd6d" (UID: "58ce49e0-4e7e-469e-8e86-431a98f3cd6d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:53:14.220467 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:14.220442 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-service-ca\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 18:53:14.220467 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:14.220465 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-console-oauth-config\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 18:53:14.220647 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:14.220481 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpkg8\" (UniqueName: \"kubernetes.io/projected/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-kube-api-access-qpkg8\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 18:53:14.220647 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:14.220505 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-oauth-serving-cert\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 18:53:14.220647 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:14.220518 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-console-config\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 18:53:14.220647 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:14.220530 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-console-serving-cert\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 18:53:14.220647 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:14.220542 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58ce49e0-4e7e-469e-8e86-431a98f3cd6d-trusted-ca-bundle\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 18:53:14.752921 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:14.752890 2572 generic.go:356] "Generic (PLEG): container finished" podID="58ce49e0-4e7e-469e-8e86-431a98f3cd6d" containerID="3a6ee871d0aaa111e59dbf77a1b05ddb9724b4567550f932275ca80aaafe79bc" exitCode=0 Jul 08 18:53:14.753039 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:14.752929 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bddf47748-788xh" event={"ID":"58ce49e0-4e7e-469e-8e86-431a98f3cd6d","Type":"ContainerDied","Data":"3a6ee871d0aaa111e59dbf77a1b05ddb9724b4567550f932275ca80aaafe79bc"} Jul 08 18:53:14.753039 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:14.752946 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bddf47748-788xh" Jul 08 18:53:14.753039 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:14.752963 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bddf47748-788xh" event={"ID":"58ce49e0-4e7e-469e-8e86-431a98f3cd6d","Type":"ContainerDied","Data":"0533e00d9bcba8bea67898437b6d35bd5a33ef80aee76a027e26ed7e57d7cbe2"} Jul 08 18:53:14.753039 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:14.752982 2572 scope.go:117] "RemoveContainer" containerID="3a6ee871d0aaa111e59dbf77a1b05ddb9724b4567550f932275ca80aaafe79bc" Jul 08 18:53:14.761964 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:14.761810 2572 scope.go:117] "RemoveContainer" containerID="3a6ee871d0aaa111e59dbf77a1b05ddb9724b4567550f932275ca80aaafe79bc" Jul 08 18:53:14.762219 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:53:14.762063 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a6ee871d0aaa111e59dbf77a1b05ddb9724b4567550f932275ca80aaafe79bc\": container with ID starting with 3a6ee871d0aaa111e59dbf77a1b05ddb9724b4567550f932275ca80aaafe79bc not found: ID does not exist" containerID="3a6ee871d0aaa111e59dbf77a1b05ddb9724b4567550f932275ca80aaafe79bc" Jul 08 18:53:14.762219 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:14.762085 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a6ee871d0aaa111e59dbf77a1b05ddb9724b4567550f932275ca80aaafe79bc"} err="failed to get container status \"3a6ee871d0aaa111e59dbf77a1b05ddb9724b4567550f932275ca80aaafe79bc\": rpc error: code = NotFound desc = could not find container \"3a6ee871d0aaa111e59dbf77a1b05ddb9724b4567550f932275ca80aaafe79bc\": container with ID starting with 3a6ee871d0aaa111e59dbf77a1b05ddb9724b4567550f932275ca80aaafe79bc not found: ID does not exist" Jul 08 18:53:14.773710 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:14.773687 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bddf47748-788xh"] Jul 08 18:53:14.782671 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:14.782651 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bddf47748-788xh"] Jul 08 18:53:15.752196 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:15.752163 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:15.868947 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:15.868842 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:15.961841 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:15.961804 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:16.692168 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:16.692137 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58ce49e0-4e7e-469e-8e86-431a98f3cd6d" path="/var/lib/kubelet/pods/58ce49e0-4e7e-469e-8e86-431a98f3cd6d/volumes" Jul 08 18:53:17.684486 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:17.684455 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:18.644746 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:18.644715 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:18.944950 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:18.944921 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:20.713687 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:20.713653 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:23.950207 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:23.950176 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:24.316007 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:24.315926 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:29.310465 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:29.310424 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:29.459234 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:29.459193 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:30.010640 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:30.010607 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:30.154302 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:30.154273 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:33.226167 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:33.226113 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:33.315552 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:33.315523 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:33.538988 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:33.538920 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:36.730166 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:36.730129 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:36.804723 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:36.804653 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:37.043962 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:37.043931 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:37.147576 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:37.147507 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:43.737366 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:43.737325 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:43.844562 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:43.844528 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:49.076145 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:49.076108 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:49.209018 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:49.208986 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:49.673298 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:49.673262 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:49.754902 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:49.754869 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:53.085791 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:53.085754 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:53.196019 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:53.195985 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:56.882760 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:56.882733 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:53:56.965093 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:53:56.965069 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:54:06.717418 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:06.717380 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:54:06.802404 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:06.802377 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:54:22.451816 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:22.451783 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:54:22.552175 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:22.552146 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:54:26.588661 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:26.588625 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:54:26.707735 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:26.707697 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:54:42.203672 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:42.203573 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:54:42.326229 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:42.326198 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:54:42.422231 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:42.422205 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:54:43.039789 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:43.039758 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-lv64w"] Jul 08 18:54:43.040099 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:43.040086 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58ce49e0-4e7e-469e-8e86-431a98f3cd6d" containerName="console" Jul 08 18:54:43.040099 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:43.040100 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="58ce49e0-4e7e-469e-8e86-431a98f3cd6d" containerName="console" Jul 08 18:54:43.040188 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:43.040165 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="58ce49e0-4e7e-469e-8e86-431a98f3cd6d" containerName="console" Jul 08 18:54:43.043186 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:43.043168 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lv64w" Jul 08 18:54:43.045436 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:43.045416 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 18:54:43.045631 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:43.045614 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 18:54:43.046420 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:43.046407 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-s4dc4\"" Jul 08 18:54:43.049279 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:43.049261 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-lv64w"] Jul 08 18:54:43.083034 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:43.083008 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:54:43.141174 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:43.141148 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbmgm\" (UniqueName: \"kubernetes.io/projected/a27cfbc0-e8d5-436f-bef7-35642517c2ff-kube-api-access-sbmgm\") pod \"authorino-58cd955675-lv64w\" (UID: \"a27cfbc0-e8d5-436f-bef7-35642517c2ff\") " pod="kuadrant-system/authorino-58cd955675-lv64w" Jul 08 18:54:43.154531 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:43.154510 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:54:43.206867 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:43.206842 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-xbwvt"] Jul 08 18:54:43.210022 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:43.210007 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xbwvt" Jul 08 18:54:43.218769 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:43.218751 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xbwvt"] Jul 08 18:54:43.242120 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:43.242097 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbmgm\" (UniqueName: \"kubernetes.io/projected/a27cfbc0-e8d5-436f-bef7-35642517c2ff-kube-api-access-sbmgm\") pod \"authorino-58cd955675-lv64w\" (UID: \"a27cfbc0-e8d5-436f-bef7-35642517c2ff\") " pod="kuadrant-system/authorino-58cd955675-lv64w" Jul 08 18:54:43.242221 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:43.242159 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbbt8\" (UniqueName: \"kubernetes.io/projected/d10763c0-21c1-452e-8ca4-50a04c8602cf-kube-api-access-wbbt8\") pod \"authorino-75d556bd77-xbwvt\" (UID: \"d10763c0-21c1-452e-8ca4-50a04c8602cf\") " pod="kuadrant-system/authorino-75d556bd77-xbwvt" Jul 08 18:54:43.250516 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:43.250496 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbmgm\" (UniqueName: \"kubernetes.io/projected/a27cfbc0-e8d5-436f-bef7-35642517c2ff-kube-api-access-sbmgm\") pod \"authorino-58cd955675-lv64w\" (UID: \"a27cfbc0-e8d5-436f-bef7-35642517c2ff\") " pod="kuadrant-system/authorino-58cd955675-lv64w" Jul 08 18:54:43.343000 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:43.342953 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbbt8\" (UniqueName: \"kubernetes.io/projected/d10763c0-21c1-452e-8ca4-50a04c8602cf-kube-api-access-wbbt8\") pod \"authorino-75d556bd77-xbwvt\" (UID: \"d10763c0-21c1-452e-8ca4-50a04c8602cf\") " pod="kuadrant-system/authorino-75d556bd77-xbwvt" Jul 08 18:54:43.352766 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:43.352745 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbbt8\" (UniqueName: \"kubernetes.io/projected/d10763c0-21c1-452e-8ca4-50a04c8602cf-kube-api-access-wbbt8\") pod \"authorino-75d556bd77-xbwvt\" (UID: \"d10763c0-21c1-452e-8ca4-50a04c8602cf\") " pod="kuadrant-system/authorino-75d556bd77-xbwvt" Jul 08 18:54:43.352866 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:43.352833 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lv64w" Jul 08 18:54:43.485767 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:43.485741 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-lv64w"] Jul 08 18:54:43.489930 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:54:43.489907 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda27cfbc0_e8d5_436f_bef7_35642517c2ff.slice/crio-efd0d571c5467a13a8b4b02f46ae473ee9eb818a461e2c607adba0aa6b762c1c WatchSource:0}: Error finding container efd0d571c5467a13a8b4b02f46ae473ee9eb818a461e2c607adba0aa6b762c1c: Status 404 returned error can't find the container with id efd0d571c5467a13a8b4b02f46ae473ee9eb818a461e2c607adba0aa6b762c1c Jul 08 18:54:43.519255 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:43.519232 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xbwvt" Jul 08 18:54:43.647496 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:43.647470 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xbwvt"] Jul 08 18:54:43.649442 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:54:43.649417 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd10763c0_21c1_452e_8ca4_50a04c8602cf.slice/crio-151822f9e816f3ccb6419cb23da61beb50f70519238333f433759e3018ba16a1 WatchSource:0}: Error finding container 151822f9e816f3ccb6419cb23da61beb50f70519238333f433759e3018ba16a1: Status 404 returned error can't find the container with id 151822f9e816f3ccb6419cb23da61beb50f70519238333f433759e3018ba16a1 Jul 08 18:54:44.147661 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:44.147629 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lv64w" event={"ID":"a27cfbc0-e8d5-436f-bef7-35642517c2ff","Type":"ContainerStarted","Data":"efd0d571c5467a13a8b4b02f46ae473ee9eb818a461e2c607adba0aa6b762c1c"} Jul 08 18:54:44.148987 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:44.148958 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xbwvt" event={"ID":"d10763c0-21c1-452e-8ca4-50a04c8602cf","Type":"ContainerStarted","Data":"151822f9e816f3ccb6419cb23da61beb50f70519238333f433759e3018ba16a1"} Jul 08 18:54:47.169545 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:47.169354 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lv64w" event={"ID":"a27cfbc0-e8d5-436f-bef7-35642517c2ff","Type":"ContainerStarted","Data":"0b8d842be10155d7cf81c68e7eb22447116ff6638954834796a37a608e416053"} Jul 08 18:54:47.171741 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:47.171703 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xbwvt" event={"ID":"d10763c0-21c1-452e-8ca4-50a04c8602cf","Type":"ContainerStarted","Data":"1972aee94de209cbd14c0f5a7cdf8645540fd1968918ef1cafa05832568b5840"} Jul 08 18:54:47.189800 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:47.189755 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-lv64w" podStartSLOduration=0.611952632 podStartE2EDuration="4.18973884s" totalImagesPullingTime="3.577786208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:54:47.187950908 +0000 UTC m=+551.058366043" watchObservedRunningTime="2026-07-08 18:54:47.18973884 +0000 UTC m=+551.060153973" Jul 08 18:54:47.241312 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:47.241250 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-xbwvt" podStartSLOduration=0.833035808 podStartE2EDuration="4.241226532s" totalImagesPullingTime="3.408190724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:54:47.217033539 +0000 UTC m=+551.087448673" watchObservedRunningTime="2026-07-08 18:54:47.241226532 +0000 UTC m=+551.111641651" Jul 08 18:54:47.242920 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:47.242896 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-lv64w"] Jul 08 18:54:49.181081 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:49.181036 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-lv64w" podUID="a27cfbc0-e8d5-436f-bef7-35642517c2ff" containerName="authorino" containerID="cri-o://0b8d842be10155d7cf81c68e7eb22447116ff6638954834796a37a608e416053" gracePeriod=30 Jul 08 18:54:49.432634 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:49.432554 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lv64w" Jul 08 18:54:49.497440 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:49.497406 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbmgm\" (UniqueName: \"kubernetes.io/projected/a27cfbc0-e8d5-436f-bef7-35642517c2ff-kube-api-access-sbmgm\") pod \"a27cfbc0-e8d5-436f-bef7-35642517c2ff\" (UID: \"a27cfbc0-e8d5-436f-bef7-35642517c2ff\") " Jul 08 18:54:49.499569 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:49.499540 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a27cfbc0-e8d5-436f-bef7-35642517c2ff-kube-api-access-sbmgm" (OuterVolumeSpecName: "kube-api-access-sbmgm") pod "a27cfbc0-e8d5-436f-bef7-35642517c2ff" (UID: "a27cfbc0-e8d5-436f-bef7-35642517c2ff"). InnerVolumeSpecName "kube-api-access-sbmgm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:54:49.598773 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:49.598744 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbmgm\" (UniqueName: \"kubernetes.io/projected/a27cfbc0-e8d5-436f-bef7-35642517c2ff-kube-api-access-sbmgm\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 18:54:50.186192 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:50.186157 2572 generic.go:356] "Generic (PLEG): container finished" podID="a27cfbc0-e8d5-436f-bef7-35642517c2ff" containerID="0b8d842be10155d7cf81c68e7eb22447116ff6638954834796a37a608e416053" exitCode=0 Jul 08 18:54:50.186697 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:50.186202 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lv64w" Jul 08 18:54:50.186697 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:50.186235 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lv64w" event={"ID":"a27cfbc0-e8d5-436f-bef7-35642517c2ff","Type":"ContainerDied","Data":"0b8d842be10155d7cf81c68e7eb22447116ff6638954834796a37a608e416053"} Jul 08 18:54:50.186697 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:50.186272 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lv64w" event={"ID":"a27cfbc0-e8d5-436f-bef7-35642517c2ff","Type":"ContainerDied","Data":"efd0d571c5467a13a8b4b02f46ae473ee9eb818a461e2c607adba0aa6b762c1c"} Jul 08 18:54:50.186697 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:50.186288 2572 scope.go:117] "RemoveContainer" containerID="0b8d842be10155d7cf81c68e7eb22447116ff6638954834796a37a608e416053" Jul 08 18:54:50.197058 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:50.196987 2572 scope.go:117] "RemoveContainer" containerID="0b8d842be10155d7cf81c68e7eb22447116ff6638954834796a37a608e416053" Jul 08 18:54:50.197279 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:54:50.197255 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b8d842be10155d7cf81c68e7eb22447116ff6638954834796a37a608e416053\": container with ID starting with 0b8d842be10155d7cf81c68e7eb22447116ff6638954834796a37a608e416053 not found: ID does not exist" containerID="0b8d842be10155d7cf81c68e7eb22447116ff6638954834796a37a608e416053" Jul 08 18:54:50.197328 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:50.197291 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b8d842be10155d7cf81c68e7eb22447116ff6638954834796a37a608e416053"} err="failed to get container status \"0b8d842be10155d7cf81c68e7eb22447116ff6638954834796a37a608e416053\": rpc error: code = NotFound desc = could not find container \"0b8d842be10155d7cf81c68e7eb22447116ff6638954834796a37a608e416053\": container with ID starting with 0b8d842be10155d7cf81c68e7eb22447116ff6638954834796a37a608e416053 not found: ID does not exist" Jul 08 18:54:50.211679 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:50.211654 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-lv64w"] Jul 08 18:54:50.213989 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:50.213969 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-lv64w"] Jul 08 18:54:50.690289 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:54:50.690252 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a27cfbc0-e8d5-436f-bef7-35642517c2ff" path="/var/lib/kubelet/pods/a27cfbc0-e8d5-436f-bef7-35642517c2ff/volumes" Jul 08 18:55:02.822871 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:02.822832 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:55:02.925976 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:02.925945 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:55:03.321202 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:03.321168 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:55:05.209019 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:05.208983 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:55:05.306740 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:05.306709 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:55:10.056681 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:10.056647 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:55:13.908989 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:13.908944 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:55:14.009871 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:14.009839 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:55:15.908097 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:15.908064 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:55:16.153495 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:16.153464 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qr897"] Jul 08 18:55:16.153842 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:16.153829 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a27cfbc0-e8d5-436f-bef7-35642517c2ff" containerName="authorino" Jul 08 18:55:16.153897 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:16.153844 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a27cfbc0-e8d5-436f-bef7-35642517c2ff" containerName="authorino" Jul 08 18:55:16.153933 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:16.153901 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a27cfbc0-e8d5-436f-bef7-35642517c2ff" containerName="authorino" Jul 08 18:55:16.156825 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:16.156809 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-qr897" Jul 08 18:55:16.167612 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:16.165420 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qr897"] Jul 08 18:55:16.228682 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:16.228651 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28nl8\" (UniqueName: \"kubernetes.io/projected/f5087482-bde7-4dbc-981f-ddd2a0938c15-kube-api-access-28nl8\") pod \"authorino-5d4b67c446-qr897\" (UID: \"f5087482-bde7-4dbc-981f-ddd2a0938c15\") " pod="kuadrant-system/authorino-5d4b67c446-qr897" Jul 08 18:55:16.329208 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:16.329182 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28nl8\" (UniqueName: \"kubernetes.io/projected/f5087482-bde7-4dbc-981f-ddd2a0938c15-kube-api-access-28nl8\") pod \"authorino-5d4b67c446-qr897\" (UID: \"f5087482-bde7-4dbc-981f-ddd2a0938c15\") " pod="kuadrant-system/authorino-5d4b67c446-qr897" Jul 08 18:55:16.338477 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:16.338444 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28nl8\" (UniqueName: \"kubernetes.io/projected/f5087482-bde7-4dbc-981f-ddd2a0938c15-kube-api-access-28nl8\") pod \"authorino-5d4b67c446-qr897\" (UID: \"f5087482-bde7-4dbc-981f-ddd2a0938c15\") " pod="kuadrant-system/authorino-5d4b67c446-qr897" Jul 08 18:55:16.383933 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:16.383908 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qr897"] Jul 08 18:55:16.384088 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:16.384076 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-qr897" Jul 08 18:55:16.416830 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:16.416807 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7476c7c888-r8ttp"] Jul 08 18:55:16.420143 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:16.420128 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7476c7c888-r8ttp" Jul 08 18:55:16.430790 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:16.430769 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7476c7c888-r8ttp"] Jul 08 18:55:16.500104 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:16.500072 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:55:16.522084 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:16.522057 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qr897"] Jul 08 18:55:16.525567 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:55:16.525542 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5087482_bde7_4dbc_981f_ddd2a0938c15.slice/crio-fbbfd9929b9eb6fec7b88b693ef3b31d2b825d477f428e0453377378cc179078 WatchSource:0}: Error finding container fbbfd9929b9eb6fec7b88b693ef3b31d2b825d477f428e0453377378cc179078: Status 404 returned error can't find the container with id fbbfd9929b9eb6fec7b88b693ef3b31d2b825d477f428e0453377378cc179078 Jul 08 18:55:16.530640 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:16.530613 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvl7c\" (UniqueName: \"kubernetes.io/projected/fb16ad8c-d332-444f-8941-a3034325b93c-kube-api-access-xvl7c\") pod \"authorino-7476c7c888-r8ttp\" (UID: \"fb16ad8c-d332-444f-8941-a3034325b93c\") " pod="kuadrant-system/authorino-7476c7c888-r8ttp" Jul 08 18:55:16.631706 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:16.631681 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvl7c\" (UniqueName: \"kubernetes.io/projected/fb16ad8c-d332-444f-8941-a3034325b93c-kube-api-access-xvl7c\") pod \"authorino-7476c7c888-r8ttp\" (UID: \"fb16ad8c-d332-444f-8941-a3034325b93c\") " pod="kuadrant-system/authorino-7476c7c888-r8ttp" Jul 08 18:55:16.639843 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:16.639823 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvl7c\" (UniqueName: \"kubernetes.io/projected/fb16ad8c-d332-444f-8941-a3034325b93c-kube-api-access-xvl7c\") pod \"authorino-7476c7c888-r8ttp\" (UID: \"fb16ad8c-d332-444f-8941-a3034325b93c\") " pod="kuadrant-system/authorino-7476c7c888-r8ttp" Jul 08 18:55:16.731227 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:16.731179 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7476c7c888-r8ttp" Jul 08 18:55:16.770995 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:16.770966 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7476c7c888-r8ttp"] Jul 08 18:55:16.808433 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:16.808410 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7fdfc848bd-k252c"] Jul 08 18:55:16.813415 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:16.813387 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fdfc848bd-k252c" Jul 08 18:55:16.815781 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:16.815762 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 08 18:55:16.821091 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:16.821072 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7fdfc848bd-k252c"] Jul 08 18:55:16.860554 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:16.860530 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7476c7c888-r8ttp"] Jul 08 18:55:16.863232 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:55:16.863210 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb16ad8c_d332_444f_8941_a3034325b93c.slice/crio-71d5f15b5f505996ec0241d36fd06101797ded7ab717eb958d44b91b439a7c40 WatchSource:0}: Error finding container 71d5f15b5f505996ec0241d36fd06101797ded7ab717eb958d44b91b439a7c40: Status 404 returned error can't find the container with id 71d5f15b5f505996ec0241d36fd06101797ded7ab717eb958d44b91b439a7c40 Jul 08 18:55:16.934368 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:16.934342 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/30d191c9-b44f-4b9a-bf88-6d17bb847e2c-tls-cert\") pod \"authorino-7fdfc848bd-k252c\" (UID: \"30d191c9-b44f-4b9a-bf88-6d17bb847e2c\") " pod="kuadrant-system/authorino-7fdfc848bd-k252c" Jul 08 18:55:16.934679 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:16.934438 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6z9k\" (UniqueName: \"kubernetes.io/projected/30d191c9-b44f-4b9a-bf88-6d17bb847e2c-kube-api-access-w6z9k\") pod \"authorino-7fdfc848bd-k252c\" (UID: \"30d191c9-b44f-4b9a-bf88-6d17bb847e2c\") " pod="kuadrant-system/authorino-7fdfc848bd-k252c" Jul 08 18:55:17.035435 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:17.035412 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6z9k\" (UniqueName: \"kubernetes.io/projected/30d191c9-b44f-4b9a-bf88-6d17bb847e2c-kube-api-access-w6z9k\") pod \"authorino-7fdfc848bd-k252c\" (UID: \"30d191c9-b44f-4b9a-bf88-6d17bb847e2c\") " pod="kuadrant-system/authorino-7fdfc848bd-k252c" Jul 08 18:55:17.035536 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:17.035476 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/30d191c9-b44f-4b9a-bf88-6d17bb847e2c-tls-cert\") pod \"authorino-7fdfc848bd-k252c\" (UID: \"30d191c9-b44f-4b9a-bf88-6d17bb847e2c\") " pod="kuadrant-system/authorino-7fdfc848bd-k252c" Jul 08 18:55:17.037817 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:17.037798 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/30d191c9-b44f-4b9a-bf88-6d17bb847e2c-tls-cert\") pod \"authorino-7fdfc848bd-k252c\" (UID: \"30d191c9-b44f-4b9a-bf88-6d17bb847e2c\") " pod="kuadrant-system/authorino-7fdfc848bd-k252c" Jul 08 18:55:17.045237 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:17.045203 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6z9k\" (UniqueName: \"kubernetes.io/projected/30d191c9-b44f-4b9a-bf88-6d17bb847e2c-kube-api-access-w6z9k\") pod \"authorino-7fdfc848bd-k252c\" (UID: \"30d191c9-b44f-4b9a-bf88-6d17bb847e2c\") " pod="kuadrant-system/authorino-7fdfc848bd-k252c" Jul 08 18:55:17.125566 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:17.125535 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fdfc848bd-k252c" Jul 08 18:55:17.259474 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:17.259410 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7fdfc848bd-k252c"] Jul 08 18:55:17.262888 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:55:17.262863 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30d191c9_b44f_4b9a_bf88_6d17bb847e2c.slice/crio-a941335a427e9231d0a5568000472eaa37722f0a4a9c223e3d51228937757828 WatchSource:0}: Error finding container a941335a427e9231d0a5568000472eaa37722f0a4a9c223e3d51228937757828: Status 404 returned error can't find the container with id a941335a427e9231d0a5568000472eaa37722f0a4a9c223e3d51228937757828 Jul 08 18:55:17.326885 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:17.326858 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7476c7c888-r8ttp" event={"ID":"fb16ad8c-d332-444f-8941-a3034325b93c","Type":"ContainerStarted","Data":"71d5f15b5f505996ec0241d36fd06101797ded7ab717eb958d44b91b439a7c40"} Jul 08 18:55:17.327979 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:17.327958 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7fdfc848bd-k252c" event={"ID":"30d191c9-b44f-4b9a-bf88-6d17bb847e2c","Type":"ContainerStarted","Data":"a941335a427e9231d0a5568000472eaa37722f0a4a9c223e3d51228937757828"} Jul 08 18:55:17.329320 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:17.329302 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-qr897" event={"ID":"f5087482-bde7-4dbc-981f-ddd2a0938c15","Type":"ContainerStarted","Data":"043d6a3727b2c076cca02f655dbd75d90522b8e43d0fc5caa48d753ca5099cab"} Jul 08 18:55:17.329395 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:17.329328 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-qr897" event={"ID":"f5087482-bde7-4dbc-981f-ddd2a0938c15","Type":"ContainerStarted","Data":"fbbfd9929b9eb6fec7b88b693ef3b31d2b825d477f428e0453377378cc179078"} Jul 08 18:55:17.329395 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:17.329371 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-qr897" podUID="f5087482-bde7-4dbc-981f-ddd2a0938c15" containerName="authorino" containerID="cri-o://043d6a3727b2c076cca02f655dbd75d90522b8e43d0fc5caa48d753ca5099cab" gracePeriod=30 Jul 08 18:55:17.345897 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:17.345857 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-qr897" podStartSLOduration=0.8698655 podStartE2EDuration="1.345843422s" totalImagesPullingTime="475.977922ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:55:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:55:17.34478864 +0000 UTC m=+581.215203775" watchObservedRunningTime="2026-07-08 18:55:17.345843422 +0000 UTC m=+581.216258555" Jul 08 18:55:17.572197 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:17.572167 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-qr897" Jul 08 18:55:17.742311 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:17.742285 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28nl8\" (UniqueName: \"kubernetes.io/projected/f5087482-bde7-4dbc-981f-ddd2a0938c15-kube-api-access-28nl8\") pod \"f5087482-bde7-4dbc-981f-ddd2a0938c15\" (UID: \"f5087482-bde7-4dbc-981f-ddd2a0938c15\") " Jul 08 18:55:17.744217 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:17.744195 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5087482-bde7-4dbc-981f-ddd2a0938c15-kube-api-access-28nl8" (OuterVolumeSpecName: "kube-api-access-28nl8") pod "f5087482-bde7-4dbc-981f-ddd2a0938c15" (UID: "f5087482-bde7-4dbc-981f-ddd2a0938c15"). InnerVolumeSpecName "kube-api-access-28nl8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:55:17.843835 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:17.843778 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28nl8\" (UniqueName: \"kubernetes.io/projected/f5087482-bde7-4dbc-981f-ddd2a0938c15-kube-api-access-28nl8\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 18:55:18.335851 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:18.335815 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7fdfc848bd-k252c" event={"ID":"30d191c9-b44f-4b9a-bf88-6d17bb847e2c","Type":"ContainerStarted","Data":"c56602432c890c3e231fd6d95f56c851ab8c56e1bef08829cc0df8b4a128f871"} Jul 08 18:55:18.337089 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:18.337067 2572 generic.go:356] "Generic (PLEG): container finished" podID="f5087482-bde7-4dbc-981f-ddd2a0938c15" containerID="043d6a3727b2c076cca02f655dbd75d90522b8e43d0fc5caa48d753ca5099cab" exitCode=0 Jul 08 18:55:18.337184 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:18.337112 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-qr897" Jul 08 18:55:18.337184 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:18.337150 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-qr897" event={"ID":"f5087482-bde7-4dbc-981f-ddd2a0938c15","Type":"ContainerDied","Data":"043d6a3727b2c076cca02f655dbd75d90522b8e43d0fc5caa48d753ca5099cab"} Jul 08 18:55:18.337184 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:18.337182 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-qr897" event={"ID":"f5087482-bde7-4dbc-981f-ddd2a0938c15","Type":"ContainerDied","Data":"fbbfd9929b9eb6fec7b88b693ef3b31d2b825d477f428e0453377378cc179078"} Jul 08 18:55:18.337362 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:18.337201 2572 scope.go:117] "RemoveContainer" containerID="043d6a3727b2c076cca02f655dbd75d90522b8e43d0fc5caa48d753ca5099cab" Jul 08 18:55:18.338551 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:18.338527 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7476c7c888-r8ttp" event={"ID":"fb16ad8c-d332-444f-8941-a3034325b93c","Type":"ContainerStarted","Data":"0b54f8e98245414940a6f460cae075850c7f1b3e2870bd0c23b159b72a57ec71"} Jul 08 18:55:18.338745 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:18.338654 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7476c7c888-r8ttp" podUID="fb16ad8c-d332-444f-8941-a3034325b93c" containerName="authorino" containerID="cri-o://0b54f8e98245414940a6f460cae075850c7f1b3e2870bd0c23b159b72a57ec71" gracePeriod=30 Jul 08 18:55:18.357423 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:18.357377 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7fdfc848bd-k252c" podStartSLOduration=2.03265431 podStartE2EDuration="2.357361736s" totalImagesPullingTime="324.707426ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:55:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:55:18.353950078 +0000 UTC m=+582.224365210" watchObservedRunningTime="2026-07-08 18:55:18.357361736 +0000 UTC m=+582.227776847" Jul 08 18:55:18.379020 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:18.378973 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7476c7c888-r8ttp" podStartSLOduration=1.962683178 podStartE2EDuration="2.378956088s" totalImagesPullingTime="416.27291ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:55:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:55:18.37823985 +0000 UTC m=+582.248654982" watchObservedRunningTime="2026-07-08 18:55:18.378956088 +0000 UTC m=+582.249371224" Jul 08 18:55:18.401535 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:18.401513 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xbwvt"] Jul 08 18:55:18.401730 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:18.401709 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-xbwvt" podUID="d10763c0-21c1-452e-8ca4-50a04c8602cf" containerName="authorino" containerID="cri-o://1972aee94de209cbd14c0f5a7cdf8645540fd1968918ef1cafa05832568b5840" gracePeriod=30 Jul 08 18:55:18.402556 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:18.402536 2572 scope.go:117] "RemoveContainer" containerID="043d6a3727b2c076cca02f655dbd75d90522b8e43d0fc5caa48d753ca5099cab" Jul 08 18:55:18.402903 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:55:18.402885 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"043d6a3727b2c076cca02f655dbd75d90522b8e43d0fc5caa48d753ca5099cab\": container with ID starting with 043d6a3727b2c076cca02f655dbd75d90522b8e43d0fc5caa48d753ca5099cab not found: ID does not exist" containerID="043d6a3727b2c076cca02f655dbd75d90522b8e43d0fc5caa48d753ca5099cab" Jul 08 18:55:18.402976 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:18.402914 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"043d6a3727b2c076cca02f655dbd75d90522b8e43d0fc5caa48d753ca5099cab"} err="failed to get container status \"043d6a3727b2c076cca02f655dbd75d90522b8e43d0fc5caa48d753ca5099cab\": rpc error: code = NotFound desc = could not find container \"043d6a3727b2c076cca02f655dbd75d90522b8e43d0fc5caa48d753ca5099cab\": container with ID starting with 043d6a3727b2c076cca02f655dbd75d90522b8e43d0fc5caa48d753ca5099cab not found: ID does not exist" Jul 08 18:55:18.428376 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:18.428351 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qr897"] Jul 08 18:55:18.433494 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:18.433472 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qr897"] Jul 08 18:55:18.660238 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:18.660217 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7476c7c888-r8ttp" Jul 08 18:55:18.664120 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:18.664100 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xbwvt" Jul 08 18:55:18.691095 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:18.691070 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5087482-bde7-4dbc-981f-ddd2a0938c15" path="/var/lib/kubelet/pods/f5087482-bde7-4dbc-981f-ddd2a0938c15/volumes" Jul 08 18:55:18.750651 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:18.750623 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbbt8\" (UniqueName: \"kubernetes.io/projected/d10763c0-21c1-452e-8ca4-50a04c8602cf-kube-api-access-wbbt8\") pod \"d10763c0-21c1-452e-8ca4-50a04c8602cf\" (UID: \"d10763c0-21c1-452e-8ca4-50a04c8602cf\") " Jul 08 18:55:18.750765 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:18.750663 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvl7c\" (UniqueName: \"kubernetes.io/projected/fb16ad8c-d332-444f-8941-a3034325b93c-kube-api-access-xvl7c\") pod \"fb16ad8c-d332-444f-8941-a3034325b93c\" (UID: \"fb16ad8c-d332-444f-8941-a3034325b93c\") " Jul 08 18:55:18.752567 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:18.752545 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d10763c0-21c1-452e-8ca4-50a04c8602cf-kube-api-access-wbbt8" (OuterVolumeSpecName: "kube-api-access-wbbt8") pod "d10763c0-21c1-452e-8ca4-50a04c8602cf" (UID: "d10763c0-21c1-452e-8ca4-50a04c8602cf"). InnerVolumeSpecName "kube-api-access-wbbt8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:55:18.752667 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:18.752585 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb16ad8c-d332-444f-8941-a3034325b93c-kube-api-access-xvl7c" (OuterVolumeSpecName: "kube-api-access-xvl7c") pod "fb16ad8c-d332-444f-8941-a3034325b93c" (UID: "fb16ad8c-d332-444f-8941-a3034325b93c"). InnerVolumeSpecName "kube-api-access-xvl7c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:55:18.851771 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:18.851710 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbbt8\" (UniqueName: \"kubernetes.io/projected/d10763c0-21c1-452e-8ca4-50a04c8602cf-kube-api-access-wbbt8\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 18:55:18.851771 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:18.851738 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvl7c\" (UniqueName: \"kubernetes.io/projected/fb16ad8c-d332-444f-8941-a3034325b93c-kube-api-access-xvl7c\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 18:55:19.344314 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:19.344057 2572 generic.go:356] "Generic (PLEG): container finished" podID="fb16ad8c-d332-444f-8941-a3034325b93c" containerID="0b54f8e98245414940a6f460cae075850c7f1b3e2870bd0c23b159b72a57ec71" exitCode=0 Jul 08 18:55:19.344314 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:19.344100 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7476c7c888-r8ttp" Jul 08 18:55:19.344314 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:19.344141 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7476c7c888-r8ttp" event={"ID":"fb16ad8c-d332-444f-8941-a3034325b93c","Type":"ContainerDied","Data":"0b54f8e98245414940a6f460cae075850c7f1b3e2870bd0c23b159b72a57ec71"} Jul 08 18:55:19.344314 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:19.344181 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7476c7c888-r8ttp" event={"ID":"fb16ad8c-d332-444f-8941-a3034325b93c","Type":"ContainerDied","Data":"71d5f15b5f505996ec0241d36fd06101797ded7ab717eb958d44b91b439a7c40"} Jul 08 18:55:19.344314 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:19.344207 2572 scope.go:117] "RemoveContainer" containerID="0b54f8e98245414940a6f460cae075850c7f1b3e2870bd0c23b159b72a57ec71" Jul 08 18:55:19.345914 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:19.345886 2572 generic.go:356] "Generic (PLEG): container finished" podID="d10763c0-21c1-452e-8ca4-50a04c8602cf" containerID="1972aee94de209cbd14c0f5a7cdf8645540fd1968918ef1cafa05832568b5840" exitCode=0 Jul 08 18:55:19.346058 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:19.346039 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xbwvt" event={"ID":"d10763c0-21c1-452e-8ca4-50a04c8602cf","Type":"ContainerDied","Data":"1972aee94de209cbd14c0f5a7cdf8645540fd1968918ef1cafa05832568b5840"} Jul 08 18:55:19.346146 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:19.346077 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xbwvt" event={"ID":"d10763c0-21c1-452e-8ca4-50a04c8602cf","Type":"ContainerDied","Data":"151822f9e816f3ccb6419cb23da61beb50f70519238333f433759e3018ba16a1"} Jul 08 18:55:19.346264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:19.346246 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xbwvt" Jul 08 18:55:19.354181 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:19.354166 2572 scope.go:117] "RemoveContainer" containerID="0b54f8e98245414940a6f460cae075850c7f1b3e2870bd0c23b159b72a57ec71" Jul 08 18:55:19.354428 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:55:19.354411 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b54f8e98245414940a6f460cae075850c7f1b3e2870bd0c23b159b72a57ec71\": container with ID starting with 0b54f8e98245414940a6f460cae075850c7f1b3e2870bd0c23b159b72a57ec71 not found: ID does not exist" containerID="0b54f8e98245414940a6f460cae075850c7f1b3e2870bd0c23b159b72a57ec71" Jul 08 18:55:19.354476 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:19.354435 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b54f8e98245414940a6f460cae075850c7f1b3e2870bd0c23b159b72a57ec71"} err="failed to get container status \"0b54f8e98245414940a6f460cae075850c7f1b3e2870bd0c23b159b72a57ec71\": rpc error: code = NotFound desc = could not find container \"0b54f8e98245414940a6f460cae075850c7f1b3e2870bd0c23b159b72a57ec71\": container with ID starting with 0b54f8e98245414940a6f460cae075850c7f1b3e2870bd0c23b159b72a57ec71 not found: ID does not exist" Jul 08 18:55:19.354476 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:19.354450 2572 scope.go:117] "RemoveContainer" containerID="1972aee94de209cbd14c0f5a7cdf8645540fd1968918ef1cafa05832568b5840" Jul 08 18:55:19.361915 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:19.361898 2572 scope.go:117] "RemoveContainer" containerID="1972aee94de209cbd14c0f5a7cdf8645540fd1968918ef1cafa05832568b5840" Jul 08 18:55:19.362153 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:55:19.362134 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1972aee94de209cbd14c0f5a7cdf8645540fd1968918ef1cafa05832568b5840\": container with ID starting with 1972aee94de209cbd14c0f5a7cdf8645540fd1968918ef1cafa05832568b5840 not found: ID does not exist" containerID="1972aee94de209cbd14c0f5a7cdf8645540fd1968918ef1cafa05832568b5840" Jul 08 18:55:19.362238 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:19.362157 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1972aee94de209cbd14c0f5a7cdf8645540fd1968918ef1cafa05832568b5840"} err="failed to get container status \"1972aee94de209cbd14c0f5a7cdf8645540fd1968918ef1cafa05832568b5840\": rpc error: code = NotFound desc = could not find container \"1972aee94de209cbd14c0f5a7cdf8645540fd1968918ef1cafa05832568b5840\": container with ID starting with 1972aee94de209cbd14c0f5a7cdf8645540fd1968918ef1cafa05832568b5840 not found: ID does not exist" Jul 08 18:55:19.371415 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:19.371393 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7476c7c888-r8ttp"] Jul 08 18:55:19.374279 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:19.374257 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7476c7c888-r8ttp"] Jul 08 18:55:19.384289 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:19.384271 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xbwvt"] Jul 08 18:55:19.388195 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:19.388176 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xbwvt"] Jul 08 18:55:20.690353 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:20.690322 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d10763c0-21c1-452e-8ca4-50a04c8602cf" path="/var/lib/kubelet/pods/d10763c0-21c1-452e-8ca4-50a04c8602cf/volumes" Jul 08 18:55:20.690754 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:20.690667 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb16ad8c-d332-444f-8941-a3034325b93c" path="/var/lib/kubelet/pods/fb16ad8c-d332-444f-8941-a3034325b93c/volumes" Jul 08 18:55:23.239789 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:23.239759 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:55:23.491653 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:23.491568 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:55:24.759871 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:24.759839 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:55:25.935970 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:25.935935 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:55:27.657401 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:27.657366 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:55:27.777549 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:27.777517 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:55:36.547216 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:36.547188 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9hx2g_56065d42-401f-45fb-bf49-8885f262ad6f/console-operator/1.log" Jul 08 18:55:36.548315 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:36.548290 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9hx2g_56065d42-401f-45fb-bf49-8885f262ad6f/console-operator/1.log" Jul 08 18:55:57.271379 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:57.271338 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:55:58.510247 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:58.510170 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:55:58.642014 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:55:58.641933 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:56:08.850704 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:08.850669 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:56:08.950669 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:08.950635 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:56:26.104474 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.104441 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k"] Jul 08 18:56:26.105016 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.104996 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5087482-bde7-4dbc-981f-ddd2a0938c15" containerName="authorino" Jul 08 18:56:26.105101 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.105019 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5087482-bde7-4dbc-981f-ddd2a0938c15" containerName="authorino" Jul 08 18:56:26.105101 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.105031 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb16ad8c-d332-444f-8941-a3034325b93c" containerName="authorino" Jul 08 18:56:26.105101 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.105039 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb16ad8c-d332-444f-8941-a3034325b93c" containerName="authorino" Jul 08 18:56:26.105101 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.105060 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d10763c0-21c1-452e-8ca4-50a04c8602cf" containerName="authorino" Jul 08 18:56:26.105101 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.105069 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d10763c0-21c1-452e-8ca4-50a04c8602cf" containerName="authorino" Jul 08 18:56:26.105339 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.105214 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5087482-bde7-4dbc-981f-ddd2a0938c15" containerName="authorino" Jul 08 18:56:26.105339 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.105229 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d10763c0-21c1-452e-8ca4-50a04c8602cf" containerName="authorino" Jul 08 18:56:26.105339 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.105238 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb16ad8c-d332-444f-8941-a3034325b93c" containerName="authorino" Jul 08 18:56:26.107660 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.107641 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k" Jul 08 18:56:26.110084 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.110062 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 08 18:56:26.110815 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.110799 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 08 18:56:26.110904 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.110817 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ff9sn\"" Jul 08 18:56:26.110904 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.110898 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 08 18:56:26.124679 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.124658 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k"] Jul 08 18:56:26.155270 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.155247 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a292c26b-158f-4de0-afef-3cd191e4bb2f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k\" (UID: \"a292c26b-158f-4de0-afef-3cd191e4bb2f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k" Jul 08 18:56:26.155390 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.155275 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a292c26b-158f-4de0-afef-3cd191e4bb2f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k\" (UID: \"a292c26b-158f-4de0-afef-3cd191e4bb2f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k" Jul 08 18:56:26.155390 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.155301 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a292c26b-158f-4de0-afef-3cd191e4bb2f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k\" (UID: \"a292c26b-158f-4de0-afef-3cd191e4bb2f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k" Jul 08 18:56:26.155390 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.155325 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvphp\" (UniqueName: \"kubernetes.io/projected/a292c26b-158f-4de0-afef-3cd191e4bb2f-kube-api-access-xvphp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k\" (UID: \"a292c26b-158f-4de0-afef-3cd191e4bb2f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k" Jul 08 18:56:26.155561 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.155402 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a292c26b-158f-4de0-afef-3cd191e4bb2f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k\" (UID: \"a292c26b-158f-4de0-afef-3cd191e4bb2f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k" Jul 08 18:56:26.155561 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.155452 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a292c26b-158f-4de0-afef-3cd191e4bb2f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k\" (UID: \"a292c26b-158f-4de0-afef-3cd191e4bb2f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k" Jul 08 18:56:26.160111 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.160091 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:56:26.256738 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.256704 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a292c26b-158f-4de0-afef-3cd191e4bb2f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k\" (UID: \"a292c26b-158f-4de0-afef-3cd191e4bb2f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k" Jul 08 18:56:26.256904 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.256752 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a292c26b-158f-4de0-afef-3cd191e4bb2f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k\" (UID: \"a292c26b-158f-4de0-afef-3cd191e4bb2f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k" Jul 08 18:56:26.256904 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.256785 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvphp\" (UniqueName: \"kubernetes.io/projected/a292c26b-158f-4de0-afef-3cd191e4bb2f-kube-api-access-xvphp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k\" (UID: \"a292c26b-158f-4de0-afef-3cd191e4bb2f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k" Jul 08 18:56:26.256904 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.256812 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a292c26b-158f-4de0-afef-3cd191e4bb2f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k\" (UID: \"a292c26b-158f-4de0-afef-3cd191e4bb2f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k" Jul 08 18:56:26.256904 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.256849 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a292c26b-158f-4de0-afef-3cd191e4bb2f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k\" (UID: \"a292c26b-158f-4de0-afef-3cd191e4bb2f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k" Jul 08 18:56:26.257071 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.256929 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a292c26b-158f-4de0-afef-3cd191e4bb2f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k\" (UID: \"a292c26b-158f-4de0-afef-3cd191e4bb2f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k" Jul 08 18:56:26.257167 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.257144 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a292c26b-158f-4de0-afef-3cd191e4bb2f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k\" (UID: \"a292c26b-158f-4de0-afef-3cd191e4bb2f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k" Jul 08 18:56:26.257224 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.257198 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a292c26b-158f-4de0-afef-3cd191e4bb2f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k\" (UID: \"a292c26b-158f-4de0-afef-3cd191e4bb2f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k" Jul 08 18:56:26.257266 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.257226 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a292c26b-158f-4de0-afef-3cd191e4bb2f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k\" (UID: \"a292c26b-158f-4de0-afef-3cd191e4bb2f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k" Jul 08 18:56:26.259223 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.259197 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a292c26b-158f-4de0-afef-3cd191e4bb2f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k\" (UID: \"a292c26b-158f-4de0-afef-3cd191e4bb2f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k" Jul 08 18:56:26.259460 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.259442 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a292c26b-158f-4de0-afef-3cd191e4bb2f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k\" (UID: \"a292c26b-158f-4de0-afef-3cd191e4bb2f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k" Jul 08 18:56:26.265561 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.265540 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvphp\" (UniqueName: \"kubernetes.io/projected/a292c26b-158f-4de0-afef-3cd191e4bb2f-kube-api-access-xvphp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k\" (UID: \"a292c26b-158f-4de0-afef-3cd191e4bb2f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k" Jul 08 18:56:26.417995 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.417967 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k" Jul 08 18:56:26.580122 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.580096 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k"] Jul 08 18:56:26.582070 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:56:26.582039 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda292c26b_158f_4de0_afef_3cd191e4bb2f.slice/crio-c3f6b84a97b77ed3ba15d0ab3cf9f1267acf6b09ebe87040fbbb13817650fa7e WatchSource:0}: Error finding container c3f6b84a97b77ed3ba15d0ab3cf9f1267acf6b09ebe87040fbbb13817650fa7e: Status 404 returned error can't find the container with id c3f6b84a97b77ed3ba15d0ab3cf9f1267acf6b09ebe87040fbbb13817650fa7e Jul 08 18:56:26.583450 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.583428 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 18:56:26.670539 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:26.670455 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k" event={"ID":"a292c26b-158f-4de0-afef-3cd191e4bb2f","Type":"ContainerStarted","Data":"c3f6b84a97b77ed3ba15d0ab3cf9f1267acf6b09ebe87040fbbb13817650fa7e"} Jul 08 18:56:28.691706 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:28.691667 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k" event={"ID":"a292c26b-158f-4de0-afef-3cd191e4bb2f","Type":"ContainerStarted","Data":"f6ea57497a5f6f1526b714fb084de06606757d7705157c2ddca90a33b036ed96"} Jul 08 18:56:28.711227 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:28.711173 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k" podStartSLOduration=1.488578124 podStartE2EDuration="2.711157736s" totalImagesPullingTime="1.222579612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:56:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:56:28.709287491 +0000 UTC m=+652.579702625" watchObservedRunningTime="2026-07-08 18:56:28.711157736 +0000 UTC m=+652.581572869" Jul 08 18:56:31.966355 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:31.966321 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:56:36.418583 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:36.418549 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k" Jul 08 18:56:36.418992 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:36.418622 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k" Jul 08 18:56:36.431193 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:36.431165 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k" Jul 08 18:56:36.737955 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:36.737865 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k" Jul 08 18:56:44.422544 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:44.422512 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-jxqj9"] Jul 08 18:56:44.425616 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:44.425579 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jxqj9" Jul 08 18:56:44.428300 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:44.428278 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 08 18:56:44.439951 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:44.439928 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-jxqj9"] Jul 08 18:56:44.497720 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:44.497686 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:56:44.523859 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:44.523830 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/583c0b6d-1ed4-49f2-b6ce-43f94e19cd51-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jxqj9\" (UID: \"583c0b6d-1ed4-49f2-b6ce-43f94e19cd51\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jxqj9" Jul 08 18:56:44.524022 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:44.523867 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csw8w\" (UniqueName: \"kubernetes.io/projected/583c0b6d-1ed4-49f2-b6ce-43f94e19cd51-kube-api-access-csw8w\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jxqj9\" (UID: \"583c0b6d-1ed4-49f2-b6ce-43f94e19cd51\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jxqj9" Jul 08 18:56:44.524022 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:44.523893 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/583c0b6d-1ed4-49f2-b6ce-43f94e19cd51-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jxqj9\" (UID: \"583c0b6d-1ed4-49f2-b6ce-43f94e19cd51\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jxqj9" Jul 08 18:56:44.524022 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:44.523984 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/583c0b6d-1ed4-49f2-b6ce-43f94e19cd51-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jxqj9\" (UID: \"583c0b6d-1ed4-49f2-b6ce-43f94e19cd51\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jxqj9" Jul 08 18:56:44.524155 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:44.524031 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/583c0b6d-1ed4-49f2-b6ce-43f94e19cd51-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jxqj9\" (UID: \"583c0b6d-1ed4-49f2-b6ce-43f94e19cd51\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jxqj9" Jul 08 18:56:44.524155 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:44.524099 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/583c0b6d-1ed4-49f2-b6ce-43f94e19cd51-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jxqj9\" (UID: \"583c0b6d-1ed4-49f2-b6ce-43f94e19cd51\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jxqj9" Jul 08 18:56:44.624743 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:44.624707 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/583c0b6d-1ed4-49f2-b6ce-43f94e19cd51-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jxqj9\" (UID: \"583c0b6d-1ed4-49f2-b6ce-43f94e19cd51\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jxqj9" Jul 08 18:56:44.624943 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:44.624756 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csw8w\" (UniqueName: \"kubernetes.io/projected/583c0b6d-1ed4-49f2-b6ce-43f94e19cd51-kube-api-access-csw8w\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jxqj9\" (UID: \"583c0b6d-1ed4-49f2-b6ce-43f94e19cd51\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jxqj9" Jul 08 18:56:44.624943 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:44.624794 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/583c0b6d-1ed4-49f2-b6ce-43f94e19cd51-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jxqj9\" (UID: \"583c0b6d-1ed4-49f2-b6ce-43f94e19cd51\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jxqj9" Jul 08 18:56:44.624943 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:44.624832 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/583c0b6d-1ed4-49f2-b6ce-43f94e19cd51-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jxqj9\" (UID: \"583c0b6d-1ed4-49f2-b6ce-43f94e19cd51\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jxqj9" Jul 08 18:56:44.624943 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:44.624868 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/583c0b6d-1ed4-49f2-b6ce-43f94e19cd51-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jxqj9\" (UID: \"583c0b6d-1ed4-49f2-b6ce-43f94e19cd51\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jxqj9" Jul 08 18:56:44.624943 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:44.624932 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/583c0b6d-1ed4-49f2-b6ce-43f94e19cd51-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jxqj9\" (UID: \"583c0b6d-1ed4-49f2-b6ce-43f94e19cd51\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jxqj9" Jul 08 18:56:44.625279 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:44.625175 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/583c0b6d-1ed4-49f2-b6ce-43f94e19cd51-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jxqj9\" (UID: \"583c0b6d-1ed4-49f2-b6ce-43f94e19cd51\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jxqj9" Jul 08 18:56:44.625279 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:44.625189 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/583c0b6d-1ed4-49f2-b6ce-43f94e19cd51-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jxqj9\" (UID: \"583c0b6d-1ed4-49f2-b6ce-43f94e19cd51\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jxqj9" Jul 08 18:56:44.625376 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:44.625293 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/583c0b6d-1ed4-49f2-b6ce-43f94e19cd51-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jxqj9\" (UID: \"583c0b6d-1ed4-49f2-b6ce-43f94e19cd51\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jxqj9" Jul 08 18:56:44.627142 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:44.627119 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/583c0b6d-1ed4-49f2-b6ce-43f94e19cd51-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jxqj9\" (UID: \"583c0b6d-1ed4-49f2-b6ce-43f94e19cd51\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jxqj9" Jul 08 18:56:44.627302 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:44.627286 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/583c0b6d-1ed4-49f2-b6ce-43f94e19cd51-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jxqj9\" (UID: \"583c0b6d-1ed4-49f2-b6ce-43f94e19cd51\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jxqj9" Jul 08 18:56:44.644881 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:44.644857 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csw8w\" (UniqueName: \"kubernetes.io/projected/583c0b6d-1ed4-49f2-b6ce-43f94e19cd51-kube-api-access-csw8w\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jxqj9\" (UID: \"583c0b6d-1ed4-49f2-b6ce-43f94e19cd51\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jxqj9" Jul 08 18:56:44.736252 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:44.736176 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jxqj9" Jul 08 18:56:44.873910 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:44.873888 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-jxqj9"] Jul 08 18:56:44.876058 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:56:44.876030 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod583c0b6d_1ed4_49f2_b6ce_43f94e19cd51.slice/crio-1b13c406a9b6050e27ec597c16133594adba04b2d67e16b2a61d98f409711444 WatchSource:0}: Error finding container 1b13c406a9b6050e27ec597c16133594adba04b2d67e16b2a61d98f409711444: Status 404 returned error can't find the container with id 1b13c406a9b6050e27ec597c16133594adba04b2d67e16b2a61d98f409711444 Jul 08 18:56:45.768199 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:45.768162 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jxqj9" event={"ID":"583c0b6d-1ed4-49f2-b6ce-43f94e19cd51","Type":"ContainerStarted","Data":"e8fa754489ebb8be76c58668f1e31992fbc7f04d495f187191391ced1148579f"} Jul 08 18:56:45.768677 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:45.768216 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jxqj9" event={"ID":"583c0b6d-1ed4-49f2-b6ce-43f94e19cd51","Type":"ContainerStarted","Data":"1b13c406a9b6050e27ec597c16133594adba04b2d67e16b2a61d98f409711444"} Jul 08 18:56:45.792351 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:45.792295 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jxqj9" podStartSLOduration=1.602859665 podStartE2EDuration="1.792277632s" totalImagesPullingTime="189.417967ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:56:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:56:45.790236905 +0000 UTC m=+669.660652039" watchObservedRunningTime="2026-07-08 18:56:45.792277632 +0000 UTC m=+669.662692766" Jul 08 18:56:54.736640 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:54.736606 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jxqj9" Jul 08 18:56:54.737070 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:54.736666 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jxqj9" Jul 08 18:56:54.748918 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:54.748891 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jxqj9" Jul 08 18:56:54.818459 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:54.818425 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jxqj9" Jul 08 18:56:55.973442 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:56:55.973410 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:57:07.911734 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:07.911700 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-bb76p"] Jul 08 18:57:07.915798 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:07.915781 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb76p" Jul 08 18:57:07.919647 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:07.919629 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 08 18:57:07.933116 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:07.933094 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-bb76p"] Jul 08 18:57:07.976136 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:07.976107 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:57:08.011179 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:08.011160 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxvf7\" (UniqueName: \"kubernetes.io/projected/b5d1f4b5-1b79-46e9-834e-a96ca7686f92-kube-api-access-mxvf7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb76p\" (UID: \"b5d1f4b5-1b79-46e9-834e-a96ca7686f92\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb76p" Jul 08 18:57:08.011264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:08.011187 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5d1f4b5-1b79-46e9-834e-a96ca7686f92-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb76p\" (UID: \"b5d1f4b5-1b79-46e9-834e-a96ca7686f92\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb76p" Jul 08 18:57:08.011264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:08.011205 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5d1f4b5-1b79-46e9-834e-a96ca7686f92-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb76p\" (UID: \"b5d1f4b5-1b79-46e9-834e-a96ca7686f92\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb76p" Jul 08 18:57:08.011264 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:08.011223 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5d1f4b5-1b79-46e9-834e-a96ca7686f92-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb76p\" (UID: \"b5d1f4b5-1b79-46e9-834e-a96ca7686f92\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb76p" Jul 08 18:57:08.011371 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:08.011310 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5d1f4b5-1b79-46e9-834e-a96ca7686f92-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb76p\" (UID: \"b5d1f4b5-1b79-46e9-834e-a96ca7686f92\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb76p" Jul 08 18:57:08.011371 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:08.011332 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5d1f4b5-1b79-46e9-834e-a96ca7686f92-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb76p\" (UID: \"b5d1f4b5-1b79-46e9-834e-a96ca7686f92\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb76p" Jul 08 18:57:08.112054 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:08.112022 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5d1f4b5-1b79-46e9-834e-a96ca7686f92-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb76p\" (UID: \"b5d1f4b5-1b79-46e9-834e-a96ca7686f92\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb76p" Jul 08 18:57:08.112161 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:08.112063 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5d1f4b5-1b79-46e9-834e-a96ca7686f92-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb76p\" (UID: \"b5d1f4b5-1b79-46e9-834e-a96ca7686f92\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb76p" Jul 08 18:57:08.112161 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:08.112113 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxvf7\" (UniqueName: \"kubernetes.io/projected/b5d1f4b5-1b79-46e9-834e-a96ca7686f92-kube-api-access-mxvf7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb76p\" (UID: \"b5d1f4b5-1b79-46e9-834e-a96ca7686f92\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb76p" Jul 08 18:57:08.112277 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:08.112193 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5d1f4b5-1b79-46e9-834e-a96ca7686f92-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb76p\" (UID: \"b5d1f4b5-1b79-46e9-834e-a96ca7686f92\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb76p" Jul 08 18:57:08.112277 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:08.112223 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5d1f4b5-1b79-46e9-834e-a96ca7686f92-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb76p\" (UID: \"b5d1f4b5-1b79-46e9-834e-a96ca7686f92\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb76p" Jul 08 18:57:08.112277 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:08.112243 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5d1f4b5-1b79-46e9-834e-a96ca7686f92-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb76p\" (UID: \"b5d1f4b5-1b79-46e9-834e-a96ca7686f92\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb76p" Jul 08 18:57:08.112441 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:08.112411 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5d1f4b5-1b79-46e9-834e-a96ca7686f92-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb76p\" (UID: \"b5d1f4b5-1b79-46e9-834e-a96ca7686f92\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb76p" Jul 08 18:57:08.112561 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:08.112523 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5d1f4b5-1b79-46e9-834e-a96ca7686f92-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb76p\" (UID: \"b5d1f4b5-1b79-46e9-834e-a96ca7686f92\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb76p" Jul 08 18:57:08.112651 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:08.112575 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5d1f4b5-1b79-46e9-834e-a96ca7686f92-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb76p\" (UID: \"b5d1f4b5-1b79-46e9-834e-a96ca7686f92\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb76p" Jul 08 18:57:08.114281 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:08.114259 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5d1f4b5-1b79-46e9-834e-a96ca7686f92-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb76p\" (UID: \"b5d1f4b5-1b79-46e9-834e-a96ca7686f92\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb76p" Jul 08 18:57:08.114506 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:08.114491 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5d1f4b5-1b79-46e9-834e-a96ca7686f92-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb76p\" (UID: \"b5d1f4b5-1b79-46e9-834e-a96ca7686f92\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb76p" Jul 08 18:57:08.125470 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:08.125449 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxvf7\" (UniqueName: \"kubernetes.io/projected/b5d1f4b5-1b79-46e9-834e-a96ca7686f92-kube-api-access-mxvf7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bb76p\" (UID: \"b5d1f4b5-1b79-46e9-834e-a96ca7686f92\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb76p" Jul 08 18:57:08.226561 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:08.226541 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb76p" Jul 08 18:57:08.365328 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:08.365301 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-bb76p"] Jul 08 18:57:08.366732 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:57:08.366704 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5d1f4b5_1b79_46e9_834e_a96ca7686f92.slice/crio-84c737819de41b23d60eca51f4d4c3efc9a92497e1e7721c9a4cf3aadb781358 WatchSource:0}: Error finding container 84c737819de41b23d60eca51f4d4c3efc9a92497e1e7721c9a4cf3aadb781358: Status 404 returned error can't find the container with id 84c737819de41b23d60eca51f4d4c3efc9a92497e1e7721c9a4cf3aadb781358 Jul 08 18:57:08.872701 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:08.872637 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb76p" event={"ID":"b5d1f4b5-1b79-46e9-834e-a96ca7686f92","Type":"ContainerStarted","Data":"025477e8421cc8fd889d67333fecbae5ba79860082a298c40d43f83196c32b43"} Jul 08 18:57:08.872701 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:08.872683 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb76p" event={"ID":"b5d1f4b5-1b79-46e9-834e-a96ca7686f92","Type":"ContainerStarted","Data":"84c737819de41b23d60eca51f4d4c3efc9a92497e1e7721c9a4cf3aadb781358"} Jul 08 18:57:16.001356 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:16.001295 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb76p" podStartSLOduration=8.820983183 podStartE2EDuration="9.001277203s" totalImagesPullingTime="180.29402ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:57:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:57:08.899170901 +0000 UTC m=+692.769586034" watchObservedRunningTime="2026-07-08 18:57:16.001277203 +0000 UTC m=+699.871692335" Jul 08 18:57:16.003255 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:16.003230 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w"] Jul 08 18:57:16.006774 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:16.006755 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w" Jul 08 18:57:16.009214 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:16.009188 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 08 18:57:16.023894 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:16.023873 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w"] Jul 08 18:57:16.078277 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:16.078258 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b51fc40-6b95-4196-b6a6-c9fb1af57669-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w\" (UID: \"6b51fc40-6b95-4196-b6a6-c9fb1af57669\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w" Jul 08 18:57:16.078374 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:16.078286 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b51fc40-6b95-4196-b6a6-c9fb1af57669-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w\" (UID: \"6b51fc40-6b95-4196-b6a6-c9fb1af57669\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w" Jul 08 18:57:16.078374 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:16.078305 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b51fc40-6b95-4196-b6a6-c9fb1af57669-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w\" (UID: \"6b51fc40-6b95-4196-b6a6-c9fb1af57669\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w" Jul 08 18:57:16.078374 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:16.078326 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b51fc40-6b95-4196-b6a6-c9fb1af57669-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w\" (UID: \"6b51fc40-6b95-4196-b6a6-c9fb1af57669\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w" Jul 08 18:57:16.078612 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:16.078391 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b51fc40-6b95-4196-b6a6-c9fb1af57669-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w\" (UID: \"6b51fc40-6b95-4196-b6a6-c9fb1af57669\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w" Jul 08 18:57:16.078612 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:16.078460 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt4nl\" (UniqueName: \"kubernetes.io/projected/6b51fc40-6b95-4196-b6a6-c9fb1af57669-kube-api-access-kt4nl\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w\" (UID: \"6b51fc40-6b95-4196-b6a6-c9fb1af57669\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w" Jul 08 18:57:16.128740 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:16.128717 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:57:16.179532 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:16.179508 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt4nl\" (UniqueName: \"kubernetes.io/projected/6b51fc40-6b95-4196-b6a6-c9fb1af57669-kube-api-access-kt4nl\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w\" (UID: \"6b51fc40-6b95-4196-b6a6-c9fb1af57669\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w" Jul 08 18:57:16.179655 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:16.179543 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b51fc40-6b95-4196-b6a6-c9fb1af57669-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w\" (UID: \"6b51fc40-6b95-4196-b6a6-c9fb1af57669\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w" Jul 08 18:57:16.179655 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:16.179562 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b51fc40-6b95-4196-b6a6-c9fb1af57669-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w\" (UID: \"6b51fc40-6b95-4196-b6a6-c9fb1af57669\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w" Jul 08 18:57:16.179655 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:16.179631 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b51fc40-6b95-4196-b6a6-c9fb1af57669-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w\" (UID: \"6b51fc40-6b95-4196-b6a6-c9fb1af57669\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w" Jul 08 18:57:16.179836 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:16.179676 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b51fc40-6b95-4196-b6a6-c9fb1af57669-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w\" (UID: \"6b51fc40-6b95-4196-b6a6-c9fb1af57669\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w" Jul 08 18:57:16.179836 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:16.179748 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b51fc40-6b95-4196-b6a6-c9fb1af57669-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w\" (UID: \"6b51fc40-6b95-4196-b6a6-c9fb1af57669\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w" Jul 08 18:57:16.180074 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:16.180048 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b51fc40-6b95-4196-b6a6-c9fb1af57669-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w\" (UID: \"6b51fc40-6b95-4196-b6a6-c9fb1af57669\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w" Jul 08 18:57:16.180182 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:16.180080 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b51fc40-6b95-4196-b6a6-c9fb1af57669-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w\" (UID: \"6b51fc40-6b95-4196-b6a6-c9fb1af57669\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w" Jul 08 18:57:16.180182 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:16.180117 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b51fc40-6b95-4196-b6a6-c9fb1af57669-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w\" (UID: \"6b51fc40-6b95-4196-b6a6-c9fb1af57669\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w" Jul 08 18:57:16.181736 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:16.181714 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b51fc40-6b95-4196-b6a6-c9fb1af57669-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w\" (UID: \"6b51fc40-6b95-4196-b6a6-c9fb1af57669\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w" Jul 08 18:57:16.181865 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:16.181849 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b51fc40-6b95-4196-b6a6-c9fb1af57669-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w\" (UID: \"6b51fc40-6b95-4196-b6a6-c9fb1af57669\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w" Jul 08 18:57:16.190302 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:16.190282 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt4nl\" (UniqueName: \"kubernetes.io/projected/6b51fc40-6b95-4196-b6a6-c9fb1af57669-kube-api-access-kt4nl\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w\" (UID: \"6b51fc40-6b95-4196-b6a6-c9fb1af57669\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w" Jul 08 18:57:16.316049 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:16.315981 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w" Jul 08 18:57:16.456814 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:16.456790 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w"] Jul 08 18:57:16.457640 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:57:16.457618 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b51fc40_6b95_4196_b6a6_c9fb1af57669.slice/crio-ae9307311042edb5eb0714c3c033bbdda31f0858384448e7a2875cf9d9ab3c33 WatchSource:0}: Error finding container ae9307311042edb5eb0714c3c033bbdda31f0858384448e7a2875cf9d9ab3c33: Status 404 returned error can't find the container with id ae9307311042edb5eb0714c3c033bbdda31f0858384448e7a2875cf9d9ab3c33 Jul 08 18:57:16.911139 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:16.911105 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w" event={"ID":"6b51fc40-6b95-4196-b6a6-c9fb1af57669","Type":"ContainerStarted","Data":"f3d6c63923daea80697301bd064a8a87386495be93baa1cc241ccf447c419681"} Jul 08 18:57:16.911309 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:16.911147 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w" event={"ID":"6b51fc40-6b95-4196-b6a6-c9fb1af57669","Type":"ContainerStarted","Data":"ae9307311042edb5eb0714c3c033bbdda31f0858384448e7a2875cf9d9ab3c33"} Jul 08 18:57:18.227742 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:18.227712 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb76p" Jul 08 18:57:18.228085 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:18.227768 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb76p" Jul 08 18:57:18.239800 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:18.239774 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb76p" Jul 08 18:57:18.266206 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:18.266164 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w" podStartSLOduration=3.063256265 podStartE2EDuration="3.266148883s" totalImagesPullingTime="202.892618ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:57:16.947006608 +0000 UTC m=+700.817421741" watchObservedRunningTime="2026-07-08 18:57:18.266148883 +0000 UTC m=+702.136564016" Jul 08 18:57:18.932079 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:18.932054 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bb76p" Jul 08 18:57:26.316304 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:26.316271 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w" Jul 08 18:57:26.316687 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:26.316351 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w" Jul 08 18:57:26.328336 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:26.328311 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w" Jul 08 18:57:26.967043 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:57:26.967019 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w" Jul 08 18:58:29.595866 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:29.595828 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-687cc6dc49-nhtgp"] Jul 08 18:58:29.599216 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:29.599198 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687cc6dc49-nhtgp" Jul 08 18:58:29.631261 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:29.631225 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-687cc6dc49-nhtgp"] Jul 08 18:58:29.665416 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:29.665379 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fb191487-56d5-4425-ae21-bcc6748d6600-tls-cert\") pod \"authorino-687cc6dc49-nhtgp\" (UID: \"fb191487-56d5-4425-ae21-bcc6748d6600\") " pod="kuadrant-system/authorino-687cc6dc49-nhtgp" Jul 08 18:58:29.665416 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:29.665418 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s66j\" (UniqueName: \"kubernetes.io/projected/fb191487-56d5-4425-ae21-bcc6748d6600-kube-api-access-9s66j\") pod \"authorino-687cc6dc49-nhtgp\" (UID: \"fb191487-56d5-4425-ae21-bcc6748d6600\") " pod="kuadrant-system/authorino-687cc6dc49-nhtgp" Jul 08 18:58:29.766924 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:29.766886 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fb191487-56d5-4425-ae21-bcc6748d6600-tls-cert\") pod \"authorino-687cc6dc49-nhtgp\" (UID: \"fb191487-56d5-4425-ae21-bcc6748d6600\") " pod="kuadrant-system/authorino-687cc6dc49-nhtgp" Jul 08 18:58:29.766924 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:29.766935 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s66j\" (UniqueName: \"kubernetes.io/projected/fb191487-56d5-4425-ae21-bcc6748d6600-kube-api-access-9s66j\") pod \"authorino-687cc6dc49-nhtgp\" (UID: \"fb191487-56d5-4425-ae21-bcc6748d6600\") " pod="kuadrant-system/authorino-687cc6dc49-nhtgp" Jul 08 18:58:29.769494 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:29.769459 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fb191487-56d5-4425-ae21-bcc6748d6600-tls-cert\") pod \"authorino-687cc6dc49-nhtgp\" (UID: \"fb191487-56d5-4425-ae21-bcc6748d6600\") " pod="kuadrant-system/authorino-687cc6dc49-nhtgp" Jul 08 18:58:29.785275 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:29.785237 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s66j\" (UniqueName: \"kubernetes.io/projected/fb191487-56d5-4425-ae21-bcc6748d6600-kube-api-access-9s66j\") pod \"authorino-687cc6dc49-nhtgp\" (UID: \"fb191487-56d5-4425-ae21-bcc6748d6600\") " pod="kuadrant-system/authorino-687cc6dc49-nhtgp" Jul 08 18:58:29.909091 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:29.908989 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687cc6dc49-nhtgp" Jul 08 18:58:30.031955 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:30.031917 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:58:30.087234 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:30.087179 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-687cc6dc49-nhtgp"] Jul 08 18:58:30.089815 ip-10-0-143-239 kubenswrapper[2572]: W0708 18:58:30.089784 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb191487_56d5_4425_ae21_bcc6748d6600.slice/crio-9a1722c573e63f3dcea8af21a26374311cf17d9e52b5abe709f6d72449e643ef WatchSource:0}: Error finding container 9a1722c573e63f3dcea8af21a26374311cf17d9e52b5abe709f6d72449e643ef: Status 404 returned error can't find the container with id 9a1722c573e63f3dcea8af21a26374311cf17d9e52b5abe709f6d72449e643ef Jul 08 18:58:30.197679 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:30.197642 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:58:30.252196 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:30.252161 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-687cc6dc49-nhtgp" event={"ID":"fb191487-56d5-4425-ae21-bcc6748d6600","Type":"ContainerStarted","Data":"9a1722c573e63f3dcea8af21a26374311cf17d9e52b5abe709f6d72449e643ef"} Jul 08 18:58:31.259296 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:31.259257 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-687cc6dc49-nhtgp" event={"ID":"fb191487-56d5-4425-ae21-bcc6748d6600","Type":"ContainerStarted","Data":"b72325112d8eb91715dfe1809e752eeddc87bc45004c7d8ab32b3fc63db59209"} Jul 08 18:58:31.305751 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:31.305694 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-687cc6dc49-nhtgp" podStartSLOduration=1.985454211 podStartE2EDuration="2.305671627s" totalImagesPullingTime="320.217416ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:58:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:58:31.30244382 +0000 UTC m=+775.172858955" watchObservedRunningTime="2026-07-08 18:58:31.305671627 +0000 UTC m=+775.176086761" Jul 08 18:58:31.384994 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:31.384955 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7fdfc848bd-k252c"] Jul 08 18:58:31.385208 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:31.385172 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7fdfc848bd-k252c" podUID="30d191c9-b44f-4b9a-bf88-6d17bb847e2c" containerName="authorino" containerID="cri-o://c56602432c890c3e231fd6d95f56c851ab8c56e1bef08829cc0df8b4a128f871" gracePeriod=30 Jul 08 18:58:31.565124 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:31.564785 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:58:31.643583 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:31.643554 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fdfc848bd-k252c" Jul 08 18:58:31.789412 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:31.789381 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/30d191c9-b44f-4b9a-bf88-6d17bb847e2c-tls-cert\") pod \"30d191c9-b44f-4b9a-bf88-6d17bb847e2c\" (UID: \"30d191c9-b44f-4b9a-bf88-6d17bb847e2c\") " Jul 08 18:58:31.789637 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:31.789528 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6z9k\" (UniqueName: \"kubernetes.io/projected/30d191c9-b44f-4b9a-bf88-6d17bb847e2c-kube-api-access-w6z9k\") pod \"30d191c9-b44f-4b9a-bf88-6d17bb847e2c\" (UID: \"30d191c9-b44f-4b9a-bf88-6d17bb847e2c\") " Jul 08 18:58:31.791538 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:31.791501 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30d191c9-b44f-4b9a-bf88-6d17bb847e2c-kube-api-access-w6z9k" (OuterVolumeSpecName: "kube-api-access-w6z9k") pod "30d191c9-b44f-4b9a-bf88-6d17bb847e2c" (UID: "30d191c9-b44f-4b9a-bf88-6d17bb847e2c"). InnerVolumeSpecName "kube-api-access-w6z9k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:58:31.801582 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:31.801539 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30d191c9-b44f-4b9a-bf88-6d17bb847e2c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "30d191c9-b44f-4b9a-bf88-6d17bb847e2c" (UID: "30d191c9-b44f-4b9a-bf88-6d17bb847e2c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:58:31.890889 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:31.890798 2572 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/30d191c9-b44f-4b9a-bf88-6d17bb847e2c-tls-cert\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 18:58:31.890889 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:31.890831 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6z9k\" (UniqueName: \"kubernetes.io/projected/30d191c9-b44f-4b9a-bf88-6d17bb847e2c-kube-api-access-w6z9k\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 18:58:32.014301 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:32.014261 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:58:32.266100 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:32.266057 2572 generic.go:356] "Generic (PLEG): container finished" podID="30d191c9-b44f-4b9a-bf88-6d17bb847e2c" containerID="c56602432c890c3e231fd6d95f56c851ab8c56e1bef08829cc0df8b4a128f871" exitCode=0 Jul 08 18:58:32.266610 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:32.266127 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fdfc848bd-k252c" Jul 08 18:58:32.266610 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:32.266162 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7fdfc848bd-k252c" event={"ID":"30d191c9-b44f-4b9a-bf88-6d17bb847e2c","Type":"ContainerDied","Data":"c56602432c890c3e231fd6d95f56c851ab8c56e1bef08829cc0df8b4a128f871"} Jul 08 18:58:32.266610 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:32.266223 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7fdfc848bd-k252c" event={"ID":"30d191c9-b44f-4b9a-bf88-6d17bb847e2c","Type":"ContainerDied","Data":"a941335a427e9231d0a5568000472eaa37722f0a4a9c223e3d51228937757828"} Jul 08 18:58:32.266610 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:32.266259 2572 scope.go:117] "RemoveContainer" containerID="c56602432c890c3e231fd6d95f56c851ab8c56e1bef08829cc0df8b4a128f871" Jul 08 18:58:32.285204 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:32.285165 2572 scope.go:117] "RemoveContainer" containerID="c56602432c890c3e231fd6d95f56c851ab8c56e1bef08829cc0df8b4a128f871" Jul 08 18:58:32.285578 ip-10-0-143-239 kubenswrapper[2572]: E0708 18:58:32.285554 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c56602432c890c3e231fd6d95f56c851ab8c56e1bef08829cc0df8b4a128f871\": container with ID starting with c56602432c890c3e231fd6d95f56c851ab8c56e1bef08829cc0df8b4a128f871 not found: ID does not exist" containerID="c56602432c890c3e231fd6d95f56c851ab8c56e1bef08829cc0df8b4a128f871" Jul 08 18:58:32.285684 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:32.285607 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c56602432c890c3e231fd6d95f56c851ab8c56e1bef08829cc0df8b4a128f871"} err="failed to get container status \"c56602432c890c3e231fd6d95f56c851ab8c56e1bef08829cc0df8b4a128f871\": rpc error: code = NotFound desc = could not find container \"c56602432c890c3e231fd6d95f56c851ab8c56e1bef08829cc0df8b4a128f871\": container with ID starting with c56602432c890c3e231fd6d95f56c851ab8c56e1bef08829cc0df8b4a128f871 not found: ID does not exist" Jul 08 18:58:32.309466 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:32.309421 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7fdfc848bd-k252c"] Jul 08 18:58:32.325059 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:32.325022 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7fdfc848bd-k252c"] Jul 08 18:58:32.692726 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:32.692682 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30d191c9-b44f-4b9a-bf88-6d17bb847e2c" path="/var/lib/kubelet/pods/30d191c9-b44f-4b9a-bf88-6d17bb847e2c/volumes" Jul 08 18:58:54.265484 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:58:54.265442 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:59:43.625367 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:59:43.625331 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 18:59:44.905456 ip-10-0-143-239 kubenswrapper[2572]: I0708 18:59:44.905423 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:00:28.922112 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:00:28.922027 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:00:29.002233 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:00:29.002202 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:00:29.124791 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:00:29.124765 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:00:35.362299 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:00:35.362263 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:00:35.464846 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:00:35.464821 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:00:35.565708 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:00:35.565682 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:00:35.712546 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:00:35.712501 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:00:36.577418 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:00:36.577390 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9hx2g_56065d42-401f-45fb-bf49-8885f262ad6f/console-operator/1.log" Jul 08 19:00:36.578835 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:00:36.578813 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9hx2g_56065d42-401f-45fb-bf49-8885f262ad6f/console-operator/1.log" Jul 08 19:00:41.651155 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:00:41.651119 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:00:41.722755 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:00:41.722724 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:03:06.914473 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:03:06.914442 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:04:35.152781 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:04:35.152743 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:04:36.009815 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:04:36.009785 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:04:36.106583 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:04:36.106545 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:04:50.882258 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:04:50.882228 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:05:36.606921 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:05:36.606891 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9hx2g_56065d42-401f-45fb-bf49-8885f262ad6f/console-operator/1.log" Jul 08 19:05:36.615423 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:05:36.615400 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9hx2g_56065d42-401f-45fb-bf49-8885f262ad6f/console-operator/1.log" Jul 08 19:08:36.261660 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:08:36.261626 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:37.758272 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:08:37.758233 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:10:36.636005 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:10:36.635976 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9hx2g_56065d42-401f-45fb-bf49-8885f262ad6f/console-operator/1.log" Jul 08 19:10:36.645473 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:10:36.645453 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9hx2g_56065d42-401f-45fb-bf49-8885f262ad6f/console-operator/1.log" Jul 08 19:10:50.871246 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:10:50.871190 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:31.870233 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:11:31.870183 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:41.606009 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:11:41.605966 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:46.974529 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:11:46.974488 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:49.907213 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:11:49.907170 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:55.142752 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:11:55.142718 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:58.376802 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:11:58.376769 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:58.604650 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:11:58.604614 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:58.924245 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:11:58.924213 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:06.860109 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:06.860071 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:07.104071 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:07.104032 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:07.288520 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:07.288485 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:07.548445 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:07.548378 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:08.417570 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:08.417529 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:08.618892 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:08.618860 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:08.876555 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:08.876471 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:09.123991 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:09.123962 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:09.799242 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:09.799203 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:10.042314 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:10.042285 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:11.443726 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:11.443698 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:13.685857 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:13.685811 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:14.016445 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:14.016366 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:14.219118 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:14.219086 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:14.677639 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:14.677572 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:16.143464 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:16.143427 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:22.253208 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:22.253169 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:22.419436 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:22.419401 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:22.697812 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:22.697773 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:23.065434 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:23.065403 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:23.835504 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:23.835466 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:24.186497 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:24.186462 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:24.463854 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:24.463770 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:24.867264 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:24.867191 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:25.452152 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:25.452116 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:25.672983 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:25.672952 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:26.374939 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:26.374905 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:28.953039 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:28.952965 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:29.491751 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:29.491716 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:35.095304 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:35.095269 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:35.193097 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:35.193067 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:37.579979 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:37.579949 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:41.576945 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:41.576911 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:41.700706 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:41.700663 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:41.920728 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:41.920699 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:42.077947 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:42.077917 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:43.038335 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:43.038305 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:43.180393 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:43.180362 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:43.294635 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:43.294555 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:43.401440 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:43.401403 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:43.932400 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:43.932365 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:44.026754 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:44.026717 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:44.958198 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:44.958170 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:47.528427 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:47.528394 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:47.723273 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:47.723243 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:47.819719 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:47.819649 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:48.071575 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:48.071506 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:51.105000 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:51.104958 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:54.300152 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:54.300116 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:54.400128 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:54.400096 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:54.919764 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:54.919721 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:55.009199 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:55.009170 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:56.621736 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:12:56.621683 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:03.109051 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:13:03.109000 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:03.217211 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:13:03.217181 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:03.347784 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:13:03.347751 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:03.449312 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:13:03.449275 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:03.954516 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:13:03.954484 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:30.021141 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:13:30.021110 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:37.340657 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:13:37.340621 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:37.679878 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:13:37.679839 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:53.394026 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:13:53.393991 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:59.675714 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:13:59.675634 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:59.761943 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:13:59.761916 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:59.871009 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:13:59.870978 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:10.460770 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:10.460721 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:11.319207 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:11.319171 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:17.349660 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:17.349626 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:17.548859 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:17.548823 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:17.672983 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:17.672952 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:18.531787 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:18.531755 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:18.618405 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:18.618375 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:18.719717 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:18.719678 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:20.423561 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:20.423519 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:26.723160 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:26.723123 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:26.790606 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:26.790560 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:27.422653 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:27.422613 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:33.832251 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:33.832214 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:33.910992 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:33.910956 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:34.019457 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:34.019424 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:34.406677 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:34.406649 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:34.495015 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:34.494977 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:37.254313 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:37.254279 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:37.405580 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:37.405547 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:37.502936 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:37.502901 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:37.703138 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:37.703102 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:38.052118 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:38.052030 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:38.152168 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:38.152141 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:41.784765 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:41.784725 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:42.485788 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:42.485754 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:42.588109 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:42.588070 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:42.973963 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:42.973931 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:49.323623 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:49.323567 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:49.425775 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:49.425738 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:49.774883 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:49.774846 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:50.229119 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:50.229082 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:50.320037 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:50.320005 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:56.928527 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:56.928493 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:57.030087 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:57.030051 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:57.226063 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:57.225986 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:57.781747 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:57.781711 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:57.904488 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:14:57.904459 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:04.096329 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:04.096299 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:04.209716 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:04.209684 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:04.332989 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:04.332957 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:04.493786 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:04.493756 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:09.128465 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:09.128420 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:09.226566 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:09.226528 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:10.520433 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:10.520402 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:10.618213 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:10.618181 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:17.491264 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:17.491230 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:17.870861 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:17.870779 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:18.622720 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:18.622676 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:20.478962 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:20.478917 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:20.559564 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:20.559529 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:20.650857 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:20.650821 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:21.117405 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:21.117372 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:21.219101 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:21.219064 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:21.817706 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:21.817673 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:25.007563 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:25.007531 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:35.295708 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:35.295674 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b"] Jul 08 19:15:35.296254 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:35.296237 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30d191c9-b44f-4b9a-bf88-6d17bb847e2c" containerName="authorino" Jul 08 19:15:35.296301 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:35.296260 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="30d191c9-b44f-4b9a-bf88-6d17bb847e2c" containerName="authorino" Jul 08 19:15:35.296381 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:35.296369 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="30d191c9-b44f-4b9a-bf88-6d17bb847e2c" containerName="authorino" Jul 08 19:15:35.299636 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:35.299617 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b" Jul 08 19:15:35.302885 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:35.302860 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-a04868c7\"/\"kube-root-ca.crt\"" Jul 08 19:15:35.303013 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:35.302883 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-a04868c7\"/\"openshift-service-ca.crt\"" Jul 08 19:15:35.303013 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:35.302934 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-a04868c7\"/\"e2e-lifecycle-model-a04868c7-kserve-self-signed-certs\"" Jul 08 19:15:35.303013 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:35.302864 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-a04868c7\"/\"default-dockercfg-vzk8n\"" Jul 08 19:15:35.309210 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:35.309187 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b"] Jul 08 19:15:35.330043 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:35.330012 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:35.372840 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:35.372811 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76bf1903-321e-4c7f-a82f-347d57a191b2-home\") pod \"e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b\" (UID: \"76bf1903-321e-4c7f-a82f-347d57a191b2\") " pod="ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b" Jul 08 19:15:35.372932 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:35.372848 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76bf1903-321e-4c7f-a82f-347d57a191b2-dshm\") pod \"e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b\" (UID: \"76bf1903-321e-4c7f-a82f-347d57a191b2\") " pod="ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b" Jul 08 19:15:35.372932 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:35.372914 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76bf1903-321e-4c7f-a82f-347d57a191b2-model-cache\") pod \"e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b\" (UID: \"76bf1903-321e-4c7f-a82f-347d57a191b2\") " pod="ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b" Jul 08 19:15:35.372932 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:35.372929 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76bf1903-321e-4c7f-a82f-347d57a191b2-tmp-dir\") pod \"e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b\" (UID: \"76bf1903-321e-4c7f-a82f-347d57a191b2\") " pod="ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b" Jul 08 19:15:35.373038 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:35.372945 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76bf1903-321e-4c7f-a82f-347d57a191b2-tls-certs\") pod \"e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b\" (UID: \"76bf1903-321e-4c7f-a82f-347d57a191b2\") " pod="ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b" Jul 08 19:15:35.373038 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:35.372974 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdqhv\" (UniqueName: \"kubernetes.io/projected/76bf1903-321e-4c7f-a82f-347d57a191b2-kube-api-access-pdqhv\") pod \"e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b\" (UID: \"76bf1903-321e-4c7f-a82f-347d57a191b2\") " pod="ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b" Jul 08 19:15:35.473508 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:35.473486 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76bf1903-321e-4c7f-a82f-347d57a191b2-home\") pod \"e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b\" (UID: \"76bf1903-321e-4c7f-a82f-347d57a191b2\") " pod="ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b" Jul 08 19:15:35.473631 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:35.473511 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76bf1903-321e-4c7f-a82f-347d57a191b2-dshm\") pod \"e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b\" (UID: \"76bf1903-321e-4c7f-a82f-347d57a191b2\") " pod="ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b" Jul 08 19:15:35.473631 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:35.473563 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76bf1903-321e-4c7f-a82f-347d57a191b2-model-cache\") pod \"e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b\" (UID: \"76bf1903-321e-4c7f-a82f-347d57a191b2\") " pod="ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b" Jul 08 19:15:35.473631 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:35.473581 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76bf1903-321e-4c7f-a82f-347d57a191b2-tmp-dir\") pod \"e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b\" (UID: \"76bf1903-321e-4c7f-a82f-347d57a191b2\") " pod="ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b" Jul 08 19:15:35.473631 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:35.473624 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76bf1903-321e-4c7f-a82f-347d57a191b2-tls-certs\") pod \"e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b\" (UID: \"76bf1903-321e-4c7f-a82f-347d57a191b2\") " pod="ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b" Jul 08 19:15:35.473793 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:35.473654 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdqhv\" (UniqueName: \"kubernetes.io/projected/76bf1903-321e-4c7f-a82f-347d57a191b2-kube-api-access-pdqhv\") pod \"e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b\" (UID: \"76bf1903-321e-4c7f-a82f-347d57a191b2\") " pod="ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b" Jul 08 19:15:35.473947 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:35.473919 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76bf1903-321e-4c7f-a82f-347d57a191b2-home\") pod \"e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b\" (UID: \"76bf1903-321e-4c7f-a82f-347d57a191b2\") " pod="ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b" Jul 08 19:15:35.474001 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:35.473958 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76bf1903-321e-4c7f-a82f-347d57a191b2-model-cache\") pod \"e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b\" (UID: \"76bf1903-321e-4c7f-a82f-347d57a191b2\") " pod="ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b" Jul 08 19:15:35.474038 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:35.474013 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76bf1903-321e-4c7f-a82f-347d57a191b2-tmp-dir\") pod \"e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b\" (UID: \"76bf1903-321e-4c7f-a82f-347d57a191b2\") " pod="ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b" Jul 08 19:15:35.475936 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:35.475913 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76bf1903-321e-4c7f-a82f-347d57a191b2-dshm\") pod \"e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b\" (UID: \"76bf1903-321e-4c7f-a82f-347d57a191b2\") " pod="ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b" Jul 08 19:15:35.476065 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:35.476051 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76bf1903-321e-4c7f-a82f-347d57a191b2-tls-certs\") pod \"e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b\" (UID: \"76bf1903-321e-4c7f-a82f-347d57a191b2\") " pod="ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b" Jul 08 19:15:35.481704 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:35.481685 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdqhv\" (UniqueName: \"kubernetes.io/projected/76bf1903-321e-4c7f-a82f-347d57a191b2-kube-api-access-pdqhv\") pod \"e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b\" (UID: \"76bf1903-321e-4c7f-a82f-347d57a191b2\") " pod="ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b" Jul 08 19:15:35.609310 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:35.609241 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b" Jul 08 19:15:35.740689 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:35.740656 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b"] Jul 08 19:15:35.743744 ip-10-0-143-239 kubenswrapper[2572]: W0708 19:15:35.743719 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76bf1903_321e_4c7f_a82f_347d57a191b2.slice/crio-34531e67514c62dd60229debdd2a5ea623d76d48bef4766c560a326d8709915b WatchSource:0}: Error finding container 34531e67514c62dd60229debdd2a5ea623d76d48bef4766c560a326d8709915b: Status 404 returned error can't find the container with id 34531e67514c62dd60229debdd2a5ea623d76d48bef4766c560a326d8709915b Jul 08 19:15:36.238692 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:36.238663 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b" event={"ID":"76bf1903-321e-4c7f-a82f-347d57a191b2","Type":"ContainerStarted","Data":"f8cd582292bd7eea30e08103090aa9f10c642d5f1d8832705e219eaee15409d1"} Jul 08 19:15:36.238692 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:36.238707 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b" event={"ID":"76bf1903-321e-4c7f-a82f-347d57a191b2","Type":"ContainerStarted","Data":"34531e67514c62dd60229debdd2a5ea623d76d48bef4766c560a326d8709915b"} Jul 08 19:15:36.256017 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:36.255966 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b" podStartSLOduration=1.2559505149999999 podStartE2EDuration="1.255950515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:15:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:15:36.255055331 +0000 UTC m=+1800.125470467" watchObservedRunningTime="2026-07-08 19:15:36.255950515 +0000 UTC m=+1800.126365648" Jul 08 19:15:36.665240 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:36.665215 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9hx2g_56065d42-401f-45fb-bf49-8885f262ad6f/console-operator/1.log" Jul 08 19:15:36.678421 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:36.678395 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9hx2g_56065d42-401f-45fb-bf49-8885f262ad6f/console-operator/1.log" Jul 08 19:15:45.610224 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:45.610181 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b" Jul 08 19:15:45.610846 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:45.610242 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b" Jul 08 19:15:45.623328 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:45.623304 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b" Jul 08 19:15:46.296697 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:15:46.296671 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b" Jul 08 19:16:02.709886 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:02.709849 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:16:03.235768 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:03.235733 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:16:08.943817 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:08.943782 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:16:13.903356 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:13.903320 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b"] Jul 08 19:16:13.998665 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:13.998634 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:16:28.923880 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:28.923836 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b" podUID="76bf1903-321e-4c7f-a82f-347d57a191b2" containerName="main" containerID="cri-o://f8cd582292bd7eea30e08103090aa9f10c642d5f1d8832705e219eaee15409d1" gracePeriod=45 Jul 08 19:16:29.179618 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:29.179531 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b" Jul 08 19:16:29.297983 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:29.297944 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76bf1903-321e-4c7f-a82f-347d57a191b2-tls-certs\") pod \"76bf1903-321e-4c7f-a82f-347d57a191b2\" (UID: \"76bf1903-321e-4c7f-a82f-347d57a191b2\") " Jul 08 19:16:29.297983 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:29.297990 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76bf1903-321e-4c7f-a82f-347d57a191b2-dshm\") pod \"76bf1903-321e-4c7f-a82f-347d57a191b2\" (UID: \"76bf1903-321e-4c7f-a82f-347d57a191b2\") " Jul 08 19:16:29.298215 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:29.298044 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76bf1903-321e-4c7f-a82f-347d57a191b2-tmp-dir\") pod \"76bf1903-321e-4c7f-a82f-347d57a191b2\" (UID: \"76bf1903-321e-4c7f-a82f-347d57a191b2\") " Jul 08 19:16:29.298215 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:29.298079 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdqhv\" (UniqueName: \"kubernetes.io/projected/76bf1903-321e-4c7f-a82f-347d57a191b2-kube-api-access-pdqhv\") pod \"76bf1903-321e-4c7f-a82f-347d57a191b2\" (UID: \"76bf1903-321e-4c7f-a82f-347d57a191b2\") " Jul 08 19:16:29.298215 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:29.298121 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76bf1903-321e-4c7f-a82f-347d57a191b2-home\") pod \"76bf1903-321e-4c7f-a82f-347d57a191b2\" (UID: \"76bf1903-321e-4c7f-a82f-347d57a191b2\") " Jul 08 19:16:29.298215 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:29.298187 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76bf1903-321e-4c7f-a82f-347d57a191b2-model-cache\") pod \"76bf1903-321e-4c7f-a82f-347d57a191b2\" (UID: \"76bf1903-321e-4c7f-a82f-347d57a191b2\") " Jul 08 19:16:29.298352 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:29.298329 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76bf1903-321e-4c7f-a82f-347d57a191b2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "76bf1903-321e-4c7f-a82f-347d57a191b2" (UID: "76bf1903-321e-4c7f-a82f-347d57a191b2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:16:29.298457 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:29.298417 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76bf1903-321e-4c7f-a82f-347d57a191b2-home" (OuterVolumeSpecName: "home") pod "76bf1903-321e-4c7f-a82f-347d57a191b2" (UID: "76bf1903-321e-4c7f-a82f-347d57a191b2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:16:29.298686 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:29.298656 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76bf1903-321e-4c7f-a82f-347d57a191b2-model-cache" (OuterVolumeSpecName: "model-cache") pod "76bf1903-321e-4c7f-a82f-347d57a191b2" (UID: "76bf1903-321e-4c7f-a82f-347d57a191b2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:16:29.298794 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:29.298665 2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76bf1903-321e-4c7f-a82f-347d57a191b2-tmp-dir\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 19:16:29.298794 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:29.298716 2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76bf1903-321e-4c7f-a82f-347d57a191b2-home\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 19:16:29.300409 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:29.300383 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76bf1903-321e-4c7f-a82f-347d57a191b2-dshm" (OuterVolumeSpecName: "dshm") pod "76bf1903-321e-4c7f-a82f-347d57a191b2" (UID: "76bf1903-321e-4c7f-a82f-347d57a191b2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:16:29.300502 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:29.300452 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76bf1903-321e-4c7f-a82f-347d57a191b2-kube-api-access-pdqhv" (OuterVolumeSpecName: "kube-api-access-pdqhv") pod "76bf1903-321e-4c7f-a82f-347d57a191b2" (UID: "76bf1903-321e-4c7f-a82f-347d57a191b2"). InnerVolumeSpecName "kube-api-access-pdqhv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:16:29.300680 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:29.300660 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76bf1903-321e-4c7f-a82f-347d57a191b2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "76bf1903-321e-4c7f-a82f-347d57a191b2" (UID: "76bf1903-321e-4c7f-a82f-347d57a191b2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:16:29.399770 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:29.399740 2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76bf1903-321e-4c7f-a82f-347d57a191b2-model-cache\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 19:16:29.399770 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:29.399766 2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76bf1903-321e-4c7f-a82f-347d57a191b2-tls-certs\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 19:16:29.399770 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:29.399775 2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76bf1903-321e-4c7f-a82f-347d57a191b2-dshm\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 19:16:29.400008 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:29.399783 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdqhv\" (UniqueName: \"kubernetes.io/projected/76bf1903-321e-4c7f-a82f-347d57a191b2-kube-api-access-pdqhv\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 19:16:29.496462 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:29.496372 2572 generic.go:356] "Generic (PLEG): container finished" podID="76bf1903-321e-4c7f-a82f-347d57a191b2" containerID="f8cd582292bd7eea30e08103090aa9f10c642d5f1d8832705e219eaee15409d1" exitCode=0 Jul 08 19:16:29.496462 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:29.496418 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b" Jul 08 19:16:29.496744 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:29.496468 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b" event={"ID":"76bf1903-321e-4c7f-a82f-347d57a191b2","Type":"ContainerDied","Data":"f8cd582292bd7eea30e08103090aa9f10c642d5f1d8832705e219eaee15409d1"} Jul 08 19:16:29.496744 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:29.496521 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b" event={"ID":"76bf1903-321e-4c7f-a82f-347d57a191b2","Type":"ContainerDied","Data":"34531e67514c62dd60229debdd2a5ea623d76d48bef4766c560a326d8709915b"} Jul 08 19:16:29.496744 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:29.496543 2572 scope.go:117] "RemoveContainer" containerID="f8cd582292bd7eea30e08103090aa9f10c642d5f1d8832705e219eaee15409d1" Jul 08 19:16:29.508154 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:29.508126 2572 scope.go:117] "RemoveContainer" containerID="f8cd582292bd7eea30e08103090aa9f10c642d5f1d8832705e219eaee15409d1" Jul 08 19:16:29.508615 ip-10-0-143-239 kubenswrapper[2572]: E0708 19:16:29.508570 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8cd582292bd7eea30e08103090aa9f10c642d5f1d8832705e219eaee15409d1\": container with ID starting with f8cd582292bd7eea30e08103090aa9f10c642d5f1d8832705e219eaee15409d1 not found: ID does not exist" containerID="f8cd582292bd7eea30e08103090aa9f10c642d5f1d8832705e219eaee15409d1" Jul 08 19:16:29.508728 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:29.508625 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8cd582292bd7eea30e08103090aa9f10c642d5f1d8832705e219eaee15409d1"} err="failed to get container status \"f8cd582292bd7eea30e08103090aa9f10c642d5f1d8832705e219eaee15409d1\": rpc error: code = NotFound desc = could not find container \"f8cd582292bd7eea30e08103090aa9f10c642d5f1d8832705e219eaee15409d1\": container with ID starting with f8cd582292bd7eea30e08103090aa9f10c642d5f1d8832705e219eaee15409d1 not found: ID does not exist" Jul 08 19:16:29.519518 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:29.519493 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b"] Jul 08 19:16:29.523265 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:29.523244 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-a04868c7/e2e-lifecycle-model-a04868c7-kserve-864f577cc5-jz52b"] Jul 08 19:16:30.691558 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:30.691525 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76bf1903-321e-4c7f-a82f-347d57a191b2" path="/var/lib/kubelet/pods/76bf1903-321e-4c7f-a82f-347d57a191b2/volumes" Jul 08 19:16:42.561129 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:42.561089 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:16:42.668638 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:42.668571 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:16:50.189752 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:50.189712 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:16:51.275479 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:51.275443 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:16:55.882728 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:55.882699 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:16:55.959606 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:55.959539 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:16:56.190668 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:56.190632 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:16:57.621763 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:57.621724 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:16:57.738684 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:57.738647 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:16:58.700637 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:58.700547 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:16:58.826169 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:16:58.826133 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:17:00.330036 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:17:00.330002 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:17:06.578306 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:17:06.578258 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:17:06.685924 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:17:06.685882 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:17:07.390894 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:17:07.390867 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:17:13.551341 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:17:13.551300 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:17:13.654774 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:17:13.654740 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:17:13.755098 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:17:13.755062 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:17:24.331058 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:17:24.331014 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:17:24.686639 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:17:24.686604 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:17:45.700238 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:17:45.700201 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:17:51.731887 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:17:51.731850 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:17:51.831176 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:17:51.831140 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:17:52.081646 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:17:52.081542 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:17:52.408585 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:17:52.408498 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:17:52.630802 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:17:52.630765 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:17:55.438376 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:17:55.438345 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:17:55.530680 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:17:55.530641 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:17:55.645152 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:17:55.645120 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:17:55.853748 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:17:55.853656 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:17:56.097724 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:17:56.097682 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:17:56.199875 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:17:56.199842 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:17:59.930289 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:17:59.930254 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:18:00.286297 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.286200 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:18:00.595581 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.595506 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq"] Jul 08 19:18:00.595912 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.595899 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76bf1903-321e-4c7f-a82f-347d57a191b2" containerName="main" Jul 08 19:18:00.595955 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.595914 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="76bf1903-321e-4c7f-a82f-347d57a191b2" containerName="main" Jul 08 19:18:00.596005 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.595996 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="76bf1903-321e-4c7f-a82f-347d57a191b2" containerName="main" Jul 08 19:18:00.599198 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.599183 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:00.602528 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.602505 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-2d9136-openshift-default-dockercfg-76xtn\"" Jul 08 19:18:00.612522 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.612495 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq"] Jul 08 19:18:00.627288 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.627264 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:18:00.662106 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.662069 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/709cef8d-06e9-4f0c-85ff-cf9f23a76877-istio-data\") pod \"e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:00.662106 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.662112 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/709cef8d-06e9-4f0c-85ff-cf9f23a76877-workload-socket\") pod \"e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:00.662274 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.662138 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/709cef8d-06e9-4f0c-85ff-cf9f23a76877-istio-envoy\") pod \"e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:00.662274 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.662154 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/709cef8d-06e9-4f0c-85ff-cf9f23a76877-istiod-ca-cert\") pod \"e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:00.662274 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.662217 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/709cef8d-06e9-4f0c-85ff-cf9f23a76877-workload-certs\") pod \"e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:00.662274 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.662231 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/709cef8d-06e9-4f0c-85ff-cf9f23a76877-istio-token\") pod \"e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:00.662274 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.662251 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/709cef8d-06e9-4f0c-85ff-cf9f23a76877-istio-podinfo\") pod \"e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:00.662460 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.662278 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m44x\" (UniqueName: \"kubernetes.io/projected/709cef8d-06e9-4f0c-85ff-cf9f23a76877-kube-api-access-9m44x\") pod \"e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:00.662460 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.662347 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/709cef8d-06e9-4f0c-85ff-cf9f23a76877-credential-socket\") pod \"e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:00.763445 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.763414 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/709cef8d-06e9-4f0c-85ff-cf9f23a76877-istio-data\") pod \"e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:00.763445 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.763451 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/709cef8d-06e9-4f0c-85ff-cf9f23a76877-workload-socket\") pod \"e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:00.763696 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.763474 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/709cef8d-06e9-4f0c-85ff-cf9f23a76877-istio-envoy\") pod \"e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:00.763696 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.763612 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/709cef8d-06e9-4f0c-85ff-cf9f23a76877-istiod-ca-cert\") pod \"e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:00.763799 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.763711 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/709cef8d-06e9-4f0c-85ff-cf9f23a76877-workload-certs\") pod \"e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:00.763799 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.763739 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/709cef8d-06e9-4f0c-85ff-cf9f23a76877-istio-token\") pod \"e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:00.763799 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.763779 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/709cef8d-06e9-4f0c-85ff-cf9f23a76877-istio-podinfo\") pod \"e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:00.763951 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.763796 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/709cef8d-06e9-4f0c-85ff-cf9f23a76877-workload-socket\") pod \"e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:00.763951 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.763833 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m44x\" (UniqueName: \"kubernetes.io/projected/709cef8d-06e9-4f0c-85ff-cf9f23a76877-kube-api-access-9m44x\") pod \"e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:00.763951 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.763884 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/709cef8d-06e9-4f0c-85ff-cf9f23a76877-credential-socket\") pod \"e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:00.763951 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.763906 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/709cef8d-06e9-4f0c-85ff-cf9f23a76877-istio-data\") pod \"e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:00.764120 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.764077 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/709cef8d-06e9-4f0c-85ff-cf9f23a76877-workload-certs\") pod \"e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:00.764202 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.764175 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/709cef8d-06e9-4f0c-85ff-cf9f23a76877-credential-socket\") pod \"e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:00.764339 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.764329 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/709cef8d-06e9-4f0c-85ff-cf9f23a76877-istiod-ca-cert\") pod \"e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:00.765935 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.765915 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/709cef8d-06e9-4f0c-85ff-cf9f23a76877-istio-envoy\") pod \"e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:00.766361 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.766344 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/709cef8d-06e9-4f0c-85ff-cf9f23a76877-istio-podinfo\") pod \"e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:00.772835 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.772814 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/709cef8d-06e9-4f0c-85ff-cf9f23a76877-istio-token\") pod \"e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:00.779529 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.779506 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m44x\" (UniqueName: \"kubernetes.io/projected/709cef8d-06e9-4f0c-85ff-cf9f23a76877-kube-api-access-9m44x\") pod \"e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:00.909281 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:00.909199 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:01.049650 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:01.049620 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq"] Jul 08 19:18:01.051368 ip-10-0-143-239 kubenswrapper[2572]: W0708 19:18:01.051338 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod709cef8d_06e9_4f0c_85ff_cf9f23a76877.slice/crio-c92df93561e444d31749dec3575789833c297a49a6b74a686a82b7786378e018 WatchSource:0}: Error finding container c92df93561e444d31749dec3575789833c297a49a6b74a686a82b7786378e018: Status 404 returned error can't find the container with id c92df93561e444d31749dec3575789833c297a49a6b74a686a82b7786378e018 Jul 08 19:18:01.053516 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:01.053482 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 19:18:01.053631 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:01.053558 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 19:18:01.053631 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:01.053622 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 19:18:01.108800 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:01.108767 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:18:01.957486 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:01.957452 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" event={"ID":"709cef8d-06e9-4f0c-85ff-cf9f23a76877","Type":"ContainerStarted","Data":"ded50efcc6a59b1a50fd8cef0ead9a973c63b7769ef8f5bbbc23a9c897f6c671"} Jul 08 19:18:01.957700 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:01.957534 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" event={"ID":"709cef8d-06e9-4f0c-85ff-cf9f23a76877","Type":"ContainerStarted","Data":"c92df93561e444d31749dec3575789833c297a49a6b74a686a82b7786378e018"} Jul 08 19:18:01.983144 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:01.983088 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" podStartSLOduration=1.983071287 podStartE2EDuration="1.983071287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:18:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:18:01.980620167 +0000 UTC m=+1945.851035297" watchObservedRunningTime="2026-07-08 19:18:01.983071287 +0000 UTC m=+1945.853486420" Jul 08 19:18:02.663118 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:02.663082 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:18:02.720916 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:02.720885 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:18:02.910299 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:02.910263 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:02.915314 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:02.915291 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:02.962294 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:02.962257 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:02.963336 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:02.963318 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:03.919901 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:03.919865 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:18:04.285744 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:04.285643 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:18:04.385776 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:04.385736 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:18:04.718041 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:04.718008 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:18:04.821020 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:04.820958 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:18:08.459650 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:08.459612 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:18:12.692279 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:12.692251 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn"] Jul 08 19:18:12.695697 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:12.695675 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn" Jul 08 19:18:12.698423 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:12.698401 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-b274ce\"/\"kube-root-ca.crt\"" Jul 08 19:18:12.699398 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:12.699378 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-b274ce\"/\"test-model-b274ce-kserve-self-signed-certs\"" Jul 08 19:18:12.699542 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:12.699430 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-b274ce\"/\"openshift-service-ca.crt\"" Jul 08 19:18:12.699542 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:12.699385 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-b274ce\"/\"default-dockercfg-9v684\"" Jul 08 19:18:12.706919 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:12.706898 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn"] Jul 08 19:18:12.727847 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:12.727821 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:18:12.787841 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:12.787806 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0220bcf4-a19b-4d4e-965b-47d05d383417-tls-certs\") pod \"test-model-b274ce-kserve-887c46767-4zwrn\" (UID: \"0220bcf4-a19b-4d4e-965b-47d05d383417\") " pod="ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn" Jul 08 19:18:12.788048 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:12.787851 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0220bcf4-a19b-4d4e-965b-47d05d383417-model-cache\") pod \"test-model-b274ce-kserve-887c46767-4zwrn\" (UID: \"0220bcf4-a19b-4d4e-965b-47d05d383417\") " pod="ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn" Jul 08 19:18:12.788048 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:12.787886 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0220bcf4-a19b-4d4e-965b-47d05d383417-home\") pod \"test-model-b274ce-kserve-887c46767-4zwrn\" (UID: \"0220bcf4-a19b-4d4e-965b-47d05d383417\") " pod="ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn" Jul 08 19:18:12.788048 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:12.787962 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0220bcf4-a19b-4d4e-965b-47d05d383417-tmp-dir\") pod \"test-model-b274ce-kserve-887c46767-4zwrn\" (UID: \"0220bcf4-a19b-4d4e-965b-47d05d383417\") " pod="ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn" Jul 08 19:18:12.788226 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:12.788055 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0220bcf4-a19b-4d4e-965b-47d05d383417-dshm\") pod \"test-model-b274ce-kserve-887c46767-4zwrn\" (UID: \"0220bcf4-a19b-4d4e-965b-47d05d383417\") " pod="ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn" Jul 08 19:18:12.788226 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:12.788095 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw4kw\" (UniqueName: \"kubernetes.io/projected/0220bcf4-a19b-4d4e-965b-47d05d383417-kube-api-access-lw4kw\") pod \"test-model-b274ce-kserve-887c46767-4zwrn\" (UID: \"0220bcf4-a19b-4d4e-965b-47d05d383417\") " pod="ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn" Jul 08 19:18:12.888957 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:12.888915 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0220bcf4-a19b-4d4e-965b-47d05d383417-dshm\") pod \"test-model-b274ce-kserve-887c46767-4zwrn\" (UID: \"0220bcf4-a19b-4d4e-965b-47d05d383417\") " pod="ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn" Jul 08 19:18:12.889172 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:12.888972 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lw4kw\" (UniqueName: \"kubernetes.io/projected/0220bcf4-a19b-4d4e-965b-47d05d383417-kube-api-access-lw4kw\") pod \"test-model-b274ce-kserve-887c46767-4zwrn\" (UID: \"0220bcf4-a19b-4d4e-965b-47d05d383417\") " pod="ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn" Jul 08 19:18:12.889172 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:12.889021 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0220bcf4-a19b-4d4e-965b-47d05d383417-tls-certs\") pod \"test-model-b274ce-kserve-887c46767-4zwrn\" (UID: \"0220bcf4-a19b-4d4e-965b-47d05d383417\") " pod="ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn" Jul 08 19:18:12.889172 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:12.889052 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0220bcf4-a19b-4d4e-965b-47d05d383417-model-cache\") pod \"test-model-b274ce-kserve-887c46767-4zwrn\" (UID: \"0220bcf4-a19b-4d4e-965b-47d05d383417\") " pod="ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn" Jul 08 19:18:12.889364 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:12.889173 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0220bcf4-a19b-4d4e-965b-47d05d383417-home\") pod \"test-model-b274ce-kserve-887c46767-4zwrn\" (UID: \"0220bcf4-a19b-4d4e-965b-47d05d383417\") " pod="ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn" Jul 08 19:18:12.889364 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:12.889308 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0220bcf4-a19b-4d4e-965b-47d05d383417-tmp-dir\") pod \"test-model-b274ce-kserve-887c46767-4zwrn\" (UID: \"0220bcf4-a19b-4d4e-965b-47d05d383417\") " pod="ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn" Jul 08 19:18:12.889529 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:12.889450 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0220bcf4-a19b-4d4e-965b-47d05d383417-model-cache\") pod \"test-model-b274ce-kserve-887c46767-4zwrn\" (UID: \"0220bcf4-a19b-4d4e-965b-47d05d383417\") " pod="ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn" Jul 08 19:18:12.889529 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:12.889506 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0220bcf4-a19b-4d4e-965b-47d05d383417-home\") pod \"test-model-b274ce-kserve-887c46767-4zwrn\" (UID: \"0220bcf4-a19b-4d4e-965b-47d05d383417\") " pod="ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn" Jul 08 19:18:12.889777 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:12.889755 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0220bcf4-a19b-4d4e-965b-47d05d383417-tmp-dir\") pod \"test-model-b274ce-kserve-887c46767-4zwrn\" (UID: \"0220bcf4-a19b-4d4e-965b-47d05d383417\") " pod="ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn" Jul 08 19:18:12.891280 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:12.891261 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0220bcf4-a19b-4d4e-965b-47d05d383417-dshm\") pod \"test-model-b274ce-kserve-887c46767-4zwrn\" (UID: \"0220bcf4-a19b-4d4e-965b-47d05d383417\") " pod="ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn" Jul 08 19:18:12.891643 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:12.891624 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0220bcf4-a19b-4d4e-965b-47d05d383417-tls-certs\") pod \"test-model-b274ce-kserve-887c46767-4zwrn\" (UID: \"0220bcf4-a19b-4d4e-965b-47d05d383417\") " pod="ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn" Jul 08 19:18:12.897579 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:12.897556 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw4kw\" (UniqueName: \"kubernetes.io/projected/0220bcf4-a19b-4d4e-965b-47d05d383417-kube-api-access-lw4kw\") pod \"test-model-b274ce-kserve-887c46767-4zwrn\" (UID: \"0220bcf4-a19b-4d4e-965b-47d05d383417\") " pod="ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn" Jul 08 19:18:13.006798 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:13.006716 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn" Jul 08 19:18:13.187454 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:13.187433 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn"] Jul 08 19:18:13.189954 ip-10-0-143-239 kubenswrapper[2572]: W0708 19:18:13.189925 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0220bcf4_a19b_4d4e_965b_47d05d383417.slice/crio-f2f6587cdd9adcc1d45378e50499e28fed84c3193ad580856511461201072f07 WatchSource:0}: Error finding container f2f6587cdd9adcc1d45378e50499e28fed84c3193ad580856511461201072f07: Status 404 returned error can't find the container with id f2f6587cdd9adcc1d45378e50499e28fed84c3193ad580856511461201072f07 Jul 08 19:18:14.030496 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:14.030461 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn" event={"ID":"0220bcf4-a19b-4d4e-965b-47d05d383417","Type":"ContainerStarted","Data":"eee9e67aa49932ef1602777d6ae0704aa569cc9afa87536e43037d283aaeee82"} Jul 08 19:18:14.030496 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:14.030502 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn" event={"ID":"0220bcf4-a19b-4d4e-965b-47d05d383417","Type":"ContainerStarted","Data":"f2f6587cdd9adcc1d45378e50499e28fed84c3193ad580856511461201072f07"} Jul 08 19:18:14.054174 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:14.054106 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn" podStartSLOduration=2.054087074 podStartE2EDuration="2.054087074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:18:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:18:14.050986297 +0000 UTC m=+1957.921401431" watchObservedRunningTime="2026-07-08 19:18:14.054087074 +0000 UTC m=+1957.924502209" Jul 08 19:18:17.776135 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:17.776075 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:18:17.871108 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:17.871071 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:18:19.003802 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:19.003752 2572 patch_prober.go:28] interesting pod/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 08 19:18:19.004203 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:19.003828 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" podUID="709cef8d-06e9-4f0c-85ff-cf9f23a76877" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 08 19:18:20.071547 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:20.071512 2572 generic.go:356] "Generic (PLEG): container finished" podID="709cef8d-06e9-4f0c-85ff-cf9f23a76877" containerID="ded50efcc6a59b1a50fd8cef0ead9a973c63b7769ef8f5bbbc23a9c897f6c671" exitCode=0 Jul 08 19:18:20.072095 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:20.071567 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" event={"ID":"709cef8d-06e9-4f0c-85ff-cf9f23a76877","Type":"ContainerDied","Data":"ded50efcc6a59b1a50fd8cef0ead9a973c63b7769ef8f5bbbc23a9c897f6c671"} Jul 08 19:18:20.072095 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:20.072080 2572 scope.go:117] "RemoveContainer" containerID="ded50efcc6a59b1a50fd8cef0ead9a973c63b7769ef8f5bbbc23a9c897f6c671" Jul 08 19:18:20.073302 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:20.073256 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 19:18:20.073377 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:20.073356 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 19:18:20.073416 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:20.073400 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 19:18:21.078773 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:21.078735 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" event={"ID":"709cef8d-06e9-4f0c-85ff-cf9f23a76877","Type":"ContainerStarted","Data":"25cd7999fb3dabc64e477e1b1547887c1e00eb0c62006b0a215b2b06b8a3e64c"} Jul 08 19:18:21.909667 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:21.909623 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:21.909882 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:21.909850 2572 patch_prober.go:28] interesting pod/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 08 19:18:21.909974 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:21.909922 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" podUID="709cef8d-06e9-4f0c-85ff-cf9f23a76877" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 08 19:18:22.910159 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:22.910125 2572 patch_prober.go:28] interesting pod/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 08 19:18:22.910537 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:22.910175 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" podUID="709cef8d-06e9-4f0c-85ff-cf9f23a76877" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 08 19:18:23.007506 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:23.007474 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn" Jul 08 19:18:23.007717 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:23.007556 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn" Jul 08 19:18:23.019875 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:23.019854 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn" Jul 08 19:18:23.099675 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:23.099643 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn" Jul 08 19:18:23.909668 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:23.909628 2572 patch_prober.go:28] interesting pod/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 08 19:18:23.909859 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:23.909690 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" podUID="709cef8d-06e9-4f0c-85ff-cf9f23a76877" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 08 19:18:24.910139 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:24.910107 2572 patch_prober.go:28] interesting pod/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 08 19:18:24.910556 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:24.910167 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" podUID="709cef8d-06e9-4f0c-85ff-cf9f23a76877" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 08 19:18:25.250538 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:25.250500 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:18:25.355870 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:25.355833 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:18:25.913462 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:25.913434 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:25.913902 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:25.913716 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:25.914374 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:25.914355 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:18:34.995453 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:34.995360 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:18:54.379951 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:54.379909 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:18:56.902407 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:56.902368 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn"] Jul 08 19:18:56.926039 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:56.926009 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:18:58.005009 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:58.004970 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:18:58.160078 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:58.160028 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:18:58.607529 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:58.607488 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:18:58.707683 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:58.707647 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:18:58.892866 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:18:58.892775 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:19:03.676642 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:03.676583 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:19:11.923376 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:11.923309 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn" podUID="0220bcf4-a19b-4d4e-965b-47d05d383417" containerName="main" containerID="cri-o://eee9e67aa49932ef1602777d6ae0704aa569cc9afa87536e43037d283aaeee82" gracePeriod=45 Jul 08 19:19:12.169918 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:12.169896 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn" Jul 08 19:19:12.336866 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:12.336794 2572 generic.go:356] "Generic (PLEG): container finished" podID="0220bcf4-a19b-4d4e-965b-47d05d383417" containerID="eee9e67aa49932ef1602777d6ae0704aa569cc9afa87536e43037d283aaeee82" exitCode=0 Jul 08 19:19:12.336866 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:12.336842 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn" Jul 08 19:19:12.337067 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:12.336882 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn" event={"ID":"0220bcf4-a19b-4d4e-965b-47d05d383417","Type":"ContainerDied","Data":"eee9e67aa49932ef1602777d6ae0704aa569cc9afa87536e43037d283aaeee82"} Jul 08 19:19:12.337067 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:12.336925 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn" event={"ID":"0220bcf4-a19b-4d4e-965b-47d05d383417","Type":"ContainerDied","Data":"f2f6587cdd9adcc1d45378e50499e28fed84c3193ad580856511461201072f07"} Jul 08 19:19:12.337067 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:12.336942 2572 scope.go:117] "RemoveContainer" containerID="eee9e67aa49932ef1602777d6ae0704aa569cc9afa87536e43037d283aaeee82" Jul 08 19:19:12.345324 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:12.345306 2572 scope.go:117] "RemoveContainer" containerID="eee9e67aa49932ef1602777d6ae0704aa569cc9afa87536e43037d283aaeee82" Jul 08 19:19:12.345578 ip-10-0-143-239 kubenswrapper[2572]: E0708 19:19:12.345556 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eee9e67aa49932ef1602777d6ae0704aa569cc9afa87536e43037d283aaeee82\": container with ID starting with eee9e67aa49932ef1602777d6ae0704aa569cc9afa87536e43037d283aaeee82 not found: ID does not exist" containerID="eee9e67aa49932ef1602777d6ae0704aa569cc9afa87536e43037d283aaeee82" Jul 08 19:19:12.345672 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:12.345603 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eee9e67aa49932ef1602777d6ae0704aa569cc9afa87536e43037d283aaeee82"} err="failed to get container status \"eee9e67aa49932ef1602777d6ae0704aa569cc9afa87536e43037d283aaeee82\": rpc error: code = NotFound desc = could not find container \"eee9e67aa49932ef1602777d6ae0704aa569cc9afa87536e43037d283aaeee82\": container with ID starting with eee9e67aa49932ef1602777d6ae0704aa569cc9afa87536e43037d283aaeee82 not found: ID does not exist" Jul 08 19:19:12.352881 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:12.352864 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0220bcf4-a19b-4d4e-965b-47d05d383417-tls-certs\") pod \"0220bcf4-a19b-4d4e-965b-47d05d383417\" (UID: \"0220bcf4-a19b-4d4e-965b-47d05d383417\") " Jul 08 19:19:12.352938 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:12.352899 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0220bcf4-a19b-4d4e-965b-47d05d383417-dshm\") pod \"0220bcf4-a19b-4d4e-965b-47d05d383417\" (UID: \"0220bcf4-a19b-4d4e-965b-47d05d383417\") " Jul 08 19:19:12.352976 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:12.352938 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0220bcf4-a19b-4d4e-965b-47d05d383417-home\") pod \"0220bcf4-a19b-4d4e-965b-47d05d383417\" (UID: \"0220bcf4-a19b-4d4e-965b-47d05d383417\") " Jul 08 19:19:12.353010 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:12.352980 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0220bcf4-a19b-4d4e-965b-47d05d383417-model-cache\") pod \"0220bcf4-a19b-4d4e-965b-47d05d383417\" (UID: \"0220bcf4-a19b-4d4e-965b-47d05d383417\") " Jul 08 19:19:12.353044 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:12.353020 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0220bcf4-a19b-4d4e-965b-47d05d383417-tmp-dir\") pod \"0220bcf4-a19b-4d4e-965b-47d05d383417\" (UID: \"0220bcf4-a19b-4d4e-965b-47d05d383417\") " Jul 08 19:19:12.353078 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:12.353057 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lw4kw\" (UniqueName: \"kubernetes.io/projected/0220bcf4-a19b-4d4e-965b-47d05d383417-kube-api-access-lw4kw\") pod \"0220bcf4-a19b-4d4e-965b-47d05d383417\" (UID: \"0220bcf4-a19b-4d4e-965b-47d05d383417\") " Jul 08 19:19:12.353198 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:12.353173 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0220bcf4-a19b-4d4e-965b-47d05d383417-home" (OuterVolumeSpecName: "home") pod "0220bcf4-a19b-4d4e-965b-47d05d383417" (UID: "0220bcf4-a19b-4d4e-965b-47d05d383417"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:19:12.353342 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:12.353217 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0220bcf4-a19b-4d4e-965b-47d05d383417-model-cache" (OuterVolumeSpecName: "model-cache") pod "0220bcf4-a19b-4d4e-965b-47d05d383417" (UID: "0220bcf4-a19b-4d4e-965b-47d05d383417"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:19:12.353342 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:12.353324 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0220bcf4-a19b-4d4e-965b-47d05d383417-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0220bcf4-a19b-4d4e-965b-47d05d383417" (UID: "0220bcf4-a19b-4d4e-965b-47d05d383417"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:19:12.353453 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:12.353387 2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0220bcf4-a19b-4d4e-965b-47d05d383417-model-cache\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 19:19:12.353453 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:12.353408 2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0220bcf4-a19b-4d4e-965b-47d05d383417-home\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 19:19:12.354952 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:12.354934 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0220bcf4-a19b-4d4e-965b-47d05d383417-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0220bcf4-a19b-4d4e-965b-47d05d383417" (UID: "0220bcf4-a19b-4d4e-965b-47d05d383417"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:19:12.355136 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:12.355116 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0220bcf4-a19b-4d4e-965b-47d05d383417-kube-api-access-lw4kw" (OuterVolumeSpecName: "kube-api-access-lw4kw") pod "0220bcf4-a19b-4d4e-965b-47d05d383417" (UID: "0220bcf4-a19b-4d4e-965b-47d05d383417"). InnerVolumeSpecName "kube-api-access-lw4kw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:19:12.355179 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:12.355136 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0220bcf4-a19b-4d4e-965b-47d05d383417-dshm" (OuterVolumeSpecName: "dshm") pod "0220bcf4-a19b-4d4e-965b-47d05d383417" (UID: "0220bcf4-a19b-4d4e-965b-47d05d383417"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:19:12.453798 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:12.453776 2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0220bcf4-a19b-4d4e-965b-47d05d383417-tmp-dir\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 19:19:12.453798 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:12.453796 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lw4kw\" (UniqueName: \"kubernetes.io/projected/0220bcf4-a19b-4d4e-965b-47d05d383417-kube-api-access-lw4kw\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 19:19:12.453920 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:12.453805 2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0220bcf4-a19b-4d4e-965b-47d05d383417-tls-certs\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 19:19:12.453920 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:12.453814 2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0220bcf4-a19b-4d4e-965b-47d05d383417-dshm\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 19:19:12.658462 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:12.658434 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn"] Jul 08 19:19:12.661079 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:12.661057 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-b274ce/test-model-b274ce-kserve-887c46767-4zwrn"] Jul 08 19:19:12.691883 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:12.691860 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0220bcf4-a19b-4d4e-965b-47d05d383417" path="/var/lib/kubelet/pods/0220bcf4-a19b-4d4e-965b-47d05d383417/volumes" Jul 08 19:19:32.243979 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:32.243931 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:19:40.775485 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:40.775452 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:19:41.059960 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:41.059876 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:19:41.546511 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:41.546474 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:19:41.992821 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:41.992784 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:19:42.093112 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:42.093089 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:19:42.193778 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:42.193757 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:19:42.330291 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:42.330215 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:19:48.123145 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:48.123108 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:19:48.225765 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:48.225728 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:19:48.398363 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:48.398280 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq"] Jul 08 19:19:48.398611 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:48.398545 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" podUID="709cef8d-06e9-4f0c-85ff-cf9f23a76877" containerName="istio-proxy" containerID="cri-o://25cd7999fb3dabc64e477e1b1547887c1e00eb0c62006b0a215b2b06b8a3e64c" gracePeriod=30 Jul 08 19:19:48.425733 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:48.425709 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:19:49.018556 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:49.018524 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:19:49.341955 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:49.341885 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:19:49.521836 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:49.521802 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:19:52.163247 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:52.163210 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:19:52.257730 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:52.257700 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:19:52.356964 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:52.356917 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:19:52.454464 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:52.454437 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:19:52.917569 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:52.917539 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:19:53.018236 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:53.018212 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:19:53.119339 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:53.119310 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:19:53.548403 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:53.548368 2572 generic.go:356] "Generic (PLEG): container finished" podID="709cef8d-06e9-4f0c-85ff-cf9f23a76877" containerID="25cd7999fb3dabc64e477e1b1547887c1e00eb0c62006b0a215b2b06b8a3e64c" exitCode=0 Jul 08 19:19:53.548845 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:53.548731 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" event={"ID":"709cef8d-06e9-4f0c-85ff-cf9f23a76877","Type":"ContainerDied","Data":"25cd7999fb3dabc64e477e1b1547887c1e00eb0c62006b0a215b2b06b8a3e64c"} Jul 08 19:19:53.548914 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:53.548841 2572 scope.go:117] "RemoveContainer" containerID="ded50efcc6a59b1a50fd8cef0ead9a973c63b7769ef8f5bbbc23a9c897f6c671" Jul 08 19:19:53.654077 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:53.654055 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:19:53.792086 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:53.792056 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/709cef8d-06e9-4f0c-85ff-cf9f23a76877-istio-podinfo\") pod \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " Jul 08 19:19:53.792222 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:53.792108 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/709cef8d-06e9-4f0c-85ff-cf9f23a76877-workload-socket\") pod \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " Jul 08 19:19:53.792222 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:53.792135 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/709cef8d-06e9-4f0c-85ff-cf9f23a76877-istio-token\") pod \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " Jul 08 19:19:53.792222 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:53.792164 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/709cef8d-06e9-4f0c-85ff-cf9f23a76877-istio-data\") pod \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " Jul 08 19:19:53.792222 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:53.792211 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/709cef8d-06e9-4f0c-85ff-cf9f23a76877-istio-envoy\") pod \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " Jul 08 19:19:53.792438 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:53.792233 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/709cef8d-06e9-4f0c-85ff-cf9f23a76877-credential-socket\") pod \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " Jul 08 19:19:53.792438 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:53.792319 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/709cef8d-06e9-4f0c-85ff-cf9f23a76877-istiod-ca-cert\") pod \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " Jul 08 19:19:53.792438 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:53.792343 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9m44x\" (UniqueName: \"kubernetes.io/projected/709cef8d-06e9-4f0c-85ff-cf9f23a76877-kube-api-access-9m44x\") pod \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " Jul 08 19:19:53.792438 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:53.792379 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/709cef8d-06e9-4f0c-85ff-cf9f23a76877-workload-certs\") pod \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\" (UID: \"709cef8d-06e9-4f0c-85ff-cf9f23a76877\") " Jul 08 19:19:53.792662 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:53.792439 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/709cef8d-06e9-4f0c-85ff-cf9f23a76877-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "709cef8d-06e9-4f0c-85ff-cf9f23a76877" (UID: "709cef8d-06e9-4f0c-85ff-cf9f23a76877"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:19:53.792720 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:53.792709 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/709cef8d-06e9-4f0c-85ff-cf9f23a76877-workload-socket\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 19:19:53.792941 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:53.792822 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/709cef8d-06e9-4f0c-85ff-cf9f23a76877-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "709cef8d-06e9-4f0c-85ff-cf9f23a76877" (UID: "709cef8d-06e9-4f0c-85ff-cf9f23a76877"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:19:53.792941 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:53.792846 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/709cef8d-06e9-4f0c-85ff-cf9f23a76877-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "709cef8d-06e9-4f0c-85ff-cf9f23a76877" (UID: "709cef8d-06e9-4f0c-85ff-cf9f23a76877"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:19:53.792941 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:53.792935 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/709cef8d-06e9-4f0c-85ff-cf9f23a76877-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "709cef8d-06e9-4f0c-85ff-cf9f23a76877" (UID: "709cef8d-06e9-4f0c-85ff-cf9f23a76877"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:19:53.793201 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:53.793173 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/709cef8d-06e9-4f0c-85ff-cf9f23a76877-istio-data" (OuterVolumeSpecName: "istio-data") pod "709cef8d-06e9-4f0c-85ff-cf9f23a76877" (UID: "709cef8d-06e9-4f0c-85ff-cf9f23a76877"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:19:53.794471 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:53.794439 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/709cef8d-06e9-4f0c-85ff-cf9f23a76877-istio-token" (OuterVolumeSpecName: "istio-token") pod "709cef8d-06e9-4f0c-85ff-cf9f23a76877" (UID: "709cef8d-06e9-4f0c-85ff-cf9f23a76877"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:19:53.794582 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:53.794516 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/709cef8d-06e9-4f0c-85ff-cf9f23a76877-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "709cef8d-06e9-4f0c-85ff-cf9f23a76877" (UID: "709cef8d-06e9-4f0c-85ff-cf9f23a76877"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 19:19:53.794582 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:53.794535 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/709cef8d-06e9-4f0c-85ff-cf9f23a76877-kube-api-access-9m44x" (OuterVolumeSpecName: "kube-api-access-9m44x") pod "709cef8d-06e9-4f0c-85ff-cf9f23a76877" (UID: "709cef8d-06e9-4f0c-85ff-cf9f23a76877"). InnerVolumeSpecName "kube-api-access-9m44x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:19:53.794582 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:53.794558 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/709cef8d-06e9-4f0c-85ff-cf9f23a76877-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "709cef8d-06e9-4f0c-85ff-cf9f23a76877" (UID: "709cef8d-06e9-4f0c-85ff-cf9f23a76877"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:19:53.894092 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:53.894070 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/709cef8d-06e9-4f0c-85ff-cf9f23a76877-istio-envoy\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 19:19:53.894092 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:53.894092 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/709cef8d-06e9-4f0c-85ff-cf9f23a76877-credential-socket\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 19:19:53.894219 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:53.894102 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/709cef8d-06e9-4f0c-85ff-cf9f23a76877-istiod-ca-cert\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 19:19:53.894219 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:53.894111 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9m44x\" (UniqueName: \"kubernetes.io/projected/709cef8d-06e9-4f0c-85ff-cf9f23a76877-kube-api-access-9m44x\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 19:19:53.894219 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:53.894121 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/709cef8d-06e9-4f0c-85ff-cf9f23a76877-workload-certs\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 19:19:53.894219 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:53.894128 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/709cef8d-06e9-4f0c-85ff-cf9f23a76877-istio-podinfo\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 19:19:53.894219 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:53.894135 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/709cef8d-06e9-4f0c-85ff-cf9f23a76877-istio-token\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 19:19:53.894219 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:53.894143 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/709cef8d-06e9-4f0c-85ff-cf9f23a76877-istio-data\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 19:19:54.554738 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:54.554708 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" Jul 08 19:19:54.555158 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:54.554740 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq" event={"ID":"709cef8d-06e9-4f0c-85ff-cf9f23a76877","Type":"ContainerDied","Data":"c92df93561e444d31749dec3575789833c297a49a6b74a686a82b7786378e018"} Jul 08 19:19:54.555158 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:54.554794 2572 scope.go:117] "RemoveContainer" containerID="25cd7999fb3dabc64e477e1b1547887c1e00eb0c62006b0a215b2b06b8a3e64c" Jul 08 19:19:54.576757 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:54.576731 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq"] Jul 08 19:19:54.581094 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:54.581061 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-2d9136-openshift-default-768665f589-wkwsq"] Jul 08 19:19:54.691285 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:54.691257 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="709cef8d-06e9-4f0c-85ff-cf9f23a76877" path="/var/lib/kubelet/pods/709cef8d-06e9-4f0c-85ff-cf9f23a76877/volumes" Jul 08 19:19:56.685555 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:56.685517 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:19:57.127976 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:57.127899 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:19:57.458408 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:57.458359 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:19:57.583019 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:19:57.582989 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:00.178380 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:00.178302 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:00.283784 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:00.283751 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:00.375213 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:00.375174 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:00.493893 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:00.493805 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:01.014424 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:01.014376 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:01.153072 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:01.153034 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:04.785433 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:04.785398 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:08.319097 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:08.319054 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:08.390355 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:08.390320 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:10.085898 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:10.085859 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:10.189409 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:10.189377 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:13.012083 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:13.012045 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:13.373927 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:13.373832 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:13.501627 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:13.501573 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:13.603104 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:13.603070 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:13.902413 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:13.902377 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:20.103405 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:20.103367 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:20.205310 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:20.205266 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:20.392518 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:20.392403 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:20.794804 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:20.794766 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:21.209889 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:21.209844 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:21.407376 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:21.407339 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:21.536512 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:21.536423 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:21.859013 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:21.858929 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:27.461431 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:27.461395 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:27.562320 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:27.562280 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:27.778547 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:27.778453 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:28.340708 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.340663 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:28.664519 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.664485 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr"] Jul 08 19:20:28.665095 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.665074 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="709cef8d-06e9-4f0c-85ff-cf9f23a76877" containerName="istio-proxy" Jul 08 19:20:28.665184 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.665098 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="709cef8d-06e9-4f0c-85ff-cf9f23a76877" containerName="istio-proxy" Jul 08 19:20:28.665184 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.665118 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="709cef8d-06e9-4f0c-85ff-cf9f23a76877" containerName="istio-proxy" Jul 08 19:20:28.665184 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.665127 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="709cef8d-06e9-4f0c-85ff-cf9f23a76877" containerName="istio-proxy" Jul 08 19:20:28.665184 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.665156 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0220bcf4-a19b-4d4e-965b-47d05d383417" containerName="main" Jul 08 19:20:28.665184 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.665165 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0220bcf4-a19b-4d4e-965b-47d05d383417" containerName="main" Jul 08 19:20:28.665440 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.665267 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="709cef8d-06e9-4f0c-85ff-cf9f23a76877" containerName="istio-proxy" Jul 08 19:20:28.665440 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.665281 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0220bcf4-a19b-4d4e-965b-47d05d383417" containerName="main" Jul 08 19:20:28.668583 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.668560 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:28.671236 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.671213 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-7ac7e6-openshift-default-dockercfg-rg9tp\"" Jul 08 19:20:28.677735 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.677697 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:28.683575 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.683550 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr"] Jul 08 19:20:28.706153 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.706118 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q89hb\" (UniqueName: \"kubernetes.io/projected/a6a5ec91-8460-4657-9828-c86b1689570d-kube-api-access-q89hb\") pod \"e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:28.706308 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.706197 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6a5ec91-8460-4657-9828-c86b1689570d-workload-certs\") pod \"e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:28.706308 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.706221 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6a5ec91-8460-4657-9828-c86b1689570d-istio-data\") pod \"e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:28.706308 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.706259 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6a5ec91-8460-4657-9828-c86b1689570d-istiod-ca-cert\") pod \"e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:28.706308 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.706294 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6a5ec91-8460-4657-9828-c86b1689570d-credential-socket\") pod \"e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:28.706468 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.706311 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6a5ec91-8460-4657-9828-c86b1689570d-workload-socket\") pod \"e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:28.706468 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.706330 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6a5ec91-8460-4657-9828-c86b1689570d-istio-podinfo\") pod \"e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:28.706468 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.706416 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6a5ec91-8460-4657-9828-c86b1689570d-istio-token\") pod \"e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:28.706468 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.706462 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6a5ec91-8460-4657-9828-c86b1689570d-istio-envoy\") pod \"e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:28.807937 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.807892 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q89hb\" (UniqueName: \"kubernetes.io/projected/a6a5ec91-8460-4657-9828-c86b1689570d-kube-api-access-q89hb\") pod \"e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:28.808143 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.807963 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6a5ec91-8460-4657-9828-c86b1689570d-workload-certs\") pod \"e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:28.808143 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.807985 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6a5ec91-8460-4657-9828-c86b1689570d-istio-data\") pod \"e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:28.808143 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.808017 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6a5ec91-8460-4657-9828-c86b1689570d-istiod-ca-cert\") pod \"e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:28.808143 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.808037 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6a5ec91-8460-4657-9828-c86b1689570d-credential-socket\") pod \"e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:28.808143 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.808053 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6a5ec91-8460-4657-9828-c86b1689570d-workload-socket\") pod \"e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:28.808143 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.808076 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6a5ec91-8460-4657-9828-c86b1689570d-istio-podinfo\") pod \"e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:28.808143 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.808111 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6a5ec91-8460-4657-9828-c86b1689570d-istio-token\") pod \"e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:28.808524 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.808161 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6a5ec91-8460-4657-9828-c86b1689570d-istio-envoy\") pod \"e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:28.808524 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.808442 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6a5ec91-8460-4657-9828-c86b1689570d-workload-certs\") pod \"e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:28.808524 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.808497 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6a5ec91-8460-4657-9828-c86b1689570d-credential-socket\") pod \"e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:28.808524 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.808519 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6a5ec91-8460-4657-9828-c86b1689570d-workload-socket\") pod \"e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:28.808850 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.808732 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6a5ec91-8460-4657-9828-c86b1689570d-istio-data\") pod \"e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:28.808960 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.808940 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6a5ec91-8460-4657-9828-c86b1689570d-istiod-ca-cert\") pod \"e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:28.810524 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.810502 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6a5ec91-8460-4657-9828-c86b1689570d-istio-envoy\") pod \"e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:28.810755 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.810738 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6a5ec91-8460-4657-9828-c86b1689570d-istio-podinfo\") pod \"e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:28.820105 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.820078 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6a5ec91-8460-4657-9828-c86b1689570d-istio-token\") pod \"e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:28.820404 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.820384 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q89hb\" (UniqueName: \"kubernetes.io/projected/a6a5ec91-8460-4657-9828-c86b1689570d-kube-api-access-q89hb\") pod \"e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:28.979494 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:28.979404 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:29.050522 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:29.050470 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:29.147791 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:29.147758 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr"] Jul 08 19:20:29.150954 ip-10-0-143-239 kubenswrapper[2572]: W0708 19:20:29.150923 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6a5ec91_8460_4657_9828_c86b1689570d.slice/crio-10b33bb66cc0c205ed8e50d6581cc8f74547fa9e8682a403d9327d42757b0d42 WatchSource:0}: Error finding container 10b33bb66cc0c205ed8e50d6581cc8f74547fa9e8682a403d9327d42757b0d42: Status 404 returned error can't find the container with id 10b33bb66cc0c205ed8e50d6581cc8f74547fa9e8682a403d9327d42757b0d42 Jul 08 19:20:29.153199 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:29.153165 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 19:20:29.153277 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:29.153234 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 19:20:29.153277 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:29.153262 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 19:20:29.738045 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:29.738012 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" event={"ID":"a6a5ec91-8460-4657-9828-c86b1689570d","Type":"ContainerStarted","Data":"04ca96f0cd6d489369c0cb96ac4f6abea6a45aaa0d29e2e6c5b2df9e5aa6a0aa"} Jul 08 19:20:29.738452 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:29.738072 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" event={"ID":"a6a5ec91-8460-4657-9828-c86b1689570d","Type":"ContainerStarted","Data":"10b33bb66cc0c205ed8e50d6581cc8f74547fa9e8682a403d9327d42757b0d42"} Jul 08 19:20:29.772041 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:29.771986 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" podStartSLOduration=1.771968102 podStartE2EDuration="1.771968102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:20:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:20:29.769100704 +0000 UTC m=+2093.639515873" watchObservedRunningTime="2026-07-08 19:20:29.771968102 +0000 UTC m=+2093.642383236" Jul 08 19:20:29.979706 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:29.979669 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:30.984667 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:30.984637 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:31.750390 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:31.750358 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:31.751428 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:31.751405 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:31.849781 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:31.849744 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:31.969406 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:31.969377 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:32.103778 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:32.103686 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:32.204719 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:32.204687 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:32.671691 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:32.671647 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:32.778292 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:32.778251 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:36.323927 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:36.323894 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:36.695815 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:36.695763 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:36.702842 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:36.702812 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9hx2g_56065d42-401f-45fb-bf49-8885f262ad6f/console-operator/1.log" Jul 08 19:20:36.713197 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:36.713172 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9hx2g_56065d42-401f-45fb-bf49-8885f262ad6f/console-operator/1.log" Jul 08 19:20:37.017341 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:37.017243 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:37.184370 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:37.184337 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:40.478137 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:40.478099 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:40.572686 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:40.572644 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:40.674304 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:40.674265 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:41.206831 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:41.206785 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:41.307340 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:41.307300 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:41.406844 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:41.406808 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:45.063733 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:45.063692 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:47.751506 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:47.750627 2572 patch_prober.go:28] interesting pod/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": read tcp 10.132.0.2:50720->10.132.0.45:15021: read: connection reset by peer" start-of-body= Jul 08 19:20:47.751506 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:47.750709 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" podUID="a6a5ec91-8460-4657-9828-c86b1689570d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": read tcp 10.132.0.2:50720->10.132.0.45:15021: read: connection reset by peer" Jul 08 19:20:47.833905 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:47.833870 2572 generic.go:356] "Generic (PLEG): container finished" podID="a6a5ec91-8460-4657-9828-c86b1689570d" containerID="04ca96f0cd6d489369c0cb96ac4f6abea6a45aaa0d29e2e6c5b2df9e5aa6a0aa" exitCode=0 Jul 08 19:20:47.834069 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:47.833943 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" event={"ID":"a6a5ec91-8460-4657-9828-c86b1689570d","Type":"ContainerDied","Data":"04ca96f0cd6d489369c0cb96ac4f6abea6a45aaa0d29e2e6c5b2df9e5aa6a0aa"} Jul 08 19:20:47.834377 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:47.834364 2572 scope.go:117] "RemoveContainer" containerID="04ca96f0cd6d489369c0cb96ac4f6abea6a45aaa0d29e2e6c5b2df9e5aa6a0aa" Jul 08 19:20:47.835425 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:47.835394 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 19:20:47.835524 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:47.835463 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 19:20:47.835524 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:47.835493 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 19:20:48.841273 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:48.841235 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" event={"ID":"a6a5ec91-8460-4657-9828-c86b1689570d","Type":"ContainerStarted","Data":"cddce326b6fbbf974fd1e75237528312a8945cfd6eaa2114cb482795d70d46c5"} Jul 08 19:20:48.979998 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:48.979953 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:48.980314 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:48.980290 2572 patch_prober.go:28] interesting pod/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 08 19:20:48.980370 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:48.980341 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" podUID="a6a5ec91-8460-4657-9828-c86b1689570d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 08 19:20:49.979848 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:49.979806 2572 patch_prober.go:28] interesting pod/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 08 19:20:49.980272 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:49.979905 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" podUID="a6a5ec91-8460-4657-9828-c86b1689570d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 08 19:20:50.980540 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:50.980501 2572 patch_prober.go:28] interesting pod/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 08 19:20:50.980980 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:50.980555 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" podUID="a6a5ec91-8460-4657-9828-c86b1689570d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 08 19:20:51.980542 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:51.980503 2572 patch_prober.go:28] interesting pod/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 08 19:20:51.980984 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:51.980567 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" podUID="a6a5ec91-8460-4657-9828-c86b1689570d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 08 19:20:52.980831 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:52.980793 2572 patch_prober.go:28] interesting pod/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 08 19:20:52.981321 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:52.980859 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" podUID="a6a5ec91-8460-4657-9828-c86b1689570d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 08 19:20:53.438936 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:53.438897 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:53.548910 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:53.548874 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:53.984272 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:53.984244 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:53.984719 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:53.984507 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:20:53.985262 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:20:53.985247 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:21:02.928123 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:21:02.928085 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:21:03.031008 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:21:03.030974 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:23:50.282308 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:23:50.282268 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:23:50.763560 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:23:50.763529 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:23:50.966918 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:23:50.966874 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:23:51.180874 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:23:51.180844 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:23:56.520161 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:23:56.520131 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:23:56.858323 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:23:56.858246 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr"] Jul 08 19:23:56.858472 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:23:56.858447 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" podUID="a6a5ec91-8460-4657-9828-c86b1689570d" containerName="istio-proxy" containerID="cri-o://cddce326b6fbbf974fd1e75237528312a8945cfd6eaa2114cb482795d70d46c5" gracePeriod=30 Jul 08 19:23:57.747154 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:23:57.747122 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:23:57.954401 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:23:57.954336 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:24:02.119027 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.118971 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:24:02.149161 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.149139 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6a5ec91-8460-4657-9828-c86b1689570d-istio-token\") pod \"a6a5ec91-8460-4657-9828-c86b1689570d\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " Jul 08 19:24:02.149280 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.149185 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6a5ec91-8460-4657-9828-c86b1689570d-istio-data\") pod \"a6a5ec91-8460-4657-9828-c86b1689570d\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " Jul 08 19:24:02.149384 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.149362 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6a5ec91-8460-4657-9828-c86b1689570d-workload-certs\") pod \"a6a5ec91-8460-4657-9828-c86b1689570d\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " Jul 08 19:24:02.149434 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.149412 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6a5ec91-8460-4657-9828-c86b1689570d-istio-podinfo\") pod \"a6a5ec91-8460-4657-9828-c86b1689570d\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " Jul 08 19:24:02.149479 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.149446 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6a5ec91-8460-4657-9828-c86b1689570d-workload-socket\") pod \"a6a5ec91-8460-4657-9828-c86b1689570d\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " Jul 08 19:24:02.149532 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.149483 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6a5ec91-8460-4657-9828-c86b1689570d-credential-socket\") pod \"a6a5ec91-8460-4657-9828-c86b1689570d\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " Jul 08 19:24:02.149606 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.149530 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6a5ec91-8460-4657-9828-c86b1689570d-istiod-ca-cert\") pod \"a6a5ec91-8460-4657-9828-c86b1689570d\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " Jul 08 19:24:02.149669 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.149603 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q89hb\" (UniqueName: \"kubernetes.io/projected/a6a5ec91-8460-4657-9828-c86b1689570d-kube-api-access-q89hb\") pod \"a6a5ec91-8460-4657-9828-c86b1689570d\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " Jul 08 19:24:02.149669 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.149634 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6a5ec91-8460-4657-9828-c86b1689570d-istio-envoy\") pod \"a6a5ec91-8460-4657-9828-c86b1689570d\" (UID: \"a6a5ec91-8460-4657-9828-c86b1689570d\") " Jul 08 19:24:02.149942 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.149826 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6a5ec91-8460-4657-9828-c86b1689570d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a6a5ec91-8460-4657-9828-c86b1689570d" (UID: "a6a5ec91-8460-4657-9828-c86b1689570d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:24:02.149942 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.149906 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6a5ec91-8460-4657-9828-c86b1689570d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a6a5ec91-8460-4657-9828-c86b1689570d" (UID: "a6a5ec91-8460-4657-9828-c86b1689570d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:24:02.149942 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.149826 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6a5ec91-8460-4657-9828-c86b1689570d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a6a5ec91-8460-4657-9828-c86b1689570d" (UID: "a6a5ec91-8460-4657-9828-c86b1689570d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:24:02.150195 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.150000 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6a5ec91-8460-4657-9828-c86b1689570d-istio-data" (OuterVolumeSpecName: "istio-data") pod "a6a5ec91-8460-4657-9828-c86b1689570d" (UID: "a6a5ec91-8460-4657-9828-c86b1689570d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:24:02.150195 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.150052 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6a5ec91-8460-4657-9828-c86b1689570d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a6a5ec91-8460-4657-9828-c86b1689570d" (UID: "a6a5ec91-8460-4657-9828-c86b1689570d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:24:02.150195 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.150098 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6a5ec91-8460-4657-9828-c86b1689570d-istio-data\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 19:24:02.150195 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.150116 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6a5ec91-8460-4657-9828-c86b1689570d-workload-socket\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 19:24:02.150195 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.150130 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6a5ec91-8460-4657-9828-c86b1689570d-credential-socket\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 19:24:02.150195 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.150144 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6a5ec91-8460-4657-9828-c86b1689570d-istiod-ca-cert\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 19:24:02.151641 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.151602 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a6a5ec91-8460-4657-9828-c86b1689570d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a6a5ec91-8460-4657-9828-c86b1689570d" (UID: "a6a5ec91-8460-4657-9828-c86b1689570d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 19:24:02.151641 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.151623 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6a5ec91-8460-4657-9828-c86b1689570d-istio-token" (OuterVolumeSpecName: "istio-token") pod "a6a5ec91-8460-4657-9828-c86b1689570d" (UID: "a6a5ec91-8460-4657-9828-c86b1689570d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:24:02.151856 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.151838 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6a5ec91-8460-4657-9828-c86b1689570d-kube-api-access-q89hb" (OuterVolumeSpecName: "kube-api-access-q89hb") pod "a6a5ec91-8460-4657-9828-c86b1689570d" (UID: "a6a5ec91-8460-4657-9828-c86b1689570d"). InnerVolumeSpecName "kube-api-access-q89hb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:24:02.151971 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.151957 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6a5ec91-8460-4657-9828-c86b1689570d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a6a5ec91-8460-4657-9828-c86b1689570d" (UID: "a6a5ec91-8460-4657-9828-c86b1689570d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:24:02.251199 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.251177 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q89hb\" (UniqueName: \"kubernetes.io/projected/a6a5ec91-8460-4657-9828-c86b1689570d-kube-api-access-q89hb\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 19:24:02.251199 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.251198 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6a5ec91-8460-4657-9828-c86b1689570d-istio-envoy\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 19:24:02.251317 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.251207 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6a5ec91-8460-4657-9828-c86b1689570d-istio-token\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 19:24:02.251317 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.251214 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6a5ec91-8460-4657-9828-c86b1689570d-workload-certs\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 19:24:02.251317 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.251222 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6a5ec91-8460-4657-9828-c86b1689570d-istio-podinfo\") on node \"ip-10-0-143-239.ec2.internal\" DevicePath \"\"" Jul 08 19:24:02.815717 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.815693 2572 generic.go:356] "Generic (PLEG): container finished" podID="a6a5ec91-8460-4657-9828-c86b1689570d" containerID="cddce326b6fbbf974fd1e75237528312a8945cfd6eaa2114cb482795d70d46c5" exitCode=0 Jul 08 19:24:02.815859 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.815724 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" event={"ID":"a6a5ec91-8460-4657-9828-c86b1689570d","Type":"ContainerDied","Data":"cddce326b6fbbf974fd1e75237528312a8945cfd6eaa2114cb482795d70d46c5"} Jul 08 19:24:02.815859 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.815738 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" Jul 08 19:24:02.815859 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.815759 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr" event={"ID":"a6a5ec91-8460-4657-9828-c86b1689570d","Type":"ContainerDied","Data":"10b33bb66cc0c205ed8e50d6581cc8f74547fa9e8682a403d9327d42757b0d42"} Jul 08 19:24:02.815859 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.815779 2572 scope.go:117] "RemoveContainer" containerID="cddce326b6fbbf974fd1e75237528312a8945cfd6eaa2114cb482795d70d46c5" Jul 08 19:24:02.824390 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.824375 2572 scope.go:117] "RemoveContainer" containerID="04ca96f0cd6d489369c0cb96ac4f6abea6a45aaa0d29e2e6c5b2df9e5aa6a0aa" Jul 08 19:24:02.832274 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.832254 2572 scope.go:117] "RemoveContainer" containerID="cddce326b6fbbf974fd1e75237528312a8945cfd6eaa2114cb482795d70d46c5" Jul 08 19:24:02.832523 ip-10-0-143-239 kubenswrapper[2572]: E0708 19:24:02.832504 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cddce326b6fbbf974fd1e75237528312a8945cfd6eaa2114cb482795d70d46c5\": container with ID starting with cddce326b6fbbf974fd1e75237528312a8945cfd6eaa2114cb482795d70d46c5 not found: ID does not exist" containerID="cddce326b6fbbf974fd1e75237528312a8945cfd6eaa2114cb482795d70d46c5" Jul 08 19:24:02.832606 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.832533 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cddce326b6fbbf974fd1e75237528312a8945cfd6eaa2114cb482795d70d46c5"} err="failed to get container status \"cddce326b6fbbf974fd1e75237528312a8945cfd6eaa2114cb482795d70d46c5\": rpc error: code = NotFound desc = could not find container \"cddce326b6fbbf974fd1e75237528312a8945cfd6eaa2114cb482795d70d46c5\": container with ID starting with cddce326b6fbbf974fd1e75237528312a8945cfd6eaa2114cb482795d70d46c5 not found: ID does not exist" Jul 08 19:24:02.832606 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.832554 2572 scope.go:117] "RemoveContainer" containerID="04ca96f0cd6d489369c0cb96ac4f6abea6a45aaa0d29e2e6c5b2df9e5aa6a0aa" Jul 08 19:24:02.832606 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.832555 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr"] Jul 08 19:24:02.832822 ip-10-0-143-239 kubenswrapper[2572]: E0708 19:24:02.832807 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04ca96f0cd6d489369c0cb96ac4f6abea6a45aaa0d29e2e6c5b2df9e5aa6a0aa\": container with ID starting with 04ca96f0cd6d489369c0cb96ac4f6abea6a45aaa0d29e2e6c5b2df9e5aa6a0aa not found: ID does not exist" containerID="04ca96f0cd6d489369c0cb96ac4f6abea6a45aaa0d29e2e6c5b2df9e5aa6a0aa" Jul 08 19:24:02.832862 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.832825 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04ca96f0cd6d489369c0cb96ac4f6abea6a45aaa0d29e2e6c5b2df9e5aa6a0aa"} err="failed to get container status \"04ca96f0cd6d489369c0cb96ac4f6abea6a45aaa0d29e2e6c5b2df9e5aa6a0aa\": rpc error: code = NotFound desc = could not find container \"04ca96f0cd6d489369c0cb96ac4f6abea6a45aaa0d29e2e6c5b2df9e5aa6a0aa\": container with ID starting with 04ca96f0cd6d489369c0cb96ac4f6abea6a45aaa0d29e2e6c5b2df9e5aa6a0aa not found: ID does not exist" Jul 08 19:24:02.837198 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:02.837175 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-7ac7e6-openshift-default-6664db6d79-b24wr"] Jul 08 19:24:03.440163 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:03.440136 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:24:03.511457 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:03.511429 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:24:03.731384 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:03.731315 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:24:04.542149 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:04.542117 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-687cc6dc49-nhtgp_fb191487-56d5-4425-ae21-bcc6748d6600/authorino/0.log" Jul 08 19:24:04.691949 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:04.691914 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6a5ec91-8460-4657-9828-c86b1689570d" path="/var/lib/kubelet/pods/a6a5ec91-8460-4657-9828-c86b1689570d/volumes" Jul 08 19:24:09.824567 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:09.824533 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-pqqpp_21a82610-8edb-4a37-a8ed-1a396de7437f/server/0.log" Jul 08 19:24:10.342506 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:10.342477 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bb8746f75-mvmxk_479c7884-121b-4edd-978c-08d86b7fbb96/copy-manifests/0.log" Jul 08 19:24:10.350549 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:10.350497 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bb8746f75-mvmxk_479c7884-121b-4edd-978c-08d86b7fbb96/manager/0.log" Jul 08 19:24:11.707402 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:11.707357 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-687cc6dc49-nhtgp_fb191487-56d5-4425-ae21-bcc6748d6600/authorino/0.log" Jul 08 19:24:12.933529 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:12.933498 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4qg54h_24b126ec-2b07-407a-9e43-93ded4c6fd79/istio-proxy/0.log" Jul 08 19:24:13.185220 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:13.185142 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64798db975-m9jct_884ab97a-0180-4260-90f0-2f946324d58a/kube-auth-proxy/0.log" Jul 08 19:24:13.790578 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:13.790551 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86b55bc475-2qk57_dd1908b4-810a-4f1d-b172-47ddfe11befe/router/0.log" Jul 08 19:24:14.146898 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:14.146830 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-zmt8k_a292c26b-158f-4de0-afef-3cd191e4bb2f/main/0.log" Jul 08 19:24:14.384761 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:14.384739 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-jxqj9_583c0b6d-1ed4-49f2-b6ce-43f94e19cd51/main/0.log" Jul 08 19:24:14.622441 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:14.622415 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-bb76p_b5d1f4b5-1b79-46e9-834e-a96ca7686f92/main/0.log" Jul 08 19:24:14.736847 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:14.736819 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-d758w_6b51fc40-6b95-4196-b6a6-c9fb1af57669/main/0.log" Jul 08 19:24:19.251813 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:19.251780 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:24:19.354941 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:19.354911 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" limit=1024 Jul 08 19:24:22.262132 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:22.262101 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mxddc_913b02f9-f3cb-4873-a4f7-0fb411ebec5f/global-pull-secret-syncer/0.log" Jul 08 19:24:22.312547 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:22.312516 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7dbjh_d4f95e26-ebfa-4527-a31b-785d477f5329/konnectivity-agent/0.log" Jul 08 19:24:22.453408 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:22.453381 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-239.ec2.internal_cad17b2cf3c8d2eb0553c09417436945/haproxy/0.log" Jul 08 19:24:27.637476 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:27.637447 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-687cc6dc49-nhtgp_fb191487-56d5-4425-ae21-bcc6748d6600/authorino/0.log" Jul 08 19:24:29.741381 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:29.741351 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d25e162a-8084-419f-9cd2-fe18d069ea6a/alertmanager/0.log" Jul 08 19:24:29.768310 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:29.768288 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d25e162a-8084-419f-9cd2-fe18d069ea6a/config-reloader/0.log" Jul 08 19:24:29.792366 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:29.792342 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d25e162a-8084-419f-9cd2-fe18d069ea6a/kube-rbac-proxy-web/0.log" Jul 08 19:24:29.817424 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:29.817397 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d25e162a-8084-419f-9cd2-fe18d069ea6a/kube-rbac-proxy/0.log" Jul 08 19:24:29.845253 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:29.845233 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d25e162a-8084-419f-9cd2-fe18d069ea6a/kube-rbac-proxy-metric/0.log" Jul 08 19:24:29.868196 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:29.868177 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d25e162a-8084-419f-9cd2-fe18d069ea6a/prom-label-proxy/0.log" Jul 08 19:24:29.892879 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:29.892857 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d25e162a-8084-419f-9cd2-fe18d069ea6a/init-config-reloader/0.log" Jul 08 19:24:29.932520 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:29.932494 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-t8cls_5f1b40e8-bee3-441d-bd78-9a6aacc76949/cluster-monitoring-operator/0.log" Jul 08 19:24:29.963562 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:29.963539 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-pxlrd_44ccee63-46df-4ca2-b8c2-5ac4656a6812/kube-state-metrics/0.log" Jul 08 19:24:29.987848 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:29.987829 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-pxlrd_44ccee63-46df-4ca2-b8c2-5ac4656a6812/kube-rbac-proxy-main/0.log" Jul 08 19:24:30.009466 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:30.009414 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-pxlrd_44ccee63-46df-4ca2-b8c2-5ac4656a6812/kube-rbac-proxy-self/0.log" Jul 08 19:24:30.273575 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:30.273517 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zz7rd_f4dad549-ed19-43bf-820d-8e87a0d8ec96/node-exporter/0.log" Jul 08 19:24:30.296667 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:30.296646 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zz7rd_f4dad549-ed19-43bf-820d-8e87a0d8ec96/kube-rbac-proxy/0.log" Jul 08 19:24:30.320737 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:30.320719 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zz7rd_f4dad549-ed19-43bf-820d-8e87a0d8ec96/init-textfile/0.log" Jul 08 19:24:30.352354 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:30.352333 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-lxx9k_1949d81d-2d64-4ee1-a3f6-72de33b17eea/kube-rbac-proxy-main/0.log" Jul 08 19:24:30.371826 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:30.371808 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-lxx9k_1949d81d-2d64-4ee1-a3f6-72de33b17eea/kube-rbac-proxy-self/0.log" Jul 08 19:24:30.393130 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:30.393112 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-lxx9k_1949d81d-2d64-4ee1-a3f6-72de33b17eea/openshift-state-metrics/0.log" Jul 08 19:24:30.705224 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:30.705203 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cf5995bf4-227hv_7fd5e3d0-b2c9-426e-a499-61d7178e7ac1/telemeter-client/0.log" Jul 08 19:24:30.730118 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:30.730097 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cf5995bf4-227hv_7fd5e3d0-b2c9-426e-a499-61d7178e7ac1/reload/0.log" Jul 08 19:24:30.749722 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:30.749703 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cf5995bf4-227hv_7fd5e3d0-b2c9-426e-a499-61d7178e7ac1/kube-rbac-proxy/0.log" Jul 08 19:24:32.648788 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:32.648755 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9hx2g_56065d42-401f-45fb-bf49-8885f262ad6f/console-operator/1.log" Jul 08 19:24:32.655875 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:32.655844 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-9hx2g_56065d42-401f-45fb-bf49-8885f262ad6f/console-operator/2.log" Jul 08 19:24:32.922104 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:32.922072 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-87fkv/perf-node-gather-daemonset-x6mxm"] Jul 08 19:24:32.922454 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:32.922442 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6a5ec91-8460-4657-9828-c86b1689570d" containerName="istio-proxy" Jul 08 19:24:32.922506 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:32.922457 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6a5ec91-8460-4657-9828-c86b1689570d" containerName="istio-proxy" Jul 08 19:24:32.922554 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:32.922544 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6a5ec91-8460-4657-9828-c86b1689570d" containerName="istio-proxy" Jul 08 19:24:32.922617 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:32.922558 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="709cef8d-06e9-4f0c-85ff-cf9f23a76877" containerName="istio-proxy" Jul 08 19:24:32.925779 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:32.925760 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-x6mxm" Jul 08 19:24:32.928202 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:32.928182 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-87fkv\"/\"kube-root-ca.crt\"" Jul 08 19:24:32.928315 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:32.928216 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-87fkv\"/\"openshift-service-ca.crt\"" Jul 08 19:24:32.928315 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:32.928220 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-87fkv\"/\"default-dockercfg-s4hc9\"" Jul 08 19:24:32.935639 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:32.935615 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-87fkv/perf-node-gather-daemonset-x6mxm"] Jul 08 19:24:33.089612 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:33.089564 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2dc47256-1a54-4938-a9cc-668430a20894-lib-modules\") pod \"perf-node-gather-daemonset-x6mxm\" (UID: \"2dc47256-1a54-4938-a9cc-668430a20894\") " pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-x6mxm" Jul 08 19:24:33.089737 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:33.089630 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmtbk\" (UniqueName: \"kubernetes.io/projected/2dc47256-1a54-4938-a9cc-668430a20894-kube-api-access-tmtbk\") pod \"perf-node-gather-daemonset-x6mxm\" (UID: \"2dc47256-1a54-4938-a9cc-668430a20894\") " pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-x6mxm" Jul 08 19:24:33.089737 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:33.089689 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2dc47256-1a54-4938-a9cc-668430a20894-proc\") pod \"perf-node-gather-daemonset-x6mxm\" (UID: \"2dc47256-1a54-4938-a9cc-668430a20894\") " pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-x6mxm" Jul 08 19:24:33.089844 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:33.089747 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2dc47256-1a54-4938-a9cc-668430a20894-sys\") pod \"perf-node-gather-daemonset-x6mxm\" (UID: \"2dc47256-1a54-4938-a9cc-668430a20894\") " pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-x6mxm" Jul 08 19:24:33.089844 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:33.089780 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2dc47256-1a54-4938-a9cc-668430a20894-podres\") pod \"perf-node-gather-daemonset-x6mxm\" (UID: \"2dc47256-1a54-4938-a9cc-668430a20894\") " pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-x6mxm" Jul 08 19:24:33.191103 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:33.191043 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmtbk\" (UniqueName: \"kubernetes.io/projected/2dc47256-1a54-4938-a9cc-668430a20894-kube-api-access-tmtbk\") pod \"perf-node-gather-daemonset-x6mxm\" (UID: \"2dc47256-1a54-4938-a9cc-668430a20894\") " pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-x6mxm" Jul 08 19:24:33.191103 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:33.191095 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2dc47256-1a54-4938-a9cc-668430a20894-proc\") pod \"perf-node-gather-daemonset-x6mxm\" (UID: \"2dc47256-1a54-4938-a9cc-668430a20894\") " pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-x6mxm" Jul 08 19:24:33.191236 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:33.191144 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2dc47256-1a54-4938-a9cc-668430a20894-sys\") pod \"perf-node-gather-daemonset-x6mxm\" (UID: \"2dc47256-1a54-4938-a9cc-668430a20894\") " pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-x6mxm" Jul 08 19:24:33.191236 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:33.191181 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2dc47256-1a54-4938-a9cc-668430a20894-podres\") pod \"perf-node-gather-daemonset-x6mxm\" (UID: \"2dc47256-1a54-4938-a9cc-668430a20894\") " pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-x6mxm" Jul 08 19:24:33.191236 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:33.191216 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2dc47256-1a54-4938-a9cc-668430a20894-lib-modules\") pod \"perf-node-gather-daemonset-x6mxm\" (UID: \"2dc47256-1a54-4938-a9cc-668430a20894\") " pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-x6mxm" Jul 08 19:24:33.191353 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:33.191244 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2dc47256-1a54-4938-a9cc-668430a20894-sys\") pod \"perf-node-gather-daemonset-x6mxm\" (UID: \"2dc47256-1a54-4938-a9cc-668430a20894\") " pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-x6mxm" Jul 08 19:24:33.191353 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:33.191214 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2dc47256-1a54-4938-a9cc-668430a20894-proc\") pod \"perf-node-gather-daemonset-x6mxm\" (UID: \"2dc47256-1a54-4938-a9cc-668430a20894\") " pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-x6mxm" Jul 08 19:24:33.191353 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:33.191311 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2dc47256-1a54-4938-a9cc-668430a20894-podres\") pod \"perf-node-gather-daemonset-x6mxm\" (UID: \"2dc47256-1a54-4938-a9cc-668430a20894\") " pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-x6mxm" Jul 08 19:24:33.191353 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:33.191341 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2dc47256-1a54-4938-a9cc-668430a20894-lib-modules\") pod \"perf-node-gather-daemonset-x6mxm\" (UID: \"2dc47256-1a54-4938-a9cc-668430a20894\") " pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-x6mxm" Jul 08 19:24:33.200786 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:33.200764 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmtbk\" (UniqueName: \"kubernetes.io/projected/2dc47256-1a54-4938-a9cc-668430a20894-kube-api-access-tmtbk\") pod \"perf-node-gather-daemonset-x6mxm\" (UID: \"2dc47256-1a54-4938-a9cc-668430a20894\") " pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-x6mxm" Jul 08 19:24:33.237794 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:33.237773 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-x6mxm" Jul 08 19:24:33.372177 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:33.372154 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-87fkv/perf-node-gather-daemonset-x6mxm"] Jul 08 19:24:33.374339 ip-10-0-143-239 kubenswrapper[2572]: W0708 19:24:33.374309 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2dc47256_1a54_4938_a9cc_668430a20894.slice/crio-9260111fe3af1522a0d5190fbe7c3ddf424409036d5b5364d613511bbab8cf1a WatchSource:0}: Error finding container 9260111fe3af1522a0d5190fbe7c3ddf424409036d5b5364d613511bbab8cf1a: Status 404 returned error can't find the container with id 9260111fe3af1522a0d5190fbe7c3ddf424409036d5b5364d613511bbab8cf1a Jul 08 19:24:33.965972 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:33.965943 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-x6mxm" event={"ID":"2dc47256-1a54-4938-a9cc-668430a20894","Type":"ContainerStarted","Data":"bb1e82fb95386ad29320d34870f4a95421dcff05a72fc5e97f22e93d99bdbfbd"} Jul 08 19:24:33.966356 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:33.965989 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-x6mxm" event={"ID":"2dc47256-1a54-4938-a9cc-668430a20894","Type":"ContainerStarted","Data":"9260111fe3af1522a0d5190fbe7c3ddf424409036d5b5364d613511bbab8cf1a"} Jul 08 19:24:33.966356 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:33.966009 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-x6mxm" Jul 08 19:24:33.984206 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:33.984161 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-x6mxm" podStartSLOduration=1.984146894 podStartE2EDuration="1.984146894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:24:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:24:33.982722912 +0000 UTC m=+2337.853138047" watchObservedRunningTime="2026-07-08 19:24:33.984146894 +0000 UTC m=+2337.854562026" Jul 08 19:24:34.026899 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:34.026880 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-j5tkz_5d609d76-9788-408f-8ca7-8d6090301785/volume-data-source-validator/0.log" Jul 08 19:24:35.062239 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:35.062207 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fj77w_964fa98c-bf64-4b37-9253-444e9cde8899/dns/0.log" Jul 08 19:24:35.084988 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:35.084967 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fj77w_964fa98c-bf64-4b37-9253-444e9cde8899/kube-rbac-proxy/0.log" Jul 08 19:24:35.222462 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:35.222440 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sz4t6_642e2d30-24f7-4997-b730-bb037276ff1b/dns-node-resolver/0.log" Jul 08 19:24:35.843105 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:35.843080 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8vn8j_4b4dd87a-0d97-4dd0-826d-b422ca31c60c/node-ca/0.log" Jul 08 19:24:36.781499 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:36.781472 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4qg54h_24b126ec-2b07-407a-9e43-93ded4c6fd79/istio-proxy/0.log" Jul 08 19:24:36.980145 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:36.980120 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64798db975-m9jct_884ab97a-0180-4260-90f0-2f946324d58a/kube-auth-proxy/0.log" Jul 08 19:24:37.204316 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:37.204295 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86b55bc475-2qk57_dd1908b4-810a-4f1d-b172-47ddfe11befe/router/0.log" Jul 08 19:24:37.980227 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:37.980202 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-q4grn_62f90ec3-f829-4be2-a4c0-1064e0f564e4/serve-healthcheck-canary/0.log" Jul 08 19:24:38.435338 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:38.435312 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-xg4bh_4a9979b4-f241-4964-a20f-b42514a3f700/insights-operator/0.log" Jul 08 19:24:38.435753 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:38.435702 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-xg4bh_4a9979b4-f241-4964-a20f-b42514a3f700/insights-operator/1.log" Jul 08 19:24:38.604751 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:38.604725 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-frvqm_3f0ed88e-5743-4e3a-af43-458dd2a94180/kube-rbac-proxy/0.log" Jul 08 19:24:38.626423 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:38.626400 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-frvqm_3f0ed88e-5743-4e3a-af43-458dd2a94180/exporter/0.log" Jul 08 19:24:38.648337 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:38.648316 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-frvqm_3f0ed88e-5743-4e3a-af43-458dd2a94180/extractor/0.log" Jul 08 19:24:39.980795 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:39.980772 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-x6mxm" Jul 08 19:24:41.089865 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:41.089835 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-pqqpp_21a82610-8edb-4a37-a8ed-1a396de7437f/server/0.log" Jul 08 19:24:41.393746 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:41.393670 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bb8746f75-mvmxk_479c7884-121b-4edd-978c-08d86b7fbb96/manager/0.log" Jul 08 19:24:41.420081 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:41.420060 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bb8746f75-mvmxk_479c7884-121b-4edd-978c-08d86b7fbb96/copy-manifests/0.log" Jul 08 19:24:42.857860 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:42.857837 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7578f4df-wwsfs_dc13221e-2af9-4e71-82e0-3a100f7c679f/manager/0.log" Jul 08 19:24:42.988300 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:42.988277 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4qg54h_24b126ec-2b07-407a-9e43-93ded4c6fd79/istio-proxy/0.log" Jul 08 19:24:43.174937 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:43.174918 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64798db975-m9jct_884ab97a-0180-4260-90f0-2f946324d58a/kube-auth-proxy/0.log" Jul 08 19:24:43.373492 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:43.373470 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86b55bc475-2qk57_dd1908b4-810a-4f1d-b172-47ddfe11befe/router/0.log" Jul 08 19:24:44.484119 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:44.484095 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4qg54h_24b126ec-2b07-407a-9e43-93ded4c6fd79/istio-proxy/0.log" Jul 08 19:24:44.667002 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:44.666980 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64798db975-m9jct_884ab97a-0180-4260-90f0-2f946324d58a/kube-auth-proxy/0.log" Jul 08 19:24:44.854128 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:44.854102 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86b55bc475-2qk57_dd1908b4-810a-4f1d-b172-47ddfe11befe/router/0.log" Jul 08 19:24:48.358773 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:48.358745 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-4b26j_5122d514-65f7-4423-8010-51bdee3932bd/kube-storage-version-migrator-operator/1.log" Jul 08 19:24:48.359718 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:48.359699 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-4b26j_5122d514-65f7-4423-8010-51bdee3932bd/kube-storage-version-migrator-operator/0.log" Jul 08 19:24:49.395274 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:49.395247 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4jdfl_193b4501-08cc-4ad0-97e4-9e3277d52c7b/kube-multus/0.log" Jul 08 19:24:49.739730 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:49.739702 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t4fzl_15f04361-bd04-449b-9cce-d46b7ba27368/kube-multus-additional-cni-plugins/0.log" Jul 08 19:24:49.760704 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:49.760681 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t4fzl_15f04361-bd04-449b-9cce-d46b7ba27368/egress-router-binary-copy/0.log" Jul 08 19:24:49.782418 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:49.782392 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t4fzl_15f04361-bd04-449b-9cce-d46b7ba27368/cni-plugins/0.log" Jul 08 19:24:49.804201 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:49.804180 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t4fzl_15f04361-bd04-449b-9cce-d46b7ba27368/bond-cni-plugin/0.log" Jul 08 19:24:49.826601 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:49.826579 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t4fzl_15f04361-bd04-449b-9cce-d46b7ba27368/routeoverride-cni/0.log" Jul 08 19:24:49.848650 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:49.848628 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t4fzl_15f04361-bd04-449b-9cce-d46b7ba27368/whereabouts-cni-bincopy/0.log" Jul 08 19:24:49.869388 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:49.869370 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t4fzl_15f04361-bd04-449b-9cce-d46b7ba27368/whereabouts-cni/0.log" Jul 08 19:24:49.961791 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:49.961775 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gtkjp_73c6d7ff-a154-4b84-9d4f-023fa34c19d0/network-metrics-daemon/0.log" Jul 08 19:24:49.981408 ip-10-0-143-239 kubenswrapper[2572]: I0708 19:24:49.981392 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gtkjp_73c6d7ff-a154-4b84-9d4f-023fa34c19d0/kube-rbac-proxy/0.log"