Jun 08 13:40:44.438907 ip-10-0-132-92 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 08 13:40:44.438919 ip-10-0-132-92 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 08 13:40:44.438925 ip-10-0-132-92 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 08 13:40:44.439219 ip-10-0-132-92 systemd[1]: Failed to start Kubernetes Kubelet. Jun 08 13:40:55.566092 ip-10-0-132-92 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 08 13:40:55.566108 ip-10-0-132-92 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 007133f791b7476c91786c6dc858fdff -- Jun 08 13:43:05.909088 ip-10-0-132-92 systemd[1]: Starting Kubernetes Kubelet... Jun 08 13:43:06.308612 ip-10-0-132-92 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 13:43:06.308612 ip-10-0-132-92 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 13:43:06.308612 ip-10-0-132-92 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 13:43:06.308612 ip-10-0-132-92 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 13:43:06.308612 ip-10-0-132-92 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 13:43:06.309800 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.309709 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 13:43:06.315207 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315188 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:43:06.315207 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315204 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:43:06.315207 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315210 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:43:06.315399 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315216 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:43:06.315399 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315220 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:43:06.315399 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315225 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:43:06.315399 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315229 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:43:06.315399 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315233 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:43:06.315399 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315237 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:43:06.315399 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315241 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:43:06.315399 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315246 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:43:06.315399 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315250 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:43:06.315399 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315254 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:43:06.315399 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315259 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:43:06.315399 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315263 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:43:06.315399 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315266 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:43:06.315399 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315270 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:43:06.315399 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315279 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:43:06.315399 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315284 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:43:06.315399 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315288 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:43:06.315399 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315291 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:43:06.315399 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315296 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:43:06.315399 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315299 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:43:06.316238 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315303 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:43:06.316238 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315307 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:43:06.316238 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315311 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:43:06.316238 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315315 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:43:06.316238 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315319 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:43:06.316238 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315325 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:43:06.316238 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315329 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:43:06.316238 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315334 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:43:06.316238 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315338 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:43:06.316238 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315342 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:43:06.316238 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315346 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:43:06.316238 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315350 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:43:06.316238 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315354 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:43:06.316238 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315359 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:43:06.316238 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315365 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:43:06.316238 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315371 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:43:06.316238 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315378 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:43:06.316238 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315382 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:43:06.316238 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315386 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:43:06.316238 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315391 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:43:06.317100 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315395 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:43:06.317100 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315399 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:43:06.317100 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315403 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:43:06.317100 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315407 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:43:06.317100 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315411 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:43:06.317100 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315415 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:43:06.317100 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315419 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:43:06.317100 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315423 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:43:06.317100 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315427 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:43:06.317100 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315431 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:43:06.317100 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315448 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:43:06.317100 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315452 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:43:06.317100 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315460 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:43:06.317100 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315464 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:43:06.317100 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315469 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:43:06.317100 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315473 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:43:06.317100 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315477 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:43:06.317100 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315482 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:43:06.317100 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315487 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:43:06.317100 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315491 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:43:06.317972 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315496 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:43:06.317972 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315500 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:43:06.317972 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315507 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:43:06.317972 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315512 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:43:06.317972 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315518 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:43:06.317972 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315524 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:43:06.317972 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315531 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:43:06.317972 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315538 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:43:06.317972 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315544 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:43:06.317972 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315549 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:43:06.317972 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315553 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:43:06.317972 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315558 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:43:06.317972 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315563 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:43:06.317972 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315567 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:43:06.317972 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315571 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:43:06.317972 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315576 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:43:06.317972 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315580 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:43:06.317972 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315584 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:43:06.317972 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315588 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:43:06.318800 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315593 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:43:06.318800 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315597 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:43:06.318800 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315602 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:43:06.318800 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315606 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:43:06.318800 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315611 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:43:06.318800 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315615 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:43:06.318800 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315619 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:43:06.318800 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315624 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:43:06.318800 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315628 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:43:06.318800 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315632 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:43:06.318800 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315637 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:43:06.318800 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315641 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:43:06.318800 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315646 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:43:06.318800 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315650 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:43:06.318800 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315655 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:43:06.318800 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315659 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:43:06.318800 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.315664 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:43:06.318800 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316816 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:43:06.318800 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316826 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:43:06.318800 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316831 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:43:06.319674 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316835 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:43:06.319674 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316840 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:43:06.319674 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316845 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:43:06.319674 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316849 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:43:06.319674 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316854 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:43:06.319674 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316858 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:43:06.319674 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316863 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:43:06.319674 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316867 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:43:06.319674 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316871 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:43:06.319674 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316875 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:43:06.319674 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316879 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:43:06.319674 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316884 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:43:06.319674 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316888 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:43:06.319674 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316892 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:43:06.319674 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316896 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:43:06.319674 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316901 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:43:06.319674 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316905 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:43:06.319674 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316909 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:43:06.319674 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316913 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:43:06.320271 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316917 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:43:06.320271 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316921 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:43:06.320271 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316925 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:43:06.320271 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316930 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:43:06.320271 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316935 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:43:06.320271 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316940 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:43:06.320271 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316944 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:43:06.320271 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316951 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:43:06.320271 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316957 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:43:06.320271 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316962 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:43:06.320271 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316967 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:43:06.320271 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316972 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:43:06.320271 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316978 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:43:06.320271 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316983 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:43:06.320271 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316987 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:43:06.320271 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316992 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:43:06.320271 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.316997 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:43:06.320271 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317001 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:43:06.320271 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317005 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:43:06.320271 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317010 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:43:06.320863 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317014 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:43:06.320863 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317018 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:43:06.320863 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317025 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:43:06.320863 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317031 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:43:06.320863 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317037 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:43:06.320863 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317043 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:43:06.320863 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317048 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:43:06.320863 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317052 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:43:06.320863 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317057 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:43:06.320863 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317061 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:43:06.320863 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317067 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:43:06.320863 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317071 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:43:06.320863 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317075 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:43:06.320863 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317080 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:43:06.320863 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317084 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:43:06.320863 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317088 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:43:06.320863 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317093 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:43:06.320863 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317097 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:43:06.320863 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317101 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:43:06.321389 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317104 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:43:06.321389 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317108 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:43:06.321389 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317112 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:43:06.321389 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317116 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:43:06.321389 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317120 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:43:06.321389 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317125 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:43:06.321389 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317129 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:43:06.321389 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317133 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:43:06.321389 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317137 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:43:06.321389 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317142 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:43:06.321389 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317147 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:43:06.321389 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317151 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:43:06.321389 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317155 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:43:06.321389 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317160 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:43:06.321389 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317164 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:43:06.321389 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317168 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:43:06.321389 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317172 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:43:06.321389 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317176 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:43:06.321389 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317180 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:43:06.321389 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317184 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:43:06.321931 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317189 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:43:06.321931 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317195 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:43:06.321931 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317199 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:43:06.321931 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317203 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:43:06.321931 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317207 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:43:06.321931 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317211 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:43:06.321931 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317216 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:43:06.321931 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317220 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:43:06.321931 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317224 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:43:06.321931 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317229 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:43:06.321931 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317233 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:43:06.321931 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317237 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:43:06.321931 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317241 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:43:06.321931 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317246 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:43:06.321931 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317250 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:43:06.321931 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317255 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:43:06.321931 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317259 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:43:06.321931 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317263 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:43:06.321931 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317906 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:43:06.321931 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317917 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:43:06.322485 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317922 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:43:06.322485 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317927 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:43:06.322485 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317932 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:43:06.322485 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317936 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:43:06.322485 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317940 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:43:06.322485 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317945 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:43:06.322485 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317950 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:43:06.322485 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317954 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:43:06.322485 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317958 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:43:06.322485 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317962 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:43:06.322485 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317966 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:43:06.322485 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317970 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:43:06.322485 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317974 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:43:06.322485 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317979 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:43:06.322485 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317983 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:43:06.322485 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317987 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:43:06.322485 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317991 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:43:06.322485 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317995 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:43:06.322485 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.317999 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:43:06.322485 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318003 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:43:06.322999 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318007 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:43:06.322999 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318011 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:43:06.322999 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318015 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:43:06.322999 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318020 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:43:06.322999 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318024 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:43:06.322999 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318028 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:43:06.322999 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318032 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:43:06.322999 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318037 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:43:06.322999 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318041 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:43:06.322999 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318045 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:43:06.322999 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318050 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:43:06.322999 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318054 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:43:06.322999 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318058 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:43:06.322999 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318063 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:43:06.322999 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318067 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:43:06.322999 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318071 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:43:06.322999 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318076 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:43:06.322999 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318081 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:43:06.322999 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318087 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:43:06.322999 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318094 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:43:06.323525 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318098 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:43:06.323525 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318102 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:43:06.323525 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318106 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:43:06.323525 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318112 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:43:06.323525 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318116 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:43:06.323525 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318120 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:43:06.323525 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318124 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:43:06.323525 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318128 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:43:06.323525 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318132 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:43:06.323525 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318136 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:43:06.323525 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318140 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:43:06.323525 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318147 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:43:06.323525 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318153 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:43:06.323525 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318157 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:43:06.323525 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318162 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:43:06.323525 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318166 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:43:06.323525 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318170 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:43:06.323525 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318175 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:43:06.323525 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318180 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:43:06.324017 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318187 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:43:06.324017 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318192 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:43:06.324017 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318199 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:43:06.324017 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318203 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:43:06.324017 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318208 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:43:06.324017 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318211 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:43:06.324017 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318216 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:43:06.324017 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318220 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:43:06.324017 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318224 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:43:06.324017 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318229 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:43:06.324017 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318234 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:43:06.324017 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318238 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:43:06.324017 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318242 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:43:06.324017 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318247 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:43:06.324017 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318250 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:43:06.324017 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318255 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:43:06.324017 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318259 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:43:06.324017 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318263 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:43:06.324017 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318268 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:43:06.324482 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318272 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:43:06.324482 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318277 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:43:06.324482 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318281 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:43:06.324482 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318285 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:43:06.324482 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318289 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:43:06.324482 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318293 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:43:06.324482 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318297 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:43:06.324482 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318302 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:43:06.324482 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318306 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:43:06.324482 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318310 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:43:06.324482 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318315 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:43:06.324482 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318319 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:43:06.324482 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318323 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:43:06.324482 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318328 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:43:06.324482 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318331 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:43:06.324482 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318335 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:43:06.324482 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318340 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:43:06.324482 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318344 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:43:06.324482 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.318348 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:43:06.324482 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318442 2561 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 13:43:06.325012 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318452 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 13:43:06.325012 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318462 2561 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 13:43:06.325012 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318470 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 13:43:06.325012 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318477 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 13:43:06.325012 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318482 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 13:43:06.325012 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318488 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 13:43:06.325012 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318495 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 13:43:06.325012 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318500 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 13:43:06.325012 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318505 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 13:43:06.325012 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318510 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 13:43:06.325012 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318516 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 13:43:06.325012 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318521 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 13:43:06.325012 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318525 2561 flags.go:64] FLAG: --cgroup-root="" Jun 08 13:43:06.325012 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318530 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 13:43:06.325012 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318534 2561 flags.go:64] FLAG: --client-ca-file="" Jun 08 13:43:06.325012 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318539 2561 flags.go:64] FLAG: --cloud-provider="external" Jun 08 13:43:06.325012 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318544 2561 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 13:43:06.325012 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318549 2561 flags.go:64] FLAG: --cluster-domain="" Jun 08 13:43:06.325012 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318554 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 13:43:06.325012 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318559 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 13:43:06.325012 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318563 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 13:43:06.325012 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318569 2561 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 13:43:06.325012 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318574 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 13:43:06.325012 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318579 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 13:43:06.325608 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318589 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 13:43:06.325608 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318594 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 13:43:06.325608 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318599 2561 flags.go:64] FLAG: --contention-profiling="false" Jun 08 13:43:06.325608 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318603 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 13:43:06.325608 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318608 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 13:43:06.325608 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318613 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 13:43:06.325608 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318618 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 13:43:06.325608 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318625 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 13:43:06.325608 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318630 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 13:43:06.325608 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318634 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 13:43:06.325608 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318639 2561 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 13:43:06.325608 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318644 2561 flags.go:64] FLAG: --enable-server="true" Jun 08 13:43:06.325608 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318650 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 13:43:06.325608 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318657 2561 flags.go:64] FLAG: --event-burst="100" Jun 08 13:43:06.325608 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318663 2561 flags.go:64] FLAG: --event-qps="50" Jun 08 13:43:06.325608 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318668 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 13:43:06.325608 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318672 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 13:43:06.325608 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318677 2561 flags.go:64] FLAG: --eviction-hard="" Jun 08 13:43:06.325608 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318683 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 13:43:06.325608 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318687 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 13:43:06.325608 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318692 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 13:43:06.325608 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318697 2561 flags.go:64] FLAG: --eviction-soft="" Jun 08 13:43:06.325608 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318701 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 13:43:06.325608 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318706 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 13:43:06.325608 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318710 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 13:43:06.326278 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318715 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 13:43:06.326278 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318720 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 13:43:06.326278 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318725 2561 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 13:43:06.326278 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318729 2561 flags.go:64] FLAG: --feature-gates="" Jun 08 13:43:06.326278 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318735 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 13:43:06.326278 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318740 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 13:43:06.326278 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318745 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 13:43:06.326278 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318751 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 13:43:06.326278 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318756 2561 flags.go:64] FLAG: --healthz-port="10248" Jun 08 13:43:06.326278 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318781 2561 flags.go:64] FLAG: --help="false" Jun 08 13:43:06.326278 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318786 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-132-92.ec2.internal" Jun 08 13:43:06.326278 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318791 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 13:43:06.326278 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318796 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 13:43:06.326278 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318801 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 13:43:06.326278 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318806 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 13:43:06.326278 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318811 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 13:43:06.326278 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318815 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 13:43:06.326278 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318820 2561 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 13:43:06.326278 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318824 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 13:43:06.326278 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318828 2561 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 13:43:06.326278 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318834 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 13:43:06.326278 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318839 2561 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 13:43:06.326278 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318844 2561 flags.go:64] FLAG: --kube-reserved="" Jun 08 13:43:06.326278 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318849 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 13:43:06.326889 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318853 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 13:43:06.326889 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318859 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 13:43:06.326889 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318863 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 13:43:06.326889 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318868 2561 flags.go:64] FLAG: --lock-file="" Jun 08 13:43:06.326889 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318872 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 13:43:06.326889 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318876 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 13:43:06.326889 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318881 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 13:43:06.326889 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318891 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 13:43:06.326889 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318896 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 13:43:06.326889 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318900 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 13:43:06.326889 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318905 2561 flags.go:64] FLAG: --logging-format="text" Jun 08 13:43:06.326889 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318910 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 13:43:06.326889 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318915 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 13:43:06.326889 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318919 2561 flags.go:64] FLAG: --manifest-url="" Jun 08 13:43:06.326889 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318924 2561 flags.go:64] FLAG: --manifest-url-header="" Jun 08 13:43:06.326889 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318933 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 13:43:06.326889 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318938 2561 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 13:43:06.326889 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318946 2561 flags.go:64] FLAG: --max-pods="110" Jun 08 13:43:06.326889 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318951 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 13:43:06.326889 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318956 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 13:43:06.326889 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318960 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 13:43:06.326889 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318964 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 13:43:06.326889 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318969 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 13:43:06.326889 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318974 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 13:43:06.326889 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318979 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 13:43:06.327507 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318992 2561 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 13:43:06.327507 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.318997 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 13:43:06.327507 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319002 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 13:43:06.327507 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319007 2561 flags.go:64] FLAG: --pod-cidr="" Jun 08 13:43:06.327507 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319012 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 13:43:06.327507 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319021 2561 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 13:43:06.327507 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319026 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 13:43:06.327507 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319031 2561 flags.go:64] FLAG: --pods-per-core="0" Jun 08 13:43:06.327507 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319035 2561 flags.go:64] FLAG: --port="10250" Jun 08 13:43:06.327507 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319040 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 13:43:06.327507 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319045 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b129ce99bd18fe9a" Jun 08 13:43:06.327507 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319050 2561 flags.go:64] FLAG: --qos-reserved="" Jun 08 13:43:06.327507 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319054 2561 flags.go:64] FLAG: --read-only-port="10255" Jun 08 13:43:06.327507 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319059 2561 flags.go:64] FLAG: --register-node="true" Jun 08 13:43:06.327507 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319064 2561 flags.go:64] FLAG: --register-with-taints="" Jun 08 13:43:06.327507 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319070 2561 flags.go:64] FLAG: --registry-burst="10" Jun 08 13:43:06.327507 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319075 2561 flags.go:64] FLAG: --registry-qps="5" Jun 08 13:43:06.327507 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319080 2561 flags.go:64] FLAG: --reserved-cpus="" Jun 08 13:43:06.327507 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319084 2561 flags.go:64] FLAG: --reserved-memory="" Jun 08 13:43:06.327507 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319090 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 13:43:06.327507 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319095 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 13:43:06.327507 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319100 2561 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 13:43:06.327507 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319105 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 13:43:06.327507 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319111 2561 flags.go:64] FLAG: --runonce="false" Jun 08 13:43:06.327507 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319118 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 13:43:06.328135 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319123 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 13:43:06.328135 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319128 2561 flags.go:64] FLAG: --seccomp-default="false" Jun 08 13:43:06.328135 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319133 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 13:43:06.328135 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319138 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 13:43:06.328135 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319143 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 13:43:06.328135 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319147 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 13:43:06.328135 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319152 2561 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 13:43:06.328135 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319157 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 13:43:06.328135 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319161 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 13:43:06.328135 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319166 2561 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 13:43:06.328135 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319170 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 13:43:06.328135 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319175 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 13:43:06.328135 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319181 2561 flags.go:64] FLAG: --system-cgroups="" Jun 08 13:43:06.328135 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319185 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 13:43:06.328135 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319194 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 13:43:06.328135 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319199 2561 flags.go:64] FLAG: --tls-cert-file="" Jun 08 13:43:06.328135 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319203 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 13:43:06.328135 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319209 2561 flags.go:64] FLAG: --tls-min-version="" Jun 08 13:43:06.328135 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319213 2561 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 13:43:06.328135 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319217 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 13:43:06.328135 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319222 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 13:43:06.328135 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319227 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 13:43:06.328135 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319232 2561 flags.go:64] FLAG: --v="2" Jun 08 13:43:06.328135 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319238 2561 flags.go:64] FLAG: --version="false" Jun 08 13:43:06.328135 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319244 2561 flags.go:64] FLAG: --vmodule="" Jun 08 13:43:06.328745 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319249 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 13:43:06.328745 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.319255 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 13:43:06.328745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319430 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:43:06.328745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319446 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:43:06.328745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319451 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:43:06.328745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319457 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:43:06.328745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319464 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:43:06.328745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319469 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:43:06.328745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319473 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:43:06.328745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319478 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:43:06.328745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319483 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:43:06.328745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319487 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:43:06.328745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319491 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:43:06.328745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319495 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:43:06.328745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319499 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:43:06.328745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319503 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:43:06.328745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319507 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:43:06.328745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319511 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:43:06.328745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319516 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:43:06.328745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319520 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:43:06.329309 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319525 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:43:06.329309 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319529 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:43:06.329309 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319534 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:43:06.329309 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319538 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:43:06.329309 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319542 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:43:06.329309 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319546 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:43:06.329309 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319550 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:43:06.329309 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319554 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:43:06.329309 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319559 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:43:06.329309 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319565 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:43:06.329309 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319571 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:43:06.329309 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319576 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:43:06.329309 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319580 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:43:06.329309 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319585 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:43:06.329309 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319589 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:43:06.329309 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319593 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:43:06.329309 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319597 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:43:06.329309 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319604 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:43:06.329309 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319610 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:43:06.329795 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319615 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:43:06.329795 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319619 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:43:06.329795 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319623 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:43:06.329795 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319627 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:43:06.329795 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319631 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:43:06.329795 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319636 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:43:06.329795 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319640 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:43:06.329795 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319644 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:43:06.329795 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319649 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:43:06.329795 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319656 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:43:06.329795 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319661 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:43:06.329795 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319665 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:43:06.329795 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319670 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:43:06.329795 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319674 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:43:06.329795 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319679 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:43:06.329795 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319683 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:43:06.329795 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319688 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:43:06.329795 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319692 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:43:06.329795 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319696 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:43:06.330335 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319701 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:43:06.330335 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319705 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:43:06.330335 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319710 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:43:06.330335 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319714 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:43:06.330335 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319719 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:43:06.330335 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319723 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:43:06.330335 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319728 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:43:06.330335 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319732 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:43:06.330335 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319736 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:43:06.330335 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319740 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:43:06.330335 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319744 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:43:06.330335 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319750 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:43:06.330335 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319756 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:43:06.330335 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319777 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:43:06.330335 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319782 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:43:06.330335 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319787 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:43:06.330335 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319791 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:43:06.330335 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319795 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:43:06.330335 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319799 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:43:06.330335 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319805 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:43:06.330841 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319811 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:43:06.330841 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319816 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:43:06.330841 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319820 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:43:06.330841 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319824 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:43:06.330841 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319829 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:43:06.330841 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319833 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:43:06.330841 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319837 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:43:06.330841 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319842 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:43:06.330841 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319847 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:43:06.330841 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319852 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:43:06.330841 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319856 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:43:06.330841 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319860 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:43:06.330841 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319864 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:43:06.330841 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319869 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:43:06.330841 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319873 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:43:06.330841 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319877 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:43:06.330841 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319881 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:43:06.330841 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319886 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:43:06.330841 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319890 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:43:06.330841 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319894 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:43:06.331342 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319899 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:43:06.331342 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319903 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:43:06.331342 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.319907 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:43:06.331342 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.320539 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 13:43:06.331342 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.327015 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 13:43:06.331342 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.327029 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 13:43:06.331342 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.327048 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 13:43:06.331342 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.327053 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 13:43:06.331342 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327103 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:43:06.331342 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327108 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:43:06.331342 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327111 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:43:06.331342 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327114 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:43:06.331342 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327118 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:43:06.331342 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327121 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:43:06.331342 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327124 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:43:06.331745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327128 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:43:06.331745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327132 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:43:06.331745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327136 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:43:06.331745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327139 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:43:06.331745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327142 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:43:06.331745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327145 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:43:06.331745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327148 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:43:06.331745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327151 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:43:06.331745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327153 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:43:06.331745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327156 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:43:06.331745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327159 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:43:06.331745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327162 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:43:06.331745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327164 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:43:06.331745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327167 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:43:06.331745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327169 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:43:06.331745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327172 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:43:06.331745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327174 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:43:06.331745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327177 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:43:06.331745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327179 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:43:06.331745 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327182 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:43:06.332278 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327185 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:43:06.332278 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327187 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:43:06.332278 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327191 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:43:06.332278 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327194 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:43:06.332278 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327197 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:43:06.332278 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327200 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:43:06.332278 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327202 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:43:06.332278 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327205 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:43:06.332278 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327208 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:43:06.332278 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327210 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:43:06.332278 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327213 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:43:06.332278 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327215 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:43:06.332278 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327218 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:43:06.332278 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327220 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:43:06.332278 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327223 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:43:06.332278 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327226 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:43:06.332278 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327228 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:43:06.332278 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327231 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:43:06.332278 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327233 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:43:06.332278 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327236 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:43:06.332791 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327238 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:43:06.332791 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327241 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:43:06.332791 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327243 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:43:06.332791 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327246 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:43:06.332791 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327248 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:43:06.332791 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327251 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:43:06.332791 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327253 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:43:06.332791 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327256 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:43:06.332791 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327258 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:43:06.332791 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327262 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:43:06.332791 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327265 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:43:06.332791 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327268 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:43:06.332791 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327271 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:43:06.332791 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327274 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:43:06.332791 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327278 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:43:06.332791 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327281 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:43:06.332791 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327284 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:43:06.332791 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327287 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:43:06.332791 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327290 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:43:06.333262 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327292 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:43:06.333262 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327295 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:43:06.333262 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327297 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:43:06.333262 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327300 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:43:06.333262 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327302 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:43:06.333262 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327305 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:43:06.333262 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327307 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:43:06.333262 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327310 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:43:06.333262 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327312 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:43:06.333262 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327315 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:43:06.333262 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327317 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:43:06.333262 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327319 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:43:06.333262 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327324 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:43:06.333262 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327327 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:43:06.333262 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327330 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:43:06.333262 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327332 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:43:06.333262 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327335 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:43:06.333262 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327338 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:43:06.333262 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327340 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:43:06.333734 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327342 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:43:06.333734 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327345 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:43:06.333734 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327348 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:43:06.333734 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327350 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:43:06.333734 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327353 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:43:06.333734 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327355 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:43:06.333734 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327358 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:43:06.333734 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327360 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:43:06.333734 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327364 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:43:06.333734 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327367 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:43:06.333734 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327370 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:43:06.333734 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327372 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:43:06.333734 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327375 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:43:06.333734 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327378 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:43:06.333734 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.327383 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 13:43:06.334134 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327510 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:43:06.334134 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327515 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:43:06.334134 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327519 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:43:06.334134 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327522 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:43:06.334134 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327525 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:43:06.334134 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327528 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:43:06.334134 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327531 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:43:06.334134 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327534 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:43:06.334134 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327537 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:43:06.334134 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327539 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:43:06.334134 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327542 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:43:06.334134 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327545 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:43:06.334134 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327547 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:43:06.334134 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327550 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:43:06.334134 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327552 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:43:06.334134 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327555 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:43:06.334134 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327557 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:43:06.334134 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327560 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:43:06.334134 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327562 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:43:06.334134 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327565 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:43:06.334134 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327567 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:43:06.334650 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327570 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:43:06.334650 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327573 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:43:06.334650 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327575 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:43:06.334650 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327578 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:43:06.334650 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327581 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:43:06.334650 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327584 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:43:06.334650 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327587 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:43:06.334650 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327590 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:43:06.334650 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327593 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:43:06.334650 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327595 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:43:06.334650 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327598 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:43:06.334650 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327600 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:43:06.334650 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327603 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:43:06.334650 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327605 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:43:06.334650 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327608 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:43:06.334650 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327611 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:43:06.334650 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327615 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:43:06.334650 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327618 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:43:06.334650 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327620 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:43:06.334650 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327623 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:43:06.335541 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327625 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:43:06.335541 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327629 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:43:06.335541 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327632 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:43:06.335541 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327635 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:43:06.335541 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327638 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:43:06.335541 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327640 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:43:06.335541 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327643 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:43:06.335541 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327646 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:43:06.335541 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327648 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:43:06.335541 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327651 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:43:06.335541 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327654 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:43:06.335541 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327656 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:43:06.335541 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327660 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:43:06.335541 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327663 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:43:06.335541 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327666 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:43:06.335541 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327669 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:43:06.335541 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327672 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:43:06.335541 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327675 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:43:06.335541 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327678 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:43:06.336232 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327681 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:43:06.336232 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327684 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:43:06.336232 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327687 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:43:06.336232 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327689 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:43:06.336232 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327692 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:43:06.336232 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327694 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:43:06.336232 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327697 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:43:06.336232 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327700 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:43:06.336232 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327702 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:43:06.336232 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327705 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:43:06.336232 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327707 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:43:06.336232 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327710 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:43:06.336232 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327712 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:43:06.336232 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327715 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:43:06.336232 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327717 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:43:06.336232 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327719 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:43:06.336232 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327722 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:43:06.336232 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327724 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:43:06.336232 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327727 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:43:06.336232 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327729 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:43:06.336716 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327732 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:43:06.336716 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327734 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:43:06.336716 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327737 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:43:06.336716 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327739 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:43:06.336716 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327742 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:43:06.336716 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327744 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:43:06.336716 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327747 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:43:06.336716 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327749 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:43:06.336716 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327752 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:43:06.336716 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327754 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:43:06.336716 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327757 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:43:06.336716 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327776 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:43:06.336716 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327780 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:43:06.336716 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327783 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:43:06.336716 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327786 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:43:06.336716 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327788 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:43:06.336716 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327791 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:43:06.336716 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327793 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:43:06.336716 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:06.327796 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:43:06.337216 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.327800 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 13:43:06.337216 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.327887 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 13:43:06.337216 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.330029 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 13:43:06.337216 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.331499 2561 server.go:1019] "Starting client certificate rotation" Jun 08 13:43:06.337216 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.331596 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 13:43:06.337216 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.331633 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 13:43:06.337379 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.337266 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 13:43:06.338347 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.338328 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 13:43:06.351634 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.351614 2561 log.go:25] "Validated CRI v1 runtime API" Jun 08 13:43:06.354399 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.354386 2561 log.go:25] "Validated CRI v1 image API" Jun 08 13:43:06.355225 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.355208 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 13:43:06.357925 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.357906 2561 fs.go:135] Filesystem UUIDs: map[126ddbf7-054f-4680-81ff-1a61584b9734:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 94863213-8f73-4ea8-be2d-0950786e02ee:/dev/nvme0n1p3] Jun 08 13:43:06.357998 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.357924 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 13:43:06.363037 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.363021 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 13:43:06.363705 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.363608 2561 manager.go:216] Machine: {Timestamp:2026-06-08 13:43:06.362247487 +0000 UTC m=+0.343275766 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100900 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20eff0149b8ce47916ba0038d619d0 SystemUUID:ec20eff0-149b-8ce4-7916-ba0038d619d0 BootID:007133f7-91b7-476c-9178-6c6dc858fdff Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:97:e4:d5:26:41 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:97:e4:d5:26:41 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:82:b9:f2:b1:e1:2e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 13:43:06.363705 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.363705 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 13:43:06.363806 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.363787 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 13:43:06.367206 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.367182 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 13:43:06.367329 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.367210 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-92.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 13:43:06.368674 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.368663 2561 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 13:43:06.368714 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.368675 2561 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 13:43:06.368714 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.368684 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 13:43:06.369423 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.369413 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 13:43:06.370560 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.370551 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 13:43:06.374689 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.374677 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 08 13:43:06.374806 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.374797 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 13:43:06.374837 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.374826 2561 kubelet.go:486] "Attempting to sync node with API server" Jun 08 13:43:06.374901 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.374843 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 13:43:06.374901 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.374860 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 13:43:06.374901 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.374872 2561 kubelet.go:398] "Adding apiserver pod source" Jun 08 13:43:06.374901 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.374884 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 13:43:06.375257 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.375243 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 13:43:06.375301 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.375266 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 13:43:06.379246 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.379226 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 13:43:06.381024 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.381007 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 13:43:06.381100 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.381042 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 13:43:06.382488 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.382476 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 13:43:06.382537 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.382492 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 13:43:06.382537 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.382499 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 13:43:06.382537 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.382504 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 13:43:06.382537 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.382512 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 13:43:06.382537 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.382521 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 13:43:06.382537 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.382531 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 13:43:06.382537 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.382536 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 13:43:06.382717 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.382543 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 13:43:06.382717 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.382549 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 13:43:06.382717 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.382557 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 13:43:06.382717 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.382563 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 13:43:06.383839 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.383828 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 13:43:06.383839 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.383839 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 13:43:06.387195 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.387181 2561 server.go:1268] "Started kubelet" Jun 08 13:43:06.387361 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.387292 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 13:43:06.387517 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.387465 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 13:43:06.387594 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.387538 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 13:43:06.387806 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:06.387783 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-92.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 13:43:06.387884 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:06.387867 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 13:43:06.387990 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.387975 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-92.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 13:43:06.389709 ip-10-0-132-92 systemd[1]: Started Kubernetes Kubelet. Jun 08 13:43:06.390409 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.390398 2561 server.go:310] "Adding debug handlers to kubelet server" Jun 08 13:43:06.390469 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.390398 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 13:43:06.395264 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:06.395243 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 13:43:06.396292 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:06.394781 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-92.ec2.internal.18b71eee46cc1db0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-92.ec2.internal,UID:ip-10-0-132-92.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-92.ec2.internal,},FirstTimestamp:2026-06-08 13:43:06.387152304 +0000 UTC m=+0.368180564,LastTimestamp:2026-06-08 13:43:06.387152304 +0000 UTC m=+0.368180564,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-92.ec2.internal,}" Jun 08 13:43:06.396537 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.396523 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 13:43:06.396597 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.396534 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 13:43:06.396734 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:06.396674 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-92.ec2.internal\" not found" Jun 08 13:43:06.397259 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.397228 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 13:43:06.397352 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.397260 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 13:43:06.397352 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.397228 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 13:43:06.397442 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.397376 2561 reconstruct.go:97] "Volume reconstruction finished" Jun 08 13:43:06.397442 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.397388 2561 reconciler.go:29] "Reconciler: start to sync state" Jun 08 13:43:06.397724 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.397708 2561 factory.go:153] Registering CRI-O factory Jun 08 13:43:06.397724 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.397727 2561 factory.go:223] Registration of the crio container factory successfully Jun 08 13:43:06.397880 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.397806 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 13:43:06.397880 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.397825 2561 factory.go:55] Registering systemd factory Jun 08 13:43:06.397880 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.397833 2561 factory.go:223] Registration of the systemd container factory successfully Jun 08 13:43:06.397880 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.397855 2561 factory.go:103] Registering Raw factory Jun 08 13:43:06.397880 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.397869 2561 manager.go:1196] Started watching for new ooms in manager Jun 08 13:43:06.398567 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.398544 2561 manager.go:349] Starting recovery of all containers Jun 08 13:43:06.404509 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:06.404463 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 08 13:43:06.404592 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:06.404567 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-92.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 08 13:43:06.407398 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.407361 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 13:43:06.410567 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.410551 2561 manager.go:354] Recovery completed Jun 08 13:43:06.414458 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.414446 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:43:06.416233 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.416214 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:43:06.416307 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.416243 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:43:06.416307 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.416257 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:43:06.416809 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.416794 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 13:43:06.416809 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.416808 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 13:43:06.416888 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.416823 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 08 13:43:06.416922 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.416808 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:43:06.417510 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.417494 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:43:06.417569 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.417523 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:43:06.417569 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.417534 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:43:06.418532 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.418520 2561 policy_none.go:49] "None policy: Start" Jun 08 13:43:06.418532 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.418534 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 13:43:06.418638 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.418543 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 13:43:06.418638 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:06.418502 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-92.ec2.internal.18b71eee4887d2cb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-92.ec2.internal,UID:ip-10-0-132-92.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-92.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-92.ec2.internal,},FirstTimestamp:2026-06-08 13:43:06.416231115 +0000 UTC m=+0.397259375,LastTimestamp:2026-06-08 13:43:06.416231115 +0000 UTC m=+0.397259375,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-92.ec2.internal,}" Jun 08 13:43:06.419327 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.419313 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9d8gf" Jun 08 13:43:06.419979 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.419968 2561 policy_none.go:47] "Start" Jun 08 13:43:06.429067 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.429052 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9d8gf" Jun 08 13:43:06.430375 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:06.430321 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-92.ec2.internal.18b71eee488819c2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-92.ec2.internal,UID:ip-10-0-132-92.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-92.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-92.ec2.internal,},FirstTimestamp:2026-06-08 13:43:06.416249282 +0000 UTC m=+0.397277543,LastTimestamp:2026-06-08 13:43:06.416249282 +0000 UTC m=+0.397277543,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-92.ec2.internal,}" Jun 08 13:43:06.451957 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.451944 2561 manager.go:337] "Starting Device Plugin manager" Jun 08 13:43:06.452038 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:06.451968 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 13:43:06.452038 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.451977 2561 server.go:87] "Starting device plugin registration server" Jun 08 13:43:06.452178 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.452167 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 13:43:06.452235 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.452181 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 13:43:06.452320 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.452308 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 13:43:06.452392 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.452381 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 13:43:06.452392 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.452392 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 13:43:06.452908 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:06.452889 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 13:43:06.452983 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:06.452942 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-92.ec2.internal\" not found" Jun 08 13:43:06.469975 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.469959 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 13:43:06.481550 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.470001 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 13:43:06.481550 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.470023 2561 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 13:43:06.481550 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:06.470076 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 08 13:43:06.481550 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.472175 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 13:43:06.552867 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.552723 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:43:06.554455 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.554439 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:43:06.554536 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.554465 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:43:06.554536 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.554481 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:43:06.554536 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.554517 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-92.ec2.internal" Jun 08 13:43:06.564510 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.564491 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-92.ec2.internal" Jun 08 13:43:06.564583 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:06.564513 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-92.ec2.internal\": node \"ip-10-0-132-92.ec2.internal\" not found" Jun 08 13:43:06.570633 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.570617 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-92.ec2.internal"] Jun 08 13:43:06.570704 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.570668 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:43:06.572247 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.572228 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:43:06.572323 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.572254 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:43:06.572323 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.572266 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:43:06.574421 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.574409 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:43:06.574518 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.574505 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal" Jun 08 13:43:06.574551 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.574535 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:43:06.575041 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.575026 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:43:06.575158 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.575052 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:43:06.575158 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.575027 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:43:06.575158 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.575086 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:43:06.575158 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.575101 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:43:06.575158 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.575063 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:43:06.577087 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.577074 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-92.ec2.internal" Jun 08 13:43:06.577142 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.577098 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:43:06.577683 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.577665 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:43:06.577788 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.577695 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:43:06.577788 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.577708 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:43:06.603956 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:06.603936 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-92.ec2.internal\" not found" Jun 08 13:43:06.610360 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:06.610340 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-92.ec2.internal\" not found" node="ip-10-0-132-92.ec2.internal" Jun 08 13:43:06.614510 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:06.614495 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-92.ec2.internal\" not found" node="ip-10-0-132-92.ec2.internal" Jun 08 13:43:06.698526 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.698502 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/851606b6637692164abff23a0059552f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal\" (UID: \"851606b6637692164abff23a0059552f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal" Jun 08 13:43:06.698611 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.698534 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/851606b6637692164abff23a0059552f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal\" (UID: \"851606b6637692164abff23a0059552f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal" Jun 08 13:43:06.698611 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.698559 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4e0e67f7045596994bc0d64a2b9588c2-config\") pod \"kube-apiserver-proxy-ip-10-0-132-92.ec2.internal\" (UID: \"4e0e67f7045596994bc0d64a2b9588c2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-92.ec2.internal" Jun 08 13:43:06.704580 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:06.704563 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-92.ec2.internal\" not found" Jun 08 13:43:06.798868 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.798835 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/851606b6637692164abff23a0059552f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal\" (UID: \"851606b6637692164abff23a0059552f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal" Jun 08 13:43:06.798868 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.798870 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/851606b6637692164abff23a0059552f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal\" (UID: \"851606b6637692164abff23a0059552f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal" Jun 08 13:43:06.798982 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.798886 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4e0e67f7045596994bc0d64a2b9588c2-config\") pod \"kube-apiserver-proxy-ip-10-0-132-92.ec2.internal\" (UID: \"4e0e67f7045596994bc0d64a2b9588c2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-92.ec2.internal" Jun 08 13:43:06.798982 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.798919 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4e0e67f7045596994bc0d64a2b9588c2-config\") pod \"kube-apiserver-proxy-ip-10-0-132-92.ec2.internal\" (UID: \"4e0e67f7045596994bc0d64a2b9588c2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-92.ec2.internal" Jun 08 13:43:06.798982 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.798932 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/851606b6637692164abff23a0059552f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal\" (UID: \"851606b6637692164abff23a0059552f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal" Jun 08 13:43:06.798982 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.798944 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/851606b6637692164abff23a0059552f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal\" (UID: \"851606b6637692164abff23a0059552f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal" Jun 08 13:43:06.804943 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:06.804926 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-92.ec2.internal\" not found" Jun 08 13:43:06.905639 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:06.905622 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-92.ec2.internal\" not found" Jun 08 13:43:06.916788 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.916772 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal" Jun 08 13:43:06.921178 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:06.921159 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-92.ec2.internal" Jun 08 13:43:07.006261 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:07.006239 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-92.ec2.internal\" not found" Jun 08 13:43:07.106701 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:07.106685 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-92.ec2.internal\" not found" Jun 08 13:43:07.205327 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.205269 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 13:43:07.297442 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.297414 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal" Jun 08 13:43:07.311143 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.311122 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 13:43:07.313316 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.313300 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-92.ec2.internal" Jun 08 13:43:07.324281 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.324266 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 13:43:07.331408 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.331394 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 13:43:07.331520 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.331502 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 13:43:07.346114 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.346096 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 13:43:07.375705 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.375678 2561 apiserver.go:52] "Watching apiserver" Jun 08 13:43:07.385648 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.385627 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 13:43:07.386041 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.386022 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-vlwt4","openshift-multus/network-metrics-daemon-6zmwj","openshift-ovn-kubernetes/ovnkube-node-lx4dj","kube-system/global-pull-secret-syncer-kzr55","kube-system/kube-apiserver-proxy-ip-10-0-132-92.ec2.internal","openshift-cluster-node-tuning-operator/tuned-fh86q","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal","openshift-multus/multus-additional-cni-plugins-jkjkk","openshift-network-diagnostics/network-check-target-s7p22","openshift-network-operator/iptables-alerter-qzp5m","kube-system/konnectivity-agent-2fw8m","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv8nt","openshift-dns/node-resolver-qms2k","openshift-image-registry/node-ca-55c2s"] Jun 08 13:43:07.388562 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.388546 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qzp5m" Jun 08 13:43:07.390539 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.390501 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2fw8m" Jun 08 13:43:07.390670 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.390651 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-sd679\"" Jun 08 13:43:07.390906 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.390890 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 13:43:07.390983 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.390892 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 13:43:07.391181 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.391162 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 13:43:07.392553 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.392534 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.393073 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.393056 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ls95n\"" Jun 08 13:43:07.393164 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.393097 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 13:43:07.393164 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.393131 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 13:43:07.394855 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.394835 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 13:43:07.396938 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.396447 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 13:43:07.396938 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.396240 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 13:43:07.396938 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.396529 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 13:43:07.396938 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.396615 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rpr9z\"" Jun 08 13:43:07.396938 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.396635 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 13:43:07.396938 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.396636 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 13:43:07.396938 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.396789 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 13:43:07.398279 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.398162 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:43:07.398279 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:07.398241 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzr55" podUID="43325f79-05b7-4adc-b726-9dbf5b9e5b68" Jun 08 13:43:07.400082 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.400064 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-55c2s" Jun 08 13:43:07.401827 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.401612 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.401827 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.401691 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-host-run-ovn-kubernetes\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.401827 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.401724 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/43325f79-05b7-4adc-b726-9dbf5b9e5b68-dbus\") pod \"global-pull-secret-syncer-kzr55\" (UID: \"43325f79-05b7-4adc-b726-9dbf5b9e5b68\") " pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:43:07.401827 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.401751 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43325f79-05b7-4adc-b726-9dbf5b9e5b68-original-pull-secret\") pod \"global-pull-secret-syncer-kzr55\" (UID: \"43325f79-05b7-4adc-b726-9dbf5b9e5b68\") " pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:43:07.401827 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.401791 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.401827 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.401816 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f51689fd-918d-4af0-8083-178dbe60a4d9-ovnkube-script-lib\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.402143 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.401837 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f51689fd-918d-4af0-8083-178dbe60a4d9-ovn-node-metrics-cert\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.402143 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.401864 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9f80246c-3dde-4a76-a65e-da7a5dc1732f-iptables-alerter-script\") pod \"iptables-alerter-qzp5m\" (UID: \"9f80246c-3dde-4a76-a65e-da7a5dc1732f\") " pod="openshift-network-operator/iptables-alerter-qzp5m" Jun 08 13:43:07.402143 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.401888 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-var-lib-openvswitch\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.402143 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.401911 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-etc-openvswitch\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.402143 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.401937 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-log-socket\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.402143 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.401974 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f51689fd-918d-4af0-8083-178dbe60a4d9-env-overrides\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.402143 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.402008 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f80246c-3dde-4a76-a65e-da7a5dc1732f-host-slash\") pod \"iptables-alerter-qzp5m\" (UID: \"9f80246c-3dde-4a76-a65e-da7a5dc1732f\") " pod="openshift-network-operator/iptables-alerter-qzp5m" Jun 08 13:43:07.402143 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.402057 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8rj2\" (UniqueName: \"kubernetes.io/projected/9f80246c-3dde-4a76-a65e-da7a5dc1732f-kube-api-access-n8rj2\") pod \"iptables-alerter-qzp5m\" (UID: \"9f80246c-3dde-4a76-a65e-da7a5dc1732f\") " pod="openshift-network-operator/iptables-alerter-qzp5m" Jun 08 13:43:07.402143 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.402090 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-host-cni-netd\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.402143 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.402113 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-host-slash\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.402143 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.402132 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-node-log\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.402143 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.402149 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-host-cni-bin\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.402664 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.402169 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f51689fd-918d-4af0-8083-178dbe60a4d9-ovnkube-config\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.402664 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.402219 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjpmp\" (UniqueName: \"kubernetes.io/projected/f51689fd-918d-4af0-8083-178dbe60a4d9-kube-api-access-rjpmp\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.402664 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.402250 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-host-run-netns\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.402664 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.402277 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/42ec3ccf-8ea7-4b23-810a-59696755f5ca-agent-certs\") pod \"konnectivity-agent-2fw8m\" (UID: \"42ec3ccf-8ea7-4b23-810a-59696755f5ca\") " pod="kube-system/konnectivity-agent-2fw8m" Jun 08 13:43:07.402664 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.402303 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/42ec3ccf-8ea7-4b23-810a-59696755f5ca-konnectivity-ca\") pod \"konnectivity-agent-2fw8m\" (UID: \"42ec3ccf-8ea7-4b23-810a-59696755f5ca\") " pod="kube-system/konnectivity-agent-2fw8m" Jun 08 13:43:07.402664 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.402336 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-run-openvswitch\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.402664 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.402362 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-run-ovn\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.402664 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.402381 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/43325f79-05b7-4adc-b726-9dbf5b9e5b68-kubelet-config\") pod \"global-pull-secret-syncer-kzr55\" (UID: \"43325f79-05b7-4adc-b726-9dbf5b9e5b68\") " pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:43:07.402664 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.402404 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-systemd-units\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.402664 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.402454 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-run-systemd\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.402664 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.402466 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 13:43:07.402664 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.402469 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 13:43:07.402664 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.402472 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-host-kubelet\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.403214 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.402821 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 13:43:07.403214 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.402843 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-62wpf\"" Jun 08 13:43:07.403711 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.403697 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7p22" Jun 08 13:43:07.403804 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:07.403787 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7p22" podUID="4fef731a-4dcc-40e0-843f-1ca10f3582a2" Jun 08 13:43:07.403966 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.403948 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 13:43:07.404082 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.403972 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 13:43:07.404382 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.404368 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wn5bl\"" Jun 08 13:43:07.405343 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.405331 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qms2k" Jun 08 13:43:07.407500 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.407486 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dxq8l\"" Jun 08 13:43:07.407617 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.407599 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:43:07.407664 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.407654 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 13:43:07.407710 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.407662 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 13:43:07.407710 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:07.407659 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zmwj" podUID="50931712-af88-4fe2-b146-0926d8e10b25" Jun 08 13:43:07.409045 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.409032 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 13:43:07.409938 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.409924 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.411951 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.411929 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jkjkk" Jun 08 13:43:07.412297 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.412283 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 13:43:07.412477 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.412463 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 13:43:07.412558 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.412542 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 13:43:07.412619 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.412547 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 13:43:07.412619 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.412552 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-t29sk\"" Jun 08 13:43:07.414145 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.414131 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv8nt" Jun 08 13:43:07.414340 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.414321 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 13:43:07.414419 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.414358 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 13:43:07.414491 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.414476 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mtgbx\"" Jun 08 13:43:07.416546 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.416517 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 13:43:07.416627 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.416518 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 13:43:07.416795 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.416780 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-b7clv\"" Jun 08 13:43:07.416887 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.416834 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 13:43:07.430631 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.430616 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wclpn" Jun 08 13:43:07.431694 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.431651 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 13:38:06 +0000 UTC" deadline="2027-11-14 08:58:08.135036964 +0000 UTC" Jun 08 13:43:07.431749 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.431694 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12571h15m0.703345785s" Jun 08 13:43:07.441211 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.441194 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wclpn" Jun 08 13:43:07.484989 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:07.484967 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod851606b6637692164abff23a0059552f.slice/crio-189e592c38e188dfcd57f4103287949f6c3367c9ba32493f04dbc38013c1e3e0 WatchSource:0}: Error finding container 189e592c38e188dfcd57f4103287949f6c3367c9ba32493f04dbc38013c1e3e0: Status 404 returned error can't find the container with id 189e592c38e188dfcd57f4103287949f6c3367c9ba32493f04dbc38013c1e3e0 Jun 08 13:43:07.485227 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:07.485204 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e0e67f7045596994bc0d64a2b9588c2.slice/crio-04bff67d47f382a9c140e9f6f307663dc6ec6fd970111d18cd2bc23955fa7e61 WatchSource:0}: Error finding container 04bff67d47f382a9c140e9f6f307663dc6ec6fd970111d18cd2bc23955fa7e61: Status 404 returned error can't find the container with id 04bff67d47f382a9c140e9f6f307663dc6ec6fd970111d18cd2bc23955fa7e61 Jun 08 13:43:07.489820 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.489800 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 13:43:07.496781 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.496749 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 13:43:07.498308 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.498290 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 13:43:07.502949 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.502929 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4n7p\" (UniqueName: \"kubernetes.io/projected/4fef731a-4dcc-40e0-843f-1ca10f3582a2-kube-api-access-v4n7p\") pod \"network-check-target-s7p22\" (UID: \"4fef731a-4dcc-40e0-843f-1ca10f3582a2\") " pod="openshift-network-diagnostics/network-check-target-s7p22" Jun 08 13:43:07.503043 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.502958 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/342c05fc-285c-48e3-8a00-f2e2acba80cb-sys\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.503043 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.502980 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2876x\" (UniqueName: \"kubernetes.io/projected/342c05fc-285c-48e3-8a00-f2e2acba80cb-kube-api-access-2876x\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.503043 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503001 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-host-run-netns\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.503043 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503029 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-host-run-netns\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.503258 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503054 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/42ec3ccf-8ea7-4b23-810a-59696755f5ca-agent-certs\") pod \"konnectivity-agent-2fw8m\" (UID: \"42ec3ccf-8ea7-4b23-810a-59696755f5ca\") " pod="kube-system/konnectivity-agent-2fw8m" Jun 08 13:43:07.503258 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503076 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-run-openvswitch\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.503258 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503101 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-host-run-multus-certs\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.503258 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503111 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-host-run-netns\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.503258 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503123 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/342c05fc-285c-48e3-8a00-f2e2acba80cb-etc-tuned\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.503258 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503161 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-run-openvswitch\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.503258 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503160 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-host-var-lib-cni-multus\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.503258 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503211 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fee2c359-741b-410b-b948-4772c46daf47-multus-daemon-config\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.503258 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503240 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-etc-kubernetes\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.503585 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503281 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5c017e70-8e4b-413f-9ee8-4d99892258ae-cni-binary-copy\") pod \"multus-additional-cni-plugins-jkjkk\" (UID: \"5c017e70-8e4b-413f-9ee8-4d99892258ae\") " pod="openshift-multus/multus-additional-cni-plugins-jkjkk" Jun 08 13:43:07.503585 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503345 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f4563444-4752-4896-a848-acb40549ebe0-hosts-file\") pod \"node-resolver-qms2k\" (UID: \"f4563444-4752-4896-a848-acb40549ebe0\") " pod="openshift-dns/node-resolver-qms2k" Jun 08 13:43:07.503585 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503370 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4563444-4752-4896-a848-acb40549ebe0-tmp-dir\") pod \"node-resolver-qms2k\" (UID: \"f4563444-4752-4896-a848-acb40549ebe0\") " pod="openshift-dns/node-resolver-qms2k" Jun 08 13:43:07.503585 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503397 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-host-kubelet\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.503585 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503423 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-host-run-ovn-kubernetes\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.503585 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503446 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-host-kubelet\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.503585 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503454 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/342c05fc-285c-48e3-8a00-f2e2acba80cb-etc-modprobe-d\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.503585 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503487 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-host-run-ovn-kubernetes\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.503585 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503506 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fee2c359-741b-410b-b948-4772c46daf47-cni-binary-copy\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.503585 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503521 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5c017e70-8e4b-413f-9ee8-4d99892258ae-cnibin\") pod \"multus-additional-cni-plugins-jkjkk\" (UID: \"5c017e70-8e4b-413f-9ee8-4d99892258ae\") " pod="openshift-multus/multus-additional-cni-plugins-jkjkk" Jun 08 13:43:07.503585 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503529 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 13:43:07.503585 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503538 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50931712-af88-4fe2-b146-0926d8e10b25-metrics-certs\") pod \"network-metrics-daemon-6zmwj\" (UID: \"50931712-af88-4fe2-b146-0926d8e10b25\") " pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:43:07.503585 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503569 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlvsc\" (UniqueName: \"kubernetes.io/projected/50931712-af88-4fe2-b146-0926d8e10b25-kube-api-access-xlvsc\") pod \"network-metrics-daemon-6zmwj\" (UID: \"50931712-af88-4fe2-b146-0926d8e10b25\") " pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:43:07.504170 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503594 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.504170 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503626 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.504170 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503629 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f51689fd-918d-4af0-8083-178dbe60a4d9-ovnkube-script-lib\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.504170 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503657 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/342c05fc-285c-48e3-8a00-f2e2acba80cb-etc-sysctl-conf\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.504170 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503772 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/67f780b7-2628-49ac-a25e-454ae247a3a0-socket-dir\") pod \"aws-ebs-csi-driver-node-qv8nt\" (UID: \"67f780b7-2628-49ac-a25e-454ae247a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv8nt" Jun 08 13:43:07.504170 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503807 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f51689fd-918d-4af0-8083-178dbe60a4d9-ovn-node-metrics-cert\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.504170 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503834 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9f80246c-3dde-4a76-a65e-da7a5dc1732f-iptables-alerter-script\") pod \"iptables-alerter-qzp5m\" (UID: \"9f80246c-3dde-4a76-a65e-da7a5dc1732f\") " pod="openshift-network-operator/iptables-alerter-qzp5m" Jun 08 13:43:07.504170 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503857 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/342c05fc-285c-48e3-8a00-f2e2acba80cb-var-lib-kubelet\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.504170 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503879 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-multus-conf-dir\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.504170 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.503914 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-var-lib-openvswitch\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.504849 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.504195 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f51689fd-918d-4af0-8083-178dbe60a4d9-ovnkube-script-lib\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.504849 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.504259 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-etc-openvswitch\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.504849 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.504291 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f51689fd-918d-4af0-8083-178dbe60a4d9-env-overrides\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.504849 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.504352 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-etc-openvswitch\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.504849 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.504382 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/342c05fc-285c-48e3-8a00-f2e2acba80cb-run\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.504849 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.504407 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/342c05fc-285c-48e3-8a00-f2e2acba80cb-lib-modules\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.504849 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.504431 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/342c05fc-285c-48e3-8a00-f2e2acba80cb-tmp\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.504849 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.504466 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-system-cni-dir\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.504849 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.504490 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-multus-cni-dir\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.504849 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.504516 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f80246c-3dde-4a76-a65e-da7a5dc1732f-host-slash\") pod \"iptables-alerter-qzp5m\" (UID: \"9f80246c-3dde-4a76-a65e-da7a5dc1732f\") " pod="openshift-network-operator/iptables-alerter-qzp5m" Jun 08 13:43:07.504849 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.504517 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9f80246c-3dde-4a76-a65e-da7a5dc1732f-iptables-alerter-script\") pod \"iptables-alerter-qzp5m\" (UID: \"9f80246c-3dde-4a76-a65e-da7a5dc1732f\") " pod="openshift-network-operator/iptables-alerter-qzp5m" Jun 08 13:43:07.504849 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.504540 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-host-cni-netd\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.504849 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.504555 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-var-lib-openvswitch\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.504849 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.504595 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/342c05fc-285c-48e3-8a00-f2e2acba80cb-etc-systemd\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.504849 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.504618 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-hostroot\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.504849 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.504643 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c017e70-8e4b-413f-9ee8-4d99892258ae-system-cni-dir\") pod \"multus-additional-cni-plugins-jkjkk\" (UID: \"5c017e70-8e4b-413f-9ee8-4d99892258ae\") " pod="openshift-multus/multus-additional-cni-plugins-jkjkk" Jun 08 13:43:07.504849 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.504677 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-host-cni-netd\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.505606 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.504711 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5c017e70-8e4b-413f-9ee8-4d99892258ae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jkjkk\" (UID: \"5c017e70-8e4b-413f-9ee8-4d99892258ae\") " pod="openshift-multus/multus-additional-cni-plugins-jkjkk" Jun 08 13:43:07.505606 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.504744 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f80246c-3dde-4a76-a65e-da7a5dc1732f-host-slash\") pod \"iptables-alerter-qzp5m\" (UID: \"9f80246c-3dde-4a76-a65e-da7a5dc1732f\") " pod="openshift-network-operator/iptables-alerter-qzp5m" Jun 08 13:43:07.505606 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.504814 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/67f780b7-2628-49ac-a25e-454ae247a3a0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qv8nt\" (UID: \"67f780b7-2628-49ac-a25e-454ae247a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv8nt" Jun 08 13:43:07.505606 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.504841 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/67f780b7-2628-49ac-a25e-454ae247a3a0-etc-selinux\") pod \"aws-ebs-csi-driver-node-qv8nt\" (UID: \"67f780b7-2628-49ac-a25e-454ae247a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv8nt" Jun 08 13:43:07.505606 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.504865 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-os-release\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.505606 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.504891 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-host-slash\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.505606 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.504917 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-host-cni-bin\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.505606 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.504938 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f51689fd-918d-4af0-8083-178dbe60a4d9-ovnkube-config\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.505606 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.504954 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f51689fd-918d-4af0-8083-178dbe60a4d9-env-overrides\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.505606 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.504964 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjpmp\" (UniqueName: \"kubernetes.io/projected/f51689fd-918d-4af0-8083-178dbe60a4d9-kube-api-access-rjpmp\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.505606 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.504990 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-host-slash\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.505606 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.504998 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/342c05fc-285c-48e3-8a00-f2e2acba80cb-etc-sysconfig\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.505606 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505021 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/342c05fc-285c-48e3-8a00-f2e2acba80cb-etc-sysctl-d\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.505606 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505030 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-host-cni-bin\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.505606 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505049 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/42ec3ccf-8ea7-4b23-810a-59696755f5ca-konnectivity-ca\") pod \"konnectivity-agent-2fw8m\" (UID: \"42ec3ccf-8ea7-4b23-810a-59696755f5ca\") " pod="kube-system/konnectivity-agent-2fw8m" Jun 08 13:43:07.505606 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505072 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-run-ovn\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.505606 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505097 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/43325f79-05b7-4adc-b726-9dbf5b9e5b68-kubelet-config\") pod \"global-pull-secret-syncer-kzr55\" (UID: \"43325f79-05b7-4adc-b726-9dbf5b9e5b68\") " pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:43:07.506432 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505121 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bf0a4a64-6cd7-489d-8aa8-635b662f64e9-serviceca\") pod \"node-ca-55c2s\" (UID: \"bf0a4a64-6cd7-489d-8aa8-635b662f64e9\") " pod="openshift-image-registry/node-ca-55c2s" Jun 08 13:43:07.506432 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505157 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w2mm\" (UniqueName: \"kubernetes.io/projected/fee2c359-741b-410b-b948-4772c46daf47-kube-api-access-4w2mm\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.506432 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505182 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5c017e70-8e4b-413f-9ee8-4d99892258ae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jkjkk\" (UID: \"5c017e70-8e4b-413f-9ee8-4d99892258ae\") " pod="openshift-multus/multus-additional-cni-plugins-jkjkk" Jun 08 13:43:07.506432 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505208 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqmxl\" (UniqueName: \"kubernetes.io/projected/5c017e70-8e4b-413f-9ee8-4d99892258ae-kube-api-access-sqmxl\") pod \"multus-additional-cni-plugins-jkjkk\" (UID: \"5c017e70-8e4b-413f-9ee8-4d99892258ae\") " pod="openshift-multus/multus-additional-cni-plugins-jkjkk" Jun 08 13:43:07.506432 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505232 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-systemd-units\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.506432 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505256 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-host-run-k8s-cni-cncf-io\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.506432 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505279 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-host-var-lib-cni-bin\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.506432 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505301 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5c017e70-8e4b-413f-9ee8-4d99892258ae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jkjkk\" (UID: \"5c017e70-8e4b-413f-9ee8-4d99892258ae\") " pod="openshift-multus/multus-additional-cni-plugins-jkjkk" Jun 08 13:43:07.506432 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505335 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-run-systemd\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.506432 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505358 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/43325f79-05b7-4adc-b726-9dbf5b9e5b68-dbus\") pod \"global-pull-secret-syncer-kzr55\" (UID: \"43325f79-05b7-4adc-b726-9dbf5b9e5b68\") " pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:43:07.506432 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505357 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f51689fd-918d-4af0-8083-178dbe60a4d9-ovnkube-config\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.506432 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505386 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43325f79-05b7-4adc-b726-9dbf5b9e5b68-original-pull-secret\") pod \"global-pull-secret-syncer-kzr55\" (UID: \"43325f79-05b7-4adc-b726-9dbf5b9e5b68\") " pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:43:07.506432 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505407 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-run-ovn\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.506432 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505409 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-host-var-lib-kubelet\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.506432 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505435 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-systemd-units\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.506432 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505434 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwpz7\" (UniqueName: \"kubernetes.io/projected/f4563444-4752-4896-a848-acb40549ebe0-kube-api-access-zwpz7\") pod \"node-resolver-qms2k\" (UID: \"f4563444-4752-4896-a848-acb40549ebe0\") " pod="openshift-dns/node-resolver-qms2k" Jun 08 13:43:07.506432 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505477 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/43325f79-05b7-4adc-b726-9dbf5b9e5b68-kubelet-config\") pod \"global-pull-secret-syncer-kzr55\" (UID: \"43325f79-05b7-4adc-b726-9dbf5b9e5b68\") " pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:43:07.507038 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505469 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/342c05fc-285c-48e3-8a00-f2e2acba80cb-host\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.507038 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:07.505553 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:43:07.507038 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505561 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/67f780b7-2628-49ac-a25e-454ae247a3a0-device-dir\") pod \"aws-ebs-csi-driver-node-qv8nt\" (UID: \"67f780b7-2628-49ac-a25e-454ae247a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv8nt" Jun 08 13:43:07.507038 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505590 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-log-socket\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.507038 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:07.505613 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43325f79-05b7-4adc-b726-9dbf5b9e5b68-original-pull-secret podName:43325f79-05b7-4adc-b726-9dbf5b9e5b68 nodeName:}" failed. No retries permitted until 2026-06-08 13:43:08.00558692 +0000 UTC m=+1.986615167 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43325f79-05b7-4adc-b726-9dbf5b9e5b68-original-pull-secret") pod "global-pull-secret-syncer-kzr55" (UID: "43325f79-05b7-4adc-b726-9dbf5b9e5b68") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:43:07.507038 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505631 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/342c05fc-285c-48e3-8a00-f2e2acba80cb-etc-kubernetes\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.507038 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505647 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-multus-socket-dir-parent\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.507038 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505647 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-log-socket\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.507038 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505662 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/67f780b7-2628-49ac-a25e-454ae247a3a0-sys-fs\") pod \"aws-ebs-csi-driver-node-qv8nt\" (UID: \"67f780b7-2628-49ac-a25e-454ae247a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv8nt" Jun 08 13:43:07.507038 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505666 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/42ec3ccf-8ea7-4b23-810a-59696755f5ca-konnectivity-ca\") pod \"konnectivity-agent-2fw8m\" (UID: \"42ec3ccf-8ea7-4b23-810a-59696755f5ca\") " pod="kube-system/konnectivity-agent-2fw8m" Jun 08 13:43:07.507038 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505680 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-run-systemd\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.507038 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505727 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jqr9\" (UniqueName: \"kubernetes.io/projected/67f780b7-2628-49ac-a25e-454ae247a3a0-kube-api-access-4jqr9\") pod \"aws-ebs-csi-driver-node-qv8nt\" (UID: \"67f780b7-2628-49ac-a25e-454ae247a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv8nt" Jun 08 13:43:07.507038 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505754 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8rj2\" (UniqueName: \"kubernetes.io/projected/9f80246c-3dde-4a76-a65e-da7a5dc1732f-kube-api-access-n8rj2\") pod \"iptables-alerter-qzp5m\" (UID: \"9f80246c-3dde-4a76-a65e-da7a5dc1732f\") " pod="openshift-network-operator/iptables-alerter-qzp5m" Jun 08 13:43:07.507038 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505777 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/43325f79-05b7-4adc-b726-9dbf5b9e5b68-dbus\") pod \"global-pull-secret-syncer-kzr55\" (UID: \"43325f79-05b7-4adc-b726-9dbf5b9e5b68\") " pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:43:07.507038 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505801 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf0a4a64-6cd7-489d-8aa8-635b662f64e9-host\") pod \"node-ca-55c2s\" (UID: \"bf0a4a64-6cd7-489d-8aa8-635b662f64e9\") " pod="openshift-image-registry/node-ca-55c2s" Jun 08 13:43:07.507038 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505908 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-cnibin\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.507038 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505937 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-node-log\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.507578 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505969 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5w5w\" (UniqueName: \"kubernetes.io/projected/bf0a4a64-6cd7-489d-8aa8-635b662f64e9-kube-api-access-d5w5w\") pod \"node-ca-55c2s\" (UID: \"bf0a4a64-6cd7-489d-8aa8-635b662f64e9\") " pod="openshift-image-registry/node-ca-55c2s" Jun 08 13:43:07.507578 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.505997 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f51689fd-918d-4af0-8083-178dbe60a4d9-node-log\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.507578 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.506030 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5c017e70-8e4b-413f-9ee8-4d99892258ae-os-release\") pod \"multus-additional-cni-plugins-jkjkk\" (UID: \"5c017e70-8e4b-413f-9ee8-4d99892258ae\") " pod="openshift-multus/multus-additional-cni-plugins-jkjkk" Jun 08 13:43:07.507578 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.506058 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/67f780b7-2628-49ac-a25e-454ae247a3a0-registration-dir\") pod \"aws-ebs-csi-driver-node-qv8nt\" (UID: \"67f780b7-2628-49ac-a25e-454ae247a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv8nt" Jun 08 13:43:07.507578 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.506688 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f51689fd-918d-4af0-8083-178dbe60a4d9-ovn-node-metrics-cert\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.507578 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.506723 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/42ec3ccf-8ea7-4b23-810a-59696755f5ca-agent-certs\") pod \"konnectivity-agent-2fw8m\" (UID: \"42ec3ccf-8ea7-4b23-810a-59696755f5ca\") " pod="kube-system/konnectivity-agent-2fw8m" Jun 08 13:43:07.512868 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.512845 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjpmp\" (UniqueName: \"kubernetes.io/projected/f51689fd-918d-4af0-8083-178dbe60a4d9-kube-api-access-rjpmp\") pod \"ovnkube-node-lx4dj\" (UID: \"f51689fd-918d-4af0-8083-178dbe60a4d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.513174 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.513158 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8rj2\" (UniqueName: \"kubernetes.io/projected/9f80246c-3dde-4a76-a65e-da7a5dc1732f-kube-api-access-n8rj2\") pod \"iptables-alerter-qzp5m\" (UID: \"9f80246c-3dde-4a76-a65e-da7a5dc1732f\") " pod="openshift-network-operator/iptables-alerter-qzp5m" Jun 08 13:43:07.606494 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.606468 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/67f780b7-2628-49ac-a25e-454ae247a3a0-device-dir\") pod \"aws-ebs-csi-driver-node-qv8nt\" (UID: \"67f780b7-2628-49ac-a25e-454ae247a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv8nt" Jun 08 13:43:07.606571 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.606499 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/342c05fc-285c-48e3-8a00-f2e2acba80cb-etc-kubernetes\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.606571 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.606517 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-multus-socket-dir-parent\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.606571 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.606532 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/67f780b7-2628-49ac-a25e-454ae247a3a0-sys-fs\") pod \"aws-ebs-csi-driver-node-qv8nt\" (UID: \"67f780b7-2628-49ac-a25e-454ae247a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv8nt" Jun 08 13:43:07.606571 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.606548 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jqr9\" (UniqueName: \"kubernetes.io/projected/67f780b7-2628-49ac-a25e-454ae247a3a0-kube-api-access-4jqr9\") pod \"aws-ebs-csi-driver-node-qv8nt\" (UID: \"67f780b7-2628-49ac-a25e-454ae247a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv8nt" Jun 08 13:43:07.606571 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.606568 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf0a4a64-6cd7-489d-8aa8-635b662f64e9-host\") pod \"node-ca-55c2s\" (UID: \"bf0a4a64-6cd7-489d-8aa8-635b662f64e9\") " pod="openshift-image-registry/node-ca-55c2s" Jun 08 13:43:07.606756 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.606577 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/67f780b7-2628-49ac-a25e-454ae247a3a0-device-dir\") pod \"aws-ebs-csi-driver-node-qv8nt\" (UID: \"67f780b7-2628-49ac-a25e-454ae247a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv8nt" Jun 08 13:43:07.606756 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.606590 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-cnibin\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.606756 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.606599 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/342c05fc-285c-48e3-8a00-f2e2acba80cb-etc-kubernetes\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.606756 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.606599 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-multus-socket-dir-parent\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.606756 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.606630 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/67f780b7-2628-49ac-a25e-454ae247a3a0-sys-fs\") pod \"aws-ebs-csi-driver-node-qv8nt\" (UID: \"67f780b7-2628-49ac-a25e-454ae247a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv8nt" Jun 08 13:43:07.606756 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.606635 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf0a4a64-6cd7-489d-8aa8-635b662f64e9-host\") pod \"node-ca-55c2s\" (UID: \"bf0a4a64-6cd7-489d-8aa8-635b662f64e9\") " pod="openshift-image-registry/node-ca-55c2s" Jun 08 13:43:07.607066 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.606783 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-cnibin\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.607066 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.606793 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5w5w\" (UniqueName: \"kubernetes.io/projected/bf0a4a64-6cd7-489d-8aa8-635b662f64e9-kube-api-access-d5w5w\") pod \"node-ca-55c2s\" (UID: \"bf0a4a64-6cd7-489d-8aa8-635b662f64e9\") " pod="openshift-image-registry/node-ca-55c2s" Jun 08 13:43:07.607066 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.606828 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5c017e70-8e4b-413f-9ee8-4d99892258ae-os-release\") pod \"multus-additional-cni-plugins-jkjkk\" (UID: \"5c017e70-8e4b-413f-9ee8-4d99892258ae\") " pod="openshift-multus/multus-additional-cni-plugins-jkjkk" Jun 08 13:43:07.607066 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.606851 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/67f780b7-2628-49ac-a25e-454ae247a3a0-registration-dir\") pod \"aws-ebs-csi-driver-node-qv8nt\" (UID: \"67f780b7-2628-49ac-a25e-454ae247a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv8nt" Jun 08 13:43:07.607066 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.606876 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4n7p\" (UniqueName: \"kubernetes.io/projected/4fef731a-4dcc-40e0-843f-1ca10f3582a2-kube-api-access-v4n7p\") pod \"network-check-target-s7p22\" (UID: \"4fef731a-4dcc-40e0-843f-1ca10f3582a2\") " pod="openshift-network-diagnostics/network-check-target-s7p22" Jun 08 13:43:07.607066 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.606899 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/342c05fc-285c-48e3-8a00-f2e2acba80cb-sys\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.607066 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.606918 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/67f780b7-2628-49ac-a25e-454ae247a3a0-registration-dir\") pod \"aws-ebs-csi-driver-node-qv8nt\" (UID: \"67f780b7-2628-49ac-a25e-454ae247a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv8nt" Jun 08 13:43:07.607066 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.606928 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5c017e70-8e4b-413f-9ee8-4d99892258ae-os-release\") pod \"multus-additional-cni-plugins-jkjkk\" (UID: \"5c017e70-8e4b-413f-9ee8-4d99892258ae\") " pod="openshift-multus/multus-additional-cni-plugins-jkjkk" Jun 08 13:43:07.607066 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.606924 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2876x\" (UniqueName: \"kubernetes.io/projected/342c05fc-285c-48e3-8a00-f2e2acba80cb-kube-api-access-2876x\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.607066 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.606949 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/342c05fc-285c-48e3-8a00-f2e2acba80cb-sys\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.607066 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.606972 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-host-run-netns\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.607066 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607003 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-host-run-multus-certs\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.607066 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607020 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/342c05fc-285c-48e3-8a00-f2e2acba80cb-etc-tuned\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.607066 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607035 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-host-var-lib-cni-multus\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.607066 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607051 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fee2c359-741b-410b-b948-4772c46daf47-multus-daemon-config\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.607066 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607059 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-host-run-netns\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.607727 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607095 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-host-var-lib-cni-multus\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.607727 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607107 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-host-run-multus-certs\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.607727 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607138 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-etc-kubernetes\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.607727 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607165 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5c017e70-8e4b-413f-9ee8-4d99892258ae-cni-binary-copy\") pod \"multus-additional-cni-plugins-jkjkk\" (UID: \"5c017e70-8e4b-413f-9ee8-4d99892258ae\") " pod="openshift-multus/multus-additional-cni-plugins-jkjkk" Jun 08 13:43:07.607727 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607201 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-etc-kubernetes\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.607727 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607206 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f4563444-4752-4896-a848-acb40549ebe0-hosts-file\") pod \"node-resolver-qms2k\" (UID: \"f4563444-4752-4896-a848-acb40549ebe0\") " pod="openshift-dns/node-resolver-qms2k" Jun 08 13:43:07.607727 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607231 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4563444-4752-4896-a848-acb40549ebe0-tmp-dir\") pod \"node-resolver-qms2k\" (UID: \"f4563444-4752-4896-a848-acb40549ebe0\") " pod="openshift-dns/node-resolver-qms2k" Jun 08 13:43:07.607727 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607256 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/342c05fc-285c-48e3-8a00-f2e2acba80cb-etc-modprobe-d\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.607727 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607261 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f4563444-4752-4896-a848-acb40549ebe0-hosts-file\") pod \"node-resolver-qms2k\" (UID: \"f4563444-4752-4896-a848-acb40549ebe0\") " pod="openshift-dns/node-resolver-qms2k" Jun 08 13:43:07.607727 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607279 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fee2c359-741b-410b-b948-4772c46daf47-cni-binary-copy\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.607727 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607302 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5c017e70-8e4b-413f-9ee8-4d99892258ae-cnibin\") pod \"multus-additional-cni-plugins-jkjkk\" (UID: \"5c017e70-8e4b-413f-9ee8-4d99892258ae\") " pod="openshift-multus/multus-additional-cni-plugins-jkjkk" Jun 08 13:43:07.607727 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607376 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50931712-af88-4fe2-b146-0926d8e10b25-metrics-certs\") pod \"network-metrics-daemon-6zmwj\" (UID: \"50931712-af88-4fe2-b146-0926d8e10b25\") " pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:43:07.607727 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607380 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/342c05fc-285c-48e3-8a00-f2e2acba80cb-etc-modprobe-d\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.607727 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607402 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlvsc\" (UniqueName: \"kubernetes.io/projected/50931712-af88-4fe2-b146-0926d8e10b25-kube-api-access-xlvsc\") pod \"network-metrics-daemon-6zmwj\" (UID: \"50931712-af88-4fe2-b146-0926d8e10b25\") " pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:43:07.607727 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607427 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5c017e70-8e4b-413f-9ee8-4d99892258ae-cnibin\") pod \"multus-additional-cni-plugins-jkjkk\" (UID: \"5c017e70-8e4b-413f-9ee8-4d99892258ae\") " pod="openshift-multus/multus-additional-cni-plugins-jkjkk" Jun 08 13:43:07.607727 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607428 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/342c05fc-285c-48e3-8a00-f2e2acba80cb-etc-sysctl-conf\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.607727 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:07.607470 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:43:07.608440 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:07.607518 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50931712-af88-4fe2-b146-0926d8e10b25-metrics-certs podName:50931712-af88-4fe2-b146-0926d8e10b25 nodeName:}" failed. No retries permitted until 2026-06-08 13:43:08.107501711 +0000 UTC m=+2.088529973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50931712-af88-4fe2-b146-0926d8e10b25-metrics-certs") pod "network-metrics-daemon-6zmwj" (UID: "50931712-af88-4fe2-b146-0926d8e10b25") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:43:07.608440 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607525 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/342c05fc-285c-48e3-8a00-f2e2acba80cb-etc-sysctl-conf\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.608440 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607569 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4563444-4752-4896-a848-acb40549ebe0-tmp-dir\") pod \"node-resolver-qms2k\" (UID: \"f4563444-4752-4896-a848-acb40549ebe0\") " pod="openshift-dns/node-resolver-qms2k" Jun 08 13:43:07.608440 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607608 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fee2c359-741b-410b-b948-4772c46daf47-multus-daemon-config\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.608440 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607471 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/67f780b7-2628-49ac-a25e-454ae247a3a0-socket-dir\") pod \"aws-ebs-csi-driver-node-qv8nt\" (UID: \"67f780b7-2628-49ac-a25e-454ae247a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv8nt" Jun 08 13:43:07.608440 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607671 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/342c05fc-285c-48e3-8a00-f2e2acba80cb-var-lib-kubelet\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.608440 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607692 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-multus-conf-dir\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.608440 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607710 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/342c05fc-285c-48e3-8a00-f2e2acba80cb-run\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.608440 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607743 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5c017e70-8e4b-413f-9ee8-4d99892258ae-cni-binary-copy\") pod \"multus-additional-cni-plugins-jkjkk\" (UID: \"5c017e70-8e4b-413f-9ee8-4d99892258ae\") " pod="openshift-multus/multus-additional-cni-plugins-jkjkk" Jun 08 13:43:07.608440 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607748 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/342c05fc-285c-48e3-8a00-f2e2acba80cb-lib-modules\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.608440 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607786 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/342c05fc-285c-48e3-8a00-f2e2acba80cb-var-lib-kubelet\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.608440 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607804 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/342c05fc-285c-48e3-8a00-f2e2acba80cb-tmp\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.608440 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607821 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-system-cni-dir\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.608440 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607822 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/342c05fc-285c-48e3-8a00-f2e2acba80cb-run\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.608440 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607774 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fee2c359-741b-410b-b948-4772c46daf47-cni-binary-copy\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.608440 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607854 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/342c05fc-285c-48e3-8a00-f2e2acba80cb-lib-modules\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.608440 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607893 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-system-cni-dir\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.609284 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607978 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-multus-cni-dir\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.609284 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607779 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-multus-conf-dir\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.609284 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608249 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/67f780b7-2628-49ac-a25e-454ae247a3a0-socket-dir\") pod \"aws-ebs-csi-driver-node-qv8nt\" (UID: \"67f780b7-2628-49ac-a25e-454ae247a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv8nt" Jun 08 13:43:07.609284 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.607837 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-multus-cni-dir\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.609284 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608308 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/342c05fc-285c-48e3-8a00-f2e2acba80cb-etc-systemd\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.609284 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608333 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-hostroot\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.609284 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608347 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c017e70-8e4b-413f-9ee8-4d99892258ae-system-cni-dir\") pod \"multus-additional-cni-plugins-jkjkk\" (UID: \"5c017e70-8e4b-413f-9ee8-4d99892258ae\") " pod="openshift-multus/multus-additional-cni-plugins-jkjkk" Jun 08 13:43:07.609284 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608364 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5c017e70-8e4b-413f-9ee8-4d99892258ae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jkjkk\" (UID: \"5c017e70-8e4b-413f-9ee8-4d99892258ae\") " pod="openshift-multus/multus-additional-cni-plugins-jkjkk" Jun 08 13:43:07.609284 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608387 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-hostroot\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.609284 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608388 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/67f780b7-2628-49ac-a25e-454ae247a3a0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qv8nt\" (UID: \"67f780b7-2628-49ac-a25e-454ae247a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv8nt" Jun 08 13:43:07.609284 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608400 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c017e70-8e4b-413f-9ee8-4d99892258ae-system-cni-dir\") pod \"multus-additional-cni-plugins-jkjkk\" (UID: \"5c017e70-8e4b-413f-9ee8-4d99892258ae\") " pod="openshift-multus/multus-additional-cni-plugins-jkjkk" Jun 08 13:43:07.609284 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608421 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/67f780b7-2628-49ac-a25e-454ae247a3a0-etc-selinux\") pod \"aws-ebs-csi-driver-node-qv8nt\" (UID: \"67f780b7-2628-49ac-a25e-454ae247a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv8nt" Jun 08 13:43:07.609284 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608426 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/67f780b7-2628-49ac-a25e-454ae247a3a0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qv8nt\" (UID: \"67f780b7-2628-49ac-a25e-454ae247a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv8nt" Jun 08 13:43:07.609284 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608425 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/342c05fc-285c-48e3-8a00-f2e2acba80cb-etc-systemd\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.609284 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608448 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-os-release\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.609284 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608496 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/67f780b7-2628-49ac-a25e-454ae247a3a0-etc-selinux\") pod \"aws-ebs-csi-driver-node-qv8nt\" (UID: \"67f780b7-2628-49ac-a25e-454ae247a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv8nt" Jun 08 13:43:07.609284 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608510 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-os-release\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.609284 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608500 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/342c05fc-285c-48e3-8a00-f2e2acba80cb-etc-sysconfig\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.610059 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608542 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/342c05fc-285c-48e3-8a00-f2e2acba80cb-etc-sysctl-d\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.610059 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608546 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/342c05fc-285c-48e3-8a00-f2e2acba80cb-etc-sysconfig\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.610059 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608572 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bf0a4a64-6cd7-489d-8aa8-635b662f64e9-serviceca\") pod \"node-ca-55c2s\" (UID: \"bf0a4a64-6cd7-489d-8aa8-635b662f64e9\") " pod="openshift-image-registry/node-ca-55c2s" Jun 08 13:43:07.610059 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608603 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w2mm\" (UniqueName: \"kubernetes.io/projected/fee2c359-741b-410b-b948-4772c46daf47-kube-api-access-4w2mm\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.610059 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608628 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5c017e70-8e4b-413f-9ee8-4d99892258ae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jkjkk\" (UID: \"5c017e70-8e4b-413f-9ee8-4d99892258ae\") " pod="openshift-multus/multus-additional-cni-plugins-jkjkk" Jun 08 13:43:07.610059 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608653 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqmxl\" (UniqueName: \"kubernetes.io/projected/5c017e70-8e4b-413f-9ee8-4d99892258ae-kube-api-access-sqmxl\") pod \"multus-additional-cni-plugins-jkjkk\" (UID: \"5c017e70-8e4b-413f-9ee8-4d99892258ae\") " pod="openshift-multus/multus-additional-cni-plugins-jkjkk" Jun 08 13:43:07.610059 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608680 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-host-run-k8s-cni-cncf-io\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.610059 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608703 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-host-var-lib-cni-bin\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.610059 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608727 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5c017e70-8e4b-413f-9ee8-4d99892258ae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jkjkk\" (UID: \"5c017e70-8e4b-413f-9ee8-4d99892258ae\") " pod="openshift-multus/multus-additional-cni-plugins-jkjkk" Jun 08 13:43:07.610059 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608780 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-host-var-lib-kubelet\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.610059 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608805 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwpz7\" (UniqueName: \"kubernetes.io/projected/f4563444-4752-4896-a848-acb40549ebe0-kube-api-access-zwpz7\") pod \"node-resolver-qms2k\" (UID: \"f4563444-4752-4896-a848-acb40549ebe0\") " pod="openshift-dns/node-resolver-qms2k" Jun 08 13:43:07.610059 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608826 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/342c05fc-285c-48e3-8a00-f2e2acba80cb-host\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.610059 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608846 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5c017e70-8e4b-413f-9ee8-4d99892258ae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jkjkk\" (UID: \"5c017e70-8e4b-413f-9ee8-4d99892258ae\") " pod="openshift-multus/multus-additional-cni-plugins-jkjkk" Jun 08 13:43:07.610059 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608861 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-host-run-k8s-cni-cncf-io\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.610059 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608605 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/342c05fc-285c-48e3-8a00-f2e2acba80cb-etc-sysctl-d\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.610059 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608900 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/342c05fc-285c-48e3-8a00-f2e2acba80cb-host\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.610059 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608910 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-host-var-lib-cni-bin\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.610516 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608947 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fee2c359-741b-410b-b948-4772c46daf47-host-var-lib-kubelet\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.610516 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.608992 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bf0a4a64-6cd7-489d-8aa8-635b662f64e9-serviceca\") pod \"node-ca-55c2s\" (UID: \"bf0a4a64-6cd7-489d-8aa8-635b662f64e9\") " pod="openshift-image-registry/node-ca-55c2s" Jun 08 13:43:07.610516 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.609043 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5c017e70-8e4b-413f-9ee8-4d99892258ae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jkjkk\" (UID: \"5c017e70-8e4b-413f-9ee8-4d99892258ae\") " pod="openshift-multus/multus-additional-cni-plugins-jkjkk" Jun 08 13:43:07.610516 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.609258 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/342c05fc-285c-48e3-8a00-f2e2acba80cb-etc-tuned\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.610516 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.609326 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5c017e70-8e4b-413f-9ee8-4d99892258ae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jkjkk\" (UID: \"5c017e70-8e4b-413f-9ee8-4d99892258ae\") " pod="openshift-multus/multus-additional-cni-plugins-jkjkk" Jun 08 13:43:07.610516 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.609984 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/342c05fc-285c-48e3-8a00-f2e2acba80cb-tmp\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.613323 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:07.613305 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:43:07.613323 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:07.613325 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:43:07.613485 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:07.613336 2561 projected.go:196] Error preparing data for projected volume kube-api-access-v4n7p for pod openshift-network-diagnostics/network-check-target-s7p22: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:43:07.613485 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:07.613385 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4fef731a-4dcc-40e0-843f-1ca10f3582a2-kube-api-access-v4n7p podName:4fef731a-4dcc-40e0-843f-1ca10f3582a2 nodeName:}" failed. No retries permitted until 2026-06-08 13:43:08.113370563 +0000 UTC m=+2.094398822 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-v4n7p" (UniqueName: "kubernetes.io/projected/4fef731a-4dcc-40e0-843f-1ca10f3582a2-kube-api-access-v4n7p") pod "network-check-target-s7p22" (UID: "4fef731a-4dcc-40e0-843f-1ca10f3582a2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:43:07.615127 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.615101 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2876x\" (UniqueName: \"kubernetes.io/projected/342c05fc-285c-48e3-8a00-f2e2acba80cb-kube-api-access-2876x\") pod \"tuned-fh86q\" (UID: \"342c05fc-285c-48e3-8a00-f2e2acba80cb\") " pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.618917 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.616168 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5w5w\" (UniqueName: \"kubernetes.io/projected/bf0a4a64-6cd7-489d-8aa8-635b662f64e9-kube-api-access-d5w5w\") pod \"node-ca-55c2s\" (UID: \"bf0a4a64-6cd7-489d-8aa8-635b662f64e9\") " pod="openshift-image-registry/node-ca-55c2s" Jun 08 13:43:07.618917 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.616377 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jqr9\" (UniqueName: \"kubernetes.io/projected/67f780b7-2628-49ac-a25e-454ae247a3a0-kube-api-access-4jqr9\") pod \"aws-ebs-csi-driver-node-qv8nt\" (UID: \"67f780b7-2628-49ac-a25e-454ae247a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv8nt" Jun 08 13:43:07.618917 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.616739 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlvsc\" (UniqueName: \"kubernetes.io/projected/50931712-af88-4fe2-b146-0926d8e10b25-kube-api-access-xlvsc\") pod \"network-metrics-daemon-6zmwj\" (UID: \"50931712-af88-4fe2-b146-0926d8e10b25\") " pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:43:07.618917 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.617360 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwpz7\" (UniqueName: \"kubernetes.io/projected/f4563444-4752-4896-a848-acb40549ebe0-kube-api-access-zwpz7\") pod \"node-resolver-qms2k\" (UID: \"f4563444-4752-4896-a848-acb40549ebe0\") " pod="openshift-dns/node-resolver-qms2k" Jun 08 13:43:07.619948 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.619926 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w2mm\" (UniqueName: \"kubernetes.io/projected/fee2c359-741b-410b-b948-4772c46daf47-kube-api-access-4w2mm\") pod \"multus-vlwt4\" (UID: \"fee2c359-741b-410b-b948-4772c46daf47\") " pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.620306 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.620289 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqmxl\" (UniqueName: \"kubernetes.io/projected/5c017e70-8e4b-413f-9ee8-4d99892258ae-kube-api-access-sqmxl\") pod \"multus-additional-cni-plugins-jkjkk\" (UID: \"5c017e70-8e4b-413f-9ee8-4d99892258ae\") " pod="openshift-multus/multus-additional-cni-plugins-jkjkk" Jun 08 13:43:07.720304 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.720251 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qzp5m" Jun 08 13:43:07.729276 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:07.729254 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f80246c_3dde_4a76_a65e_da7a5dc1732f.slice/crio-e9677b20b123f65b1336390382cb9d88af6a716be23975872b28adb1e9807256 WatchSource:0}: Error finding container e9677b20b123f65b1336390382cb9d88af6a716be23975872b28adb1e9807256: Status 404 returned error can't find the container with id e9677b20b123f65b1336390382cb9d88af6a716be23975872b28adb1e9807256 Jun 08 13:43:07.734076 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.734061 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2fw8m" Jun 08 13:43:07.742797 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:07.742774 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42ec3ccf_8ea7_4b23_810a_59696755f5ca.slice/crio-be89b9a75de11b6057834d04d6edef8216dfac5fc4e80116c38cd127a28d8f44 WatchSource:0}: Error finding container be89b9a75de11b6057834d04d6edef8216dfac5fc4e80116c38cd127a28d8f44: Status 404 returned error can't find the container with id be89b9a75de11b6057834d04d6edef8216dfac5fc4e80116c38cd127a28d8f44 Jun 08 13:43:07.750913 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.750896 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:07.758295 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:07.758276 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf51689fd_918d_4af0_8083_178dbe60a4d9.slice/crio-24bdeb065d3f252fc0647cec035bccb84c7b70251880805eb6f9f0e4ba46a0fb WatchSource:0}: Error finding container 24bdeb065d3f252fc0647cec035bccb84c7b70251880805eb6f9f0e4ba46a0fb: Status 404 returned error can't find the container with id 24bdeb065d3f252fc0647cec035bccb84c7b70251880805eb6f9f0e4ba46a0fb Jun 08 13:43:07.765770 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.765742 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-55c2s" Jun 08 13:43:07.773604 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.773586 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fh86q" Jun 08 13:43:07.773726 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:07.773705 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf0a4a64_6cd7_489d_8aa8_635b662f64e9.slice/crio-58b0afc4fdb2d81893cd8f110419a44f918ffd3c66a0e4a7c924f6e4b3e6dfe2 WatchSource:0}: Error finding container 58b0afc4fdb2d81893cd8f110419a44f918ffd3c66a0e4a7c924f6e4b3e6dfe2: Status 404 returned error can't find the container with id 58b0afc4fdb2d81893cd8f110419a44f918ffd3c66a0e4a7c924f6e4b3e6dfe2 Jun 08 13:43:07.780898 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:07.780879 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod342c05fc_285c_48e3_8a00_f2e2acba80cb.slice/crio-99d29c72c3b08a354b317d981e336fa8d4e4ad998c25e266491df63d88e2b0bb WatchSource:0}: Error finding container 99d29c72c3b08a354b317d981e336fa8d4e4ad998c25e266491df63d88e2b0bb: Status 404 returned error can't find the container with id 99d29c72c3b08a354b317d981e336fa8d4e4ad998c25e266491df63d88e2b0bb Jun 08 13:43:07.789220 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.789203 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qms2k" Jun 08 13:43:07.796445 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:07.796426 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4563444_4752_4896_a848_acb40549ebe0.slice/crio-2c22818903b89757ca279f28600132a6366cff03318d39f01519da8f8f981c91 WatchSource:0}: Error finding container 2c22818903b89757ca279f28600132a6366cff03318d39f01519da8f8f981c91: Status 404 returned error can't find the container with id 2c22818903b89757ca279f28600132a6366cff03318d39f01519da8f8f981c91 Jun 08 13:43:07.797006 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.796990 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vlwt4" Jun 08 13:43:07.801536 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.801520 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jkjkk" Jun 08 13:43:07.804623 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:07.804602 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfee2c359_741b_410b_b948_4772c46daf47.slice/crio-0abdbb6bb0e5da6007142dafa54fbd33c8caaf288f1665eef88f21146f708dcd WatchSource:0}: Error finding container 0abdbb6bb0e5da6007142dafa54fbd33c8caaf288f1665eef88f21146f708dcd: Status 404 returned error can't find the container with id 0abdbb6bb0e5da6007142dafa54fbd33c8caaf288f1665eef88f21146f708dcd Jun 08 13:43:07.806602 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:07.806569 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv8nt" Jun 08 13:43:07.810615 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:07.810594 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c017e70_8e4b_413f_9ee8_4d99892258ae.slice/crio-6cd699d52aea0cb047f9b099f8a7240ef907a25d039b4decd46c58f5117e4045 WatchSource:0}: Error finding container 6cd699d52aea0cb047f9b099f8a7240ef907a25d039b4decd46c58f5117e4045: Status 404 returned error can't find the container with id 6cd699d52aea0cb047f9b099f8a7240ef907a25d039b4decd46c58f5117e4045 Jun 08 13:43:07.815268 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:07.815250 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67f780b7_2628_49ac_a25e_454ae247a3a0.slice/crio-df7d54230e64a7bb68720452970659319753483c0d86bbe3cadbb99356a3615b WatchSource:0}: Error finding container df7d54230e64a7bb68720452970659319753483c0d86bbe3cadbb99356a3615b: Status 404 returned error can't find the container with id df7d54230e64a7bb68720452970659319753483c0d86bbe3cadbb99356a3615b Jun 08 13:43:08.012218 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:08.012136 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43325f79-05b7-4adc-b726-9dbf5b9e5b68-original-pull-secret\") pod \"global-pull-secret-syncer-kzr55\" (UID: \"43325f79-05b7-4adc-b726-9dbf5b9e5b68\") " pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:43:08.012343 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:08.012258 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:43:08.012343 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:08.012321 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43325f79-05b7-4adc-b726-9dbf5b9e5b68-original-pull-secret podName:43325f79-05b7-4adc-b726-9dbf5b9e5b68 nodeName:}" failed. No retries permitted until 2026-06-08 13:43:09.012302769 +0000 UTC m=+2.993331019 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43325f79-05b7-4adc-b726-9dbf5b9e5b68-original-pull-secret") pod "global-pull-secret-syncer-kzr55" (UID: "43325f79-05b7-4adc-b726-9dbf5b9e5b68") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:43:08.113145 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:08.113111 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50931712-af88-4fe2-b146-0926d8e10b25-metrics-certs\") pod \"network-metrics-daemon-6zmwj\" (UID: \"50931712-af88-4fe2-b146-0926d8e10b25\") " pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:43:08.113287 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:08.113247 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:43:08.113347 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:08.113309 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50931712-af88-4fe2-b146-0926d8e10b25-metrics-certs podName:50931712-af88-4fe2-b146-0926d8e10b25 nodeName:}" failed. No retries permitted until 2026-06-08 13:43:09.113289496 +0000 UTC m=+3.094317746 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50931712-af88-4fe2-b146-0926d8e10b25-metrics-certs") pod "network-metrics-daemon-6zmwj" (UID: "50931712-af88-4fe2-b146-0926d8e10b25") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:43:08.214344 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:08.214306 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4n7p\" (UniqueName: \"kubernetes.io/projected/4fef731a-4dcc-40e0-843f-1ca10f3582a2-kube-api-access-v4n7p\") pod \"network-check-target-s7p22\" (UID: \"4fef731a-4dcc-40e0-843f-1ca10f3582a2\") " pod="openshift-network-diagnostics/network-check-target-s7p22" Jun 08 13:43:08.214541 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:08.214524 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:43:08.214616 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:08.214548 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:43:08.214616 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:08.214561 2561 projected.go:196] Error preparing data for projected volume kube-api-access-v4n7p for pod openshift-network-diagnostics/network-check-target-s7p22: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:43:08.214723 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:08.214619 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4fef731a-4dcc-40e0-843f-1ca10f3582a2-kube-api-access-v4n7p podName:4fef731a-4dcc-40e0-843f-1ca10f3582a2 nodeName:}" failed. No retries permitted until 2026-06-08 13:43:09.214601764 +0000 UTC m=+3.195630036 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-v4n7p" (UniqueName: "kubernetes.io/projected/4fef731a-4dcc-40e0-843f-1ca10f3582a2-kube-api-access-v4n7p") pod "network-check-target-s7p22" (UID: "4fef731a-4dcc-40e0-843f-1ca10f3582a2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:43:08.443941 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:08.443832 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 13:38:07 +0000 UTC" deadline="2027-12-07 07:04:03.668325877 +0000 UTC" Jun 08 13:43:08.443941 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:08.443886 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13121h20m55.224443838s" Jun 08 13:43:08.489290 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:08.489204 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2fw8m" event={"ID":"42ec3ccf-8ea7-4b23-810a-59696755f5ca","Type":"ContainerStarted","Data":"be89b9a75de11b6057834d04d6edef8216dfac5fc4e80116c38cd127a28d8f44"} Jun 08 13:43:08.496165 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:08.496136 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal" event={"ID":"851606b6637692164abff23a0059552f","Type":"ContainerStarted","Data":"189e592c38e188dfcd57f4103287949f6c3367c9ba32493f04dbc38013c1e3e0"} Jun 08 13:43:08.514782 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:08.514686 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkjkk" event={"ID":"5c017e70-8e4b-413f-9ee8-4d99892258ae","Type":"ContainerStarted","Data":"6cd699d52aea0cb047f9b099f8a7240ef907a25d039b4decd46c58f5117e4045"} Jun 08 13:43:08.549691 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:08.549659 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vlwt4" event={"ID":"fee2c359-741b-410b-b948-4772c46daf47","Type":"ContainerStarted","Data":"0abdbb6bb0e5da6007142dafa54fbd33c8caaf288f1665eef88f21146f708dcd"} Jun 08 13:43:08.589744 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:08.589717 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qms2k" event={"ID":"f4563444-4752-4896-a848-acb40549ebe0","Type":"ContainerStarted","Data":"2c22818903b89757ca279f28600132a6366cff03318d39f01519da8f8f981c91"} Jun 08 13:43:08.601849 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:08.601813 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fh86q" event={"ID":"342c05fc-285c-48e3-8a00-f2e2acba80cb","Type":"ContainerStarted","Data":"99d29c72c3b08a354b317d981e336fa8d4e4ad998c25e266491df63d88e2b0bb"} Jun 08 13:43:08.616307 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:08.616279 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qzp5m" event={"ID":"9f80246c-3dde-4a76-a65e-da7a5dc1732f","Type":"ContainerStarted","Data":"e9677b20b123f65b1336390382cb9d88af6a716be23975872b28adb1e9807256"} Jun 08 13:43:08.633637 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:08.633608 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-92.ec2.internal" event={"ID":"4e0e67f7045596994bc0d64a2b9588c2","Type":"ContainerStarted","Data":"04bff67d47f382a9c140e9f6f307663dc6ec6fd970111d18cd2bc23955fa7e61"} Jun 08 13:43:08.640140 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:08.640113 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv8nt" event={"ID":"67f780b7-2628-49ac-a25e-454ae247a3a0","Type":"ContainerStarted","Data":"df7d54230e64a7bb68720452970659319753483c0d86bbe3cadbb99356a3615b"} Jun 08 13:43:08.665969 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:08.665943 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-55c2s" event={"ID":"bf0a4a64-6cd7-489d-8aa8-635b662f64e9","Type":"ContainerStarted","Data":"58b0afc4fdb2d81893cd8f110419a44f918ffd3c66a0e4a7c924f6e4b3e6dfe2"} Jun 08 13:43:08.696666 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:08.696542 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" event={"ID":"f51689fd-918d-4af0-8083-178dbe60a4d9","Type":"ContainerStarted","Data":"24bdeb065d3f252fc0647cec035bccb84c7b70251880805eb6f9f0e4ba46a0fb"} Jun 08 13:43:08.783245 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:08.783014 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 13:43:09.023315 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:09.022563 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43325f79-05b7-4adc-b726-9dbf5b9e5b68-original-pull-secret\") pod \"global-pull-secret-syncer-kzr55\" (UID: \"43325f79-05b7-4adc-b726-9dbf5b9e5b68\") " pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:43:09.023315 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:09.022807 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:43:09.023315 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:09.022873 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43325f79-05b7-4adc-b726-9dbf5b9e5b68-original-pull-secret podName:43325f79-05b7-4adc-b726-9dbf5b9e5b68 nodeName:}" failed. No retries permitted until 2026-06-08 13:43:11.022854487 +0000 UTC m=+5.003882746 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43325f79-05b7-4adc-b726-9dbf5b9e5b68-original-pull-secret") pod "global-pull-secret-syncer-kzr55" (UID: "43325f79-05b7-4adc-b726-9dbf5b9e5b68") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:43:09.123954 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:09.123405 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50931712-af88-4fe2-b146-0926d8e10b25-metrics-certs\") pod \"network-metrics-daemon-6zmwj\" (UID: \"50931712-af88-4fe2-b146-0926d8e10b25\") " pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:43:09.123954 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:09.123562 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:43:09.123954 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:09.123619 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50931712-af88-4fe2-b146-0926d8e10b25-metrics-certs podName:50931712-af88-4fe2-b146-0926d8e10b25 nodeName:}" failed. No retries permitted until 2026-06-08 13:43:11.123602088 +0000 UTC m=+5.104630339 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50931712-af88-4fe2-b146-0926d8e10b25-metrics-certs") pod "network-metrics-daemon-6zmwj" (UID: "50931712-af88-4fe2-b146-0926d8e10b25") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:43:09.224287 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:09.224253 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4n7p\" (UniqueName: \"kubernetes.io/projected/4fef731a-4dcc-40e0-843f-1ca10f3582a2-kube-api-access-v4n7p\") pod \"network-check-target-s7p22\" (UID: \"4fef731a-4dcc-40e0-843f-1ca10f3582a2\") " pod="openshift-network-diagnostics/network-check-target-s7p22" Jun 08 13:43:09.224470 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:09.224452 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:43:09.224533 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:09.224478 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:43:09.224533 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:09.224492 2561 projected.go:196] Error preparing data for projected volume kube-api-access-v4n7p for pod openshift-network-diagnostics/network-check-target-s7p22: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:43:09.224673 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:09.224548 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4fef731a-4dcc-40e0-843f-1ca10f3582a2-kube-api-access-v4n7p podName:4fef731a-4dcc-40e0-843f-1ca10f3582a2 nodeName:}" failed. No retries permitted until 2026-06-08 13:43:11.224530471 +0000 UTC m=+5.205558718 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-v4n7p" (UniqueName: "kubernetes.io/projected/4fef731a-4dcc-40e0-843f-1ca10f3582a2-kube-api-access-v4n7p") pod "network-check-target-s7p22" (UID: "4fef731a-4dcc-40e0-843f-1ca10f3582a2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:43:09.444577 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:09.444503 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 13:38:07 +0000 UTC" deadline="2027-11-16 06:37:02.243119485 +0000 UTC" Jun 08 13:43:09.444577 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:09.444545 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12616h53m52.798578782s" Jun 08 13:43:09.471378 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:09.470515 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:43:09.471378 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:09.470668 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zmwj" podUID="50931712-af88-4fe2-b146-0926d8e10b25" Jun 08 13:43:09.471378 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:09.471084 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:43:09.471378 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:09.471182 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzr55" podUID="43325f79-05b7-4adc-b726-9dbf5b9e5b68" Jun 08 13:43:09.471378 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:09.471242 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7p22" Jun 08 13:43:09.471378 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:09.471320 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7p22" podUID="4fef731a-4dcc-40e0-843f-1ca10f3582a2" Jun 08 13:43:11.039794 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:11.039726 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43325f79-05b7-4adc-b726-9dbf5b9e5b68-original-pull-secret\") pod \"global-pull-secret-syncer-kzr55\" (UID: \"43325f79-05b7-4adc-b726-9dbf5b9e5b68\") " pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:43:11.040266 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:11.039884 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:43:11.040266 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:11.039962 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43325f79-05b7-4adc-b726-9dbf5b9e5b68-original-pull-secret podName:43325f79-05b7-4adc-b726-9dbf5b9e5b68 nodeName:}" failed. No retries permitted until 2026-06-08 13:43:15.039940697 +0000 UTC m=+9.020968958 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43325f79-05b7-4adc-b726-9dbf5b9e5b68-original-pull-secret") pod "global-pull-secret-syncer-kzr55" (UID: "43325f79-05b7-4adc-b726-9dbf5b9e5b68") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:43:11.141059 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:11.140716 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50931712-af88-4fe2-b146-0926d8e10b25-metrics-certs\") pod \"network-metrics-daemon-6zmwj\" (UID: \"50931712-af88-4fe2-b146-0926d8e10b25\") " pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:43:11.141059 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:11.140885 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:43:11.141059 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:11.140941 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50931712-af88-4fe2-b146-0926d8e10b25-metrics-certs podName:50931712-af88-4fe2-b146-0926d8e10b25 nodeName:}" failed. No retries permitted until 2026-06-08 13:43:15.140922777 +0000 UTC m=+9.121951026 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50931712-af88-4fe2-b146-0926d8e10b25-metrics-certs") pod "network-metrics-daemon-6zmwj" (UID: "50931712-af88-4fe2-b146-0926d8e10b25") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:43:11.241370 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:11.241335 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4n7p\" (UniqueName: \"kubernetes.io/projected/4fef731a-4dcc-40e0-843f-1ca10f3582a2-kube-api-access-v4n7p\") pod \"network-check-target-s7p22\" (UID: \"4fef731a-4dcc-40e0-843f-1ca10f3582a2\") " pod="openshift-network-diagnostics/network-check-target-s7p22" Jun 08 13:43:11.242062 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:11.241560 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:43:11.242062 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:11.241585 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:43:11.242062 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:11.241598 2561 projected.go:196] Error preparing data for projected volume kube-api-access-v4n7p for pod openshift-network-diagnostics/network-check-target-s7p22: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:43:11.242062 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:11.241658 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4fef731a-4dcc-40e0-843f-1ca10f3582a2-kube-api-access-v4n7p podName:4fef731a-4dcc-40e0-843f-1ca10f3582a2 nodeName:}" failed. No retries permitted until 2026-06-08 13:43:15.241638591 +0000 UTC m=+9.222666880 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-v4n7p" (UniqueName: "kubernetes.io/projected/4fef731a-4dcc-40e0-843f-1ca10f3582a2-kube-api-access-v4n7p") pod "network-check-target-s7p22" (UID: "4fef731a-4dcc-40e0-843f-1ca10f3582a2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:43:11.470736 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:11.470695 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:43:11.470911 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:11.470853 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zmwj" podUID="50931712-af88-4fe2-b146-0926d8e10b25" Jun 08 13:43:11.470973 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:11.470949 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:43:11.471094 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:11.471065 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzr55" podUID="43325f79-05b7-4adc-b726-9dbf5b9e5b68" Jun 08 13:43:11.471168 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:11.471139 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7p22" Jun 08 13:43:11.471295 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:11.471274 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7p22" podUID="4fef731a-4dcc-40e0-843f-1ca10f3582a2" Jun 08 13:43:13.470642 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:13.470481 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:43:13.470642 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:13.470618 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zmwj" podUID="50931712-af88-4fe2-b146-0926d8e10b25" Jun 08 13:43:13.470642 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:13.470487 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7p22" Jun 08 13:43:13.470642 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:13.470483 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:43:13.471280 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:13.470709 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7p22" podUID="4fef731a-4dcc-40e0-843f-1ca10f3582a2" Jun 08 13:43:13.471280 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:13.470801 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzr55" podUID="43325f79-05b7-4adc-b726-9dbf5b9e5b68" Jun 08 13:43:15.075261 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:15.074716 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43325f79-05b7-4adc-b726-9dbf5b9e5b68-original-pull-secret\") pod \"global-pull-secret-syncer-kzr55\" (UID: \"43325f79-05b7-4adc-b726-9dbf5b9e5b68\") " pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:43:15.075261 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:15.074875 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:43:15.075261 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:15.074939 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43325f79-05b7-4adc-b726-9dbf5b9e5b68-original-pull-secret podName:43325f79-05b7-4adc-b726-9dbf5b9e5b68 nodeName:}" failed. No retries permitted until 2026-06-08 13:43:23.074918616 +0000 UTC m=+17.055946877 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43325f79-05b7-4adc-b726-9dbf5b9e5b68-original-pull-secret") pod "global-pull-secret-syncer-kzr55" (UID: "43325f79-05b7-4adc-b726-9dbf5b9e5b68") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:43:15.175202 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:15.175171 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50931712-af88-4fe2-b146-0926d8e10b25-metrics-certs\") pod \"network-metrics-daemon-6zmwj\" (UID: \"50931712-af88-4fe2-b146-0926d8e10b25\") " pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:43:15.175374 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:15.175314 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:43:15.175374 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:15.175369 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50931712-af88-4fe2-b146-0926d8e10b25-metrics-certs podName:50931712-af88-4fe2-b146-0926d8e10b25 nodeName:}" failed. No retries permitted until 2026-06-08 13:43:23.175356887 +0000 UTC m=+17.156385134 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50931712-af88-4fe2-b146-0926d8e10b25-metrics-certs") pod "network-metrics-daemon-6zmwj" (UID: "50931712-af88-4fe2-b146-0926d8e10b25") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:43:15.275917 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:15.275667 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4n7p\" (UniqueName: \"kubernetes.io/projected/4fef731a-4dcc-40e0-843f-1ca10f3582a2-kube-api-access-v4n7p\") pod \"network-check-target-s7p22\" (UID: \"4fef731a-4dcc-40e0-843f-1ca10f3582a2\") " pod="openshift-network-diagnostics/network-check-target-s7p22" Jun 08 13:43:15.275917 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:15.275835 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:43:15.275917 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:15.275859 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:43:15.275917 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:15.275872 2561 projected.go:196] Error preparing data for projected volume kube-api-access-v4n7p for pod openshift-network-diagnostics/network-check-target-s7p22: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:43:15.276218 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:15.275936 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4fef731a-4dcc-40e0-843f-1ca10f3582a2-kube-api-access-v4n7p podName:4fef731a-4dcc-40e0-843f-1ca10f3582a2 nodeName:}" failed. No retries permitted until 2026-06-08 13:43:23.275918297 +0000 UTC m=+17.256946543 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-v4n7p" (UniqueName: "kubernetes.io/projected/4fef731a-4dcc-40e0-843f-1ca10f3582a2-kube-api-access-v4n7p") pod "network-check-target-s7p22" (UID: "4fef731a-4dcc-40e0-843f-1ca10f3582a2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:43:15.470960 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:15.470925 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:43:15.471121 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:15.471084 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zmwj" podUID="50931712-af88-4fe2-b146-0926d8e10b25" Jun 08 13:43:15.471514 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:15.471490 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:43:15.471627 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:15.471603 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzr55" podUID="43325f79-05b7-4adc-b726-9dbf5b9e5b68" Jun 08 13:43:15.471688 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:15.471659 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7p22" Jun 08 13:43:15.471754 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:15.471734 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7p22" podUID="4fef731a-4dcc-40e0-843f-1ca10f3582a2" Jun 08 13:43:17.471085 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:17.471049 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7p22" Jun 08 13:43:17.471554 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:17.471092 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:43:17.471554 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:17.471092 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:43:17.471554 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:17.471167 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7p22" podUID="4fef731a-4dcc-40e0-843f-1ca10f3582a2" Jun 08 13:43:17.471554 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:17.471256 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzr55" podUID="43325f79-05b7-4adc-b726-9dbf5b9e5b68" Jun 08 13:43:17.471554 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:17.471350 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zmwj" podUID="50931712-af88-4fe2-b146-0926d8e10b25" Jun 08 13:43:19.470286 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:19.470265 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7p22" Jun 08 13:43:19.470579 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:19.470263 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:43:19.470579 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:19.470348 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7p22" podUID="4fef731a-4dcc-40e0-843f-1ca10f3582a2" Jun 08 13:43:19.470579 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:19.470269 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:43:19.470579 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:19.470430 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zmwj" podUID="50931712-af88-4fe2-b146-0926d8e10b25" Jun 08 13:43:19.470579 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:19.470486 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzr55" podUID="43325f79-05b7-4adc-b726-9dbf5b9e5b68" Jun 08 13:43:21.470556 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:21.470520 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7p22" Jun 08 13:43:21.471019 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:21.470519 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:43:21.471019 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:21.470636 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7p22" podUID="4fef731a-4dcc-40e0-843f-1ca10f3582a2" Jun 08 13:43:21.471019 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:21.470679 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:43:21.471019 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:21.470788 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzr55" podUID="43325f79-05b7-4adc-b726-9dbf5b9e5b68" Jun 08 13:43:21.471019 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:21.470873 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zmwj" podUID="50931712-af88-4fe2-b146-0926d8e10b25" Jun 08 13:43:23.139820 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:23.139788 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43325f79-05b7-4adc-b726-9dbf5b9e5b68-original-pull-secret\") pod \"global-pull-secret-syncer-kzr55\" (UID: \"43325f79-05b7-4adc-b726-9dbf5b9e5b68\") " pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:43:23.140314 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:23.139890 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:43:23.140314 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:23.139955 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43325f79-05b7-4adc-b726-9dbf5b9e5b68-original-pull-secret podName:43325f79-05b7-4adc-b726-9dbf5b9e5b68 nodeName:}" failed. No retries permitted until 2026-06-08 13:43:39.139934752 +0000 UTC m=+33.120963002 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43325f79-05b7-4adc-b726-9dbf5b9e5b68-original-pull-secret") pod "global-pull-secret-syncer-kzr55" (UID: "43325f79-05b7-4adc-b726-9dbf5b9e5b68") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:43:23.240668 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:23.240639 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50931712-af88-4fe2-b146-0926d8e10b25-metrics-certs\") pod \"network-metrics-daemon-6zmwj\" (UID: \"50931712-af88-4fe2-b146-0926d8e10b25\") " pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:43:23.240814 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:23.240752 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:43:23.240814 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:23.240810 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50931712-af88-4fe2-b146-0926d8e10b25-metrics-certs podName:50931712-af88-4fe2-b146-0926d8e10b25 nodeName:}" failed. No retries permitted until 2026-06-08 13:43:39.240796985 +0000 UTC m=+33.221825236 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50931712-af88-4fe2-b146-0926d8e10b25-metrics-certs") pod "network-metrics-daemon-6zmwj" (UID: "50931712-af88-4fe2-b146-0926d8e10b25") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:43:23.341832 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:23.341804 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4n7p\" (UniqueName: \"kubernetes.io/projected/4fef731a-4dcc-40e0-843f-1ca10f3582a2-kube-api-access-v4n7p\") pod \"network-check-target-s7p22\" (UID: \"4fef731a-4dcc-40e0-843f-1ca10f3582a2\") " pod="openshift-network-diagnostics/network-check-target-s7p22" Jun 08 13:43:23.342026 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:23.341981 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:43:23.342026 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:23.342009 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:43:23.342026 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:23.342026 2561 projected.go:196] Error preparing data for projected volume kube-api-access-v4n7p for pod openshift-network-diagnostics/network-check-target-s7p22: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:43:23.342143 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:23.342082 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4fef731a-4dcc-40e0-843f-1ca10f3582a2-kube-api-access-v4n7p podName:4fef731a-4dcc-40e0-843f-1ca10f3582a2 nodeName:}" failed. No retries permitted until 2026-06-08 13:43:39.34206793 +0000 UTC m=+33.323096176 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-v4n7p" (UniqueName: "kubernetes.io/projected/4fef731a-4dcc-40e0-843f-1ca10f3582a2-kube-api-access-v4n7p") pod "network-check-target-s7p22" (UID: "4fef731a-4dcc-40e0-843f-1ca10f3582a2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:43:23.470533 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:23.470454 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:43:23.470533 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:23.470468 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7p22" Jun 08 13:43:23.470745 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:23.470454 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:43:23.470745 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:23.470576 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zmwj" podUID="50931712-af88-4fe2-b146-0926d8e10b25" Jun 08 13:43:23.470745 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:23.470672 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzr55" podUID="43325f79-05b7-4adc-b726-9dbf5b9e5b68" Jun 08 13:43:23.470952 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:23.470757 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7p22" podUID="4fef731a-4dcc-40e0-843f-1ca10f3582a2" Jun 08 13:43:25.470215 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:25.470174 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:43:25.470215 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:25.470208 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7p22" Jun 08 13:43:25.470667 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:25.470208 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:43:25.470667 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:25.470295 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zmwj" podUID="50931712-af88-4fe2-b146-0926d8e10b25" Jun 08 13:43:25.470667 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:25.470382 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7p22" podUID="4fef731a-4dcc-40e0-843f-1ca10f3582a2" Jun 08 13:43:25.470667 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:25.470466 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzr55" podUID="43325f79-05b7-4adc-b726-9dbf5b9e5b68" Jun 08 13:43:27.470558 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:27.470525 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:43:27.470558 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:27.470548 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7p22" Jun 08 13:43:27.470994 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:27.470531 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:43:27.470994 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:27.470627 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzr55" podUID="43325f79-05b7-4adc-b726-9dbf5b9e5b68" Jun 08 13:43:27.470994 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:27.470690 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zmwj" podUID="50931712-af88-4fe2-b146-0926d8e10b25" Jun 08 13:43:27.470994 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:27.470754 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7p22" podUID="4fef731a-4dcc-40e0-843f-1ca10f3582a2" Jun 08 13:43:28.747031 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:28.746674 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vlwt4" event={"ID":"fee2c359-741b-410b-b948-4772c46daf47","Type":"ContainerStarted","Data":"7de4bb123c1e9d7b5ffef0aa4a9a79881033de9cef02625b619e27de3954c0da"} Jun 08 13:43:28.749172 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:28.749142 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fh86q" event={"ID":"342c05fc-285c-48e3-8a00-f2e2acba80cb","Type":"ContainerStarted","Data":"c24fa71bccf1e59cbc016d362ab79d3883573411faeff234d76737f882772454"} Jun 08 13:43:28.750754 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:28.750634 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-92.ec2.internal" event={"ID":"4e0e67f7045596994bc0d64a2b9588c2","Type":"ContainerStarted","Data":"ba36826a402afca75cb3f487f817352e5669a17f45afb2e08d83825f878b889e"} Jun 08 13:43:28.753777 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:28.753745 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" event={"ID":"f51689fd-918d-4af0-8083-178dbe60a4d9","Type":"ContainerStarted","Data":"3d0f45f3214aee7e74c0654a3c1864ddc84757a07f7e6164e9354c7c99287d6d"} Jun 08 13:43:28.753851 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:28.753818 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" event={"ID":"f51689fd-918d-4af0-8083-178dbe60a4d9","Type":"ContainerStarted","Data":"5d1feef780fdc6b7d4abf934311c9e54396954b32abe606cdba125e3a95503d0"} Jun 08 13:43:28.753890 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:28.753854 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" event={"ID":"f51689fd-918d-4af0-8083-178dbe60a4d9","Type":"ContainerStarted","Data":"41b29e1ce8bf22d289740215c05f8de562524b4be69cd530c813c7257d4000ad"} Jun 08 13:43:28.753890 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:28.753888 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" event={"ID":"f51689fd-918d-4af0-8083-178dbe60a4d9","Type":"ContainerStarted","Data":"d4d830a01a134d97957a572d2c6942ecf1f64595b78926ad35b6a482e0289ddd"} Jun 08 13:43:28.753971 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:28.753915 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" event={"ID":"f51689fd-918d-4af0-8083-178dbe60a4d9","Type":"ContainerStarted","Data":"29dc7e1ee0a3474831bc5af478a6856066a22a914da83ec5e8797b3195965cf8"} Jun 08 13:43:28.766356 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:28.766315 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vlwt4" podStartSLOduration=2.694398967 podStartE2EDuration="22.766302625s" totalImagesPullingTime="20.071903658s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:43:28.765878697 +0000 UTC m=+22.746906967" watchObservedRunningTime="2026-06-08 13:43:28.766302625 +0000 UTC m=+22.747330893" Jun 08 13:43:28.802829 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:28.802784 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-92.ec2.internal" podStartSLOduration=21.802753677 podStartE2EDuration="21.802753677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:43:28.783447736 +0000 UTC m=+22.764476021" watchObservedRunningTime="2026-06-08 13:43:28.802753677 +0000 UTC m=+22.783781947" Jun 08 13:43:28.802951 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:28.802859 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fh86q" podStartSLOduration=2.708826322 podStartE2EDuration="22.802852952s" totalImagesPullingTime="20.09402663s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:43:28.802354693 +0000 UTC m=+22.783382961" watchObservedRunningTime="2026-06-08 13:43:28.802852952 +0000 UTC m=+22.783881257" Jun 08 13:43:29.471080 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:29.470870 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:43:29.471203 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:29.470880 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:43:29.471260 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:29.471195 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zmwj" podUID="50931712-af88-4fe2-b146-0926d8e10b25" Jun 08 13:43:29.471260 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:29.470882 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7p22" Jun 08 13:43:29.471369 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:29.471269 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzr55" podUID="43325f79-05b7-4adc-b726-9dbf5b9e5b68" Jun 08 13:43:29.471369 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:29.471348 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7p22" podUID="4fef731a-4dcc-40e0-843f-1ca10f3582a2" Jun 08 13:43:29.758148 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:29.758058 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qzp5m" event={"ID":"9f80246c-3dde-4a76-a65e-da7a5dc1732f","Type":"ContainerStarted","Data":"9f1ac3f516f7af3a280dbb426918af357acf348f4bbd69b3a854844f448bbdb4"} Jun 08 13:43:29.759681 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:29.759647 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv8nt" event={"ID":"67f780b7-2628-49ac-a25e-454ae247a3a0","Type":"ContainerStarted","Data":"89cc8ceeb2e3662a2895287466e8aad2977bc168c949b3c7616b14d552c99c1b"} Jun 08 13:43:29.761259 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:29.761233 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-55c2s" event={"ID":"bf0a4a64-6cd7-489d-8aa8-635b662f64e9","Type":"ContainerStarted","Data":"ec48a1732fca0e8d37a9fa69e235b70f836d1573c3d19aaa2f4efef1d9ae56a9"} Jun 08 13:43:29.764726 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:29.764701 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" event={"ID":"f51689fd-918d-4af0-8083-178dbe60a4d9","Type":"ContainerStarted","Data":"93e90162fd5fd2ee83d0bb0c9ba0d8e8f4a0ccac7115378864174aa72a548ad6"} Jun 08 13:43:29.766250 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:29.766222 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2fw8m" event={"ID":"42ec3ccf-8ea7-4b23-810a-59696755f5ca","Type":"ContainerStarted","Data":"eaf9492723a46d8c8c383357f1631605d0d1ea9291f89b4b84b7bb950554c97e"} Jun 08 13:43:29.767703 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:29.767681 2561 generic.go:356] "Generic (PLEG): container finished" podID="851606b6637692164abff23a0059552f" containerID="78069ede344a761c3a8960eef6caa3531e1b68edc646c17fa0e2f0fd4ea2df80" exitCode=0 Jun 08 13:43:29.767823 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:29.767773 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal" event={"ID":"851606b6637692164abff23a0059552f","Type":"ContainerDied","Data":"78069ede344a761c3a8960eef6caa3531e1b68edc646c17fa0e2f0fd4ea2df80"} Jun 08 13:43:29.769343 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:29.769311 2561 generic.go:356] "Generic (PLEG): container finished" podID="5c017e70-8e4b-413f-9ee8-4d99892258ae" containerID="f1869cf604613d3bbc2c14bcda36e036fbbbb19c346e928376265aab884a548e" exitCode=0 Jun 08 13:43:29.769442 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:29.769394 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkjkk" event={"ID":"5c017e70-8e4b-413f-9ee8-4d99892258ae","Type":"ContainerDied","Data":"f1869cf604613d3bbc2c14bcda36e036fbbbb19c346e928376265aab884a548e"} Jun 08 13:43:29.771685 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:29.771666 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qms2k" event={"ID":"f4563444-4752-4896-a848-acb40549ebe0","Type":"ContainerStarted","Data":"aa5655aa8768eab50cdc3f8a43ec483f2bcf9ca4132b4b10e1dcb871608d81fa"} Jun 08 13:43:29.782750 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:29.782704 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qzp5m" podStartSLOduration=3.668261479 podStartE2EDuration="23.782686176s" totalImagesPullingTime="20.114424697s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:43:29.774076807 +0000 UTC m=+23.755105100" watchObservedRunningTime="2026-06-08 13:43:29.782686176 +0000 UTC m=+23.763714446" Jun 08 13:43:29.819450 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:29.819406 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2fw8m" podStartSLOduration=11.965662966 podStartE2EDuration="23.819394123s" totalImagesPullingTime="11.853731157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:43:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:43:29.80401596 +0000 UTC m=+23.785044246" watchObservedRunningTime="2026-06-08 13:43:29.819394123 +0000 UTC m=+23.800422391" Jun 08 13:43:29.819540 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:29.819524 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qms2k" podStartSLOduration=3.7440127050000003 podStartE2EDuration="23.819519563s" totalImagesPullingTime="20.075506858s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:43:29.81921727 +0000 UTC m=+23.800245538" watchObservedRunningTime="2026-06-08 13:43:29.819519563 +0000 UTC m=+23.800547831" Jun 08 13:43:29.858013 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:29.857977 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-55c2s" podStartSLOduration=3.759160166 podStartE2EDuration="23.857965164s" totalImagesPullingTime="20.098804998s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:43:29.857470241 +0000 UTC m=+23.838498510" watchObservedRunningTime="2026-06-08 13:43:29.857965164 +0000 UTC m=+23.838993433" Jun 08 13:43:30.192166 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:30.192145 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 13:43:30.463250 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:30.463104 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T13:43:30.192163149Z","UUID":"3e396920-ed06-4f45-9cb7-32fbc9c7748e","Handler":null,"Name":"","Endpoint":""} Jun 08 13:43:30.464679 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:30.464653 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 13:43:30.464889 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:30.464701 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 13:43:30.775807 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:30.775696 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal" event={"ID":"851606b6637692164abff23a0059552f","Type":"ContainerStarted","Data":"3b24c05c9e33aed4773ef4b4163e59afcf65d2c72570a7e6dbe404f93740bd91"} Jun 08 13:43:30.777350 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:30.777327 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv8nt" event={"ID":"67f780b7-2628-49ac-a25e-454ae247a3a0","Type":"ContainerStarted","Data":"b229312d28054a8bd37e7d73ce2b2cfd07c1d06264a286f78020fa1238a5b392"} Jun 08 13:43:30.791550 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:30.791512 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal" podStartSLOduration=23.791500039 podStartE2EDuration="23.791500039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:43:30.791501111 +0000 UTC m=+24.772529380" watchObservedRunningTime="2026-06-08 13:43:30.791500039 +0000 UTC m=+24.772528306" Jun 08 13:43:31.470749 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:31.470572 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:43:31.470909 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:31.470606 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:43:31.470909 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:31.470858 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zmwj" podUID="50931712-af88-4fe2-b146-0926d8e10b25" Jun 08 13:43:31.470909 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:31.470606 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7p22" Jun 08 13:43:31.471063 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:31.470914 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzr55" podUID="43325f79-05b7-4adc-b726-9dbf5b9e5b68" Jun 08 13:43:31.471063 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:31.470986 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7p22" podUID="4fef731a-4dcc-40e0-843f-1ca10f3582a2" Jun 08 13:43:31.781561 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:31.781533 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv8nt" event={"ID":"67f780b7-2628-49ac-a25e-454ae247a3a0","Type":"ContainerStarted","Data":"e508a355801864d2ad93f7bcba647c3fea5d5fc8d3f4f8a1d927ec0392cb3f55"} Jun 08 13:43:31.785515 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:31.785487 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" event={"ID":"f51689fd-918d-4af0-8083-178dbe60a4d9","Type":"ContainerStarted","Data":"1187ebfa8e8cdd8cb7a7043bcf14d493dc9c0c2e9dc7daf88d1758b67be80b4b"} Jun 08 13:43:33.295745 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:33.295717 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2fw8m" Jun 08 13:43:33.296416 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:33.296398 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2fw8m" Jun 08 13:43:33.313863 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:33.313822 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv8nt" podStartSLOduration=5.126933148 podStartE2EDuration="27.313808153s" totalImagesPullingTime="22.186875005s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:43:31.801356608 +0000 UTC m=+25.782384878" watchObservedRunningTime="2026-06-08 13:43:33.313808153 +0000 UTC m=+27.294836422" Jun 08 13:43:33.470717 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:33.470686 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:43:33.470890 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:33.470721 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7p22" Jun 08 13:43:33.470890 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:33.470721 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:43:33.470890 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:33.470842 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zmwj" podUID="50931712-af88-4fe2-b146-0926d8e10b25" Jun 08 13:43:33.471061 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:33.470991 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7p22" podUID="4fef731a-4dcc-40e0-843f-1ca10f3582a2" Jun 08 13:43:33.471113 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:33.471073 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzr55" podUID="43325f79-05b7-4adc-b726-9dbf5b9e5b68" Jun 08 13:43:33.790633 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:33.790562 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2fw8m" Jun 08 13:43:33.791068 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:33.791046 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2fw8m" Jun 08 13:43:34.795841 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:34.795567 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" event={"ID":"f51689fd-918d-4af0-8083-178dbe60a4d9","Type":"ContainerStarted","Data":"f557cd49d3bb8076c7d8528b7cb7b4f1e502b50161d3b4bc112000365ab45cd5"} Jun 08 13:43:34.796299 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:34.795895 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:34.796299 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:34.795950 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:34.797518 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:34.797499 2561 generic.go:356] "Generic (PLEG): container finished" podID="5c017e70-8e4b-413f-9ee8-4d99892258ae" containerID="d950f9003f749c2b3a1cd7b253735fdeb0f8ade2e73ce8f08cf4d8514aae66b9" exitCode=0 Jun 08 13:43:34.797615 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:34.797580 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkjkk" event={"ID":"5c017e70-8e4b-413f-9ee8-4d99892258ae","Type":"ContainerDied","Data":"d950f9003f749c2b3a1cd7b253735fdeb0f8ade2e73ce8f08cf4d8514aae66b9"} Jun 08 13:43:34.810842 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:34.810823 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:34.826016 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:34.825982 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" podStartSLOduration=8.45165156 podStartE2EDuration="28.825969791s" totalImagesPullingTime="20.374318231s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:43:34.824685445 +0000 UTC m=+28.805713715" watchObservedRunningTime="2026-06-08 13:43:34.825969791 +0000 UTC m=+28.806998054" Jun 08 13:43:35.471137 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:35.471097 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:43:35.471362 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:35.471137 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:43:35.471362 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:35.471143 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7p22" Jun 08 13:43:35.471362 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:35.471224 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zmwj" podUID="50931712-af88-4fe2-b146-0926d8e10b25" Jun 08 13:43:35.471362 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:35.471337 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzr55" podUID="43325f79-05b7-4adc-b726-9dbf5b9e5b68" Jun 08 13:43:35.471551 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:35.471438 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7p22" podUID="4fef731a-4dcc-40e0-843f-1ca10f3582a2" Jun 08 13:43:35.799860 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:35.799797 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:35.813170 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:35.813146 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:43:36.209178 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:36.209148 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kzr55"] Jun 08 13:43:36.209331 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:36.209247 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:43:36.209395 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:36.209349 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzr55" podUID="43325f79-05b7-4adc-b726-9dbf5b9e5b68" Jun 08 13:43:36.212136 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:36.212114 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s7p22"] Jun 08 13:43:36.212257 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:36.212191 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7p22" Jun 08 13:43:36.212323 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:36.212279 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7p22" podUID="4fef731a-4dcc-40e0-843f-1ca10f3582a2" Jun 08 13:43:36.215094 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:36.215075 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6zmwj"] Jun 08 13:43:36.215200 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:36.215155 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:43:36.215274 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:36.215253 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zmwj" podUID="50931712-af88-4fe2-b146-0926d8e10b25" Jun 08 13:43:36.802369 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:36.802333 2561 generic.go:356] "Generic (PLEG): container finished" podID="5c017e70-8e4b-413f-9ee8-4d99892258ae" containerID="ab020edd0d8e2a625f3a7b05cb19206153aa3999ef1e7f389af78e0db38a0b2b" exitCode=0 Jun 08 13:43:36.802823 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:36.802389 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkjkk" event={"ID":"5c017e70-8e4b-413f-9ee8-4d99892258ae","Type":"ContainerDied","Data":"ab020edd0d8e2a625f3a7b05cb19206153aa3999ef1e7f389af78e0db38a0b2b"} Jun 08 13:43:37.471004 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:37.470978 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:43:37.471133 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:37.471077 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zmwj" podUID="50931712-af88-4fe2-b146-0926d8e10b25" Jun 08 13:43:38.470717 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:38.470550 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:43:38.471100 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:38.470601 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7p22" Jun 08 13:43:38.471100 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:38.470839 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzr55" podUID="43325f79-05b7-4adc-b726-9dbf5b9e5b68" Jun 08 13:43:38.471100 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:38.470887 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7p22" podUID="4fef731a-4dcc-40e0-843f-1ca10f3582a2" Jun 08 13:43:38.808793 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:38.808750 2561 generic.go:356] "Generic (PLEG): container finished" podID="5c017e70-8e4b-413f-9ee8-4d99892258ae" containerID="741ead672dc3a93377a51c94bb8297d6161b319bef0b0b5dee0373f88578d872" exitCode=0 Jun 08 13:43:38.808948 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:38.808810 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkjkk" event={"ID":"5c017e70-8e4b-413f-9ee8-4d99892258ae","Type":"ContainerDied","Data":"741ead672dc3a93377a51c94bb8297d6161b319bef0b0b5dee0373f88578d872"} Jun 08 13:43:39.165796 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:39.165771 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43325f79-05b7-4adc-b726-9dbf5b9e5b68-original-pull-secret\") pod \"global-pull-secret-syncer-kzr55\" (UID: \"43325f79-05b7-4adc-b726-9dbf5b9e5b68\") " pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:43:39.165935 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:39.165894 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:43:39.165972 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:39.165950 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43325f79-05b7-4adc-b726-9dbf5b9e5b68-original-pull-secret podName:43325f79-05b7-4adc-b726-9dbf5b9e5b68 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:11.165934138 +0000 UTC m=+65.146962385 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43325f79-05b7-4adc-b726-9dbf5b9e5b68-original-pull-secret") pod "global-pull-secret-syncer-kzr55" (UID: "43325f79-05b7-4adc-b726-9dbf5b9e5b68") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:43:39.266715 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:39.266688 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50931712-af88-4fe2-b146-0926d8e10b25-metrics-certs\") pod \"network-metrics-daemon-6zmwj\" (UID: \"50931712-af88-4fe2-b146-0926d8e10b25\") " pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:43:39.266869 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:39.266805 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:43:39.266869 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:39.266856 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50931712-af88-4fe2-b146-0926d8e10b25-metrics-certs podName:50931712-af88-4fe2-b146-0926d8e10b25 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:11.266842889 +0000 UTC m=+65.247871135 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50931712-af88-4fe2-b146-0926d8e10b25-metrics-certs") pod "network-metrics-daemon-6zmwj" (UID: "50931712-af88-4fe2-b146-0926d8e10b25") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:43:39.367674 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:39.367593 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4n7p\" (UniqueName: \"kubernetes.io/projected/4fef731a-4dcc-40e0-843f-1ca10f3582a2-kube-api-access-v4n7p\") pod \"network-check-target-s7p22\" (UID: \"4fef731a-4dcc-40e0-843f-1ca10f3582a2\") " pod="openshift-network-diagnostics/network-check-target-s7p22" Jun 08 13:43:39.367882 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:39.367739 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:43:39.367882 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:39.367772 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:43:39.367882 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:39.367786 2561 projected.go:196] Error preparing data for projected volume kube-api-access-v4n7p for pod openshift-network-diagnostics/network-check-target-s7p22: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:43:39.367882 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:39.367839 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4fef731a-4dcc-40e0-843f-1ca10f3582a2-kube-api-access-v4n7p podName:4fef731a-4dcc-40e0-843f-1ca10f3582a2 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:11.367821556 +0000 UTC m=+65.348849804 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-v4n7p" (UniqueName: "kubernetes.io/projected/4fef731a-4dcc-40e0-843f-1ca10f3582a2-kube-api-access-v4n7p") pod "network-check-target-s7p22" (UID: "4fef731a-4dcc-40e0-843f-1ca10f3582a2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:43:39.470912 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:39.470841 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:43:39.471271 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:39.470954 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zmwj" podUID="50931712-af88-4fe2-b146-0926d8e10b25" Jun 08 13:43:40.470934 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:40.470904 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:43:40.471359 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:40.471015 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzr55" podUID="43325f79-05b7-4adc-b726-9dbf5b9e5b68" Jun 08 13:43:40.471359 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:40.471080 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7p22" Jun 08 13:43:40.471359 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:40.471189 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7p22" podUID="4fef731a-4dcc-40e0-843f-1ca10f3582a2" Jun 08 13:43:41.470476 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:41.470449 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:43:41.470660 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:41.470556 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6zmwj" podUID="50931712-af88-4fe2-b146-0926d8e10b25" Jun 08 13:43:41.868901 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:41.868833 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeReady" Jun 08 13:43:41.869295 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:41.868986 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 13:43:41.905114 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:41.905087 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-646c6ff68f-gn7v4"] Jun 08 13:43:41.910724 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:41.910703 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:43:41.913582 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:41.913560 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-f95r6\"" Jun 08 13:43:41.913727 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:41.913709 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 08 13:43:41.913867 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:41.913839 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 08 13:43:41.914285 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:41.914265 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 08 13:43:41.919365 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:41.919320 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 08 13:43:41.927514 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:41.927489 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-646c6ff68f-gn7v4"] Jun 08 13:43:41.927600 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:41.927578 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hfcp7"] Jun 08 13:43:41.931516 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:41.931499 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hfcp7" Jun 08 13:43:41.931835 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:41.931651 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-28v6r"] Jun 08 13:43:41.934971 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:41.934953 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 13:43:41.935214 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:41.935193 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-28v6r" Jun 08 13:43:41.937140 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:41.937121 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2cfkx\"" Jun 08 13:43:41.938078 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:41.938059 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 13:43:41.939024 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:41.938945 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 13:43:41.939024 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:41.938961 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 13:43:41.939147 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:41.939098 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zjvk2\"" Jun 08 13:43:41.939488 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:41.939450 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 13:43:41.949534 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:41.947179 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hfcp7"] Jun 08 13:43:41.952044 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:41.952023 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-28v6r"] Jun 08 13:43:42.088866 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.088827 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-registry-tls\") pod \"image-registry-646c6ff68f-gn7v4\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:43:42.089031 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.088873 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktxft\" (UniqueName: \"kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-kube-api-access-ktxft\") pod \"image-registry-646c6ff68f-gn7v4\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:43:42.089031 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.088947 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08f23d9b-da1c-4813-a46c-833263139241-metrics-tls\") pod \"dns-default-hfcp7\" (UID: \"08f23d9b-da1c-4813-a46c-833263139241\") " pod="openshift-dns/dns-default-hfcp7" Jun 08 13:43:42.089031 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.088977 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08f23d9b-da1c-4813-a46c-833263139241-tmp-dir\") pod \"dns-default-hfcp7\" (UID: \"08f23d9b-da1c-4813-a46c-833263139241\") " pod="openshift-dns/dns-default-hfcp7" Jun 08 13:43:42.089031 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.089016 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da03cecf-0ab0-48c7-bd1b-ba9d7d1798b6-cert\") pod \"ingress-canary-28v6r\" (UID: \"da03cecf-0ab0-48c7-bd1b-ba9d7d1798b6\") " pod="openshift-ingress-canary/ingress-canary-28v6r" Jun 08 13:43:42.089233 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.089080 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/139a2ec4-1171-479a-a203-1c91f6547fcd-trusted-ca\") pod \"image-registry-646c6ff68f-gn7v4\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:43:42.089233 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.089115 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/139a2ec4-1171-479a-a203-1c91f6547fcd-image-registry-private-configuration\") pod \"image-registry-646c6ff68f-gn7v4\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:43:42.089233 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.089152 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/08f23d9b-da1c-4813-a46c-833263139241-config-volume\") pod \"dns-default-hfcp7\" (UID: \"08f23d9b-da1c-4813-a46c-833263139241\") " pod="openshift-dns/dns-default-hfcp7" Jun 08 13:43:42.089233 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.089185 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xclc\" (UniqueName: \"kubernetes.io/projected/da03cecf-0ab0-48c7-bd1b-ba9d7d1798b6-kube-api-access-4xclc\") pod \"ingress-canary-28v6r\" (UID: \"da03cecf-0ab0-48c7-bd1b-ba9d7d1798b6\") " pod="openshift-ingress-canary/ingress-canary-28v6r" Jun 08 13:43:42.089233 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.089208 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/139a2ec4-1171-479a-a203-1c91f6547fcd-installation-pull-secrets\") pod \"image-registry-646c6ff68f-gn7v4\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:43:42.089419 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.089260 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/139a2ec4-1171-479a-a203-1c91f6547fcd-registry-certificates\") pod \"image-registry-646c6ff68f-gn7v4\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:43:42.089419 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.089298 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/139a2ec4-1171-479a-a203-1c91f6547fcd-ca-trust-extracted\") pod \"image-registry-646c6ff68f-gn7v4\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:43:42.089419 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.089343 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-bound-sa-token\") pod \"image-registry-646c6ff68f-gn7v4\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:43:42.089419 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.089373 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzkpr\" (UniqueName: \"kubernetes.io/projected/08f23d9b-da1c-4813-a46c-833263139241-kube-api-access-vzkpr\") pod \"dns-default-hfcp7\" (UID: \"08f23d9b-da1c-4813-a46c-833263139241\") " pod="openshift-dns/dns-default-hfcp7" Jun 08 13:43:42.190057 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.190026 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktxft\" (UniqueName: \"kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-kube-api-access-ktxft\") pod \"image-registry-646c6ff68f-gn7v4\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:43:42.190225 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.190067 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08f23d9b-da1c-4813-a46c-833263139241-metrics-tls\") pod \"dns-default-hfcp7\" (UID: \"08f23d9b-da1c-4813-a46c-833263139241\") " pod="openshift-dns/dns-default-hfcp7" Jun 08 13:43:42.190225 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.190089 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08f23d9b-da1c-4813-a46c-833263139241-tmp-dir\") pod \"dns-default-hfcp7\" (UID: \"08f23d9b-da1c-4813-a46c-833263139241\") " pod="openshift-dns/dns-default-hfcp7" Jun 08 13:43:42.190225 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.190113 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da03cecf-0ab0-48c7-bd1b-ba9d7d1798b6-cert\") pod \"ingress-canary-28v6r\" (UID: \"da03cecf-0ab0-48c7-bd1b-ba9d7d1798b6\") " pod="openshift-ingress-canary/ingress-canary-28v6r" Jun 08 13:43:42.190225 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.190158 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/139a2ec4-1171-479a-a203-1c91f6547fcd-trusted-ca\") pod \"image-registry-646c6ff68f-gn7v4\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:43:42.190225 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:42.190200 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:43:42.190479 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:42.190270 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08f23d9b-da1c-4813-a46c-833263139241-metrics-tls podName:08f23d9b-da1c-4813-a46c-833263139241 nodeName:}" failed. No retries permitted until 2026-06-08 13:43:42.690248556 +0000 UTC m=+36.671276804 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08f23d9b-da1c-4813-a46c-833263139241-metrics-tls") pod "dns-default-hfcp7" (UID: "08f23d9b-da1c-4813-a46c-833263139241") : secret "dns-default-metrics-tls" not found Jun 08 13:43:42.190479 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.190185 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/139a2ec4-1171-479a-a203-1c91f6547fcd-image-registry-private-configuration\") pod \"image-registry-646c6ff68f-gn7v4\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:43:42.190479 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.190388 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/08f23d9b-da1c-4813-a46c-833263139241-config-volume\") pod \"dns-default-hfcp7\" (UID: \"08f23d9b-da1c-4813-a46c-833263139241\") " pod="openshift-dns/dns-default-hfcp7" Jun 08 13:43:42.190479 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.190438 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xclc\" (UniqueName: \"kubernetes.io/projected/da03cecf-0ab0-48c7-bd1b-ba9d7d1798b6-kube-api-access-4xclc\") pod \"ingress-canary-28v6r\" (UID: \"da03cecf-0ab0-48c7-bd1b-ba9d7d1798b6\") " pod="openshift-ingress-canary/ingress-canary-28v6r" Jun 08 13:43:42.190479 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.190456 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08f23d9b-da1c-4813-a46c-833263139241-tmp-dir\") pod \"dns-default-hfcp7\" (UID: \"08f23d9b-da1c-4813-a46c-833263139241\") " pod="openshift-dns/dns-default-hfcp7" Jun 08 13:43:42.190479 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.190466 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/139a2ec4-1171-479a-a203-1c91f6547fcd-installation-pull-secrets\") pod \"image-registry-646c6ff68f-gn7v4\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:43:42.190793 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.190493 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/139a2ec4-1171-479a-a203-1c91f6547fcd-registry-certificates\") pod \"image-registry-646c6ff68f-gn7v4\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:43:42.190793 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.190525 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/139a2ec4-1171-479a-a203-1c91f6547fcd-ca-trust-extracted\") pod \"image-registry-646c6ff68f-gn7v4\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:43:42.190793 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.190547 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-bound-sa-token\") pod \"image-registry-646c6ff68f-gn7v4\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:43:42.190793 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.190594 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzkpr\" (UniqueName: \"kubernetes.io/projected/08f23d9b-da1c-4813-a46c-833263139241-kube-api-access-vzkpr\") pod \"dns-default-hfcp7\" (UID: \"08f23d9b-da1c-4813-a46c-833263139241\") " pod="openshift-dns/dns-default-hfcp7" Jun 08 13:43:42.190793 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.190665 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-registry-tls\") pod \"image-registry-646c6ff68f-gn7v4\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:43:42.191045 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:42.190800 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 13:43:42.191045 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:42.190814 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-646c6ff68f-gn7v4: secret "image-registry-tls" not found Jun 08 13:43:42.191045 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:42.190858 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-registry-tls podName:139a2ec4-1171-479a-a203-1c91f6547fcd nodeName:}" failed. No retries permitted until 2026-06-08 13:43:42.690842473 +0000 UTC m=+36.671870733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-registry-tls") pod "image-registry-646c6ff68f-gn7v4" (UID: "139a2ec4-1171-479a-a203-1c91f6547fcd") : secret "image-registry-tls" not found Jun 08 13:43:42.191045 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.190990 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/08f23d9b-da1c-4813-a46c-833263139241-config-volume\") pod \"dns-default-hfcp7\" (UID: \"08f23d9b-da1c-4813-a46c-833263139241\") " pod="openshift-dns/dns-default-hfcp7" Jun 08 13:43:42.191630 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.191598 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/139a2ec4-1171-479a-a203-1c91f6547fcd-trusted-ca\") pod \"image-registry-646c6ff68f-gn7v4\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:43:42.191999 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.191975 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/139a2ec4-1171-479a-a203-1c91f6547fcd-ca-trust-extracted\") pod \"image-registry-646c6ff68f-gn7v4\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:43:42.192213 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.192175 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/139a2ec4-1171-479a-a203-1c91f6547fcd-registry-certificates\") pod \"image-registry-646c6ff68f-gn7v4\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:43:42.194879 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.194806 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/139a2ec4-1171-479a-a203-1c91f6547fcd-installation-pull-secrets\") pod \"image-registry-646c6ff68f-gn7v4\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:43:42.194879 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.194808 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/139a2ec4-1171-479a-a203-1c91f6547fcd-image-registry-private-configuration\") pod \"image-registry-646c6ff68f-gn7v4\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:43:42.194879 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.194860 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da03cecf-0ab0-48c7-bd1b-ba9d7d1798b6-cert\") pod \"ingress-canary-28v6r\" (UID: \"da03cecf-0ab0-48c7-bd1b-ba9d7d1798b6\") " pod="openshift-ingress-canary/ingress-canary-28v6r" Jun 08 13:43:42.199497 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.199472 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-bound-sa-token\") pod \"image-registry-646c6ff68f-gn7v4\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:43:42.199603 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.199579 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xclc\" (UniqueName: \"kubernetes.io/projected/da03cecf-0ab0-48c7-bd1b-ba9d7d1798b6-kube-api-access-4xclc\") pod \"ingress-canary-28v6r\" (UID: \"da03cecf-0ab0-48c7-bd1b-ba9d7d1798b6\") " pod="openshift-ingress-canary/ingress-canary-28v6r" Jun 08 13:43:42.199799 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.199750 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktxft\" (UniqueName: \"kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-kube-api-access-ktxft\") pod \"image-registry-646c6ff68f-gn7v4\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:43:42.199906 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.199846 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzkpr\" (UniqueName: \"kubernetes.io/projected/08f23d9b-da1c-4813-a46c-833263139241-kube-api-access-vzkpr\") pod \"dns-default-hfcp7\" (UID: \"08f23d9b-da1c-4813-a46c-833263139241\") " pod="openshift-dns/dns-default-hfcp7" Jun 08 13:43:42.251319 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.251300 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-28v6r" Jun 08 13:43:42.367811 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.367775 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:43:42.460535 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.460460 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:43:42.470509 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.470485 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7p22" Jun 08 13:43:42.470650 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.470486 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:43:42.473755 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.473735 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-229wc\"" Jun 08 13:43:42.473755 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.473733 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 13:43:42.473956 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.473808 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 13:43:42.473956 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.473742 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 13:43:42.526802 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.526773 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:43:42.696155 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.696111 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-registry-tls\") pod \"image-registry-646c6ff68f-gn7v4\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:43:42.696339 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.696170 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08f23d9b-da1c-4813-a46c-833263139241-metrics-tls\") pod \"dns-default-hfcp7\" (UID: \"08f23d9b-da1c-4813-a46c-833263139241\") " pod="openshift-dns/dns-default-hfcp7" Jun 08 13:43:42.696339 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:42.696265 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 13:43:42.696339 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:42.696286 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-646c6ff68f-gn7v4: secret "image-registry-tls" not found Jun 08 13:43:42.696339 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:42.696329 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:43:42.696545 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:42.696363 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-registry-tls podName:139a2ec4-1171-479a-a203-1c91f6547fcd nodeName:}" failed. No retries permitted until 2026-06-08 13:43:43.696342894 +0000 UTC m=+37.677371145 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-registry-tls") pod "image-registry-646c6ff68f-gn7v4" (UID: "139a2ec4-1171-479a-a203-1c91f6547fcd") : secret "image-registry-tls" not found Jun 08 13:43:42.696545 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:42.696385 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08f23d9b-da1c-4813-a46c-833263139241-metrics-tls podName:08f23d9b-da1c-4813-a46c-833263139241 nodeName:}" failed. No retries permitted until 2026-06-08 13:43:43.696375207 +0000 UTC m=+37.677403459 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08f23d9b-da1c-4813-a46c-833263139241-metrics-tls") pod "dns-default-hfcp7" (UID: "08f23d9b-da1c-4813-a46c-833263139241") : secret "dns-default-metrics-tls" not found Jun 08 13:43:42.905222 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:42.905042 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-28v6r"] Jun 08 13:43:42.908969 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:43:42.908947 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda03cecf_0ab0_48c7_bd1b_ba9d7d1798b6.slice/crio-0a9b98654a97db26086552994524231ed80cc3e48bb3eceb8ef8777ccf117c22 WatchSource:0}: Error finding container 0a9b98654a97db26086552994524231ed80cc3e48bb3eceb8ef8777ccf117c22: Status 404 returned error can't find the container with id 0a9b98654a97db26086552994524231ed80cc3e48bb3eceb8ef8777ccf117c22 Jun 08 13:43:43.471089 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:43.471067 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:43:43.473970 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:43.473943 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 13:43:43.474063 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:43.473972 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-96pfm\"" Jun 08 13:43:43.703407 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:43.703375 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-registry-tls\") pod \"image-registry-646c6ff68f-gn7v4\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:43:43.703407 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:43.703410 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08f23d9b-da1c-4813-a46c-833263139241-metrics-tls\") pod \"dns-default-hfcp7\" (UID: \"08f23d9b-da1c-4813-a46c-833263139241\") " pod="openshift-dns/dns-default-hfcp7" Jun 08 13:43:43.703618 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:43.703519 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 13:43:43.703618 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:43.703534 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-646c6ff68f-gn7v4: secret "image-registry-tls" not found Jun 08 13:43:43.703618 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:43.703550 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:43:43.703618 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:43.703583 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-registry-tls podName:139a2ec4-1171-479a-a203-1c91f6547fcd nodeName:}" failed. No retries permitted until 2026-06-08 13:43:45.703568703 +0000 UTC m=+39.684596949 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-registry-tls") pod "image-registry-646c6ff68f-gn7v4" (UID: "139a2ec4-1171-479a-a203-1c91f6547fcd") : secret "image-registry-tls" not found Jun 08 13:43:43.703618 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:43.703612 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08f23d9b-da1c-4813-a46c-833263139241-metrics-tls podName:08f23d9b-da1c-4813-a46c-833263139241 nodeName:}" failed. No retries permitted until 2026-06-08 13:43:45.703596823 +0000 UTC m=+39.684625073 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08f23d9b-da1c-4813-a46c-833263139241-metrics-tls") pod "dns-default-hfcp7" (UID: "08f23d9b-da1c-4813-a46c-833263139241") : secret "dns-default-metrics-tls" not found Jun 08 13:43:43.824017 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:43.823912 2561 generic.go:356] "Generic (PLEG): container finished" podID="5c017e70-8e4b-413f-9ee8-4d99892258ae" containerID="8f7fd8eebd981c9e84502cd4a0e8f196f1585f3134b39ea2a6ab14962ed6710f" exitCode=0 Jun 08 13:43:43.824017 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:43.823956 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkjkk" event={"ID":"5c017e70-8e4b-413f-9ee8-4d99892258ae","Type":"ContainerDied","Data":"8f7fd8eebd981c9e84502cd4a0e8f196f1585f3134b39ea2a6ab14962ed6710f"} Jun 08 13:43:43.825487 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:43.825458 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-28v6r" event={"ID":"da03cecf-0ab0-48c7-bd1b-ba9d7d1798b6","Type":"ContainerStarted","Data":"0a9b98654a97db26086552994524231ed80cc3e48bb3eceb8ef8777ccf117c22"} Jun 08 13:43:44.829740 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:44.829705 2561 generic.go:356] "Generic (PLEG): container finished" podID="5c017e70-8e4b-413f-9ee8-4d99892258ae" containerID="a16438566756a1642204aa536d010d36cd10b6f9dde61c7fc4612a2b655dc621" exitCode=0 Jun 08 13:43:44.830284 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:44.829778 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkjkk" event={"ID":"5c017e70-8e4b-413f-9ee8-4d99892258ae","Type":"ContainerDied","Data":"a16438566756a1642204aa536d010d36cd10b6f9dde61c7fc4612a2b655dc621"} Jun 08 13:43:45.623589 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:45.623376 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:43:45.682743 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:45.682708 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:43:45.719829 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:45.719801 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-registry-tls\") pod \"image-registry-646c6ff68f-gn7v4\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:43:45.719929 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:45.719838 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08f23d9b-da1c-4813-a46c-833263139241-metrics-tls\") pod \"dns-default-hfcp7\" (UID: \"08f23d9b-da1c-4813-a46c-833263139241\") " pod="openshift-dns/dns-default-hfcp7" Jun 08 13:43:45.720005 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:45.719961 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 13:43:45.720005 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:45.719976 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-646c6ff68f-gn7v4: secret "image-registry-tls" not found Jun 08 13:43:45.720005 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:45.719980 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:43:45.720122 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:45.720026 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-registry-tls podName:139a2ec4-1171-479a-a203-1c91f6547fcd nodeName:}" failed. No retries permitted until 2026-06-08 13:43:49.720012812 +0000 UTC m=+43.701041059 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-registry-tls") pod "image-registry-646c6ff68f-gn7v4" (UID: "139a2ec4-1171-479a-a203-1c91f6547fcd") : secret "image-registry-tls" not found Jun 08 13:43:45.720122 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:45.720039 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08f23d9b-da1c-4813-a46c-833263139241-metrics-tls podName:08f23d9b-da1c-4813-a46c-833263139241 nodeName:}" failed. No retries permitted until 2026-06-08 13:43:49.720033334 +0000 UTC m=+43.701061580 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08f23d9b-da1c-4813-a46c-833263139241-metrics-tls") pod "dns-default-hfcp7" (UID: "08f23d9b-da1c-4813-a46c-833263139241") : secret "dns-default-metrics-tls" not found Jun 08 13:43:45.835410 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:45.835388 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkjkk" event={"ID":"5c017e70-8e4b-413f-9ee8-4d99892258ae","Type":"ContainerStarted","Data":"0e5e55ed05d04f4140c816150a1730414d1383bfb1e216d6ca1e777885ae57e8"} Jun 08 13:43:45.836756 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:45.836737 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-28v6r" event={"ID":"da03cecf-0ab0-48c7-bd1b-ba9d7d1798b6","Type":"ContainerStarted","Data":"ed0a13d2ded246d253e45b4c42e1d3ab1042f1611eac4bbd09c32c4532fbea5f"} Jun 08 13:43:45.859774 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:45.859720 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jkjkk" podStartSLOduration=8.712319538 podStartE2EDuration="39.859706721s" totalImagesPullingTime="31.147387183s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:43:45.858386475 +0000 UTC m=+39.839414744" watchObservedRunningTime="2026-06-08 13:43:45.859706721 +0000 UTC m=+39.840734989" Jun 08 13:43:45.873639 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:45.873570 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-28v6r" podStartSLOduration=2.536848603 podStartE2EDuration="4.873558708s" totalImagesPullingTime="2.336710105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:43:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:43:45.873453586 +0000 UTC m=+39.854481867" watchObservedRunningTime="2026-06-08 13:43:45.873558708 +0000 UTC m=+39.854586977" Jun 08 13:43:46.087551 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:46.087527 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:43:46.152217 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:46.152193 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:43:49.267598 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:49.267561 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:43:49.346853 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:49.346819 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:43:49.448489 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:49.448460 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:43:49.530502 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:49.530436 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:43:49.665256 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:49.665227 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:43:49.747026 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:49.747000 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-registry-tls\") pod \"image-registry-646c6ff68f-gn7v4\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:43:49.747128 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:49.747030 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08f23d9b-da1c-4813-a46c-833263139241-metrics-tls\") pod \"dns-default-hfcp7\" (UID: \"08f23d9b-da1c-4813-a46c-833263139241\") " pod="openshift-dns/dns-default-hfcp7" Jun 08 13:43:49.747164 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:49.747140 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:43:49.747193 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:49.747142 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 13:43:49.747193 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:49.747183 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08f23d9b-da1c-4813-a46c-833263139241-metrics-tls podName:08f23d9b-da1c-4813-a46c-833263139241 nodeName:}" failed. No retries permitted until 2026-06-08 13:43:57.747171866 +0000 UTC m=+51.728200112 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08f23d9b-da1c-4813-a46c-833263139241-metrics-tls") pod "dns-default-hfcp7" (UID: "08f23d9b-da1c-4813-a46c-833263139241") : secret "dns-default-metrics-tls" not found Jun 08 13:43:49.747193 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:49.747188 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-646c6ff68f-gn7v4: secret "image-registry-tls" not found Jun 08 13:43:49.747298 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:49.747225 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-registry-tls podName:139a2ec4-1171-479a-a203-1c91f6547fcd nodeName:}" failed. No retries permitted until 2026-06-08 13:43:57.747214741 +0000 UTC m=+51.728242988 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-registry-tls") pod "image-registry-646c6ff68f-gn7v4" (UID: "139a2ec4-1171-479a-a203-1c91f6547fcd") : secret "image-registry-tls" not found Jun 08 13:43:49.761252 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:49.761230 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:43:50.407126 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:50.407089 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:43:50.468221 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:50.468199 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:43:50.783200 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:50.783107 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:43:50.882777 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:50.882746 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:43:55.362749 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:55.362717 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:43:55.462849 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:55.462819 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:43:56.308695 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:56.308664 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:43:56.373205 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:56.373178 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:43:57.799754 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:57.799724 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-registry-tls\") pod \"image-registry-646c6ff68f-gn7v4\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:43:57.799754 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:43:57.799754 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08f23d9b-da1c-4813-a46c-833263139241-metrics-tls\") pod \"dns-default-hfcp7\" (UID: \"08f23d9b-da1c-4813-a46c-833263139241\") " pod="openshift-dns/dns-default-hfcp7" Jun 08 13:43:57.800204 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:57.799855 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:43:57.800204 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:57.799863 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 13:43:57.800204 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:57.799877 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-646c6ff68f-gn7v4: secret "image-registry-tls" not found Jun 08 13:43:57.800204 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:57.799902 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08f23d9b-da1c-4813-a46c-833263139241-metrics-tls podName:08f23d9b-da1c-4813-a46c-833263139241 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:13.799890167 +0000 UTC m=+67.780918413 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08f23d9b-da1c-4813-a46c-833263139241-metrics-tls") pod "dns-default-hfcp7" (UID: "08f23d9b-da1c-4813-a46c-833263139241") : secret "dns-default-metrics-tls" not found Jun 08 13:43:57.800204 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:43:57.799914 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-registry-tls podName:139a2ec4-1171-479a-a203-1c91f6547fcd nodeName:}" failed. No retries permitted until 2026-06-08 13:44:13.799909032 +0000 UTC m=+67.780937278 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-registry-tls") pod "image-registry-646c6ff68f-gn7v4" (UID: "139a2ec4-1171-479a-a203-1c91f6547fcd") : secret "image-registry-tls" not found Jun 08 13:44:00.296211 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:00.296173 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:04.071865 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.071828 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4grq5"] Jun 08 13:44:04.074134 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.074118 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ttw8m"] Jun 08 13:44:04.074245 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.074228 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4grq5" Jun 08 13:44:04.075644 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.075623 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ttw8m" Jun 08 13:44:04.076980 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.076963 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-jdfs6\"" Jun 08 13:44:04.076980 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.076972 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 08 13:44:04.077225 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.077210 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 08 13:44:04.078114 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.078094 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 08 13:44:04.078325 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.078310 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 08 13:44:04.078388 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.078329 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 08 13:44:04.078388 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.078329 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 08 13:44:04.078497 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.078425 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-wghqk\"" Jun 08 13:44:04.086149 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.086130 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4grq5"] Jun 08 13:44:04.087044 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.087024 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ttw8m"] Jun 08 13:44:04.144717 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.144694 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/79b6e8f8-b91f-4d94-8a43-3925d18615c3-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-ttw8m\" (UID: \"79b6e8f8-b91f-4d94-8a43-3925d18615c3\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ttw8m" Jun 08 13:44:04.144835 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.144722 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22tcv\" (UniqueName: \"kubernetes.io/projected/79b6e8f8-b91f-4d94-8a43-3925d18615c3-kube-api-access-22tcv\") pod \"service-ca-operator-6bc5ff68f5-ttw8m\" (UID: \"79b6e8f8-b91f-4d94-8a43-3925d18615c3\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ttw8m" Jun 08 13:44:04.144835 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.144828 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/79b6e8f8-b91f-4d94-8a43-3925d18615c3-config\") pod \"service-ca-operator-6bc5ff68f5-ttw8m\" (UID: \"79b6e8f8-b91f-4d94-8a43-3925d18615c3\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ttw8m" Jun 08 13:44:04.144931 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.144862 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5xmk\" (UniqueName: \"kubernetes.io/projected/070c0e0e-a4fd-40bb-bc17-b8eacbedd81a-kube-api-access-f5xmk\") pod \"volume-data-source-validator-78dd696465-4grq5\" (UID: \"070c0e0e-a4fd-40bb-bc17-b8eacbedd81a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4grq5" Jun 08 13:44:04.158696 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.158679 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-8rmnl"] Jun 08 13:44:04.160371 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.160358 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-8rmnl" Jun 08 13:44:04.162514 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.162495 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fzt4k"] Jun 08 13:44:04.162879 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.162860 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-gfq2r\"" Jun 08 13:44:04.164120 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.164104 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-k4lxx"] Jun 08 13:44:04.164227 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.164213 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fzt4k" Jun 08 13:44:04.165934 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.165919 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-k4lxx" Jun 08 13:44:04.167711 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.167687 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-dvrdv\"" Jun 08 13:44:04.168176 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.168155 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 08 13:44:04.169986 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.169963 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 08 13:44:04.170668 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.169974 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 08 13:44:04.170772 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.170710 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-br45s\"" Jun 08 13:44:04.171857 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.171839 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 08 13:44:04.171939 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.171890 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 08 13:44:04.171990 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.171960 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 08 13:44:04.174107 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.174089 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-8rmnl"] Jun 08 13:44:04.185022 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.185002 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fzt4k"] Jun 08 13:44:04.185882 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.185865 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-k4lxx"] Jun 08 13:44:04.186456 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.186440 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vx96x"] Jun 08 13:44:04.188042 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.188027 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vx96x" Jun 08 13:44:04.190550 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.190533 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-j8sxj\"" Jun 08 13:44:04.190642 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.190537 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 08 13:44:04.190825 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.190807 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 08 13:44:04.190912 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.190855 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 08 13:44:04.190912 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.190889 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 08 13:44:04.194700 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.194677 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vx96x"] Jun 08 13:44:04.245958 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.245935 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1bf3f3fe-50d8-424f-81f2-b1c3bc33620e-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-vx96x\" (UID: \"1bf3f3fe-50d8-424f-81f2-b1c3bc33620e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vx96x" Jun 08 13:44:04.246061 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.245971 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9j6g\" (UniqueName: \"kubernetes.io/projected/3a631351-b41a-4d67-952f-96bb322cddc9-kube-api-access-j9j6g\") pod \"cluster-monitoring-operator-74bbf69bbb-fzt4k\" (UID: \"3a631351-b41a-4d67-952f-96bb322cddc9\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fzt4k" Jun 08 13:44:04.246061 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.246028 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1bf3f3fe-50d8-424f-81f2-b1c3bc33620e-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-vx96x\" (UID: \"1bf3f3fe-50d8-424f-81f2-b1c3bc33620e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vx96x" Jun 08 13:44:04.246061 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.246056 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a631351-b41a-4d67-952f-96bb322cddc9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fzt4k\" (UID: \"3a631351-b41a-4d67-952f-96bb322cddc9\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fzt4k" Jun 08 13:44:04.246203 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.246096 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3a631351-b41a-4d67-952f-96bb322cddc9-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-fzt4k\" (UID: \"3a631351-b41a-4d67-952f-96bb322cddc9\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fzt4k" Jun 08 13:44:04.246203 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.246133 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/79b6e8f8-b91f-4d94-8a43-3925d18615c3-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-ttw8m\" (UID: \"79b6e8f8-b91f-4d94-8a43-3925d18615c3\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ttw8m" Jun 08 13:44:04.246203 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.246167 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22tcv\" (UniqueName: \"kubernetes.io/projected/79b6e8f8-b91f-4d94-8a43-3925d18615c3-kube-api-access-22tcv\") pod \"service-ca-operator-6bc5ff68f5-ttw8m\" (UID: \"79b6e8f8-b91f-4d94-8a43-3925d18615c3\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ttw8m" Jun 08 13:44:04.246353 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.246251 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ba77c5b-eaff-4674-9cd8-897e0da339b4-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-k4lxx\" (UID: \"0ba77c5b-eaff-4674-9cd8-897e0da339b4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-k4lxx" Jun 08 13:44:04.246353 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.246281 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5xmk\" (UniqueName: \"kubernetes.io/projected/070c0e0e-a4fd-40bb-bc17-b8eacbedd81a-kube-api-access-f5xmk\") pod \"volume-data-source-validator-78dd696465-4grq5\" (UID: \"070c0e0e-a4fd-40bb-bc17-b8eacbedd81a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4grq5" Jun 08 13:44:04.246353 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.246310 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/79b6e8f8-b91f-4d94-8a43-3925d18615c3-config\") pod \"service-ca-operator-6bc5ff68f5-ttw8m\" (UID: \"79b6e8f8-b91f-4d94-8a43-3925d18615c3\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ttw8m" Jun 08 13:44:04.246504 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.246365 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0ba77c5b-eaff-4674-9cd8-897e0da339b4-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-k4lxx\" (UID: \"0ba77c5b-eaff-4674-9cd8-897e0da339b4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-k4lxx" Jun 08 13:44:04.246504 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.246409 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4pr4\" (UniqueName: \"kubernetes.io/projected/1bf3f3fe-50d8-424f-81f2-b1c3bc33620e-kube-api-access-r4pr4\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-vx96x\" (UID: \"1bf3f3fe-50d8-424f-81f2-b1c3bc33620e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vx96x" Jun 08 13:44:04.246504 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.246450 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bclv\" (UniqueName: \"kubernetes.io/projected/c39ac88f-8047-42a3-b90f-8868c686fe8a-kube-api-access-2bclv\") pod \"network-check-source-dbd9cf844-8rmnl\" (UID: \"c39ac88f-8047-42a3-b90f-8868c686fe8a\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-8rmnl" Jun 08 13:44:04.246871 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.246846 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/79b6e8f8-b91f-4d94-8a43-3925d18615c3-config\") pod \"service-ca-operator-6bc5ff68f5-ttw8m\" (UID: \"79b6e8f8-b91f-4d94-8a43-3925d18615c3\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ttw8m" Jun 08 13:44:04.249497 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.249478 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/79b6e8f8-b91f-4d94-8a43-3925d18615c3-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-ttw8m\" (UID: \"79b6e8f8-b91f-4d94-8a43-3925d18615c3\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ttw8m" Jun 08 13:44:04.259740 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.259722 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22tcv\" (UniqueName: \"kubernetes.io/projected/79b6e8f8-b91f-4d94-8a43-3925d18615c3-kube-api-access-22tcv\") pod \"service-ca-operator-6bc5ff68f5-ttw8m\" (UID: \"79b6e8f8-b91f-4d94-8a43-3925d18615c3\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ttw8m" Jun 08 13:44:04.260517 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.260503 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-l7lbv"] Jun 08 13:44:04.262188 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.262171 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" Jun 08 13:44:04.263675 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.263630 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5xmk\" (UniqueName: \"kubernetes.io/projected/070c0e0e-a4fd-40bb-bc17-b8eacbedd81a-kube-api-access-f5xmk\") pod \"volume-data-source-validator-78dd696465-4grq5\" (UID: \"070c0e0e-a4fd-40bb-bc17-b8eacbedd81a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4grq5" Jun 08 13:44:04.264674 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.264657 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 08 13:44:04.264774 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.264686 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 08 13:44:04.265008 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.264996 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-6m85q\"" Jun 08 13:44:04.265085 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.265024 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 08 13:44:04.265207 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.265195 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 08 13:44:04.267819 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.267799 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-2v2bz"] Jun 08 13:44:04.269715 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.269694 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-2v2bz" Jun 08 13:44:04.269820 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.269787 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-76c77975cf-zh8wm"] Jun 08 13:44:04.271332 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.271314 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 08 13:44:04.271703 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.271688 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-76c77975cf-zh8wm" Jun 08 13:44:04.272347 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.272331 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 08 13:44:04.272676 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.272659 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-6wgxs\"" Jun 08 13:44:04.272676 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.272674 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 08 13:44:04.273193 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.273174 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 08 13:44:04.273530 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.273514 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 08 13:44:04.273958 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.273944 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 08 13:44:04.274883 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.274861 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 08 13:44:04.274883 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.274876 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7qcdg\"" Jun 08 13:44:04.275748 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.275536 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 08 13:44:04.275748 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.275568 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 08 13:44:04.275748 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.275621 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 08 13:44:04.277657 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.276716 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 08 13:44:04.282804 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.282713 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 08 13:44:04.283955 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.283935 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-l7lbv"] Jun 08 13:44:04.284808 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.284789 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-2v2bz"] Jun 08 13:44:04.301197 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.301177 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-76c77975cf-zh8wm"] Jun 08 13:44:04.310195 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.310172 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:04.346802 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.346740 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bclv\" (UniqueName: \"kubernetes.io/projected/c39ac88f-8047-42a3-b90f-8868c686fe8a-kube-api-access-2bclv\") pod \"network-check-source-dbd9cf844-8rmnl\" (UID: \"c39ac88f-8047-42a3-b90f-8868c686fe8a\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-8rmnl" Jun 08 13:44:04.346802 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.346784 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-metrics-certs\") pod \"router-default-76c77975cf-zh8wm\" (UID: \"3977f3b1-efb9-45fb-8c63-9f7c504f8eed\") " pod="openshift-ingress/router-default-76c77975cf-zh8wm" Jun 08 13:44:04.346927 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.346803 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0453a3c5-bb95-4060-bd97-67aba216bcc6-serving-cert\") pod \"console-operator-668fdbf85c-l7lbv\" (UID: \"0453a3c5-bb95-4060-bd97-67aba216bcc6\") " pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" Jun 08 13:44:04.346927 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.346821 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1bf3f3fe-50d8-424f-81f2-b1c3bc33620e-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-vx96x\" (UID: \"1bf3f3fe-50d8-424f-81f2-b1c3bc33620e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vx96x" Jun 08 13:44:04.346927 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.346840 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9j6g\" (UniqueName: \"kubernetes.io/projected/3a631351-b41a-4d67-952f-96bb322cddc9-kube-api-access-j9j6g\") pod \"cluster-monitoring-operator-74bbf69bbb-fzt4k\" (UID: \"3a631351-b41a-4d67-952f-96bb322cddc9\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fzt4k" Jun 08 13:44:04.346927 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.346888 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1bf3f3fe-50d8-424f-81f2-b1c3bc33620e-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-vx96x\" (UID: \"1bf3f3fe-50d8-424f-81f2-b1c3bc33620e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vx96x" Jun 08 13:44:04.347081 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.347001 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10b62eb7-d904-4652-bb5a-a6cb57c7df03-trusted-ca-bundle\") pod \"insights-operator-896549976-2v2bz\" (UID: \"10b62eb7-d904-4652-bb5a-a6cb57c7df03\") " pod="openshift-insights/insights-operator-896549976-2v2bz" Jun 08 13:44:04.347081 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.347040 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a631351-b41a-4d67-952f-96bb322cddc9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fzt4k\" (UID: \"3a631351-b41a-4d67-952f-96bb322cddc9\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fzt4k" Jun 08 13:44:04.347081 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.347063 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3a631351-b41a-4d67-952f-96bb322cddc9-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-fzt4k\" (UID: \"3a631351-b41a-4d67-952f-96bb322cddc9\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fzt4k" Jun 08 13:44:04.347236 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.347085 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nxr5\" (UniqueName: \"kubernetes.io/projected/10b62eb7-d904-4652-bb5a-a6cb57c7df03-kube-api-access-8nxr5\") pod \"insights-operator-896549976-2v2bz\" (UID: \"10b62eb7-d904-4652-bb5a-a6cb57c7df03\") " pod="openshift-insights/insights-operator-896549976-2v2bz" Jun 08 13:44:04.347236 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.347132 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-stats-auth\") pod \"router-default-76c77975cf-zh8wm\" (UID: \"3977f3b1-efb9-45fb-8c63-9f7c504f8eed\") " pod="openshift-ingress/router-default-76c77975cf-zh8wm" Jun 08 13:44:04.347236 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:04.347158 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 13:44:04.347236 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.347164 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/10b62eb7-d904-4652-bb5a-a6cb57c7df03-snapshots\") pod \"insights-operator-896549976-2v2bz\" (UID: \"10b62eb7-d904-4652-bb5a-a6cb57c7df03\") " pod="openshift-insights/insights-operator-896549976-2v2bz" Jun 08 13:44:04.347236 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:04.347210 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a631351-b41a-4d67-952f-96bb322cddc9-cluster-monitoring-operator-tls podName:3a631351-b41a-4d67-952f-96bb322cddc9 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:04.847194161 +0000 UTC m=+58.828222408 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3a631351-b41a-4d67-952f-96bb322cddc9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-fzt4k" (UID: "3a631351-b41a-4d67-952f-96bb322cddc9") : secret "cluster-monitoring-operator-tls" not found Jun 08 13:44:04.347496 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.347250 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7d98\" (UniqueName: \"kubernetes.io/projected/0453a3c5-bb95-4060-bd97-67aba216bcc6-kube-api-access-s7d98\") pod \"console-operator-668fdbf85c-l7lbv\" (UID: \"0453a3c5-bb95-4060-bd97-67aba216bcc6\") " pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" Jun 08 13:44:04.347496 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.347280 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-service-ca-bundle\") pod \"router-default-76c77975cf-zh8wm\" (UID: \"3977f3b1-efb9-45fb-8c63-9f7c504f8eed\") " pod="openshift-ingress/router-default-76c77975cf-zh8wm" Jun 08 13:44:04.347496 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.347319 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ba77c5b-eaff-4674-9cd8-897e0da339b4-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-k4lxx\" (UID: \"0ba77c5b-eaff-4674-9cd8-897e0da339b4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-k4lxx" Jun 08 13:44:04.347496 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.347353 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10b62eb7-d904-4652-bb5a-a6cb57c7df03-tmp\") pod \"insights-operator-896549976-2v2bz\" (UID: \"10b62eb7-d904-4652-bb5a-a6cb57c7df03\") " pod="openshift-insights/insights-operator-896549976-2v2bz" Jun 08 13:44:04.347496 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:04.347442 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 13:44:04.347496 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.347464 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/10b62eb7-d904-4652-bb5a-a6cb57c7df03-serving-cert\") pod \"insights-operator-896549976-2v2bz\" (UID: \"10b62eb7-d904-4652-bb5a-a6cb57c7df03\") " pod="openshift-insights/insights-operator-896549976-2v2bz" Jun 08 13:44:04.347496 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.347480 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1bf3f3fe-50d8-424f-81f2-b1c3bc33620e-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-vx96x\" (UID: \"1bf3f3fe-50d8-424f-81f2-b1c3bc33620e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vx96x" Jun 08 13:44:04.347496 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:04.347499 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ba77c5b-eaff-4674-9cd8-897e0da339b4-networking-console-plugin-cert podName:0ba77c5b-eaff-4674-9cd8-897e0da339b4 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:04.847483524 +0000 UTC m=+58.828511774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0ba77c5b-eaff-4674-9cd8-897e0da339b4-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-k4lxx" (UID: "0ba77c5b-eaff-4674-9cd8-897e0da339b4") : secret "networking-console-plugin-cert" not found Jun 08 13:44:04.347496 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.347488 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0453a3c5-bb95-4060-bd97-67aba216bcc6-config\") pod \"console-operator-668fdbf85c-l7lbv\" (UID: \"0453a3c5-bb95-4060-bd97-67aba216bcc6\") " pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" Jun 08 13:44:04.347994 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.347532 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-default-certificate\") pod \"router-default-76c77975cf-zh8wm\" (UID: \"3977f3b1-efb9-45fb-8c63-9f7c504f8eed\") " pod="openshift-ingress/router-default-76c77975cf-zh8wm" Jun 08 13:44:04.347994 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.347551 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0ba77c5b-eaff-4674-9cd8-897e0da339b4-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-k4lxx\" (UID: \"0ba77c5b-eaff-4674-9cd8-897e0da339b4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-k4lxx" Jun 08 13:44:04.347994 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.347584 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10b62eb7-d904-4652-bb5a-a6cb57c7df03-service-ca-bundle\") pod \"insights-operator-896549976-2v2bz\" (UID: \"10b62eb7-d904-4652-bb5a-a6cb57c7df03\") " pod="openshift-insights/insights-operator-896549976-2v2bz" Jun 08 13:44:04.347994 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.347606 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4m8p\" (UniqueName: \"kubernetes.io/projected/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-kube-api-access-g4m8p\") pod \"router-default-76c77975cf-zh8wm\" (UID: \"3977f3b1-efb9-45fb-8c63-9f7c504f8eed\") " pod="openshift-ingress/router-default-76c77975cf-zh8wm" Jun 08 13:44:04.347994 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.347620 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0453a3c5-bb95-4060-bd97-67aba216bcc6-trusted-ca\") pod \"console-operator-668fdbf85c-l7lbv\" (UID: \"0453a3c5-bb95-4060-bd97-67aba216bcc6\") " pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" Jun 08 13:44:04.347994 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.347653 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4pr4\" (UniqueName: \"kubernetes.io/projected/1bf3f3fe-50d8-424f-81f2-b1c3bc33620e-kube-api-access-r4pr4\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-vx96x\" (UID: \"1bf3f3fe-50d8-424f-81f2-b1c3bc33620e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vx96x" Jun 08 13:44:04.347994 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.347729 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3a631351-b41a-4d67-952f-96bb322cddc9-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-fzt4k\" (UID: \"3a631351-b41a-4d67-952f-96bb322cddc9\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fzt4k" Jun 08 13:44:04.348363 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.348099 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0ba77c5b-eaff-4674-9cd8-897e0da339b4-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-k4lxx\" (UID: \"0ba77c5b-eaff-4674-9cd8-897e0da339b4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-k4lxx" Jun 08 13:44:04.349170 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.349152 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1bf3f3fe-50d8-424f-81f2-b1c3bc33620e-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-vx96x\" (UID: \"1bf3f3fe-50d8-424f-81f2-b1c3bc33620e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vx96x" Jun 08 13:44:04.361078 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.361054 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dpch7"] Jun 08 13:44:04.363253 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.363239 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dpch7" Jun 08 13:44:04.363897 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.363877 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9j6g\" (UniqueName: \"kubernetes.io/projected/3a631351-b41a-4d67-952f-96bb322cddc9-kube-api-access-j9j6g\") pod \"cluster-monitoring-operator-74bbf69bbb-fzt4k\" (UID: \"3a631351-b41a-4d67-952f-96bb322cddc9\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fzt4k" Jun 08 13:44:04.365942 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.365923 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 08 13:44:04.365942 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.365938 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-96src\"" Jun 08 13:44:04.366184 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.366169 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 08 13:44:04.366227 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.366169 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 08 13:44:04.366657 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.366639 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4pr4\" (UniqueName: \"kubernetes.io/projected/1bf3f3fe-50d8-424f-81f2-b1c3bc33620e-kube-api-access-r4pr4\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-vx96x\" (UID: \"1bf3f3fe-50d8-424f-81f2-b1c3bc33620e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vx96x" Jun 08 13:44:04.366818 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.366798 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bclv\" (UniqueName: \"kubernetes.io/projected/c39ac88f-8047-42a3-b90f-8868c686fe8a-kube-api-access-2bclv\") pod \"network-check-source-dbd9cf844-8rmnl\" (UID: \"c39ac88f-8047-42a3-b90f-8868c686fe8a\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-8rmnl" Jun 08 13:44:04.383680 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.383661 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4grq5" Jun 08 13:44:04.383980 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.383961 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dpch7"] Jun 08 13:44:04.389475 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.389458 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ttw8m" Jun 08 13:44:04.443991 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.443961 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:04.449198 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.448969 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10b62eb7-d904-4652-bb5a-a6cb57c7df03-tmp\") pod \"insights-operator-896549976-2v2bz\" (UID: \"10b62eb7-d904-4652-bb5a-a6cb57c7df03\") " pod="openshift-insights/insights-operator-896549976-2v2bz" Jun 08 13:44:04.449198 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.449010 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/10b62eb7-d904-4652-bb5a-a6cb57c7df03-serving-cert\") pod \"insights-operator-896549976-2v2bz\" (UID: \"10b62eb7-d904-4652-bb5a-a6cb57c7df03\") " pod="openshift-insights/insights-operator-896549976-2v2bz" Jun 08 13:44:04.449198 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.449077 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0453a3c5-bb95-4060-bd97-67aba216bcc6-config\") pod \"console-operator-668fdbf85c-l7lbv\" (UID: \"0453a3c5-bb95-4060-bd97-67aba216bcc6\") " pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" Jun 08 13:44:04.449198 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.449138 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-default-certificate\") pod \"router-default-76c77975cf-zh8wm\" (UID: \"3977f3b1-efb9-45fb-8c63-9f7c504f8eed\") " pod="openshift-ingress/router-default-76c77975cf-zh8wm" Jun 08 13:44:04.449198 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.449174 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10b62eb7-d904-4652-bb5a-a6cb57c7df03-service-ca-bundle\") pod \"insights-operator-896549976-2v2bz\" (UID: \"10b62eb7-d904-4652-bb5a-a6cb57c7df03\") " pod="openshift-insights/insights-operator-896549976-2v2bz" Jun 08 13:44:04.449524 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.449223 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4m8p\" (UniqueName: \"kubernetes.io/projected/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-kube-api-access-g4m8p\") pod \"router-default-76c77975cf-zh8wm\" (UID: \"3977f3b1-efb9-45fb-8c63-9f7c504f8eed\") " pod="openshift-ingress/router-default-76c77975cf-zh8wm" Jun 08 13:44:04.449524 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.449251 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0453a3c5-bb95-4060-bd97-67aba216bcc6-trusted-ca\") pod \"console-operator-668fdbf85c-l7lbv\" (UID: \"0453a3c5-bb95-4060-bd97-67aba216bcc6\") " pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" Jun 08 13:44:04.449524 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.449312 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-metrics-certs\") pod \"router-default-76c77975cf-zh8wm\" (UID: \"3977f3b1-efb9-45fb-8c63-9f7c504f8eed\") " pod="openshift-ingress/router-default-76c77975cf-zh8wm" Jun 08 13:44:04.449524 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.449336 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0453a3c5-bb95-4060-bd97-67aba216bcc6-serving-cert\") pod \"console-operator-668fdbf85c-l7lbv\" (UID: \"0453a3c5-bb95-4060-bd97-67aba216bcc6\") " pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" Jun 08 13:44:04.449524 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.449372 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10b62eb7-d904-4652-bb5a-a6cb57c7df03-trusted-ca-bundle\") pod \"insights-operator-896549976-2v2bz\" (UID: \"10b62eb7-d904-4652-bb5a-a6cb57c7df03\") " pod="openshift-insights/insights-operator-896549976-2v2bz" Jun 08 13:44:04.449524 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.449402 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/27fd7046-06c8-469e-a9b4-1e2758dfe0dc-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-dpch7\" (UID: \"27fd7046-06c8-469e-a9b4-1e2758dfe0dc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dpch7" Jun 08 13:44:04.449524 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.449441 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nxr5\" (UniqueName: \"kubernetes.io/projected/10b62eb7-d904-4652-bb5a-a6cb57c7df03-kube-api-access-8nxr5\") pod \"insights-operator-896549976-2v2bz\" (UID: \"10b62eb7-d904-4652-bb5a-a6cb57c7df03\") " pod="openshift-insights/insights-operator-896549976-2v2bz" Jun 08 13:44:04.449524 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.449464 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-stats-auth\") pod \"router-default-76c77975cf-zh8wm\" (UID: \"3977f3b1-efb9-45fb-8c63-9f7c504f8eed\") " pod="openshift-ingress/router-default-76c77975cf-zh8wm" Jun 08 13:44:04.449524 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.449495 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/10b62eb7-d904-4652-bb5a-a6cb57c7df03-snapshots\") pod \"insights-operator-896549976-2v2bz\" (UID: \"10b62eb7-d904-4652-bb5a-a6cb57c7df03\") " pod="openshift-insights/insights-operator-896549976-2v2bz" Jun 08 13:44:04.450035 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.449560 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7d98\" (UniqueName: \"kubernetes.io/projected/0453a3c5-bb95-4060-bd97-67aba216bcc6-kube-api-access-s7d98\") pod \"console-operator-668fdbf85c-l7lbv\" (UID: \"0453a3c5-bb95-4060-bd97-67aba216bcc6\") " pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" Jun 08 13:44:04.450035 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.449586 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glh66\" (UniqueName: \"kubernetes.io/projected/27fd7046-06c8-469e-a9b4-1e2758dfe0dc-kube-api-access-glh66\") pod \"cluster-samples-operator-854f8b96b6-dpch7\" (UID: \"27fd7046-06c8-469e-a9b4-1e2758dfe0dc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dpch7" Jun 08 13:44:04.450035 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.449619 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-service-ca-bundle\") pod \"router-default-76c77975cf-zh8wm\" (UID: \"3977f3b1-efb9-45fb-8c63-9f7c504f8eed\") " pod="openshift-ingress/router-default-76c77975cf-zh8wm" Jun 08 13:44:04.450035 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:04.449835 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-service-ca-bundle podName:3977f3b1-efb9-45fb-8c63-9f7c504f8eed nodeName:}" failed. No retries permitted until 2026-06-08 13:44:04.949815734 +0000 UTC m=+58.930843981 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-service-ca-bundle") pod "router-default-76c77975cf-zh8wm" (UID: "3977f3b1-efb9-45fb-8c63-9f7c504f8eed") : configmap references non-existent config key: service-ca.crt Jun 08 13:44:04.451394 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.450913 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10b62eb7-d904-4652-bb5a-a6cb57c7df03-trusted-ca-bundle\") pod \"insights-operator-896549976-2v2bz\" (UID: \"10b62eb7-d904-4652-bb5a-a6cb57c7df03\") " pod="openshift-insights/insights-operator-896549976-2v2bz" Jun 08 13:44:04.451750 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.451727 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0453a3c5-bb95-4060-bd97-67aba216bcc6-config\") pod \"console-operator-668fdbf85c-l7lbv\" (UID: \"0453a3c5-bb95-4060-bd97-67aba216bcc6\") " pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" Jun 08 13:44:04.452794 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:04.452331 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 13:44:04.452794 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:04.452391 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-metrics-certs podName:3977f3b1-efb9-45fb-8c63-9f7c504f8eed nodeName:}" failed. No retries permitted until 2026-06-08 13:44:04.952371475 +0000 UTC m=+58.933399737 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-metrics-certs") pod "router-default-76c77975cf-zh8wm" (UID: "3977f3b1-efb9-45fb-8c63-9f7c504f8eed") : secret "router-metrics-certs-default" not found Jun 08 13:44:04.452949 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.452907 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/10b62eb7-d904-4652-bb5a-a6cb57c7df03-snapshots\") pod \"insights-operator-896549976-2v2bz\" (UID: \"10b62eb7-d904-4652-bb5a-a6cb57c7df03\") " pod="openshift-insights/insights-operator-896549976-2v2bz" Jun 08 13:44:04.453270 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.453038 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10b62eb7-d904-4652-bb5a-a6cb57c7df03-tmp\") pod \"insights-operator-896549976-2v2bz\" (UID: \"10b62eb7-d904-4652-bb5a-a6cb57c7df03\") " pod="openshift-insights/insights-operator-896549976-2v2bz" Jun 08 13:44:04.453392 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.453369 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10b62eb7-d904-4652-bb5a-a6cb57c7df03-service-ca-bundle\") pod \"insights-operator-896549976-2v2bz\" (UID: \"10b62eb7-d904-4652-bb5a-a6cb57c7df03\") " pod="openshift-insights/insights-operator-896549976-2v2bz" Jun 08 13:44:04.454066 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.453875 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0453a3c5-bb95-4060-bd97-67aba216bcc6-trusted-ca\") pod \"console-operator-668fdbf85c-l7lbv\" (UID: \"0453a3c5-bb95-4060-bd97-67aba216bcc6\") " pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" Jun 08 13:44:04.455321 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.455276 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/10b62eb7-d904-4652-bb5a-a6cb57c7df03-serving-cert\") pod \"insights-operator-896549976-2v2bz\" (UID: \"10b62eb7-d904-4652-bb5a-a6cb57c7df03\") " pod="openshift-insights/insights-operator-896549976-2v2bz" Jun 08 13:44:04.455870 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.455752 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-default-certificate\") pod \"router-default-76c77975cf-zh8wm\" (UID: \"3977f3b1-efb9-45fb-8c63-9f7c504f8eed\") " pod="openshift-ingress/router-default-76c77975cf-zh8wm" Jun 08 13:44:04.456598 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.456569 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-stats-auth\") pod \"router-default-76c77975cf-zh8wm\" (UID: \"3977f3b1-efb9-45fb-8c63-9f7c504f8eed\") " pod="openshift-ingress/router-default-76c77975cf-zh8wm" Jun 08 13:44:04.457225 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.457198 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0453a3c5-bb95-4060-bd97-67aba216bcc6-serving-cert\") pod \"console-operator-668fdbf85c-l7lbv\" (UID: \"0453a3c5-bb95-4060-bd97-67aba216bcc6\") " pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" Jun 08 13:44:04.459625 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.459607 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7d98\" (UniqueName: \"kubernetes.io/projected/0453a3c5-bb95-4060-bd97-67aba216bcc6-kube-api-access-s7d98\") pod \"console-operator-668fdbf85c-l7lbv\" (UID: \"0453a3c5-bb95-4060-bd97-67aba216bcc6\") " pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" Jun 08 13:44:04.464118 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.464073 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4m8p\" (UniqueName: \"kubernetes.io/projected/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-kube-api-access-g4m8p\") pod \"router-default-76c77975cf-zh8wm\" (UID: \"3977f3b1-efb9-45fb-8c63-9f7c504f8eed\") " pod="openshift-ingress/router-default-76c77975cf-zh8wm" Jun 08 13:44:04.465227 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.464691 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nxr5\" (UniqueName: \"kubernetes.io/projected/10b62eb7-d904-4652-bb5a-a6cb57c7df03-kube-api-access-8nxr5\") pod \"insights-operator-896549976-2v2bz\" (UID: \"10b62eb7-d904-4652-bb5a-a6cb57c7df03\") " pod="openshift-insights/insights-operator-896549976-2v2bz" Jun 08 13:44:04.472159 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.472137 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-8rmnl" Jun 08 13:44:04.495557 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.495531 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vx96x" Jun 08 13:44:04.513107 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.513035 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4grq5"] Jun 08 13:44:04.515707 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.515637 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:04.515946 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:44:04.515925 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod070c0e0e_a4fd_40bb_bc17_b8eacbedd81a.slice/crio-43c34a26964a98974a2af47a2d5edb99317c8346e728304f84743b70f3f930e5 WatchSource:0}: Error finding container 43c34a26964a98974a2af47a2d5edb99317c8346e728304f84743b70f3f930e5: Status 404 returned error can't find the container with id 43c34a26964a98974a2af47a2d5edb99317c8346e728304f84743b70f3f930e5 Jun 08 13:44:04.528000 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.527971 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ttw8m"] Jun 08 13:44:04.531273 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:44:04.531236 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79b6e8f8_b91f_4d94_8a43_3925d18615c3.slice/crio-1d67f6a3ca52d74271815a34d06e7ce8f0fa6f13d6c2c7b944ec17ccbd844511 WatchSource:0}: Error finding container 1d67f6a3ca52d74271815a34d06e7ce8f0fa6f13d6c2c7b944ec17ccbd844511: Status 404 returned error can't find the container with id 1d67f6a3ca52d74271815a34d06e7ce8f0fa6f13d6c2c7b944ec17ccbd844511 Jun 08 13:44:04.550696 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.550666 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glh66\" (UniqueName: \"kubernetes.io/projected/27fd7046-06c8-469e-a9b4-1e2758dfe0dc-kube-api-access-glh66\") pod \"cluster-samples-operator-854f8b96b6-dpch7\" (UID: \"27fd7046-06c8-469e-a9b4-1e2758dfe0dc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dpch7" Jun 08 13:44:04.550897 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.550876 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/27fd7046-06c8-469e-a9b4-1e2758dfe0dc-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-dpch7\" (UID: \"27fd7046-06c8-469e-a9b4-1e2758dfe0dc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dpch7" Jun 08 13:44:04.551180 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:04.551041 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 13:44:04.551180 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:04.551108 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27fd7046-06c8-469e-a9b4-1e2758dfe0dc-samples-operator-tls podName:27fd7046-06c8-469e-a9b4-1e2758dfe0dc nodeName:}" failed. No retries permitted until 2026-06-08 13:44:05.051087678 +0000 UTC m=+59.032115928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/27fd7046-06c8-469e-a9b4-1e2758dfe0dc-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-dpch7" (UID: "27fd7046-06c8-469e-a9b4-1e2758dfe0dc") : secret "samples-operator-tls" not found Jun 08 13:44:04.560911 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.560871 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glh66\" (UniqueName: \"kubernetes.io/projected/27fd7046-06c8-469e-a9b4-1e2758dfe0dc-kube-api-access-glh66\") pod \"cluster-samples-operator-854f8b96b6-dpch7\" (UID: \"27fd7046-06c8-469e-a9b4-1e2758dfe0dc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dpch7" Jun 08 13:44:04.578674 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.578647 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" Jun 08 13:44:04.586426 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.586403 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-2v2bz" Jun 08 13:44:04.603575 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.603478 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-8rmnl"] Jun 08 13:44:04.605946 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:44:04.605919 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc39ac88f_8047_42a3_b90f_8868c686fe8a.slice/crio-fe048c2b81ffd57c585d856be44edbeb7397de02187972802838167762a8b114 WatchSource:0}: Error finding container fe048c2b81ffd57c585d856be44edbeb7397de02187972802838167762a8b114: Status 404 returned error can't find the container with id fe048c2b81ffd57c585d856be44edbeb7397de02187972802838167762a8b114 Jun 08 13:44:04.633537 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.633503 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vx96x"] Jun 08 13:44:04.638872 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:44:04.638840 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bf3f3fe_50d8_424f_81f2_b1c3bc33620e.slice/crio-889e29207950f67f1d91042d0fc06f6126719d5666d1bed8f698229aeb3839ae WatchSource:0}: Error finding container 889e29207950f67f1d91042d0fc06f6126719d5666d1bed8f698229aeb3839ae: Status 404 returned error can't find the container with id 889e29207950f67f1d91042d0fc06f6126719d5666d1bed8f698229aeb3839ae Jun 08 13:44:04.710655 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.710626 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-l7lbv"] Jun 08 13:44:04.715806 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:44:04.715730 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0453a3c5_bb95_4060_bd97_67aba216bcc6.slice/crio-a7058068b50900844a31dea42f2dd14c6e3e45994f40abb7e139d9ae2586c2ee WatchSource:0}: Error finding container a7058068b50900844a31dea42f2dd14c6e3e45994f40abb7e139d9ae2586c2ee: Status 404 returned error can't find the container with id a7058068b50900844a31dea42f2dd14c6e3e45994f40abb7e139d9ae2586c2ee Jun 08 13:44:04.729077 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.729052 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-2v2bz"] Jun 08 13:44:04.732545 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:44:04.732520 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10b62eb7_d904_4652_bb5a_a6cb57c7df03.slice/crio-749d9b76eb04f4b2f8c822f39dfc71ea38e4f39464b5e5aeac1e3f7c51ec85f7 WatchSource:0}: Error finding container 749d9b76eb04f4b2f8c822f39dfc71ea38e4f39464b5e5aeac1e3f7c51ec85f7: Status 404 returned error can't find the container with id 749d9b76eb04f4b2f8c822f39dfc71ea38e4f39464b5e5aeac1e3f7c51ec85f7 Jun 08 13:44:04.854349 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.854295 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ba77c5b-eaff-4674-9cd8-897e0da339b4-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-k4lxx\" (UID: \"0ba77c5b-eaff-4674-9cd8-897e0da339b4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-k4lxx" Jun 08 13:44:04.854438 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.854404 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a631351-b41a-4d67-952f-96bb322cddc9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fzt4k\" (UID: \"3a631351-b41a-4d67-952f-96bb322cddc9\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fzt4k" Jun 08 13:44:04.854480 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:04.854438 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 13:44:04.854513 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:04.854492 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ba77c5b-eaff-4674-9cd8-897e0da339b4-networking-console-plugin-cert podName:0ba77c5b-eaff-4674-9cd8-897e0da339b4 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:05.854477074 +0000 UTC m=+59.835505326 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0ba77c5b-eaff-4674-9cd8-897e0da339b4-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-k4lxx" (UID: "0ba77c5b-eaff-4674-9cd8-897e0da339b4") : secret "networking-console-plugin-cert" not found Jun 08 13:44:04.854552 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:04.854511 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 13:44:04.854552 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:04.854547 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a631351-b41a-4d67-952f-96bb322cddc9-cluster-monitoring-operator-tls podName:3a631351-b41a-4d67-952f-96bb322cddc9 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:05.854536026 +0000 UTC m=+59.835564272 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3a631351-b41a-4d67-952f-96bb322cddc9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-fzt4k" (UID: "3a631351-b41a-4d67-952f-96bb322cddc9") : secret "cluster-monitoring-operator-tls" not found Jun 08 13:44:04.877756 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.877728 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ttw8m" event={"ID":"79b6e8f8-b91f-4d94-8a43-3925d18615c3","Type":"ContainerStarted","Data":"1d67f6a3ca52d74271815a34d06e7ce8f0fa6f13d6c2c7b944ec17ccbd844511"} Jun 08 13:44:04.878730 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.878709 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" event={"ID":"0453a3c5-bb95-4060-bd97-67aba216bcc6","Type":"ContainerStarted","Data":"a7058068b50900844a31dea42f2dd14c6e3e45994f40abb7e139d9ae2586c2ee"} Jun 08 13:44:04.879691 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.879664 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vx96x" event={"ID":"1bf3f3fe-50d8-424f-81f2-b1c3bc33620e","Type":"ContainerStarted","Data":"889e29207950f67f1d91042d0fc06f6126719d5666d1bed8f698229aeb3839ae"} Jun 08 13:44:04.880615 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.880597 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-2v2bz" event={"ID":"10b62eb7-d904-4652-bb5a-a6cb57c7df03","Type":"ContainerStarted","Data":"749d9b76eb04f4b2f8c822f39dfc71ea38e4f39464b5e5aeac1e3f7c51ec85f7"} Jun 08 13:44:04.881522 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.881505 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-8rmnl" event={"ID":"c39ac88f-8047-42a3-b90f-8868c686fe8a","Type":"ContainerStarted","Data":"fe048c2b81ffd57c585d856be44edbeb7397de02187972802838167762a8b114"} Jun 08 13:44:04.882474 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.882456 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4grq5" event={"ID":"070c0e0e-a4fd-40bb-bc17-b8eacbedd81a","Type":"ContainerStarted","Data":"43c34a26964a98974a2af47a2d5edb99317c8346e728304f84743b70f3f930e5"} Jun 08 13:44:04.955117 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.955097 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-metrics-certs\") pod \"router-default-76c77975cf-zh8wm\" (UID: \"3977f3b1-efb9-45fb-8c63-9f7c504f8eed\") " pod="openshift-ingress/router-default-76c77975cf-zh8wm" Jun 08 13:44:04.955207 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:04.955174 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-service-ca-bundle\") pod \"router-default-76c77975cf-zh8wm\" (UID: \"3977f3b1-efb9-45fb-8c63-9f7c504f8eed\") " pod="openshift-ingress/router-default-76c77975cf-zh8wm" Jun 08 13:44:04.955257 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:04.955226 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 13:44:04.955294 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:04.955275 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-metrics-certs podName:3977f3b1-efb9-45fb-8c63-9f7c504f8eed nodeName:}" failed. No retries permitted until 2026-06-08 13:44:05.955261374 +0000 UTC m=+59.936289620 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-metrics-certs") pod "router-default-76c77975cf-zh8wm" (UID: "3977f3b1-efb9-45fb-8c63-9f7c504f8eed") : secret "router-metrics-certs-default" not found Jun 08 13:44:04.955294 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:04.955290 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-service-ca-bundle podName:3977f3b1-efb9-45fb-8c63-9f7c504f8eed nodeName:}" failed. No retries permitted until 2026-06-08 13:44:05.95527958 +0000 UTC m=+59.936307827 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-service-ca-bundle") pod "router-default-76c77975cf-zh8wm" (UID: "3977f3b1-efb9-45fb-8c63-9f7c504f8eed") : configmap references non-existent config key: service-ca.crt Jun 08 13:44:05.056668 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:05.056633 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/27fd7046-06c8-469e-a9b4-1e2758dfe0dc-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-dpch7\" (UID: \"27fd7046-06c8-469e-a9b4-1e2758dfe0dc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dpch7" Jun 08 13:44:05.057151 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:05.056810 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 13:44:05.057151 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:05.056885 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27fd7046-06c8-469e-a9b4-1e2758dfe0dc-samples-operator-tls podName:27fd7046-06c8-469e-a9b4-1e2758dfe0dc nodeName:}" failed. No retries permitted until 2026-06-08 13:44:06.05686602 +0000 UTC m=+60.037894269 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/27fd7046-06c8-469e-a9b4-1e2758dfe0dc-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-dpch7" (UID: "27fd7046-06c8-469e-a9b4-1e2758dfe0dc") : secret "samples-operator-tls" not found Jun 08 13:44:05.868924 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:05.868889 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ba77c5b-eaff-4674-9cd8-897e0da339b4-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-k4lxx\" (UID: \"0ba77c5b-eaff-4674-9cd8-897e0da339b4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-k4lxx" Jun 08 13:44:05.869361 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:05.869050 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 13:44:05.869361 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:05.869089 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a631351-b41a-4d67-952f-96bb322cddc9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fzt4k\" (UID: \"3a631351-b41a-4d67-952f-96bb322cddc9\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fzt4k" Jun 08 13:44:05.869361 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:05.869135 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ba77c5b-eaff-4674-9cd8-897e0da339b4-networking-console-plugin-cert podName:0ba77c5b-eaff-4674-9cd8-897e0da339b4 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:07.869103348 +0000 UTC m=+61.850131597 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0ba77c5b-eaff-4674-9cd8-897e0da339b4-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-k4lxx" (UID: "0ba77c5b-eaff-4674-9cd8-897e0da339b4") : secret "networking-console-plugin-cert" not found Jun 08 13:44:05.869361 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:05.869181 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 13:44:05.869361 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:05.869237 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a631351-b41a-4d67-952f-96bb322cddc9-cluster-monitoring-operator-tls podName:3a631351-b41a-4d67-952f-96bb322cddc9 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:07.869220009 +0000 UTC m=+61.850248271 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3a631351-b41a-4d67-952f-96bb322cddc9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-fzt4k" (UID: "3a631351-b41a-4d67-952f-96bb322cddc9") : secret "cluster-monitoring-operator-tls" not found Jun 08 13:44:05.970006 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:05.969971 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-metrics-certs\") pod \"router-default-76c77975cf-zh8wm\" (UID: \"3977f3b1-efb9-45fb-8c63-9f7c504f8eed\") " pod="openshift-ingress/router-default-76c77975cf-zh8wm" Jun 08 13:44:05.970183 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:05.970101 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-service-ca-bundle\") pod \"router-default-76c77975cf-zh8wm\" (UID: \"3977f3b1-efb9-45fb-8c63-9f7c504f8eed\") " pod="openshift-ingress/router-default-76c77975cf-zh8wm" Jun 08 13:44:05.970854 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:05.970315 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-service-ca-bundle podName:3977f3b1-efb9-45fb-8c63-9f7c504f8eed nodeName:}" failed. No retries permitted until 2026-06-08 13:44:07.970295075 +0000 UTC m=+61.951323339 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-service-ca-bundle") pod "router-default-76c77975cf-zh8wm" (UID: "3977f3b1-efb9-45fb-8c63-9f7c504f8eed") : configmap references non-existent config key: service-ca.crt Jun 08 13:44:05.970854 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:05.970719 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 13:44:05.971126 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:05.971108 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-metrics-certs podName:3977f3b1-efb9-45fb-8c63-9f7c504f8eed nodeName:}" failed. No retries permitted until 2026-06-08 13:44:07.9707562 +0000 UTC m=+61.951784471 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-metrics-certs") pod "router-default-76c77975cf-zh8wm" (UID: "3977f3b1-efb9-45fb-8c63-9f7c504f8eed") : secret "router-metrics-certs-default" not found Jun 08 13:44:06.071419 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:06.071391 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/27fd7046-06c8-469e-a9b4-1e2758dfe0dc-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-dpch7\" (UID: \"27fd7046-06c8-469e-a9b4-1e2758dfe0dc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dpch7" Jun 08 13:44:06.071713 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:06.071695 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 13:44:06.071820 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:06.071785 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27fd7046-06c8-469e-a9b4-1e2758dfe0dc-samples-operator-tls podName:27fd7046-06c8-469e-a9b4-1e2758dfe0dc nodeName:}" failed. No retries permitted until 2026-06-08 13:44:08.071742805 +0000 UTC m=+62.052771052 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/27fd7046-06c8-469e-a9b4-1e2758dfe0dc-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-dpch7" (UID: "27fd7046-06c8-469e-a9b4-1e2758dfe0dc") : secret "samples-operator-tls" not found Jun 08 13:44:06.891922 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:06.891810 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4grq5" event={"ID":"070c0e0e-a4fd-40bb-bc17-b8eacbedd81a","Type":"ContainerStarted","Data":"12f512d2084f6b4124f11f0d72e3eb32c0c7193c84c73b248870738517cb22ec"} Jun 08 13:44:06.908923 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:06.908879 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4grq5" podStartSLOduration=1.417711821 podStartE2EDuration="2.908865138s" totalImagesPullingTime="1.491153317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:44:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:06.908425683 +0000 UTC m=+60.889453954" watchObservedRunningTime="2026-06-08 13:44:06.908865138 +0000 UTC m=+60.889893388" Jun 08 13:44:07.013854 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:07.013819 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:07.114755 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:07.114684 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:07.819425 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:07.819396 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lx4dj" Jun 08 13:44:07.890011 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:07.889976 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a631351-b41a-4d67-952f-96bb322cddc9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fzt4k\" (UID: \"3a631351-b41a-4d67-952f-96bb322cddc9\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fzt4k" Jun 08 13:44:07.890181 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:07.890106 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ba77c5b-eaff-4674-9cd8-897e0da339b4-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-k4lxx\" (UID: \"0ba77c5b-eaff-4674-9cd8-897e0da339b4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-k4lxx" Jun 08 13:44:07.890255 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:07.890192 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 13:44:07.890255 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:07.890214 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 13:44:07.890359 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:07.890269 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a631351-b41a-4d67-952f-96bb322cddc9-cluster-monitoring-operator-tls podName:3a631351-b41a-4d67-952f-96bb322cddc9 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:11.890248115 +0000 UTC m=+65.871276377 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3a631351-b41a-4d67-952f-96bb322cddc9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-fzt4k" (UID: "3a631351-b41a-4d67-952f-96bb322cddc9") : secret "cluster-monitoring-operator-tls" not found Jun 08 13:44:07.890359 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:07.890289 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ba77c5b-eaff-4674-9cd8-897e0da339b4-networking-console-plugin-cert podName:0ba77c5b-eaff-4674-9cd8-897e0da339b4 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:11.890280018 +0000 UTC m=+65.871308264 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0ba77c5b-eaff-4674-9cd8-897e0da339b4-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-k4lxx" (UID: "0ba77c5b-eaff-4674-9cd8-897e0da339b4") : secret "networking-console-plugin-cert" not found Jun 08 13:44:07.974811 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:07.974750 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:07.991213 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:07.991182 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-metrics-certs\") pod \"router-default-76c77975cf-zh8wm\" (UID: \"3977f3b1-efb9-45fb-8c63-9f7c504f8eed\") " pod="openshift-ingress/router-default-76c77975cf-zh8wm" Jun 08 13:44:07.991372 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:07.991296 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-service-ca-bundle\") pod \"router-default-76c77975cf-zh8wm\" (UID: \"3977f3b1-efb9-45fb-8c63-9f7c504f8eed\") " pod="openshift-ingress/router-default-76c77975cf-zh8wm" Jun 08 13:44:07.991372 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:07.991355 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 13:44:07.991482 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:07.991425 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-metrics-certs podName:3977f3b1-efb9-45fb-8c63-9f7c504f8eed nodeName:}" failed. No retries permitted until 2026-06-08 13:44:11.991405565 +0000 UTC m=+65.972433833 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-metrics-certs") pod "router-default-76c77975cf-zh8wm" (UID: "3977f3b1-efb9-45fb-8c63-9f7c504f8eed") : secret "router-metrics-certs-default" not found Jun 08 13:44:07.991778 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:07.991745 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-service-ca-bundle podName:3977f3b1-efb9-45fb-8c63-9f7c504f8eed nodeName:}" failed. No retries permitted until 2026-06-08 13:44:11.991727393 +0000 UTC m=+65.972755643 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-service-ca-bundle") pod "router-default-76c77975cf-zh8wm" (UID: "3977f3b1-efb9-45fb-8c63-9f7c504f8eed") : configmap references non-existent config key: service-ca.crt Jun 08 13:44:08.073494 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:08.073415 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:08.091863 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:08.091836 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/27fd7046-06c8-469e-a9b4-1e2758dfe0dc-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-dpch7\" (UID: \"27fd7046-06c8-469e-a9b4-1e2758dfe0dc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dpch7" Jun 08 13:44:08.092014 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:08.091991 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 13:44:08.092078 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:08.092067 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27fd7046-06c8-469e-a9b4-1e2758dfe0dc-samples-operator-tls podName:27fd7046-06c8-469e-a9b4-1e2758dfe0dc nodeName:}" failed. No retries permitted until 2026-06-08 13:44:12.092047792 +0000 UTC m=+66.073076059 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/27fd7046-06c8-469e-a9b4-1e2758dfe0dc-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-dpch7" (UID: "27fd7046-06c8-469e-a9b4-1e2758dfe0dc") : secret "samples-operator-tls" not found Jun 08 13:44:10.907054 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:10.907004 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ttw8m" event={"ID":"79b6e8f8-b91f-4d94-8a43-3925d18615c3","Type":"ContainerStarted","Data":"80368ea17232a7165048c2c660d7a6f71f50eb001e8ce70ea90aa1202b18ef51"} Jun 08 13:44:10.909906 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:10.909214 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l7lbv_0453a3c5-bb95-4060-bd97-67aba216bcc6/console-operator/0.log" Jun 08 13:44:10.909906 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:10.909254 2561 generic.go:356] "Generic (PLEG): container finished" podID="0453a3c5-bb95-4060-bd97-67aba216bcc6" containerID="bd7aaefa7cdd7fae1d60da40de06485f42320ffcea7f2381a8ce1b0fcdaeef63" exitCode=255 Jun 08 13:44:10.909906 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:10.909326 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" event={"ID":"0453a3c5-bb95-4060-bd97-67aba216bcc6","Type":"ContainerDied","Data":"bd7aaefa7cdd7fae1d60da40de06485f42320ffcea7f2381a8ce1b0fcdaeef63"} Jun 08 13:44:10.909906 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:10.909609 2561 scope.go:117] "RemoveContainer" containerID="bd7aaefa7cdd7fae1d60da40de06485f42320ffcea7f2381a8ce1b0fcdaeef63" Jun 08 13:44:10.912131 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:10.911689 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vx96x" event={"ID":"1bf3f3fe-50d8-424f-81f2-b1c3bc33620e","Type":"ContainerStarted","Data":"8fcfc0bf66f9f131361168cf31e2b7d0cc715ce884e85c83f0a61d72d8c2e125"} Jun 08 13:44:10.914778 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:10.914657 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-2v2bz" event={"ID":"10b62eb7-d904-4652-bb5a-a6cb57c7df03","Type":"ContainerStarted","Data":"3ac7bfda82505b24dd5338ce1f24061e1c74c69d0bf3f5a72b646504d337c70f"} Jun 08 13:44:10.918450 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:10.918059 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-8rmnl" event={"ID":"c39ac88f-8047-42a3-b90f-8868c686fe8a","Type":"ContainerStarted","Data":"b82a3b2a9006ee4313215307e4c5adc4a86a12d10fd70a76975775566419d857"} Jun 08 13:44:10.961775 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:10.961710 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ttw8m" podStartSLOduration=1.4884895949999999 podStartE2EDuration="6.961690812s" totalImagesPullingTime="5.473201217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:44:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:10.937155139 +0000 UTC m=+64.918183408" watchObservedRunningTime="2026-06-08 13:44:10.961690812 +0000 UTC m=+64.942719082" Jun 08 13:44:10.961919 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:10.961887 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vx96x" podStartSLOduration=1.595468592 podStartE2EDuration="6.961880073s" totalImagesPullingTime="5.366411481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:44:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:10.960815407 +0000 UTC m=+64.941843679" watchObservedRunningTime="2026-06-08 13:44:10.961880073 +0000 UTC m=+64.942908343" Jun 08 13:44:10.986574 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:10.986533 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:10.999372 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:10.999289 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-8rmnl" podStartSLOduration=1.589558451 podStartE2EDuration="6.999269671s" totalImagesPullingTime="5.40971122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:44:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:10.997685868 +0000 UTC m=+64.978714162" watchObservedRunningTime="2026-06-08 13:44:10.999269671 +0000 UTC m=+64.980297942" Jun 08 13:44:11.020707 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:11.020647 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-2v2bz" podStartSLOduration=1.745236499 podStartE2EDuration="7.020627089s" totalImagesPullingTime="5.27539059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:44:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:11.015379652 +0000 UTC m=+64.996407923" watchObservedRunningTime="2026-06-08 13:44:11.020627089 +0000 UTC m=+65.001655360" Jun 08 13:44:11.101302 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:11.101268 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:11.229661 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:11.229559 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43325f79-05b7-4adc-b726-9dbf5b9e5b68-original-pull-secret\") pod \"global-pull-secret-syncer-kzr55\" (UID: \"43325f79-05b7-4adc-b726-9dbf5b9e5b68\") " pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:44:11.232531 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:11.232508 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 13:44:11.243192 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:11.243163 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43325f79-05b7-4adc-b726-9dbf5b9e5b68-original-pull-secret\") pod \"global-pull-secret-syncer-kzr55\" (UID: \"43325f79-05b7-4adc-b726-9dbf5b9e5b68\") " pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:44:11.287019 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:11.286988 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzr55" Jun 08 13:44:11.330658 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:11.330630 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50931712-af88-4fe2-b146-0926d8e10b25-metrics-certs\") pod \"network-metrics-daemon-6zmwj\" (UID: \"50931712-af88-4fe2-b146-0926d8e10b25\") " pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:44:11.333161 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:11.333143 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 13:44:11.341750 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:11.341702 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 13:44:11.341889 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:11.341799 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50931712-af88-4fe2-b146-0926d8e10b25-metrics-certs podName:50931712-af88-4fe2-b146-0926d8e10b25 nodeName:}" failed. No retries permitted until 2026-06-08 13:45:15.341774003 +0000 UTC m=+129.322802268 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50931712-af88-4fe2-b146-0926d8e10b25-metrics-certs") pod "network-metrics-daemon-6zmwj" (UID: "50931712-af88-4fe2-b146-0926d8e10b25") : secret "metrics-daemon-secret" not found Jun 08 13:44:11.413815 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:11.413787 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kzr55"] Jun 08 13:44:11.416494 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:44:11.416470 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43325f79_05b7_4adc_b726_9dbf5b9e5b68.slice/crio-2adde64787b8f513cc021739c62b8ef1fe6f7fe976ef513dcf2dfecce9c4a521 WatchSource:0}: Error finding container 2adde64787b8f513cc021739c62b8ef1fe6f7fe976ef513dcf2dfecce9c4a521: Status 404 returned error can't find the container with id 2adde64787b8f513cc021739c62b8ef1fe6f7fe976ef513dcf2dfecce9c4a521 Jun 08 13:44:11.431398 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:11.431370 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4n7p\" (UniqueName: \"kubernetes.io/projected/4fef731a-4dcc-40e0-843f-1ca10f3582a2-kube-api-access-v4n7p\") pod \"network-check-target-s7p22\" (UID: \"4fef731a-4dcc-40e0-843f-1ca10f3582a2\") " pod="openshift-network-diagnostics/network-check-target-s7p22" Jun 08 13:44:11.433715 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:11.433696 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4n7p\" (UniqueName: \"kubernetes.io/projected/4fef731a-4dcc-40e0-843f-1ca10f3582a2-kube-api-access-v4n7p\") pod \"network-check-target-s7p22\" (UID: \"4fef731a-4dcc-40e0-843f-1ca10f3582a2\") " pod="openshift-network-diagnostics/network-check-target-s7p22" Jun 08 13:44:11.507455 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:11.507404 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:11.584382 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:11.584360 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-229wc\"" Jun 08 13:44:11.592753 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:11.592736 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7p22" Jun 08 13:44:11.608100 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:11.608067 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:11.744568 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:11.744543 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s7p22"] Jun 08 13:44:11.747991 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:44:11.747967 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fef731a_4dcc_40e0_843f_1ca10f3582a2.slice/crio-bf78833e679b142c96cdd601e6a7fa2a50a94c3bf470704b9faec062ef1ddf6e WatchSource:0}: Error finding container bf78833e679b142c96cdd601e6a7fa2a50a94c3bf470704b9faec062ef1ddf6e: Status 404 returned error can't find the container with id bf78833e679b142c96cdd601e6a7fa2a50a94c3bf470704b9faec062ef1ddf6e Jun 08 13:44:11.923170 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:11.923135 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s7p22" event={"ID":"4fef731a-4dcc-40e0-843f-1ca10f3582a2","Type":"ContainerStarted","Data":"6e335f3e06918657f91d191c967085ca54d04f718ed9e4570715ab61a92e3869"} Jun 08 13:44:11.923602 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:11.923189 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s7p22" event={"ID":"4fef731a-4dcc-40e0-843f-1ca10f3582a2","Type":"ContainerStarted","Data":"bf78833e679b142c96cdd601e6a7fa2a50a94c3bf470704b9faec062ef1ddf6e"} Jun 08 13:44:11.923602 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:11.923248 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-s7p22" Jun 08 13:44:11.924294 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:11.924262 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kzr55" event={"ID":"43325f79-05b7-4adc-b726-9dbf5b9e5b68","Type":"ContainerStarted","Data":"2adde64787b8f513cc021739c62b8ef1fe6f7fe976ef513dcf2dfecce9c4a521"} Jun 08 13:44:11.925718 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:11.925700 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l7lbv_0453a3c5-bb95-4060-bd97-67aba216bcc6/console-operator/1.log" Jun 08 13:44:11.926112 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:11.926098 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l7lbv_0453a3c5-bb95-4060-bd97-67aba216bcc6/console-operator/0.log" Jun 08 13:44:11.926166 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:11.926128 2561 generic.go:356] "Generic (PLEG): container finished" podID="0453a3c5-bb95-4060-bd97-67aba216bcc6" containerID="3e04c667ac99a8fa97ac1cfd5b2d9fe55be816ae2d80b4cea3f468770fc27ba8" exitCode=255 Jun 08 13:44:11.926203 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:11.926185 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" event={"ID":"0453a3c5-bb95-4060-bd97-67aba216bcc6","Type":"ContainerDied","Data":"3e04c667ac99a8fa97ac1cfd5b2d9fe55be816ae2d80b4cea3f468770fc27ba8"} Jun 08 13:44:11.926245 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:11.926215 2561 scope.go:117] "RemoveContainer" containerID="bd7aaefa7cdd7fae1d60da40de06485f42320ffcea7f2381a8ce1b0fcdaeef63" Jun 08 13:44:11.926399 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:11.926383 2561 scope.go:117] "RemoveContainer" containerID="3e04c667ac99a8fa97ac1cfd5b2d9fe55be816ae2d80b4cea3f468770fc27ba8" Jun 08 13:44:11.926681 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:11.926574 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-l7lbv_openshift-console-operator(0453a3c5-bb95-4060-bd97-67aba216bcc6)\"" pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" podUID="0453a3c5-bb95-4060-bd97-67aba216bcc6" Jun 08 13:44:11.934988 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:11.934967 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ba77c5b-eaff-4674-9cd8-897e0da339b4-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-k4lxx\" (UID: \"0ba77c5b-eaff-4674-9cd8-897e0da339b4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-k4lxx" Jun 08 13:44:11.935152 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:11.935132 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 13:44:11.935200 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:11.935144 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a631351-b41a-4d67-952f-96bb322cddc9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fzt4k\" (UID: \"3a631351-b41a-4d67-952f-96bb322cddc9\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fzt4k" Jun 08 13:44:11.935243 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:11.935201 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ba77c5b-eaff-4674-9cd8-897e0da339b4-networking-console-plugin-cert podName:0ba77c5b-eaff-4674-9cd8-897e0da339b4 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:19.935180178 +0000 UTC m=+73.916208438 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0ba77c5b-eaff-4674-9cd8-897e0da339b4-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-k4lxx" (UID: "0ba77c5b-eaff-4674-9cd8-897e0da339b4") : secret "networking-console-plugin-cert" not found Jun 08 13:44:11.935243 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:11.935236 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 13:44:11.935313 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:11.935292 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a631351-b41a-4d67-952f-96bb322cddc9-cluster-monitoring-operator-tls podName:3a631351-b41a-4d67-952f-96bb322cddc9 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:19.935279071 +0000 UTC m=+73.916307319 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3a631351-b41a-4d67-952f-96bb322cddc9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-fzt4k" (UID: "3a631351-b41a-4d67-952f-96bb322cddc9") : secret "cluster-monitoring-operator-tls" not found Jun 08 13:44:11.991525 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:11.991482 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-s7p22" podStartSLOduration=65.991461655 podStartE2EDuration="1m5.991461655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:43:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:11.989112872 +0000 UTC m=+65.970141140" watchObservedRunningTime="2026-06-08 13:44:11.991461655 +0000 UTC m=+65.972489923" Jun 08 13:44:12.020614 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:12.020556 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:12.036024 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:12.036003 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-service-ca-bundle\") pod \"router-default-76c77975cf-zh8wm\" (UID: \"3977f3b1-efb9-45fb-8c63-9f7c504f8eed\") " pod="openshift-ingress/router-default-76c77975cf-zh8wm" Jun 08 13:44:12.036196 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:12.036176 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-service-ca-bundle podName:3977f3b1-efb9-45fb-8c63-9f7c504f8eed nodeName:}" failed. No retries permitted until 2026-06-08 13:44:20.036154711 +0000 UTC m=+74.017182972 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-service-ca-bundle") pod "router-default-76c77975cf-zh8wm" (UID: "3977f3b1-efb9-45fb-8c63-9f7c504f8eed") : configmap references non-existent config key: service-ca.crt Jun 08 13:44:12.036377 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:12.036357 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-metrics-certs\") pod \"router-default-76c77975cf-zh8wm\" (UID: \"3977f3b1-efb9-45fb-8c63-9f7c504f8eed\") " pod="openshift-ingress/router-default-76c77975cf-zh8wm" Jun 08 13:44:12.036713 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:12.036695 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 13:44:12.036834 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:12.036750 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-metrics-certs podName:3977f3b1-efb9-45fb-8c63-9f7c504f8eed nodeName:}" failed. No retries permitted until 2026-06-08 13:44:20.036735467 +0000 UTC m=+74.017763714 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-metrics-certs") pod "router-default-76c77975cf-zh8wm" (UID: "3977f3b1-efb9-45fb-8c63-9f7c504f8eed") : secret "router-metrics-certs-default" not found Jun 08 13:44:12.137951 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:12.137923 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/27fd7046-06c8-469e-a9b4-1e2758dfe0dc-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-dpch7\" (UID: \"27fd7046-06c8-469e-a9b4-1e2758dfe0dc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dpch7" Jun 08 13:44:12.138109 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:12.138081 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 13:44:12.138195 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:12.138182 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27fd7046-06c8-469e-a9b4-1e2758dfe0dc-samples-operator-tls podName:27fd7046-06c8-469e-a9b4-1e2758dfe0dc nodeName:}" failed. No retries permitted until 2026-06-08 13:44:20.138166132 +0000 UTC m=+74.119194381 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/27fd7046-06c8-469e-a9b4-1e2758dfe0dc-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-dpch7" (UID: "27fd7046-06c8-469e-a9b4-1e2758dfe0dc") : secret "samples-operator-tls" not found Jun 08 13:44:12.214197 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:12.214161 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:12.380455 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:12.380372 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:12.477092 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:12.477058 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:12.573716 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:12.573685 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:12.675839 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:12.675808 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:12.726991 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:12.726965 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qms2k_f4563444-4752-4896-a848-acb40549ebe0/dns-node-resolver/0.log" Jun 08 13:44:12.931456 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:12.931382 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l7lbv_0453a3c5-bb95-4060-bd97-67aba216bcc6/console-operator/1.log" Jun 08 13:44:12.931929 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:12.931903 2561 scope.go:117] "RemoveContainer" containerID="3e04c667ac99a8fa97ac1cfd5b2d9fe55be816ae2d80b4cea3f468770fc27ba8" Jun 08 13:44:12.932116 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:12.932094 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-l7lbv_openshift-console-operator(0453a3c5-bb95-4060-bd97-67aba216bcc6)\"" pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" podUID="0453a3c5-bb95-4060-bd97-67aba216bcc6" Jun 08 13:44:13.326335 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:13.326256 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-55c2s_bf0a4a64-6cd7-489d-8aa8-635b662f64e9/node-ca/0.log" Jun 08 13:44:13.386004 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:13.385974 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:13.486027 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:13.485994 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:13.821885 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:13.821848 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:13.853506 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:13.853468 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-registry-tls\") pod \"image-registry-646c6ff68f-gn7v4\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:44:13.853656 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:13.853590 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08f23d9b-da1c-4813-a46c-833263139241-metrics-tls\") pod \"dns-default-hfcp7\" (UID: \"08f23d9b-da1c-4813-a46c-833263139241\") " pod="openshift-dns/dns-default-hfcp7" Jun 08 13:44:13.853656 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:13.853627 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 13:44:13.853656 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:13.853646 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-646c6ff68f-gn7v4: secret "image-registry-tls" not found Jun 08 13:44:13.853845 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:13.853694 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:44:13.853845 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:13.853715 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-registry-tls podName:139a2ec4-1171-479a-a203-1c91f6547fcd nodeName:}" failed. No retries permitted until 2026-06-08 13:44:45.853693253 +0000 UTC m=+99.834721521 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-registry-tls") pod "image-registry-646c6ff68f-gn7v4" (UID: "139a2ec4-1171-479a-a203-1c91f6547fcd") : secret "image-registry-tls" not found Jun 08 13:44:13.853845 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:13.853742 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08f23d9b-da1c-4813-a46c-833263139241-metrics-tls podName:08f23d9b-da1c-4813-a46c-833263139241 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:45.853725109 +0000 UTC m=+99.834753360 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08f23d9b-da1c-4813-a46c-833263139241-metrics-tls") pod "dns-default-hfcp7" (UID: "08f23d9b-da1c-4813-a46c-833263139241") : secret "dns-default-metrics-tls" not found Jun 08 13:44:13.926290 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:13.926262 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:14.126067 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:14.125984 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-28v6r_da03cecf-0ab0-48c7-bd1b-ba9d7d1798b6/serve-healthcheck-canary/0.log" Jun 08 13:44:14.371503 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:14.371464 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:14.472991 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:14.472917 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:14.578754 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:14.578726 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" Jun 08 13:44:14.578961 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:14.578821 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" Jun 08 13:44:14.579199 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:14.579181 2561 scope.go:117] "RemoveContainer" containerID="3e04c667ac99a8fa97ac1cfd5b2d9fe55be816ae2d80b4cea3f468770fc27ba8" Jun 08 13:44:14.579409 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:14.579380 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-l7lbv_openshift-console-operator(0453a3c5-bb95-4060-bd97-67aba216bcc6)\"" pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" podUID="0453a3c5-bb95-4060-bd97-67aba216bcc6" Jun 08 13:44:14.937243 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:14.937216 2561 scope.go:117] "RemoveContainer" containerID="3e04c667ac99a8fa97ac1cfd5b2d9fe55be816ae2d80b4cea3f468770fc27ba8" Jun 08 13:44:14.937416 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:14.937384 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-l7lbv_openshift-console-operator(0453a3c5-bb95-4060-bd97-67aba216bcc6)\"" pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" podUID="0453a3c5-bb95-4060-bd97-67aba216bcc6" Jun 08 13:44:15.058338 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:15.058305 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:15.942639 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:15.942605 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kzr55" event={"ID":"43325f79-05b7-4adc-b726-9dbf5b9e5b68","Type":"ContainerStarted","Data":"7c2314d25e31f5a9f1c9e0776170a2f4d84e28d85c1d91aa1f29800fc411abf6"} Jun 08 13:44:16.965138 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:16.965088 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kzr55" podStartSLOduration=66.591403967 podStartE2EDuration="1m10.965074036s" totalImagesPullingTime="4.373670069s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:16.964205771 +0000 UTC m=+70.945234034" watchObservedRunningTime="2026-06-08 13:44:16.965074036 +0000 UTC m=+70.946102304" Jun 08 13:44:18.070533 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:18.070500 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:18.270327 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:18.270292 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:18.517050 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:18.517019 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:18.583564 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:18.583528 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:18.676250 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:18.676222 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:18.847183 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:18.847111 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:19.050820 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:19.050786 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:19.148127 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:19.148101 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:19.823740 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:19.823708 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:19.987525 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:19.987481 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:20.003705 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:20.003679 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ba77c5b-eaff-4674-9cd8-897e0da339b4-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-k4lxx\" (UID: \"0ba77c5b-eaff-4674-9cd8-897e0da339b4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-k4lxx" Jun 08 13:44:20.003841 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:20.003755 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a631351-b41a-4d67-952f-96bb322cddc9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fzt4k\" (UID: \"3a631351-b41a-4d67-952f-96bb322cddc9\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fzt4k" Jun 08 13:44:20.003841 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:20.003828 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 13:44:20.003950 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:20.003888 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ba77c5b-eaff-4674-9cd8-897e0da339b4-networking-console-plugin-cert podName:0ba77c5b-eaff-4674-9cd8-897e0da339b4 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:36.003872076 +0000 UTC m=+89.984900322 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0ba77c5b-eaff-4674-9cd8-897e0da339b4-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-k4lxx" (UID: "0ba77c5b-eaff-4674-9cd8-897e0da339b4") : secret "networking-console-plugin-cert" not found Jun 08 13:44:20.003950 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:20.003907 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 13:44:20.004038 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:20.003971 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a631351-b41a-4d67-952f-96bb322cddc9-cluster-monitoring-operator-tls podName:3a631351-b41a-4d67-952f-96bb322cddc9 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:36.0039518 +0000 UTC m=+89.984980057 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3a631351-b41a-4d67-952f-96bb322cddc9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-fzt4k" (UID: "3a631351-b41a-4d67-952f-96bb322cddc9") : secret "cluster-monitoring-operator-tls" not found Jun 08 13:44:20.104539 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:20.104468 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-metrics-certs\") pod \"router-default-76c77975cf-zh8wm\" (UID: \"3977f3b1-efb9-45fb-8c63-9f7c504f8eed\") " pod="openshift-ingress/router-default-76c77975cf-zh8wm" Jun 08 13:44:20.104660 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:20.104556 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-service-ca-bundle\") pod \"router-default-76c77975cf-zh8wm\" (UID: \"3977f3b1-efb9-45fb-8c63-9f7c504f8eed\") " pod="openshift-ingress/router-default-76c77975cf-zh8wm" Jun 08 13:44:20.104660 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:20.104605 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 13:44:20.104660 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:20.104659 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-metrics-certs podName:3977f3b1-efb9-45fb-8c63-9f7c504f8eed nodeName:}" failed. No retries permitted until 2026-06-08 13:44:36.10464536 +0000 UTC m=+90.085673607 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-metrics-certs") pod "router-default-76c77975cf-zh8wm" (UID: "3977f3b1-efb9-45fb-8c63-9f7c504f8eed") : secret "router-metrics-certs-default" not found Jun 08 13:44:20.104800 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:20.104671 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-service-ca-bundle podName:3977f3b1-efb9-45fb-8c63-9f7c504f8eed nodeName:}" failed. No retries permitted until 2026-06-08 13:44:36.104665816 +0000 UTC m=+90.085694063 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-service-ca-bundle") pod "router-default-76c77975cf-zh8wm" (UID: "3977f3b1-efb9-45fb-8c63-9f7c504f8eed") : configmap references non-existent config key: service-ca.crt Jun 08 13:44:20.205951 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:20.205924 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/27fd7046-06c8-469e-a9b4-1e2758dfe0dc-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-dpch7\" (UID: \"27fd7046-06c8-469e-a9b4-1e2758dfe0dc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dpch7" Jun 08 13:44:20.208229 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:20.208211 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/27fd7046-06c8-469e-a9b4-1e2758dfe0dc-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-dpch7\" (UID: \"27fd7046-06c8-469e-a9b4-1e2758dfe0dc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dpch7" Jun 08 13:44:20.278037 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:20.278012 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-96src\"" Jun 08 13:44:20.285516 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:20.285500 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dpch7" Jun 08 13:44:20.413027 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:20.412999 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dpch7"] Jun 08 13:44:20.551205 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:20.551173 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:20.959429 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:20.959398 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dpch7" event={"ID":"27fd7046-06c8-469e-a9b4-1e2758dfe0dc","Type":"ContainerStarted","Data":"75b74bbccf73681cf94d9fb9bb5a3a5fa1919341b1e24449751aa95195e1ce98"} Jun 08 13:44:21.017061 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:21.016958 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:21.405239 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:21.405201 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:21.593817 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:21.593785 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:21.994454 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:21.994417 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:22.101935 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:22.101908 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:22.427554 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:22.427525 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:22.755006 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:22.754920 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:22.968657 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:22.968624 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dpch7" event={"ID":"27fd7046-06c8-469e-a9b4-1e2758dfe0dc","Type":"ContainerStarted","Data":"724c9aed686f1207716ebe3231aeacb0fd1b06d608a235b1a22e4b2505101e9b"} Jun 08 13:44:22.968851 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:22.968672 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dpch7" event={"ID":"27fd7046-06c8-469e-a9b4-1e2758dfe0dc","Type":"ContainerStarted","Data":"fea1264be5eacc30b1bfe04d47457e4590f7f3f8f4bbdffdf9031786051dcd51"} Jun 08 13:44:22.994149 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:22.994097 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dpch7" podStartSLOduration=17.317362195 podStartE2EDuration="18.994079317s" totalImagesPullingTime="1.676717122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:44:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:22.993530573 +0000 UTC m=+76.974558843" watchObservedRunningTime="2026-06-08 13:44:22.994079317 +0000 UTC m=+76.975107587" Jun 08 13:44:23.153985 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:23.153953 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:23.258535 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:23.258513 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:23.347493 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:23.347466 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:23.551195 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:23.551128 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:23.747010 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:23.746983 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:24.049244 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:24.049214 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:24.761239 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:24.761209 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:25.161312 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:25.161283 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:25.377623 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:25.377590 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:25.476401 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:25.476321 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:25.575520 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:25.575488 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:25.957427 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:25.957398 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:26.268521 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:26.268430 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:26.352643 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:26.352618 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:27.145480 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:27.145451 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:27.359567 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:27.359525 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:27.437946 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:27.437876 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:27.740548 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:27.740463 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:27.949954 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:27.949927 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:28.354489 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:28.354444 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:28.470663 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:28.470639 2561 scope.go:117] "RemoveContainer" containerID="3e04c667ac99a8fa97ac1cfd5b2d9fe55be816ae2d80b4cea3f468770fc27ba8" Jun 08 13:44:28.739943 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:28.739895 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:28.948601 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:28.948578 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:28.988575 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:28.988556 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l7lbv_0453a3c5-bb95-4060-bd97-67aba216bcc6/console-operator/2.log" Jun 08 13:44:28.988905 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:28.988891 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l7lbv_0453a3c5-bb95-4060-bd97-67aba216bcc6/console-operator/1.log" Jun 08 13:44:28.988961 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:28.988921 2561 generic.go:356] "Generic (PLEG): container finished" podID="0453a3c5-bb95-4060-bd97-67aba216bcc6" containerID="3ee2b013f8abe518a31594c9323e396725d59f250b45fbd97390c1b12d6abd2f" exitCode=255 Jun 08 13:44:28.988997 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:28.988959 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" event={"ID":"0453a3c5-bb95-4060-bd97-67aba216bcc6","Type":"ContainerDied","Data":"3ee2b013f8abe518a31594c9323e396725d59f250b45fbd97390c1b12d6abd2f"} Jun 08 13:44:28.989043 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:28.989002 2561 scope.go:117] "RemoveContainer" containerID="3e04c667ac99a8fa97ac1cfd5b2d9fe55be816ae2d80b4cea3f468770fc27ba8" Jun 08 13:44:28.989317 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:28.989296 2561 scope.go:117] "RemoveContainer" containerID="3ee2b013f8abe518a31594c9323e396725d59f250b45fbd97390c1b12d6abd2f" Jun 08 13:44:28.989462 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:28.989445 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-l7lbv_openshift-console-operator(0453a3c5-bb95-4060-bd97-67aba216bcc6)\"" pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" podUID="0453a3c5-bb95-4060-bd97-67aba216bcc6" Jun 08 13:44:29.993491 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:29.993465 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l7lbv_0453a3c5-bb95-4060-bd97-67aba216bcc6/console-operator/2.log" Jun 08 13:44:34.579282 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.579246 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" Jun 08 13:44:34.579680 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.579310 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" Jun 08 13:44:34.579680 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.579559 2561 scope.go:117] "RemoveContainer" containerID="3ee2b013f8abe518a31594c9323e396725d59f250b45fbd97390c1b12d6abd2f" Jun 08 13:44:34.579813 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:34.579709 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-l7lbv_openshift-console-operator(0453a3c5-bb95-4060-bd97-67aba216bcc6)\"" pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" podUID="0453a3c5-bb95-4060-bd97-67aba216bcc6" Jun 08 13:44:34.797250 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.797220 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ktp77"] Jun 08 13:44:34.801963 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.801939 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ktp77" Jun 08 13:44:34.804674 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.804652 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 08 13:44:34.804674 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.804653 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 08 13:44:34.804900 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.804744 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tzzjv\"" Jun 08 13:44:34.814563 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.814539 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ktp77"] Jun 08 13:44:34.816916 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.816891 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c35905bc-2626-4781-bc7a-9087bf5466d8-crio-socket\") pod \"insights-runtime-extractor-ktp77\" (UID: \"c35905bc-2626-4781-bc7a-9087bf5466d8\") " pod="openshift-insights/insights-runtime-extractor-ktp77" Jun 08 13:44:34.817001 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.816966 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c35905bc-2626-4781-bc7a-9087bf5466d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ktp77\" (UID: \"c35905bc-2626-4781-bc7a-9087bf5466d8\") " pod="openshift-insights/insights-runtime-extractor-ktp77" Jun 08 13:44:34.817001 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.816996 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c35905bc-2626-4781-bc7a-9087bf5466d8-data-volume\") pod \"insights-runtime-extractor-ktp77\" (UID: \"c35905bc-2626-4781-bc7a-9087bf5466d8\") " pod="openshift-insights/insights-runtime-extractor-ktp77" Jun 08 13:44:34.817117 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.817095 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2hgm\" (UniqueName: \"kubernetes.io/projected/c35905bc-2626-4781-bc7a-9087bf5466d8-kube-api-access-g2hgm\") pod \"insights-runtime-extractor-ktp77\" (UID: \"c35905bc-2626-4781-bc7a-9087bf5466d8\") " pod="openshift-insights/insights-runtime-extractor-ktp77" Jun 08 13:44:34.817161 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.817131 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c35905bc-2626-4781-bc7a-9087bf5466d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ktp77\" (UID: \"c35905bc-2626-4781-bc7a-9087bf5466d8\") " pod="openshift-insights/insights-runtime-extractor-ktp77" Jun 08 13:44:34.854498 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.854447 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:34.888481 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.888459 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-765d59947b-zddd5"] Jun 08 13:44:34.891481 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.891465 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-765d59947b-zddd5" Jun 08 13:44:34.895825 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.895808 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 08 13:44:34.896302 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.896283 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 08 13:44:34.896559 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.896537 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 08 13:44:34.900178 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.900159 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 08 13:44:34.909295 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.909277 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-765d59947b-zddd5"] Jun 08 13:44:34.918429 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.918413 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/891599b6-fb6d-415b-8a16-7e0a44f2d4a4-tmp\") pod \"klusterlet-addon-workmgr-765d59947b-zddd5\" (UID: \"891599b6-fb6d-415b-8a16-7e0a44f2d4a4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-765d59947b-zddd5" Jun 08 13:44:34.918528 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.918437 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2hgm\" (UniqueName: \"kubernetes.io/projected/c35905bc-2626-4781-bc7a-9087bf5466d8-kube-api-access-g2hgm\") pod \"insights-runtime-extractor-ktp77\" (UID: \"c35905bc-2626-4781-bc7a-9087bf5466d8\") " pod="openshift-insights/insights-runtime-extractor-ktp77" Jun 08 13:44:34.918528 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.918455 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klqcg\" (UniqueName: \"kubernetes.io/projected/891599b6-fb6d-415b-8a16-7e0a44f2d4a4-kube-api-access-klqcg\") pod \"klusterlet-addon-workmgr-765d59947b-zddd5\" (UID: \"891599b6-fb6d-415b-8a16-7e0a44f2d4a4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-765d59947b-zddd5" Jun 08 13:44:34.918528 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.918472 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c35905bc-2626-4781-bc7a-9087bf5466d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ktp77\" (UID: \"c35905bc-2626-4781-bc7a-9087bf5466d8\") " pod="openshift-insights/insights-runtime-extractor-ktp77" Jun 08 13:44:34.918643 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.918626 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c35905bc-2626-4781-bc7a-9087bf5466d8-crio-socket\") pod \"insights-runtime-extractor-ktp77\" (UID: \"c35905bc-2626-4781-bc7a-9087bf5466d8\") " pod="openshift-insights/insights-runtime-extractor-ktp77" Jun 08 13:44:34.918680 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.918668 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/891599b6-fb6d-415b-8a16-7e0a44f2d4a4-klusterlet-config\") pod \"klusterlet-addon-workmgr-765d59947b-zddd5\" (UID: \"891599b6-fb6d-415b-8a16-7e0a44f2d4a4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-765d59947b-zddd5" Jun 08 13:44:34.918722 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.918708 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c35905bc-2626-4781-bc7a-9087bf5466d8-crio-socket\") pod \"insights-runtime-extractor-ktp77\" (UID: \"c35905bc-2626-4781-bc7a-9087bf5466d8\") " pod="openshift-insights/insights-runtime-extractor-ktp77" Jun 08 13:44:34.918722 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.918713 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c35905bc-2626-4781-bc7a-9087bf5466d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ktp77\" (UID: \"c35905bc-2626-4781-bc7a-9087bf5466d8\") " pod="openshift-insights/insights-runtime-extractor-ktp77" Jun 08 13:44:34.918808 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.918748 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c35905bc-2626-4781-bc7a-9087bf5466d8-data-volume\") pod \"insights-runtime-extractor-ktp77\" (UID: \"c35905bc-2626-4781-bc7a-9087bf5466d8\") " pod="openshift-insights/insights-runtime-extractor-ktp77" Jun 08 13:44:34.919029 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.919014 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c35905bc-2626-4781-bc7a-9087bf5466d8-data-volume\") pod \"insights-runtime-extractor-ktp77\" (UID: \"c35905bc-2626-4781-bc7a-9087bf5466d8\") " pod="openshift-insights/insights-runtime-extractor-ktp77" Jun 08 13:44:34.919176 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.919162 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c35905bc-2626-4781-bc7a-9087bf5466d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ktp77\" (UID: \"c35905bc-2626-4781-bc7a-9087bf5466d8\") " pod="openshift-insights/insights-runtime-extractor-ktp77" Jun 08 13:44:34.920610 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.920593 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c35905bc-2626-4781-bc7a-9087bf5466d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ktp77\" (UID: \"c35905bc-2626-4781-bc7a-9087bf5466d8\") " pod="openshift-insights/insights-runtime-extractor-ktp77" Jun 08 13:44:34.931383 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.931365 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2hgm\" (UniqueName: \"kubernetes.io/projected/c35905bc-2626-4781-bc7a-9087bf5466d8-kube-api-access-g2hgm\") pod \"insights-runtime-extractor-ktp77\" (UID: \"c35905bc-2626-4781-bc7a-9087bf5466d8\") " pod="openshift-insights/insights-runtime-extractor-ktp77" Jun 08 13:44:34.954261 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:34.954235 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:35.007513 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:35.007493 2561 scope.go:117] "RemoveContainer" containerID="3ee2b013f8abe518a31594c9323e396725d59f250b45fbd97390c1b12d6abd2f" Jun 08 13:44:35.007660 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:35.007642 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-l7lbv_openshift-console-operator(0453a3c5-bb95-4060-bd97-67aba216bcc6)\"" pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" podUID="0453a3c5-bb95-4060-bd97-67aba216bcc6" Jun 08 13:44:35.020068 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:35.020045 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/891599b6-fb6d-415b-8a16-7e0a44f2d4a4-klusterlet-config\") pod \"klusterlet-addon-workmgr-765d59947b-zddd5\" (UID: \"891599b6-fb6d-415b-8a16-7e0a44f2d4a4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-765d59947b-zddd5" Jun 08 13:44:35.020160 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:35.020145 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/891599b6-fb6d-415b-8a16-7e0a44f2d4a4-tmp\") pod \"klusterlet-addon-workmgr-765d59947b-zddd5\" (UID: \"891599b6-fb6d-415b-8a16-7e0a44f2d4a4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-765d59947b-zddd5" Jun 08 13:44:35.020206 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:35.020180 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klqcg\" (UniqueName: \"kubernetes.io/projected/891599b6-fb6d-415b-8a16-7e0a44f2d4a4-kube-api-access-klqcg\") pod \"klusterlet-addon-workmgr-765d59947b-zddd5\" (UID: \"891599b6-fb6d-415b-8a16-7e0a44f2d4a4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-765d59947b-zddd5" Jun 08 13:44:35.020570 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:35.020550 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/891599b6-fb6d-415b-8a16-7e0a44f2d4a4-tmp\") pod \"klusterlet-addon-workmgr-765d59947b-zddd5\" (UID: \"891599b6-fb6d-415b-8a16-7e0a44f2d4a4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-765d59947b-zddd5" Jun 08 13:44:35.022398 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:35.022380 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/891599b6-fb6d-415b-8a16-7e0a44f2d4a4-klusterlet-config\") pod \"klusterlet-addon-workmgr-765d59947b-zddd5\" (UID: \"891599b6-fb6d-415b-8a16-7e0a44f2d4a4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-765d59947b-zddd5" Jun 08 13:44:35.032234 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:35.032213 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klqcg\" (UniqueName: \"kubernetes.io/projected/891599b6-fb6d-415b-8a16-7e0a44f2d4a4-kube-api-access-klqcg\") pod \"klusterlet-addon-workmgr-765d59947b-zddd5\" (UID: \"891599b6-fb6d-415b-8a16-7e0a44f2d4a4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-765d59947b-zddd5" Jun 08 13:44:35.056358 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:35.056331 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:35.111921 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:35.111875 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ktp77" Jun 08 13:44:35.169592 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:35.169510 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:35.201237 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:35.201212 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-765d59947b-zddd5" Jun 08 13:44:35.238247 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:35.238215 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ktp77"] Jun 08 13:44:35.241526 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:44:35.241495 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc35905bc_2626_4781_bc7a_9087bf5466d8.slice/crio-e6107f71ad795ba8baeba85921695154f04a4856bc4e325d0b89910e134a50ee WatchSource:0}: Error finding container e6107f71ad795ba8baeba85921695154f04a4856bc4e325d0b89910e134a50ee: Status 404 returned error can't find the container with id e6107f71ad795ba8baeba85921695154f04a4856bc4e325d0b89910e134a50ee Jun 08 13:44:35.328596 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:35.328573 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-765d59947b-zddd5"] Jun 08 13:44:35.331435 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:44:35.331413 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod891599b6_fb6d_415b_8a16_7e0a44f2d4a4.slice/crio-92d40b3bd9f7c52b696117d83f86f40ee7ad0ed1a8ed8a69047a1b90472937d9 WatchSource:0}: Error finding container 92d40b3bd9f7c52b696117d83f86f40ee7ad0ed1a8ed8a69047a1b90472937d9: Status 404 returned error can't find the container with id 92d40b3bd9f7c52b696117d83f86f40ee7ad0ed1a8ed8a69047a1b90472937d9 Jun 08 13:44:36.012203 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:36.012171 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ktp77" event={"ID":"c35905bc-2626-4781-bc7a-9087bf5466d8","Type":"ContainerStarted","Data":"be37d7ce6c30aab91326ec8432468670f94cdf9c2befcd2ff3ac36a2b329bbb1"} Jun 08 13:44:36.012515 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:36.012234 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ktp77" event={"ID":"c35905bc-2626-4781-bc7a-9087bf5466d8","Type":"ContainerStarted","Data":"982dc66c4b8fec10eee654856b1d05644c3220a499503e432747a535ceca283d"} Jun 08 13:44:36.012515 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:36.012256 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ktp77" event={"ID":"c35905bc-2626-4781-bc7a-9087bf5466d8","Type":"ContainerStarted","Data":"e6107f71ad795ba8baeba85921695154f04a4856bc4e325d0b89910e134a50ee"} Jun 08 13:44:36.013160 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:36.013143 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-765d59947b-zddd5" event={"ID":"891599b6-fb6d-415b-8a16-7e0a44f2d4a4","Type":"ContainerStarted","Data":"92d40b3bd9f7c52b696117d83f86f40ee7ad0ed1a8ed8a69047a1b90472937d9"} Jun 08 13:44:36.029679 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:36.029658 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a631351-b41a-4d67-952f-96bb322cddc9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fzt4k\" (UID: \"3a631351-b41a-4d67-952f-96bb322cddc9\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fzt4k" Jun 08 13:44:36.029745 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:36.029716 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ba77c5b-eaff-4674-9cd8-897e0da339b4-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-k4lxx\" (UID: \"0ba77c5b-eaff-4674-9cd8-897e0da339b4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-k4lxx" Jun 08 13:44:36.031784 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:36.031749 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a631351-b41a-4d67-952f-96bb322cddc9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fzt4k\" (UID: \"3a631351-b41a-4d67-952f-96bb322cddc9\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fzt4k" Jun 08 13:44:36.032018 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:36.031998 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ba77c5b-eaff-4674-9cd8-897e0da339b4-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-k4lxx\" (UID: \"0ba77c5b-eaff-4674-9cd8-897e0da339b4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-k4lxx" Jun 08 13:44:36.130482 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:36.130455 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-service-ca-bundle\") pod \"router-default-76c77975cf-zh8wm\" (UID: \"3977f3b1-efb9-45fb-8c63-9f7c504f8eed\") " pod="openshift-ingress/router-default-76c77975cf-zh8wm" Jun 08 13:44:36.130629 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:36.130617 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-metrics-certs\") pod \"router-default-76c77975cf-zh8wm\" (UID: \"3977f3b1-efb9-45fb-8c63-9f7c504f8eed\") " pod="openshift-ingress/router-default-76c77975cf-zh8wm" Jun 08 13:44:36.131119 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:36.131084 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-service-ca-bundle\") pod \"router-default-76c77975cf-zh8wm\" (UID: \"3977f3b1-efb9-45fb-8c63-9f7c504f8eed\") " pod="openshift-ingress/router-default-76c77975cf-zh8wm" Jun 08 13:44:36.132796 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:36.132756 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3977f3b1-efb9-45fb-8c63-9f7c504f8eed-metrics-certs\") pod \"router-default-76c77975cf-zh8wm\" (UID: \"3977f3b1-efb9-45fb-8c63-9f7c504f8eed\") " pod="openshift-ingress/router-default-76c77975cf-zh8wm" Jun 08 13:44:36.282368 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:36.282293 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-dvrdv\"" Jun 08 13:44:36.287902 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:36.287885 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-br45s\"" Jun 08 13:44:36.290048 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:36.290035 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fzt4k" Jun 08 13:44:36.296151 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:36.296129 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-k4lxx" Jun 08 13:44:36.395706 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:36.395503 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7qcdg\"" Jun 08 13:44:36.403096 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:36.402837 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-76c77975cf-zh8wm" Jun 08 13:44:36.428096 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:36.428067 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fzt4k"] Jun 08 13:44:36.430883 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:44:36.430835 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a631351_b41a_4d67_952f_96bb322cddc9.slice/crio-b4e4a2405dd907f47e57c27e7f5d6babe56d4f1f4bf17ef20367ca436b6ff38c WatchSource:0}: Error finding container b4e4a2405dd907f47e57c27e7f5d6babe56d4f1f4bf17ef20367ca436b6ff38c: Status 404 returned error can't find the container with id b4e4a2405dd907f47e57c27e7f5d6babe56d4f1f4bf17ef20367ca436b6ff38c Jun 08 13:44:36.448212 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:36.447614 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-k4lxx"] Jun 08 13:44:36.452755 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:44:36.452723 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ba77c5b_eaff_4674_9cd8_897e0da339b4.slice/crio-682ccc827fd0f4300884acdca37f5b1ce2c5c4217d39cb8c8e2e48fa5580a1c2 WatchSource:0}: Error finding container 682ccc827fd0f4300884acdca37f5b1ce2c5c4217d39cb8c8e2e48fa5580a1c2: Status 404 returned error can't find the container with id 682ccc827fd0f4300884acdca37f5b1ce2c5c4217d39cb8c8e2e48fa5580a1c2 Jun 08 13:44:36.584982 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:36.584944 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-76c77975cf-zh8wm"] Jun 08 13:44:36.588408 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:44:36.588379 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3977f3b1_efb9_45fb_8c63_9f7c504f8eed.slice/crio-be97bca40b4299c9c3099b25d4a3361ea20ea1d5820024c02caeb549ea627691 WatchSource:0}: Error finding container be97bca40b4299c9c3099b25d4a3361ea20ea1d5820024c02caeb549ea627691: Status 404 returned error can't find the container with id be97bca40b4299c9c3099b25d4a3361ea20ea1d5820024c02caeb549ea627691 Jun 08 13:44:37.026044 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:37.025184 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-76c77975cf-zh8wm" event={"ID":"3977f3b1-efb9-45fb-8c63-9f7c504f8eed","Type":"ContainerStarted","Data":"9247065e023825d10b72c2fa974f07c346f2aeb9a37bb0a70c1f62ebac14a103"} Jun 08 13:44:37.026044 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:37.025243 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-76c77975cf-zh8wm" event={"ID":"3977f3b1-efb9-45fb-8c63-9f7c504f8eed","Type":"ContainerStarted","Data":"be97bca40b4299c9c3099b25d4a3361ea20ea1d5820024c02caeb549ea627691"} Jun 08 13:44:37.028693 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:37.028661 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fzt4k" event={"ID":"3a631351-b41a-4d67-952f-96bb322cddc9","Type":"ContainerStarted","Data":"b4e4a2405dd907f47e57c27e7f5d6babe56d4f1f4bf17ef20367ca436b6ff38c"} Jun 08 13:44:37.031580 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:37.031546 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-k4lxx" event={"ID":"0ba77c5b-eaff-4674-9cd8-897e0da339b4","Type":"ContainerStarted","Data":"682ccc827fd0f4300884acdca37f5b1ce2c5c4217d39cb8c8e2e48fa5580a1c2"} Jun 08 13:44:37.053679 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:37.052229 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-76c77975cf-zh8wm" podStartSLOduration=33.052213013 podStartE2EDuration="33.052213013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:44:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:37.051875169 +0000 UTC m=+91.032903441" watchObservedRunningTime="2026-06-08 13:44:37.052213013 +0000 UTC m=+91.033241283" Jun 08 13:44:37.403610 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:37.403565 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-76c77975cf-zh8wm" Jun 08 13:44:37.406566 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:37.406354 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-76c77975cf-zh8wm" Jun 08 13:44:38.036250 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:38.036185 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-76c77975cf-zh8wm" Jun 08 13:44:38.037548 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:38.037523 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-76c77975cf-zh8wm" Jun 08 13:44:41.247000 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:41.246968 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:41.299812 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:41.299782 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:41.994755 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:41.994714 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:42.054736 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:42.054704 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ktp77" event={"ID":"c35905bc-2626-4781-bc7a-9087bf5466d8","Type":"ContainerStarted","Data":"ea9e16354f9c16b029dec48a25dd8d6dea899b06b87d73c998585fb441fb5ce8"} Jun 08 13:44:42.056248 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:42.056223 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-765d59947b-zddd5" event={"ID":"891599b6-fb6d-415b-8a16-7e0a44f2d4a4","Type":"ContainerStarted","Data":"0fad514d274bdc25380914a3090d74cff04cac98c961b6234dd446433e18a4be"} Jun 08 13:44:42.056419 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:42.056406 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-765d59947b-zddd5" Jun 08 13:44:42.057535 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:42.057496 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-765d59947b-zddd5" podUID="891599b6-fb6d-415b-8a16-7e0a44f2d4a4" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.20:8000/readyz\": dial tcp 10.132.0.20:8000: connect: connection refused" Jun 08 13:44:42.057868 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:42.057848 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fzt4k" event={"ID":"3a631351-b41a-4d67-952f-96bb322cddc9","Type":"ContainerStarted","Data":"11b618da1d20b7db617a29699245172770a757ba2ec4f2cd73c6a23efe004cd8"} Jun 08 13:44:42.059181 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:42.059160 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-k4lxx" event={"ID":"0ba77c5b-eaff-4674-9cd8-897e0da339b4","Type":"ContainerStarted","Data":"530404c2cdd5a0043fe295bf9c1da6c6b4e1915b619f3cdb324eab9c6a933f6a"} Jun 08 13:44:42.085432 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:42.085364 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ktp77" podStartSLOduration=1.942060778 podStartE2EDuration="8.085351999s" totalImagesPullingTime="6.143291221s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:44:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:42.084354073 +0000 UTC m=+96.065382343" watchObservedRunningTime="2026-06-08 13:44:42.085351999 +0000 UTC m=+96.066380268" Jun 08 13:44:42.111280 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:42.111243 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-765d59947b-zddd5" podStartSLOduration=1.513507449 podStartE2EDuration="8.111230526s" totalImagesPullingTime="6.597723077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:44:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:42.110399297 +0000 UTC m=+96.091427571" watchObservedRunningTime="2026-06-08 13:44:42.111230526 +0000 UTC m=+96.092258795" Jun 08 13:44:42.126945 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:42.126915 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:42.132400 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:42.132367 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fzt4k" podStartSLOduration=33.053786154 podStartE2EDuration="38.132355105s" totalImagesPullingTime="5.078568951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:44:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:42.131568892 +0000 UTC m=+96.112597163" watchObservedRunningTime="2026-06-08 13:44:42.132355105 +0000 UTC m=+96.113383374" Jun 08 13:44:42.151513 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:42.151474 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-k4lxx" podStartSLOduration=33.102365676 podStartE2EDuration="38.151462546s" totalImagesPullingTime="5.04909687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:44:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:42.150681499 +0000 UTC m=+96.131709769" watchObservedRunningTime="2026-06-08 13:44:42.151462546 +0000 UTC m=+96.132490815" Jun 08 13:44:42.242666 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:42.242595 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:42.338560 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:42.338515 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:42.420726 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:42.420686 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:42.541757 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:42.541677 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:42.605850 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:42.605790 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:42.933715 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:42.933690 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-s7p22" Jun 08 13:44:43.063394 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:43.063367 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-765d59947b-zddd5" Jun 08 13:44:44.925491 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:44.925460 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:44.989272 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:44.989244 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:45.573686 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:45.573641 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:45.630602 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:45.630578 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:45.909722 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:45.909697 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-registry-tls\") pod \"image-registry-646c6ff68f-gn7v4\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:44:45.909895 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:45.909805 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08f23d9b-da1c-4813-a46c-833263139241-metrics-tls\") pod \"dns-default-hfcp7\" (UID: \"08f23d9b-da1c-4813-a46c-833263139241\") " pod="openshift-dns/dns-default-hfcp7" Jun 08 13:44:45.911830 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:45.911807 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08f23d9b-da1c-4813-a46c-833263139241-metrics-tls\") pod \"dns-default-hfcp7\" (UID: \"08f23d9b-da1c-4813-a46c-833263139241\") " pod="openshift-dns/dns-default-hfcp7" Jun 08 13:44:45.911930 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:45.911846 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-registry-tls\") pod \"image-registry-646c6ff68f-gn7v4\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:44:46.127042 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:46.127018 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-f95r6\"" Jun 08 13:44:46.132262 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:46.132249 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:44:46.144756 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:46.144736 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2cfkx\"" Jun 08 13:44:46.152898 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:46.152882 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hfcp7" Jun 08 13:44:46.267616 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:46.267582 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-646c6ff68f-gn7v4"] Jun 08 13:44:46.271646 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:44:46.271617 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod139a2ec4_1171_479a_a203_1c91f6547fcd.slice/crio-c81848137691fba53894d672c8ed896ea3d61f575c9b15c1a73ff0be10166890 WatchSource:0}: Error finding container c81848137691fba53894d672c8ed896ea3d61f575c9b15c1a73ff0be10166890: Status 404 returned error can't find the container with id c81848137691fba53894d672c8ed896ea3d61f575c9b15c1a73ff0be10166890 Jun 08 13:44:46.282917 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:44:46.282897 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08f23d9b_da1c_4813_a46c_833263139241.slice/crio-f63b68f73d8a6e0692a5ccd6920cff71d8193c3e302e7dab0400776a2bf1a316 WatchSource:0}: Error finding container f63b68f73d8a6e0692a5ccd6920cff71d8193c3e302e7dab0400776a2bf1a316: Status 404 returned error can't find the container with id f63b68f73d8a6e0692a5ccd6920cff71d8193c3e302e7dab0400776a2bf1a316 Jun 08 13:44:46.286488 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:46.286469 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hfcp7"] Jun 08 13:44:46.394195 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:46.394160 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:46.452250 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:46.452178 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:47.076302 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:47.076265 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hfcp7" event={"ID":"08f23d9b-da1c-4813-a46c-833263139241","Type":"ContainerStarted","Data":"f63b68f73d8a6e0692a5ccd6920cff71d8193c3e302e7dab0400776a2bf1a316"} Jun 08 13:44:47.077549 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:47.077526 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" event={"ID":"139a2ec4-1171-479a-a203-1c91f6547fcd","Type":"ContainerStarted","Data":"d7a0063ddb0948e9cd3cd20ee2f0160f448925a48dae3a3ed4f1122ae3cf43b0"} Jun 08 13:44:47.077672 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:47.077563 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" event={"ID":"139a2ec4-1171-479a-a203-1c91f6547fcd","Type":"ContainerStarted","Data":"c81848137691fba53894d672c8ed896ea3d61f575c9b15c1a73ff0be10166890"} Jun 08 13:44:47.077672 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:47.077660 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:44:47.102379 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:47.102338 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" podStartSLOduration=100.102325936 podStartE2EDuration="1m40.102325936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:43:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:47.101521622 +0000 UTC m=+101.082549890" watchObservedRunningTime="2026-06-08 13:44:47.102325936 +0000 UTC m=+101.083354204" Jun 08 13:44:47.470598 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:47.470571 2561 scope.go:117] "RemoveContainer" containerID="3ee2b013f8abe518a31594c9323e396725d59f250b45fbd97390c1b12d6abd2f" Jun 08 13:44:47.470985 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:44:47.470730 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-l7lbv_openshift-console-operator(0453a3c5-bb95-4060-bd97-67aba216bcc6)\"" pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" podUID="0453a3c5-bb95-4060-bd97-67aba216bcc6" Jun 08 13:44:48.249108 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:48.249080 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:48.359156 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:48.359081 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:48.475720 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:48.475692 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:49.086658 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:49.086623 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hfcp7" event={"ID":"08f23d9b-da1c-4813-a46c-833263139241","Type":"ContainerStarted","Data":"1400cd8a78d00799f01132e5f72ba31ebc5bd869f50f95bd5ca9d6496adcfe34"} Jun 08 13:44:49.086849 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:49.086683 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hfcp7" event={"ID":"08f23d9b-da1c-4813-a46c-833263139241","Type":"ContainerStarted","Data":"8d5407ad20cb1f7821afbeb540cdbdf03f51f7d6a785d80a0138592c94e86a65"} Jun 08 13:44:49.086849 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:49.086730 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hfcp7" Jun 08 13:44:49.137061 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:49.137017 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hfcp7" podStartSLOduration=66.386705385 podStartE2EDuration="1m8.137002733s" totalImagesPullingTime="1.750297348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:43:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:49.13591669 +0000 UTC m=+103.116944959" watchObservedRunningTime="2026-06-08 13:44:49.137002733 +0000 UTC m=+103.118031001" Jun 08 13:44:50.424458 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:50.424424 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:50.531127 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:50.531090 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:50.686790 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:50.686695 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:53.396506 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.396465 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:53.497366 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.497334 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:53.613641 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.613610 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:53.694807 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.694729 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vfjhj"] Jun 08 13:44:53.697872 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.697853 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vfjhj" Jun 08 13:44:53.701604 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.701583 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 08 13:44:53.701721 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.701602 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 08 13:44:53.701721 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.701602 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 08 13:44:53.701721 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.701655 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 08 13:44:53.701721 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.701714 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cpglf\"" Jun 08 13:44:53.725603 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.725575 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:53.770266 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.770242 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpvsz\" (UniqueName: \"kubernetes.io/projected/f5e8500c-e54b-4307-83b7-1f39f63165f2-kube-api-access-cpvsz\") pod \"node-exporter-vfjhj\" (UID: \"f5e8500c-e54b-4307-83b7-1f39f63165f2\") " pod="openshift-monitoring/node-exporter-vfjhj" Jun 08 13:44:53.770378 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.770284 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5e8500c-e54b-4307-83b7-1f39f63165f2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vfjhj\" (UID: \"f5e8500c-e54b-4307-83b7-1f39f63165f2\") " pod="openshift-monitoring/node-exporter-vfjhj" Jun 08 13:44:53.770378 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.770308 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f5e8500c-e54b-4307-83b7-1f39f63165f2-node-exporter-textfile\") pod \"node-exporter-vfjhj\" (UID: \"f5e8500c-e54b-4307-83b7-1f39f63165f2\") " pod="openshift-monitoring/node-exporter-vfjhj" Jun 08 13:44:53.770494 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.770399 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f5e8500c-e54b-4307-83b7-1f39f63165f2-node-exporter-tls\") pod \"node-exporter-vfjhj\" (UID: \"f5e8500c-e54b-4307-83b7-1f39f63165f2\") " pod="openshift-monitoring/node-exporter-vfjhj" Jun 08 13:44:53.770494 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.770443 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5e8500c-e54b-4307-83b7-1f39f63165f2-sys\") pod \"node-exporter-vfjhj\" (UID: \"f5e8500c-e54b-4307-83b7-1f39f63165f2\") " pod="openshift-monitoring/node-exporter-vfjhj" Jun 08 13:44:53.770494 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.770466 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f5e8500c-e54b-4307-83b7-1f39f63165f2-root\") pod \"node-exporter-vfjhj\" (UID: \"f5e8500c-e54b-4307-83b7-1f39f63165f2\") " pod="openshift-monitoring/node-exporter-vfjhj" Jun 08 13:44:53.770640 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.770497 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f5e8500c-e54b-4307-83b7-1f39f63165f2-node-exporter-accelerators-collector-config\") pod \"node-exporter-vfjhj\" (UID: \"f5e8500c-e54b-4307-83b7-1f39f63165f2\") " pod="openshift-monitoring/node-exporter-vfjhj" Jun 08 13:44:53.770640 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.770532 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f5e8500c-e54b-4307-83b7-1f39f63165f2-node-exporter-wtmp\") pod \"node-exporter-vfjhj\" (UID: \"f5e8500c-e54b-4307-83b7-1f39f63165f2\") " pod="openshift-monitoring/node-exporter-vfjhj" Jun 08 13:44:53.770640 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.770591 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5e8500c-e54b-4307-83b7-1f39f63165f2-metrics-client-ca\") pod \"node-exporter-vfjhj\" (UID: \"f5e8500c-e54b-4307-83b7-1f39f63165f2\") " pod="openshift-monitoring/node-exporter-vfjhj" Jun 08 13:44:53.817586 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.817559 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:53.871830 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.871808 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5e8500c-e54b-4307-83b7-1f39f63165f2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vfjhj\" (UID: \"f5e8500c-e54b-4307-83b7-1f39f63165f2\") " pod="openshift-monitoring/node-exporter-vfjhj" Jun 08 13:44:53.871938 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.871861 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f5e8500c-e54b-4307-83b7-1f39f63165f2-node-exporter-textfile\") pod \"node-exporter-vfjhj\" (UID: \"f5e8500c-e54b-4307-83b7-1f39f63165f2\") " pod="openshift-monitoring/node-exporter-vfjhj" Jun 08 13:44:53.871938 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.871919 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f5e8500c-e54b-4307-83b7-1f39f63165f2-node-exporter-tls\") pod \"node-exporter-vfjhj\" (UID: \"f5e8500c-e54b-4307-83b7-1f39f63165f2\") " pod="openshift-monitoring/node-exporter-vfjhj" Jun 08 13:44:53.872063 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.871948 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5e8500c-e54b-4307-83b7-1f39f63165f2-sys\") pod \"node-exporter-vfjhj\" (UID: \"f5e8500c-e54b-4307-83b7-1f39f63165f2\") " pod="openshift-monitoring/node-exporter-vfjhj" Jun 08 13:44:53.872063 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.871972 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f5e8500c-e54b-4307-83b7-1f39f63165f2-root\") pod \"node-exporter-vfjhj\" (UID: \"f5e8500c-e54b-4307-83b7-1f39f63165f2\") " pod="openshift-monitoring/node-exporter-vfjhj" Jun 08 13:44:53.872063 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.872030 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f5e8500c-e54b-4307-83b7-1f39f63165f2-root\") pod \"node-exporter-vfjhj\" (UID: \"f5e8500c-e54b-4307-83b7-1f39f63165f2\") " pod="openshift-monitoring/node-exporter-vfjhj" Jun 08 13:44:53.872063 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.872031 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5e8500c-e54b-4307-83b7-1f39f63165f2-sys\") pod \"node-exporter-vfjhj\" (UID: \"f5e8500c-e54b-4307-83b7-1f39f63165f2\") " pod="openshift-monitoring/node-exporter-vfjhj" Jun 08 13:44:53.872273 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.872080 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f5e8500c-e54b-4307-83b7-1f39f63165f2-node-exporter-accelerators-collector-config\") pod \"node-exporter-vfjhj\" (UID: \"f5e8500c-e54b-4307-83b7-1f39f63165f2\") " pod="openshift-monitoring/node-exporter-vfjhj" Jun 08 13:44:53.872273 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.872120 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f5e8500c-e54b-4307-83b7-1f39f63165f2-node-exporter-wtmp\") pod \"node-exporter-vfjhj\" (UID: \"f5e8500c-e54b-4307-83b7-1f39f63165f2\") " pod="openshift-monitoring/node-exporter-vfjhj" Jun 08 13:44:53.872273 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.872156 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5e8500c-e54b-4307-83b7-1f39f63165f2-metrics-client-ca\") pod \"node-exporter-vfjhj\" (UID: \"f5e8500c-e54b-4307-83b7-1f39f63165f2\") " pod="openshift-monitoring/node-exporter-vfjhj" Jun 08 13:44:53.872273 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.872184 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpvsz\" (UniqueName: \"kubernetes.io/projected/f5e8500c-e54b-4307-83b7-1f39f63165f2-kube-api-access-cpvsz\") pod \"node-exporter-vfjhj\" (UID: \"f5e8500c-e54b-4307-83b7-1f39f63165f2\") " pod="openshift-monitoring/node-exporter-vfjhj" Jun 08 13:44:53.872455 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.872271 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f5e8500c-e54b-4307-83b7-1f39f63165f2-node-exporter-wtmp\") pod \"node-exporter-vfjhj\" (UID: \"f5e8500c-e54b-4307-83b7-1f39f63165f2\") " pod="openshift-monitoring/node-exporter-vfjhj" Jun 08 13:44:53.872455 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.872371 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f5e8500c-e54b-4307-83b7-1f39f63165f2-node-exporter-textfile\") pod \"node-exporter-vfjhj\" (UID: \"f5e8500c-e54b-4307-83b7-1f39f63165f2\") " pod="openshift-monitoring/node-exporter-vfjhj" Jun 08 13:44:53.872799 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.872776 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f5e8500c-e54b-4307-83b7-1f39f63165f2-node-exporter-accelerators-collector-config\") pod \"node-exporter-vfjhj\" (UID: \"f5e8500c-e54b-4307-83b7-1f39f63165f2\") " pod="openshift-monitoring/node-exporter-vfjhj" Jun 08 13:44:53.872926 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.872909 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5e8500c-e54b-4307-83b7-1f39f63165f2-metrics-client-ca\") pod \"node-exporter-vfjhj\" (UID: \"f5e8500c-e54b-4307-83b7-1f39f63165f2\") " pod="openshift-monitoring/node-exporter-vfjhj" Jun 08 13:44:53.874197 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.874179 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5e8500c-e54b-4307-83b7-1f39f63165f2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vfjhj\" (UID: \"f5e8500c-e54b-4307-83b7-1f39f63165f2\") " pod="openshift-monitoring/node-exporter-vfjhj" Jun 08 13:44:53.874465 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.874447 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f5e8500c-e54b-4307-83b7-1f39f63165f2-node-exporter-tls\") pod \"node-exporter-vfjhj\" (UID: \"f5e8500c-e54b-4307-83b7-1f39f63165f2\") " pod="openshift-monitoring/node-exporter-vfjhj" Jun 08 13:44:53.881204 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:53.881185 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpvsz\" (UniqueName: \"kubernetes.io/projected/f5e8500c-e54b-4307-83b7-1f39f63165f2-kube-api-access-cpvsz\") pod \"node-exporter-vfjhj\" (UID: \"f5e8500c-e54b-4307-83b7-1f39f63165f2\") " pod="openshift-monitoring/node-exporter-vfjhj" Jun 08 13:44:54.006455 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:54.006388 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vfjhj" Jun 08 13:44:54.017866 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:44:54.017844 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5e8500c_e54b_4307_83b7_1f39f63165f2.slice/crio-a180a8a4cda6e2c942c6ad1ca7dc1bbeb06288c21f08680e3ea59e9bf7b4bb4f WatchSource:0}: Error finding container a180a8a4cda6e2c942c6ad1ca7dc1bbeb06288c21f08680e3ea59e9bf7b4bb4f: Status 404 returned error can't find the container with id a180a8a4cda6e2c942c6ad1ca7dc1bbeb06288c21f08680e3ea59e9bf7b4bb4f Jun 08 13:44:54.042826 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:54.042805 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:54.103448 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:54.103425 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vfjhj" event={"ID":"f5e8500c-e54b-4307-83b7-1f39f63165f2","Type":"ContainerStarted","Data":"a180a8a4cda6e2c942c6ad1ca7dc1bbeb06288c21f08680e3ea59e9bf7b4bb4f"} Jun 08 13:44:54.112377 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:54.112355 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:54.381593 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:54.381508 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:54.706792 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:54.706745 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:54.792057 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:54.792018 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:54.887847 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:54.887797 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:56.113365 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:56.113334 2561 generic.go:356] "Generic (PLEG): container finished" podID="f5e8500c-e54b-4307-83b7-1f39f63165f2" containerID="2b8224fd835298f7d3a738039662c87d518b9ffc423743a839d79a691f0b6de2" exitCode=0 Jun 08 13:44:56.113733 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:56.113402 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vfjhj" event={"ID":"f5e8500c-e54b-4307-83b7-1f39f63165f2","Type":"ContainerDied","Data":"2b8224fd835298f7d3a738039662c87d518b9ffc423743a839d79a691f0b6de2"} Jun 08 13:44:56.683714 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:56.683686 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:56.784653 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:56.784620 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:56.887024 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:56.886990 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:57.117844 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:57.117754 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:57.119286 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:57.119258 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vfjhj" event={"ID":"f5e8500c-e54b-4307-83b7-1f39f63165f2","Type":"ContainerStarted","Data":"b3242df247cbdccd2409159223037104a06888c9abbfd85af93b4f119902ff0b"} Jun 08 13:44:57.119426 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:57.119309 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vfjhj" event={"ID":"f5e8500c-e54b-4307-83b7-1f39f63165f2","Type":"ContainerStarted","Data":"408314b15e536071841a05b28f039559ea1a0a4463670fc104e53e467c033604"} Jun 08 13:44:57.139883 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:57.139844 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vfjhj" podStartSLOduration=3.000737417 podStartE2EDuration="4.139832564s" totalImagesPullingTime="1.075255703s" totalInitContainerRuntime="63.839444ms" isStatefulPod=true podCreationTimestamp="2026-06-08 13:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:57.138496422 +0000 UTC m=+111.119524691" watchObservedRunningTime="2026-06-08 13:44:57.139832564 +0000 UTC m=+111.120860832" Jun 08 13:44:57.371167 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:57.371090 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:57.462140 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:57.462111 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:58.465594 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:58.465554 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-646c6ff68f-gn7v4"] Jun 08 13:44:58.513371 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:58.513342 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:58.596286 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:58.596251 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:58.711256 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:58.711223 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:58.779111 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:58.779040 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:58.898031 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:58.898004 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:59.092688 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:44:59.092615 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hfcp7" Jun 08 13:45:00.066144 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:00.066103 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:02.470670 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:02.470643 2561 scope.go:117] "RemoveContainer" containerID="3ee2b013f8abe518a31594c9323e396725d59f250b45fbd97390c1b12d6abd2f" Jun 08 13:45:02.666631 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:02.666591 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:02.749279 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:02.749195 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:03.140946 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:03.140916 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l7lbv_0453a3c5-bb95-4060-bd97-67aba216bcc6/console-operator/2.log" Jun 08 13:45:03.141095 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:03.141036 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" event={"ID":"0453a3c5-bb95-4060-bd97-67aba216bcc6","Type":"ContainerStarted","Data":"59cf3b93570b2e6b1ce0151d041451fde3ecda3ae09fa19ca8f574ab8fb161b6"} Jun 08 13:45:03.141340 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:03.141318 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" Jun 08 13:45:03.149120 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:03.149089 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" Jun 08 13:45:03.161448 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:03.161400 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-l7lbv" podStartSLOduration=53.871568467 podStartE2EDuration="59.161381197s" totalImagesPullingTime="5.28981273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:44:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:45:03.160336953 +0000 UTC m=+117.141365223" watchObservedRunningTime="2026-06-08 13:45:03.161381197 +0000 UTC m=+117.142409468" Jun 08 13:45:03.310864 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:03.310836 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-hlzqv"] Jun 08 13:45:03.313996 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:03.313971 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-hlzqv" Jun 08 13:45:03.316677 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:03.316658 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 08 13:45:03.316808 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:03.316660 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 08 13:45:03.316808 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:03.316682 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-hpnqb\"" Jun 08 13:45:03.330284 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:03.330239 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-hlzqv"] Jun 08 13:45:03.330456 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:03.330417 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:03.427374 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:03.427280 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:03.452278 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:03.452248 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjgsh\" (UniqueName: \"kubernetes.io/projected/06d98bf2-a0f5-4c6d-be96-16118f0967cd-kube-api-access-cjgsh\") pod \"downloads-6657875f97-hlzqv\" (UID: \"06d98bf2-a0f5-4c6d-be96-16118f0967cd\") " pod="openshift-console/downloads-6657875f97-hlzqv" Jun 08 13:45:03.522711 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:03.522684 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:03.552630 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:03.552603 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjgsh\" (UniqueName: \"kubernetes.io/projected/06d98bf2-a0f5-4c6d-be96-16118f0967cd-kube-api-access-cjgsh\") pod \"downloads-6657875f97-hlzqv\" (UID: \"06d98bf2-a0f5-4c6d-be96-16118f0967cd\") " pod="openshift-console/downloads-6657875f97-hlzqv" Jun 08 13:45:03.561898 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:03.561879 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjgsh\" (UniqueName: \"kubernetes.io/projected/06d98bf2-a0f5-4c6d-be96-16118f0967cd-kube-api-access-cjgsh\") pod \"downloads-6657875f97-hlzqv\" (UID: \"06d98bf2-a0f5-4c6d-be96-16118f0967cd\") " pod="openshift-console/downloads-6657875f97-hlzqv" Jun 08 13:45:03.622589 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:03.622563 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:03.623375 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:03.623353 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-hlzqv" Jun 08 13:45:03.752537 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:03.752510 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-hlzqv"] Jun 08 13:45:03.753854 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:45:03.753832 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06d98bf2_a0f5_4c6d_be96_16118f0967cd.slice/crio-df128a88c50f1f1e44de2aa88de6b3e58631679503894d188bdd93b4012bee7f WatchSource:0}: Error finding container df128a88c50f1f1e44de2aa88de6b3e58631679503894d188bdd93b4012bee7f: Status 404 returned error can't find the container with id df128a88c50f1f1e44de2aa88de6b3e58631679503894d188bdd93b4012bee7f Jun 08 13:45:03.790749 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:03.790717 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:03.891913 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:03.891887 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:04.145980 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:04.145939 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-hlzqv" event={"ID":"06d98bf2-a0f5-4c6d-be96-16118f0967cd","Type":"ContainerStarted","Data":"df128a88c50f1f1e44de2aa88de6b3e58631679503894d188bdd93b4012bee7f"} Jun 08 13:45:04.193286 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:04.193192 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:04.294884 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:04.294852 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:04.395885 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:04.395849 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:04.494031 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:04.493957 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:04.550858 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:04.550827 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:05.001965 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:05.001924 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:05.200040 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:05.199995 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:05.419661 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:05.419608 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:06.826428 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:06.826395 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:06.932361 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:06.932325 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:08.185172 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:08.185134 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:08.280705 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:08.280647 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:08.476349 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:08.476272 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:45:12.350881 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:12.350849 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:12.454822 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:12.454782 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:13.506353 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:13.506289 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:13.607869 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:13.607792 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:13.812682 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:13.812598 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:14.465437 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:14.465402 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68d788dc7f-78mwr"] Jun 08 13:45:14.495425 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:14.495383 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68d788dc7f-78mwr" Jun 08 13:45:14.498421 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:14.498192 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 08 13:45:14.498421 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:14.498239 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 08 13:45:14.498421 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:14.498250 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 08 13:45:14.499388 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:14.499358 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7swzf\"" Jun 08 13:45:14.499520 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:14.499413 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 08 13:45:14.499520 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:14.499426 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 08 13:45:14.501786 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:14.501750 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68d788dc7f-78mwr"] Jun 08 13:45:14.647101 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:14.647060 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/567b740d-0672-4987-8a22-918e0a1d0b07-console-serving-cert\") pod \"console-68d788dc7f-78mwr\" (UID: \"567b740d-0672-4987-8a22-918e0a1d0b07\") " pod="openshift-console/console-68d788dc7f-78mwr" Jun 08 13:45:14.647101 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:14.647106 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/567b740d-0672-4987-8a22-918e0a1d0b07-service-ca\") pod \"console-68d788dc7f-78mwr\" (UID: \"567b740d-0672-4987-8a22-918e0a1d0b07\") " pod="openshift-console/console-68d788dc7f-78mwr" Jun 08 13:45:14.647645 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:14.647290 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnvtj\" (UniqueName: \"kubernetes.io/projected/567b740d-0672-4987-8a22-918e0a1d0b07-kube-api-access-vnvtj\") pod \"console-68d788dc7f-78mwr\" (UID: \"567b740d-0672-4987-8a22-918e0a1d0b07\") " pod="openshift-console/console-68d788dc7f-78mwr" Jun 08 13:45:14.647645 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:14.647332 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/567b740d-0672-4987-8a22-918e0a1d0b07-console-oauth-config\") pod \"console-68d788dc7f-78mwr\" (UID: \"567b740d-0672-4987-8a22-918e0a1d0b07\") " pod="openshift-console/console-68d788dc7f-78mwr" Jun 08 13:45:14.647645 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:14.647393 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/567b740d-0672-4987-8a22-918e0a1d0b07-oauth-serving-cert\") pod \"console-68d788dc7f-78mwr\" (UID: \"567b740d-0672-4987-8a22-918e0a1d0b07\") " pod="openshift-console/console-68d788dc7f-78mwr" Jun 08 13:45:14.647645 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:14.647420 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/567b740d-0672-4987-8a22-918e0a1d0b07-console-config\") pod \"console-68d788dc7f-78mwr\" (UID: \"567b740d-0672-4987-8a22-918e0a1d0b07\") " pod="openshift-console/console-68d788dc7f-78mwr" Jun 08 13:45:14.748586 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:14.748506 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/567b740d-0672-4987-8a22-918e0a1d0b07-console-serving-cert\") pod \"console-68d788dc7f-78mwr\" (UID: \"567b740d-0672-4987-8a22-918e0a1d0b07\") " pod="openshift-console/console-68d788dc7f-78mwr" Jun 08 13:45:14.748586 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:14.748546 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/567b740d-0672-4987-8a22-918e0a1d0b07-service-ca\") pod \"console-68d788dc7f-78mwr\" (UID: \"567b740d-0672-4987-8a22-918e0a1d0b07\") " pod="openshift-console/console-68d788dc7f-78mwr" Jun 08 13:45:14.748586 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:14.748580 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnvtj\" (UniqueName: \"kubernetes.io/projected/567b740d-0672-4987-8a22-918e0a1d0b07-kube-api-access-vnvtj\") pod \"console-68d788dc7f-78mwr\" (UID: \"567b740d-0672-4987-8a22-918e0a1d0b07\") " pod="openshift-console/console-68d788dc7f-78mwr" Jun 08 13:45:14.748903 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:14.748609 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/567b740d-0672-4987-8a22-918e0a1d0b07-console-oauth-config\") pod \"console-68d788dc7f-78mwr\" (UID: \"567b740d-0672-4987-8a22-918e0a1d0b07\") " pod="openshift-console/console-68d788dc7f-78mwr" Jun 08 13:45:14.748903 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:14.748646 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/567b740d-0672-4987-8a22-918e0a1d0b07-oauth-serving-cert\") pod \"console-68d788dc7f-78mwr\" (UID: \"567b740d-0672-4987-8a22-918e0a1d0b07\") " pod="openshift-console/console-68d788dc7f-78mwr" Jun 08 13:45:14.748903 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:14.748671 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/567b740d-0672-4987-8a22-918e0a1d0b07-console-config\") pod \"console-68d788dc7f-78mwr\" (UID: \"567b740d-0672-4987-8a22-918e0a1d0b07\") " pod="openshift-console/console-68d788dc7f-78mwr" Jun 08 13:45:14.749486 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:14.749447 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/567b740d-0672-4987-8a22-918e0a1d0b07-service-ca\") pod \"console-68d788dc7f-78mwr\" (UID: \"567b740d-0672-4987-8a22-918e0a1d0b07\") " pod="openshift-console/console-68d788dc7f-78mwr" Jun 08 13:45:14.749616 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:14.749497 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/567b740d-0672-4987-8a22-918e0a1d0b07-console-config\") pod \"console-68d788dc7f-78mwr\" (UID: \"567b740d-0672-4987-8a22-918e0a1d0b07\") " pod="openshift-console/console-68d788dc7f-78mwr" Jun 08 13:45:14.749616 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:14.749524 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/567b740d-0672-4987-8a22-918e0a1d0b07-oauth-serving-cert\") pod \"console-68d788dc7f-78mwr\" (UID: \"567b740d-0672-4987-8a22-918e0a1d0b07\") " pod="openshift-console/console-68d788dc7f-78mwr" Jun 08 13:45:14.751414 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:14.751389 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/567b740d-0672-4987-8a22-918e0a1d0b07-console-oauth-config\") pod \"console-68d788dc7f-78mwr\" (UID: \"567b740d-0672-4987-8a22-918e0a1d0b07\") " pod="openshift-console/console-68d788dc7f-78mwr" Jun 08 13:45:14.751611 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:14.751580 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/567b740d-0672-4987-8a22-918e0a1d0b07-console-serving-cert\") pod \"console-68d788dc7f-78mwr\" (UID: \"567b740d-0672-4987-8a22-918e0a1d0b07\") " pod="openshift-console/console-68d788dc7f-78mwr" Jun 08 13:45:14.787569 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:14.787543 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnvtj\" (UniqueName: \"kubernetes.io/projected/567b740d-0672-4987-8a22-918e0a1d0b07-kube-api-access-vnvtj\") pod \"console-68d788dc7f-78mwr\" (UID: \"567b740d-0672-4987-8a22-918e0a1d0b07\") " pod="openshift-console/console-68d788dc7f-78mwr" Jun 08 13:45:14.807806 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:14.807747 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68d788dc7f-78mwr" Jun 08 13:45:14.813522 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:14.813489 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:14.910020 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:14.909986 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:15.355283 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:15.355242 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50931712-af88-4fe2-b146-0926d8e10b25-metrics-certs\") pod \"network-metrics-daemon-6zmwj\" (UID: \"50931712-af88-4fe2-b146-0926d8e10b25\") " pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:45:15.357756 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:15.357732 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50931712-af88-4fe2-b146-0926d8e10b25-metrics-certs\") pod \"network-metrics-daemon-6zmwj\" (UID: \"50931712-af88-4fe2-b146-0926d8e10b25\") " pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:45:15.584042 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:15.584001 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-96pfm\"" Jun 08 13:45:15.592294 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:15.592271 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6zmwj" Jun 08 13:45:19.390462 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:19.390435 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68d788dc7f-78mwr"] Jun 08 13:45:19.392417 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:45:19.392392 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod567b740d_0672_4987_8a22_918e0a1d0b07.slice/crio-0b810246f0418b9341eb578b44162aaaa636040bb3e42c830b5fbf840df26bfb WatchSource:0}: Error finding container 0b810246f0418b9341eb578b44162aaaa636040bb3e42c830b5fbf840df26bfb: Status 404 returned error can't find the container with id 0b810246f0418b9341eb578b44162aaaa636040bb3e42c830b5fbf840df26bfb Jun 08 13:45:19.408099 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:19.408079 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6zmwj"] Jun 08 13:45:19.410676 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:45:19.410653 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50931712_af88_4fe2_b146_0926d8e10b25.slice/crio-6f73b189c5894a4ffc1a390f5ca3bd1c8afe0b5106fe7f747f68d4d2192e66dd WatchSource:0}: Error finding container 6f73b189c5894a4ffc1a390f5ca3bd1c8afe0b5106fe7f747f68d4d2192e66dd: Status 404 returned error can't find the container with id 6f73b189c5894a4ffc1a390f5ca3bd1c8afe0b5106fe7f747f68d4d2192e66dd Jun 08 13:45:19.428704 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:19.428679 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:19.529824 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:19.529716 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:20.217315 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:20.217220 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-hlzqv" event={"ID":"06d98bf2-a0f5-4c6d-be96-16118f0967cd","Type":"ContainerStarted","Data":"0adcb6e687c0ca5a6aeade0ae4629fc6f0131c6d2ba4c0f9676e0dae3030cdbe"} Jun 08 13:45:20.218196 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:20.217989 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-hlzqv" Jun 08 13:45:20.220317 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:20.220263 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68d788dc7f-78mwr" event={"ID":"567b740d-0672-4987-8a22-918e0a1d0b07","Type":"ContainerStarted","Data":"0b810246f0418b9341eb578b44162aaaa636040bb3e42c830b5fbf840df26bfb"} Jun 08 13:45:20.222996 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:20.222948 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6zmwj" event={"ID":"50931712-af88-4fe2-b146-0926d8e10b25","Type":"ContainerStarted","Data":"6f73b189c5894a4ffc1a390f5ca3bd1c8afe0b5106fe7f747f68d4d2192e66dd"} Jun 08 13:45:20.236151 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:20.236107 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-hlzqv" Jun 08 13:45:20.261471 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:20.261387 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-hlzqv" podStartSLOduration=1.685373574 podStartE2EDuration="17.261367655s" totalImagesPullingTime="15.575994081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:45:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:45:20.24175631 +0000 UTC m=+134.222784582" watchObservedRunningTime="2026-06-08 13:45:20.261367655 +0000 UTC m=+134.242395926" Jun 08 13:45:21.234179 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:21.234023 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6zmwj" event={"ID":"50931712-af88-4fe2-b146-0926d8e10b25","Type":"ContainerStarted","Data":"b1ab865e8d2e91ad140ac09d2fbe1a2da7bd3e4dca2cd42f593c907c3fcc7209"} Jun 08 13:45:21.234179 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:21.234119 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6zmwj" event={"ID":"50931712-af88-4fe2-b146-0926d8e10b25","Type":"ContainerStarted","Data":"cf6184a295b274c001186a968526cb789626d2d402e2d6c4f725c8a474507ff5"} Jun 08 13:45:21.251217 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:21.251158 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6zmwj" podStartSLOduration=134.083621799 podStartE2EDuration="2m15.251082105s" totalImagesPullingTime="1.167460306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:43:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:45:21.249002645 +0000 UTC m=+135.230030935" watchObservedRunningTime="2026-06-08 13:45:21.251082105 +0000 UTC m=+135.232110374" Jun 08 13:45:21.348226 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:21.348173 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:21.411030 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:21.410991 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:23.416198 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:23.416165 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:23.484633 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:23.484595 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" podUID="139a2ec4-1171-479a-a203-1c91f6547fcd" containerName="registry" containerID="cri-o://d7a0063ddb0948e9cd3cd20ee2f0160f448925a48dae3a3ed4f1122ae3cf43b0" gracePeriod=30 Jun 08 13:45:23.520106 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:23.520072 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:23.782964 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:23.782940 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:45:23.828548 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:23.828520 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/139a2ec4-1171-479a-a203-1c91f6547fcd-registry-certificates\") pod \"139a2ec4-1171-479a-a203-1c91f6547fcd\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " Jun 08 13:45:23.828690 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:23.828558 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-registry-tls\") pod \"139a2ec4-1171-479a-a203-1c91f6547fcd\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " Jun 08 13:45:23.828690 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:23.828600 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/139a2ec4-1171-479a-a203-1c91f6547fcd-installation-pull-secrets\") pod \"139a2ec4-1171-479a-a203-1c91f6547fcd\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " Jun 08 13:45:23.828690 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:23.828629 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktxft\" (UniqueName: \"kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-kube-api-access-ktxft\") pod \"139a2ec4-1171-479a-a203-1c91f6547fcd\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " Jun 08 13:45:23.828690 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:23.828656 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/139a2ec4-1171-479a-a203-1c91f6547fcd-trusted-ca\") pod \"139a2ec4-1171-479a-a203-1c91f6547fcd\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " Jun 08 13:45:23.828690 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:23.828685 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/139a2ec4-1171-479a-a203-1c91f6547fcd-image-registry-private-configuration\") pod \"139a2ec4-1171-479a-a203-1c91f6547fcd\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " Jun 08 13:45:23.828978 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:23.828748 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/139a2ec4-1171-479a-a203-1c91f6547fcd-ca-trust-extracted\") pod \"139a2ec4-1171-479a-a203-1c91f6547fcd\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " Jun 08 13:45:23.828978 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:23.828812 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-bound-sa-token\") pod \"139a2ec4-1171-479a-a203-1c91f6547fcd\" (UID: \"139a2ec4-1171-479a-a203-1c91f6547fcd\") " Jun 08 13:45:23.828978 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:23.828943 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/139a2ec4-1171-479a-a203-1c91f6547fcd-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "139a2ec4-1171-479a-a203-1c91f6547fcd" (UID: "139a2ec4-1171-479a-a203-1c91f6547fcd"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:45:23.829428 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:23.829383 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/139a2ec4-1171-479a-a203-1c91f6547fcd-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "139a2ec4-1171-479a-a203-1c91f6547fcd" (UID: "139a2ec4-1171-479a-a203-1c91f6547fcd"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:45:23.829706 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:23.829659 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/139a2ec4-1171-479a-a203-1c91f6547fcd-trusted-ca\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:45:23.829706 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:23.829686 2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/139a2ec4-1171-479a-a203-1c91f6547fcd-registry-certificates\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:45:23.833673 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:23.833565 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-kube-api-access-ktxft" (OuterVolumeSpecName: "kube-api-access-ktxft") pod "139a2ec4-1171-479a-a203-1c91f6547fcd" (UID: "139a2ec4-1171-479a-a203-1c91f6547fcd"). InnerVolumeSpecName "kube-api-access-ktxft". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:45:23.833673 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:23.833595 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "139a2ec4-1171-479a-a203-1c91f6547fcd" (UID: "139a2ec4-1171-479a-a203-1c91f6547fcd"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:45:23.833673 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:23.833629 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/139a2ec4-1171-479a-a203-1c91f6547fcd-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "139a2ec4-1171-479a-a203-1c91f6547fcd" (UID: "139a2ec4-1171-479a-a203-1c91f6547fcd"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:45:23.833980 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:23.833953 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/139a2ec4-1171-479a-a203-1c91f6547fcd-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "139a2ec4-1171-479a-a203-1c91f6547fcd" (UID: "139a2ec4-1171-479a-a203-1c91f6547fcd"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:45:23.834120 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:23.834004 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "139a2ec4-1171-479a-a203-1c91f6547fcd" (UID: "139a2ec4-1171-479a-a203-1c91f6547fcd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:45:23.855904 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:23.855870 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/139a2ec4-1171-479a-a203-1c91f6547fcd-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "139a2ec4-1171-479a-a203-1c91f6547fcd" (UID: "139a2ec4-1171-479a-a203-1c91f6547fcd"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:45:23.930888 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:23.930860 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-registry-tls\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:45:23.930996 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:23.930890 2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/139a2ec4-1171-479a-a203-1c91f6547fcd-installation-pull-secrets\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:45:23.930996 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:23.930902 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktxft\" (UniqueName: \"kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-kube-api-access-ktxft\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:45:23.930996 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:23.930913 2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/139a2ec4-1171-479a-a203-1c91f6547fcd-image-registry-private-configuration\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:45:23.930996 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:23.930922 2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/139a2ec4-1171-479a-a203-1c91f6547fcd-ca-trust-extracted\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:45:23.930996 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:23.930930 2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/139a2ec4-1171-479a-a203-1c91f6547fcd-bound-sa-token\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:45:24.248351 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:24.248261 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68d788dc7f-78mwr" event={"ID":"567b740d-0672-4987-8a22-918e0a1d0b07","Type":"ContainerStarted","Data":"93cae1d79c2688da64535a4e5edb3171bc4cdbf1a19db3625b077f3395d00df3"} Jun 08 13:45:24.249866 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:24.249833 2561 generic.go:356] "Generic (PLEG): container finished" podID="139a2ec4-1171-479a-a203-1c91f6547fcd" containerID="d7a0063ddb0948e9cd3cd20ee2f0160f448925a48dae3a3ed4f1122ae3cf43b0" exitCode=0 Jun 08 13:45:24.249866 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:24.249866 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" Jun 08 13:45:24.250075 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:24.249892 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" event={"ID":"139a2ec4-1171-479a-a203-1c91f6547fcd","Type":"ContainerDied","Data":"d7a0063ddb0948e9cd3cd20ee2f0160f448925a48dae3a3ed4f1122ae3cf43b0"} Jun 08 13:45:24.250075 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:24.249935 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-646c6ff68f-gn7v4" event={"ID":"139a2ec4-1171-479a-a203-1c91f6547fcd","Type":"ContainerDied","Data":"c81848137691fba53894d672c8ed896ea3d61f575c9b15c1a73ff0be10166890"} Jun 08 13:45:24.250075 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:24.249961 2561 scope.go:117] "RemoveContainer" containerID="d7a0063ddb0948e9cd3cd20ee2f0160f448925a48dae3a3ed4f1122ae3cf43b0" Jun 08 13:45:24.259656 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:24.259536 2561 scope.go:117] "RemoveContainer" containerID="d7a0063ddb0948e9cd3cd20ee2f0160f448925a48dae3a3ed4f1122ae3cf43b0" Jun 08 13:45:24.259946 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:45:24.259901 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7a0063ddb0948e9cd3cd20ee2f0160f448925a48dae3a3ed4f1122ae3cf43b0\": container with ID starting with d7a0063ddb0948e9cd3cd20ee2f0160f448925a48dae3a3ed4f1122ae3cf43b0 not found: ID does not exist" containerID="d7a0063ddb0948e9cd3cd20ee2f0160f448925a48dae3a3ed4f1122ae3cf43b0" Jun 08 13:45:24.260052 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:24.259956 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7a0063ddb0948e9cd3cd20ee2f0160f448925a48dae3a3ed4f1122ae3cf43b0"} err="failed to get container status \"d7a0063ddb0948e9cd3cd20ee2f0160f448925a48dae3a3ed4f1122ae3cf43b0\": rpc error: code = NotFound desc = could not find container \"d7a0063ddb0948e9cd3cd20ee2f0160f448925a48dae3a3ed4f1122ae3cf43b0\": container with ID starting with d7a0063ddb0948e9cd3cd20ee2f0160f448925a48dae3a3ed4f1122ae3cf43b0 not found: ID does not exist" Jun 08 13:45:24.265991 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:24.265955 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68d788dc7f-78mwr" podStartSLOduration=6.355978344 podStartE2EDuration="10.26594189s" totalImagesPullingTime="3.909963546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:45:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:45:24.265029746 +0000 UTC m=+138.246058061" watchObservedRunningTime="2026-06-08 13:45:24.26594189 +0000 UTC m=+138.246970160" Jun 08 13:45:24.281667 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:24.281639 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-646c6ff68f-gn7v4"] Jun 08 13:45:24.285901 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:24.285878 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-646c6ff68f-gn7v4"] Jun 08 13:45:24.483071 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:24.483037 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="139a2ec4-1171-479a-a203-1c91f6547fcd" path="/var/lib/kubelet/pods/139a2ec4-1171-479a-a203-1c91f6547fcd/volumes" Jun 08 13:45:24.808581 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:24.808543 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68d788dc7f-78mwr" Jun 08 13:45:24.808831 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:24.808613 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68d788dc7f-78mwr" Jun 08 13:45:24.814132 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:24.814107 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68d788dc7f-78mwr" Jun 08 13:45:25.259930 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:25.259902 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68d788dc7f-78mwr" Jun 08 13:45:26.262396 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:26.262358 2561 generic.go:356] "Generic (PLEG): container finished" podID="10b62eb7-d904-4652-bb5a-a6cb57c7df03" containerID="3ac7bfda82505b24dd5338ce1f24061e1c74c69d0bf3f5a72b646504d337c70f" exitCode=0 Jun 08 13:45:26.262873 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:26.262436 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-2v2bz" event={"ID":"10b62eb7-d904-4652-bb5a-a6cb57c7df03","Type":"ContainerDied","Data":"3ac7bfda82505b24dd5338ce1f24061e1c74c69d0bf3f5a72b646504d337c70f"} Jun 08 13:45:26.262945 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:26.262871 2561 scope.go:117] "RemoveContainer" containerID="3ac7bfda82505b24dd5338ce1f24061e1c74c69d0bf3f5a72b646504d337c70f" Jun 08 13:45:26.264312 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:26.264289 2561 generic.go:356] "Generic (PLEG): container finished" podID="79b6e8f8-b91f-4d94-8a43-3925d18615c3" containerID="80368ea17232a7165048c2c660d7a6f71f50eb001e8ce70ea90aa1202b18ef51" exitCode=0 Jun 08 13:45:26.264425 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:26.264370 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ttw8m" event={"ID":"79b6e8f8-b91f-4d94-8a43-3925d18615c3","Type":"ContainerDied","Data":"80368ea17232a7165048c2c660d7a6f71f50eb001e8ce70ea90aa1202b18ef51"} Jun 08 13:45:26.264727 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:26.264705 2561 scope.go:117] "RemoveContainer" containerID="80368ea17232a7165048c2c660d7a6f71f50eb001e8ce70ea90aa1202b18ef51" Jun 08 13:45:27.271467 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:27.271418 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ttw8m" event={"ID":"79b6e8f8-b91f-4d94-8a43-3925d18615c3","Type":"ContainerStarted","Data":"a73eb646a904ccde8f2cef0945b9dda3707d79ba499ad2ed27933b9d9b0c7200"} Jun 08 13:45:27.273797 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:27.273754 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-2v2bz" event={"ID":"10b62eb7-d904-4652-bb5a-a6cb57c7df03","Type":"ContainerStarted","Data":"bb498f901f9c45a82c287018ef0aab01d4d748eb6e53eb42382a4927db9c892a"} Jun 08 13:45:27.353168 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:27.353136 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:27.453852 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:27.453813 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:32.042136 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:32.042099 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:32.123841 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:32.123810 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:33.029112 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:33.029052 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:33.093460 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:33.093422 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:33.632733 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:33.632704 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68d788dc7f-78mwr"] Jun 08 13:45:33.741806 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:33.741757 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:33.799758 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:33.799731 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:33.998842 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:33.998809 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:34.099680 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:34.099646 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:34.155210 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:34.155187 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:41.329306 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:41.329276 2561 generic.go:356] "Generic (PLEG): container finished" podID="1bf3f3fe-50d8-424f-81f2-b1c3bc33620e" containerID="8fcfc0bf66f9f131361168cf31e2b7d0cc715ce884e85c83f0a61d72d8c2e125" exitCode=0 Jun 08 13:45:41.329671 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:41.329341 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vx96x" event={"ID":"1bf3f3fe-50d8-424f-81f2-b1c3bc33620e","Type":"ContainerDied","Data":"8fcfc0bf66f9f131361168cf31e2b7d0cc715ce884e85c83f0a61d72d8c2e125"} Jun 08 13:45:41.329671 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:41.329577 2561 scope.go:117] "RemoveContainer" containerID="8fcfc0bf66f9f131361168cf31e2b7d0cc715ce884e85c83f0a61d72d8c2e125" Jun 08 13:45:42.334697 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:42.334654 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vx96x" event={"ID":"1bf3f3fe-50d8-424f-81f2-b1c3bc33620e","Type":"ContainerStarted","Data":"b2bca88d05a28dd55238903a5179c32dad8873638bdd7565ddc965dff7743c1b"} Jun 08 13:45:44.053979 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:44.053946 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:57.350874 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:57.350781 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:57.406090 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:57.406060 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:58.653967 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:58.653931 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-68d788dc7f-78mwr" podUID="567b740d-0672-4987-8a22-918e0a1d0b07" containerName="console" containerID="cri-o://93cae1d79c2688da64535a4e5edb3171bc4cdbf1a19db3625b077f3395d00df3" gracePeriod=15 Jun 08 13:45:58.928356 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:58.928294 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68d788dc7f-78mwr" Jun 08 13:45:58.983387 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:58.983355 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/567b740d-0672-4987-8a22-918e0a1d0b07-oauth-serving-cert\") pod \"567b740d-0672-4987-8a22-918e0a1d0b07\" (UID: \"567b740d-0672-4987-8a22-918e0a1d0b07\") " Jun 08 13:45:58.983570 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:58.983408 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/567b740d-0672-4987-8a22-918e0a1d0b07-console-oauth-config\") pod \"567b740d-0672-4987-8a22-918e0a1d0b07\" (UID: \"567b740d-0672-4987-8a22-918e0a1d0b07\") " Jun 08 13:45:58.983570 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:58.983458 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/567b740d-0672-4987-8a22-918e0a1d0b07-console-serving-cert\") pod \"567b740d-0672-4987-8a22-918e0a1d0b07\" (UID: \"567b740d-0672-4987-8a22-918e0a1d0b07\") " Jun 08 13:45:58.983570 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:58.983477 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/567b740d-0672-4987-8a22-918e0a1d0b07-service-ca\") pod \"567b740d-0672-4987-8a22-918e0a1d0b07\" (UID: \"567b740d-0672-4987-8a22-918e0a1d0b07\") " Jun 08 13:45:58.983570 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:58.983497 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/567b740d-0672-4987-8a22-918e0a1d0b07-console-config\") pod \"567b740d-0672-4987-8a22-918e0a1d0b07\" (UID: \"567b740d-0672-4987-8a22-918e0a1d0b07\") " Jun 08 13:45:58.983570 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:58.983537 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnvtj\" (UniqueName: \"kubernetes.io/projected/567b740d-0672-4987-8a22-918e0a1d0b07-kube-api-access-vnvtj\") pod \"567b740d-0672-4987-8a22-918e0a1d0b07\" (UID: \"567b740d-0672-4987-8a22-918e0a1d0b07\") " Jun 08 13:45:58.983892 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:58.983866 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/567b740d-0672-4987-8a22-918e0a1d0b07-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "567b740d-0672-4987-8a22-918e0a1d0b07" (UID: "567b740d-0672-4987-8a22-918e0a1d0b07"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:45:58.983892 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:58.983883 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/567b740d-0672-4987-8a22-918e0a1d0b07-service-ca" (OuterVolumeSpecName: "service-ca") pod "567b740d-0672-4987-8a22-918e0a1d0b07" (UID: "567b740d-0672-4987-8a22-918e0a1d0b07"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:45:58.983973 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:58.983891 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/567b740d-0672-4987-8a22-918e0a1d0b07-console-config" (OuterVolumeSpecName: "console-config") pod "567b740d-0672-4987-8a22-918e0a1d0b07" (UID: "567b740d-0672-4987-8a22-918e0a1d0b07"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:45:58.985801 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:58.985772 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/567b740d-0672-4987-8a22-918e0a1d0b07-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "567b740d-0672-4987-8a22-918e0a1d0b07" (UID: "567b740d-0672-4987-8a22-918e0a1d0b07"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:45:58.985912 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:58.985889 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/567b740d-0672-4987-8a22-918e0a1d0b07-kube-api-access-vnvtj" (OuterVolumeSpecName: "kube-api-access-vnvtj") pod "567b740d-0672-4987-8a22-918e0a1d0b07" (UID: "567b740d-0672-4987-8a22-918e0a1d0b07"). InnerVolumeSpecName "kube-api-access-vnvtj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:45:58.985971 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:58.985905 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/567b740d-0672-4987-8a22-918e0a1d0b07-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "567b740d-0672-4987-8a22-918e0a1d0b07" (UID: "567b740d-0672-4987-8a22-918e0a1d0b07"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:45:59.084911 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:59.084884 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnvtj\" (UniqueName: \"kubernetes.io/projected/567b740d-0672-4987-8a22-918e0a1d0b07-kube-api-access-vnvtj\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:45:59.084911 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:59.084906 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/567b740d-0672-4987-8a22-918e0a1d0b07-oauth-serving-cert\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:45:59.084911 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:59.084915 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/567b740d-0672-4987-8a22-918e0a1d0b07-console-oauth-config\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:45:59.085069 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:59.084923 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/567b740d-0672-4987-8a22-918e0a1d0b07-console-serving-cert\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:45:59.085069 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:59.084931 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/567b740d-0672-4987-8a22-918e0a1d0b07-service-ca\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:45:59.085069 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:59.084939 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/567b740d-0672-4987-8a22-918e0a1d0b07-console-config\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:45:59.397829 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:59.397784 2561 generic.go:356] "Generic (PLEG): container finished" podID="567b740d-0672-4987-8a22-918e0a1d0b07" containerID="93cae1d79c2688da64535a4e5edb3171bc4cdbf1a19db3625b077f3395d00df3" exitCode=0 Jun 08 13:45:59.397829 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:59.397825 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68d788dc7f-78mwr" Jun 08 13:45:59.397994 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:59.397840 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68d788dc7f-78mwr" event={"ID":"567b740d-0672-4987-8a22-918e0a1d0b07","Type":"ContainerDied","Data":"93cae1d79c2688da64535a4e5edb3171bc4cdbf1a19db3625b077f3395d00df3"} Jun 08 13:45:59.397994 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:59.397880 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68d788dc7f-78mwr" event={"ID":"567b740d-0672-4987-8a22-918e0a1d0b07","Type":"ContainerDied","Data":"0b810246f0418b9341eb578b44162aaaa636040bb3e42c830b5fbf840df26bfb"} Jun 08 13:45:59.397994 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:59.397899 2561 scope.go:117] "RemoveContainer" containerID="93cae1d79c2688da64535a4e5edb3171bc4cdbf1a19db3625b077f3395d00df3" Jun 08 13:45:59.406343 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:59.406317 2561 scope.go:117] "RemoveContainer" containerID="93cae1d79c2688da64535a4e5edb3171bc4cdbf1a19db3625b077f3395d00df3" Jun 08 13:45:59.406590 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:45:59.406570 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93cae1d79c2688da64535a4e5edb3171bc4cdbf1a19db3625b077f3395d00df3\": container with ID starting with 93cae1d79c2688da64535a4e5edb3171bc4cdbf1a19db3625b077f3395d00df3 not found: ID does not exist" containerID="93cae1d79c2688da64535a4e5edb3171bc4cdbf1a19db3625b077f3395d00df3" Jun 08 13:45:59.406651 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:59.406598 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93cae1d79c2688da64535a4e5edb3171bc4cdbf1a19db3625b077f3395d00df3"} err="failed to get container status \"93cae1d79c2688da64535a4e5edb3171bc4cdbf1a19db3625b077f3395d00df3\": rpc error: code = NotFound desc = could not find container \"93cae1d79c2688da64535a4e5edb3171bc4cdbf1a19db3625b077f3395d00df3\": container with ID starting with 93cae1d79c2688da64535a4e5edb3171bc4cdbf1a19db3625b077f3395d00df3 not found: ID does not exist" Jun 08 13:45:59.419298 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:59.419276 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68d788dc7f-78mwr"] Jun 08 13:45:59.424498 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:45:59.424474 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68d788dc7f-78mwr"] Jun 08 13:46:00.474916 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:00.474880 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="567b740d-0672-4987-8a22-918e0a1d0b07" path="/var/lib/kubelet/pods/567b740d-0672-4987-8a22-918e0a1d0b07/volumes" Jun 08 13:46:09.870246 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:09.870214 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:46:09.929393 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:09.929365 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:46:12.160440 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.160405 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b8c6787fd-48pdt"] Jun 08 13:46:12.160988 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.160857 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="139a2ec4-1171-479a-a203-1c91f6547fcd" containerName="registry" Jun 08 13:46:12.160988 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.160877 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="139a2ec4-1171-479a-a203-1c91f6547fcd" containerName="registry" Jun 08 13:46:12.160988 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.160919 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="567b740d-0672-4987-8a22-918e0a1d0b07" containerName="console" Jun 08 13:46:12.160988 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.160928 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="567b740d-0672-4987-8a22-918e0a1d0b07" containerName="console" Jun 08 13:46:12.161165 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.160999 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="567b740d-0672-4987-8a22-918e0a1d0b07" containerName="console" Jun 08 13:46:12.161165 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.161011 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="139a2ec4-1171-479a-a203-1c91f6547fcd" containerName="registry" Jun 08 13:46:12.164119 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.164098 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b8c6787fd-48pdt" Jun 08 13:46:12.167306 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.167287 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7swzf\"" Jun 08 13:46:12.168582 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.168560 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 08 13:46:12.168709 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.168625 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 08 13:46:12.168709 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.168623 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 08 13:46:12.168857 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.168830 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 08 13:46:12.168920 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.168830 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 08 13:46:12.175587 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.175561 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b8c6787fd-48pdt"] Jun 08 13:46:12.180579 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.180558 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 08 13:46:12.217930 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.217880 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:46:12.283066 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.283042 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d70e045-d0e7-48cc-acef-672815f9666a-console-serving-cert\") pod \"console-5b8c6787fd-48pdt\" (UID: \"4d70e045-d0e7-48cc-acef-672815f9666a\") " pod="openshift-console/console-5b8c6787fd-48pdt" Jun 08 13:46:12.283151 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.283075 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d70e045-d0e7-48cc-acef-672815f9666a-console-oauth-config\") pod \"console-5b8c6787fd-48pdt\" (UID: \"4d70e045-d0e7-48cc-acef-672815f9666a\") " pod="openshift-console/console-5b8c6787fd-48pdt" Jun 08 13:46:12.283151 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.283108 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d70e045-d0e7-48cc-acef-672815f9666a-oauth-serving-cert\") pod \"console-5b8c6787fd-48pdt\" (UID: \"4d70e045-d0e7-48cc-acef-672815f9666a\") " pod="openshift-console/console-5b8c6787fd-48pdt" Jun 08 13:46:12.283151 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.283123 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtxsd\" (UniqueName: \"kubernetes.io/projected/4d70e045-d0e7-48cc-acef-672815f9666a-kube-api-access-mtxsd\") pod \"console-5b8c6787fd-48pdt\" (UID: \"4d70e045-d0e7-48cc-acef-672815f9666a\") " pod="openshift-console/console-5b8c6787fd-48pdt" Jun 08 13:46:12.283151 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.283144 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d70e045-d0e7-48cc-acef-672815f9666a-service-ca\") pod \"console-5b8c6787fd-48pdt\" (UID: \"4d70e045-d0e7-48cc-acef-672815f9666a\") " pod="openshift-console/console-5b8c6787fd-48pdt" Jun 08 13:46:12.283281 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.283178 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d70e045-d0e7-48cc-acef-672815f9666a-console-config\") pod \"console-5b8c6787fd-48pdt\" (UID: \"4d70e045-d0e7-48cc-acef-672815f9666a\") " pod="openshift-console/console-5b8c6787fd-48pdt" Jun 08 13:46:12.283281 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.283197 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d70e045-d0e7-48cc-acef-672815f9666a-trusted-ca-bundle\") pod \"console-5b8c6787fd-48pdt\" (UID: \"4d70e045-d0e7-48cc-acef-672815f9666a\") " pod="openshift-console/console-5b8c6787fd-48pdt" Jun 08 13:46:12.319078 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.319055 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:46:12.384433 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.384409 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d70e045-d0e7-48cc-acef-672815f9666a-oauth-serving-cert\") pod \"console-5b8c6787fd-48pdt\" (UID: \"4d70e045-d0e7-48cc-acef-672815f9666a\") " pod="openshift-console/console-5b8c6787fd-48pdt" Jun 08 13:46:12.384504 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.384437 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtxsd\" (UniqueName: \"kubernetes.io/projected/4d70e045-d0e7-48cc-acef-672815f9666a-kube-api-access-mtxsd\") pod \"console-5b8c6787fd-48pdt\" (UID: \"4d70e045-d0e7-48cc-acef-672815f9666a\") " pod="openshift-console/console-5b8c6787fd-48pdt" Jun 08 13:46:12.384504 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.384454 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d70e045-d0e7-48cc-acef-672815f9666a-service-ca\") pod \"console-5b8c6787fd-48pdt\" (UID: \"4d70e045-d0e7-48cc-acef-672815f9666a\") " pod="openshift-console/console-5b8c6787fd-48pdt" Jun 08 13:46:12.384504 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.384477 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d70e045-d0e7-48cc-acef-672815f9666a-console-config\") pod \"console-5b8c6787fd-48pdt\" (UID: \"4d70e045-d0e7-48cc-acef-672815f9666a\") " pod="openshift-console/console-5b8c6787fd-48pdt" Jun 08 13:46:12.384708 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.384686 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d70e045-d0e7-48cc-acef-672815f9666a-trusted-ca-bundle\") pod \"console-5b8c6787fd-48pdt\" (UID: \"4d70e045-d0e7-48cc-acef-672815f9666a\") " pod="openshift-console/console-5b8c6787fd-48pdt" Jun 08 13:46:12.384829 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.384811 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d70e045-d0e7-48cc-acef-672815f9666a-console-serving-cert\") pod \"console-5b8c6787fd-48pdt\" (UID: \"4d70e045-d0e7-48cc-acef-672815f9666a\") " pod="openshift-console/console-5b8c6787fd-48pdt" Jun 08 13:46:12.384886 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.384860 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d70e045-d0e7-48cc-acef-672815f9666a-console-oauth-config\") pod \"console-5b8c6787fd-48pdt\" (UID: \"4d70e045-d0e7-48cc-acef-672815f9666a\") " pod="openshift-console/console-5b8c6787fd-48pdt" Jun 08 13:46:12.385291 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.385263 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d70e045-d0e7-48cc-acef-672815f9666a-oauth-serving-cert\") pod \"console-5b8c6787fd-48pdt\" (UID: \"4d70e045-d0e7-48cc-acef-672815f9666a\") " pod="openshift-console/console-5b8c6787fd-48pdt" Jun 08 13:46:12.385375 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.385311 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d70e045-d0e7-48cc-acef-672815f9666a-service-ca\") pod \"console-5b8c6787fd-48pdt\" (UID: \"4d70e045-d0e7-48cc-acef-672815f9666a\") " pod="openshift-console/console-5b8c6787fd-48pdt" Jun 08 13:46:12.385375 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.385314 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d70e045-d0e7-48cc-acef-672815f9666a-console-config\") pod \"console-5b8c6787fd-48pdt\" (UID: \"4d70e045-d0e7-48cc-acef-672815f9666a\") " pod="openshift-console/console-5b8c6787fd-48pdt" Jun 08 13:46:12.385477 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.385461 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d70e045-d0e7-48cc-acef-672815f9666a-trusted-ca-bundle\") pod \"console-5b8c6787fd-48pdt\" (UID: \"4d70e045-d0e7-48cc-acef-672815f9666a\") " pod="openshift-console/console-5b8c6787fd-48pdt" Jun 08 13:46:12.387105 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.387083 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d70e045-d0e7-48cc-acef-672815f9666a-console-serving-cert\") pod \"console-5b8c6787fd-48pdt\" (UID: \"4d70e045-d0e7-48cc-acef-672815f9666a\") " pod="openshift-console/console-5b8c6787fd-48pdt" Jun 08 13:46:12.387224 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.387204 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d70e045-d0e7-48cc-acef-672815f9666a-console-oauth-config\") pod \"console-5b8c6787fd-48pdt\" (UID: \"4d70e045-d0e7-48cc-acef-672815f9666a\") " pod="openshift-console/console-5b8c6787fd-48pdt" Jun 08 13:46:12.392461 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.392443 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtxsd\" (UniqueName: \"kubernetes.io/projected/4d70e045-d0e7-48cc-acef-672815f9666a-kube-api-access-mtxsd\") pod \"console-5b8c6787fd-48pdt\" (UID: \"4d70e045-d0e7-48cc-acef-672815f9666a\") " pod="openshift-console/console-5b8c6787fd-48pdt" Jun 08 13:46:12.478321 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.478255 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b8c6787fd-48pdt" Jun 08 13:46:12.600260 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:12.600238 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b8c6787fd-48pdt"] Jun 08 13:46:12.602830 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:46:12.602805 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d70e045_d0e7_48cc_acef_672815f9666a.slice/crio-0bb46c2fb35420a4421a1bb08345025a1be0a3ef7ce45463fb45ad646a33e2e0 WatchSource:0}: Error finding container 0bb46c2fb35420a4421a1bb08345025a1be0a3ef7ce45463fb45ad646a33e2e0: Status 404 returned error can't find the container with id 0bb46c2fb35420a4421a1bb08345025a1be0a3ef7ce45463fb45ad646a33e2e0 Jun 08 13:46:13.448831 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:13.448797 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b8c6787fd-48pdt" event={"ID":"4d70e045-d0e7-48cc-acef-672815f9666a","Type":"ContainerStarted","Data":"b2bdd7418a4864f344760e75581ee7a693879dd6ae62f91e64b52506e7178796"} Jun 08 13:46:13.449282 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:13.448853 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b8c6787fd-48pdt" event={"ID":"4d70e045-d0e7-48cc-acef-672815f9666a","Type":"ContainerStarted","Data":"0bb46c2fb35420a4421a1bb08345025a1be0a3ef7ce45463fb45ad646a33e2e0"} Jun 08 13:46:13.466563 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:13.466516 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b8c6787fd-48pdt" podStartSLOduration=1.46650308 podStartE2EDuration="1.46650308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:46:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:46:13.46542488 +0000 UTC m=+187.446453178" watchObservedRunningTime="2026-06-08 13:46:13.46650308 +0000 UTC m=+187.447531396" Jun 08 13:46:13.523730 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:13.523699 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:46:21.640699 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:21.640665 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:46:21.701062 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:21.701029 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:46:22.478484 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:22.478453 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b8c6787fd-48pdt" Jun 08 13:46:22.478652 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:22.478500 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b8c6787fd-48pdt" Jun 08 13:46:22.483755 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:22.483731 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b8c6787fd-48pdt" Jun 08 13:46:23.489068 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:23.489037 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b8c6787fd-48pdt" Jun 08 13:46:23.638422 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:23.638385 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:46:23.702186 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:23.702158 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:46:23.760279 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:23.760210 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:46:27.355847 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:27.355815 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:46:27.456346 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:27.456322 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:46:27.526209 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:46:27.526178 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:00.478143 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:00.478090 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:00.574634 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:00.574606 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:00.983603 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:00.983574 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtds9j"] Jun 08 13:47:00.985680 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:00.985665 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtds9j" Jun 08 13:47:00.988509 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:00.988492 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 13:47:00.990012 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:00.989994 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jb7sc\"" Jun 08 13:47:00.990089 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:00.990035 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 13:47:00.997508 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:00.997486 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtds9j"] Jun 08 13:47:01.014079 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:01.014056 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ffd6f53-8113-442d-ae05-b642460e6277-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtds9j\" (UID: \"0ffd6f53-8113-442d-ae05-b642460e6277\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtds9j" Jun 08 13:47:01.014184 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:01.014098 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9fp6\" (UniqueName: \"kubernetes.io/projected/0ffd6f53-8113-442d-ae05-b642460e6277-kube-api-access-s9fp6\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtds9j\" (UID: \"0ffd6f53-8113-442d-ae05-b642460e6277\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtds9j" Jun 08 13:47:01.014184 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:01.014121 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ffd6f53-8113-442d-ae05-b642460e6277-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtds9j\" (UID: \"0ffd6f53-8113-442d-ae05-b642460e6277\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtds9j" Jun 08 13:47:01.115035 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:01.115010 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9fp6\" (UniqueName: \"kubernetes.io/projected/0ffd6f53-8113-442d-ae05-b642460e6277-kube-api-access-s9fp6\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtds9j\" (UID: \"0ffd6f53-8113-442d-ae05-b642460e6277\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtds9j" Jun 08 13:47:01.115181 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:01.115053 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ffd6f53-8113-442d-ae05-b642460e6277-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtds9j\" (UID: \"0ffd6f53-8113-442d-ae05-b642460e6277\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtds9j" Jun 08 13:47:01.115181 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:01.115122 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ffd6f53-8113-442d-ae05-b642460e6277-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtds9j\" (UID: \"0ffd6f53-8113-442d-ae05-b642460e6277\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtds9j" Jun 08 13:47:01.115443 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:01.115422 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ffd6f53-8113-442d-ae05-b642460e6277-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtds9j\" (UID: \"0ffd6f53-8113-442d-ae05-b642460e6277\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtds9j" Jun 08 13:47:01.115519 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:01.115489 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ffd6f53-8113-442d-ae05-b642460e6277-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtds9j\" (UID: \"0ffd6f53-8113-442d-ae05-b642460e6277\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtds9j" Jun 08 13:47:01.124405 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:01.124375 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9fp6\" (UniqueName: \"kubernetes.io/projected/0ffd6f53-8113-442d-ae05-b642460e6277-kube-api-access-s9fp6\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtds9j\" (UID: \"0ffd6f53-8113-442d-ae05-b642460e6277\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtds9j" Jun 08 13:47:01.294904 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:01.294840 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtds9j" Jun 08 13:47:01.418396 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:01.418375 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtds9j"] Jun 08 13:47:01.420903 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:47:01.420876 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ffd6f53_8113_442d_ae05_b642460e6277.slice/crio-4a57b5092c457fb5aaa4cf514645fa4fd8431ab44fa9565989f840a88abd0ca7 WatchSource:0}: Error finding container 4a57b5092c457fb5aaa4cf514645fa4fd8431ab44fa9565989f840a88abd0ca7: Status 404 returned error can't find the container with id 4a57b5092c457fb5aaa4cf514645fa4fd8431ab44fa9565989f840a88abd0ca7 Jun 08 13:47:01.617834 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:01.617747 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtds9j" event={"ID":"0ffd6f53-8113-442d-ae05-b642460e6277","Type":"ContainerStarted","Data":"4a57b5092c457fb5aaa4cf514645fa4fd8431ab44fa9565989f840a88abd0ca7"} Jun 08 13:47:10.651852 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:10.651818 2561 generic.go:356] "Generic (PLEG): container finished" podID="0ffd6f53-8113-442d-ae05-b642460e6277" containerID="84592aed6f172b2d66254bce8320a7354bbb2a1c91d0b5526a23c2a4494179d2" exitCode=0 Jun 08 13:47:10.652253 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:10.651904 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtds9j" event={"ID":"0ffd6f53-8113-442d-ae05-b642460e6277","Type":"ContainerDied","Data":"84592aed6f172b2d66254bce8320a7354bbb2a1c91d0b5526a23c2a4494179d2"} Jun 08 13:47:13.666024 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:13.665984 2561 generic.go:356] "Generic (PLEG): container finished" podID="0ffd6f53-8113-442d-ae05-b642460e6277" containerID="65371b9dd459deae943e00b4251b6e20521f318f8966a7adb8bc4f18d7d434da" exitCode=0 Jun 08 13:47:13.666403 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:13.666071 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtds9j" event={"ID":"0ffd6f53-8113-442d-ae05-b642460e6277","Type":"ContainerDied","Data":"65371b9dd459deae943e00b4251b6e20521f318f8966a7adb8bc4f18d7d434da"} Jun 08 13:47:17.336256 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:17.336204 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:17.410563 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:17.410535 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:19.693107 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:19.693081 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtds9j" event={"ID":"0ffd6f53-8113-442d-ae05-b642460e6277","Type":"ContainerStarted","Data":"e85beca6f8161cd7aab9080a673c911d852e5565f867e2a259c8bf69260baf02"} Jun 08 13:47:20.697924 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:20.697893 2561 generic.go:356] "Generic (PLEG): container finished" podID="0ffd6f53-8113-442d-ae05-b642460e6277" containerID="e85beca6f8161cd7aab9080a673c911d852e5565f867e2a259c8bf69260baf02" exitCode=0 Jun 08 13:47:20.697924 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:20.697927 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtds9j" event={"ID":"0ffd6f53-8113-442d-ae05-b642460e6277","Type":"ContainerDied","Data":"e85beca6f8161cd7aab9080a673c911d852e5565f867e2a259c8bf69260baf02"} Jun 08 13:47:21.825148 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:21.825127 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtds9j" Jun 08 13:47:21.885416 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:21.885379 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ffd6f53-8113-442d-ae05-b642460e6277-bundle\") pod \"0ffd6f53-8113-442d-ae05-b642460e6277\" (UID: \"0ffd6f53-8113-442d-ae05-b642460e6277\") " Jun 08 13:47:21.885539 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:21.885458 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9fp6\" (UniqueName: \"kubernetes.io/projected/0ffd6f53-8113-442d-ae05-b642460e6277-kube-api-access-s9fp6\") pod \"0ffd6f53-8113-442d-ae05-b642460e6277\" (UID: \"0ffd6f53-8113-442d-ae05-b642460e6277\") " Jun 08 13:47:21.885539 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:21.885504 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ffd6f53-8113-442d-ae05-b642460e6277-util\") pod \"0ffd6f53-8113-442d-ae05-b642460e6277\" (UID: \"0ffd6f53-8113-442d-ae05-b642460e6277\") " Jun 08 13:47:21.886071 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:21.886045 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ffd6f53-8113-442d-ae05-b642460e6277-bundle" (OuterVolumeSpecName: "bundle") pod "0ffd6f53-8113-442d-ae05-b642460e6277" (UID: "0ffd6f53-8113-442d-ae05-b642460e6277"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:47:21.887525 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:21.887501 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ffd6f53-8113-442d-ae05-b642460e6277-kube-api-access-s9fp6" (OuterVolumeSpecName: "kube-api-access-s9fp6") pod "0ffd6f53-8113-442d-ae05-b642460e6277" (UID: "0ffd6f53-8113-442d-ae05-b642460e6277"). InnerVolumeSpecName "kube-api-access-s9fp6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:47:21.889322 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:21.889303 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ffd6f53-8113-442d-ae05-b642460e6277-util" (OuterVolumeSpecName: "util") pod "0ffd6f53-8113-442d-ae05-b642460e6277" (UID: "0ffd6f53-8113-442d-ae05-b642460e6277"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:47:21.986591 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:21.986540 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9fp6\" (UniqueName: \"kubernetes.io/projected/0ffd6f53-8113-442d-ae05-b642460e6277-kube-api-access-s9fp6\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:47:21.986591 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:21.986561 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ffd6f53-8113-442d-ae05-b642460e6277-util\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:47:21.986591 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:21.986572 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ffd6f53-8113-442d-ae05-b642460e6277-bundle\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:47:22.707518 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:22.707490 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtds9j" Jun 08 13:47:22.707518 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:22.707496 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtds9j" event={"ID":"0ffd6f53-8113-442d-ae05-b642460e6277","Type":"ContainerDied","Data":"4a57b5092c457fb5aaa4cf514645fa4fd8431ab44fa9565989f840a88abd0ca7"} Jun 08 13:47:22.707692 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:22.707558 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4a57b5092c457fb5aaa4cf514645fa4fd8431ab44fa9565989f840a88abd0ca7" Jun 08 13:47:27.058515 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:27.058442 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:27.891117 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:27.891080 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:29.103903 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:29.103871 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-shpwj"] Jun 08 13:47:29.104243 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:29.104126 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ffd6f53-8113-442d-ae05-b642460e6277" containerName="util" Jun 08 13:47:29.104243 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:29.104136 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ffd6f53-8113-442d-ae05-b642460e6277" containerName="util" Jun 08 13:47:29.104243 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:29.104144 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ffd6f53-8113-442d-ae05-b642460e6277" containerName="pull" Jun 08 13:47:29.104243 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:29.104149 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ffd6f53-8113-442d-ae05-b642460e6277" containerName="pull" Jun 08 13:47:29.104243 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:29.104166 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ffd6f53-8113-442d-ae05-b642460e6277" containerName="extract" Jun 08 13:47:29.104243 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:29.104171 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ffd6f53-8113-442d-ae05-b642460e6277" containerName="extract" Jun 08 13:47:29.104243 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:29.104220 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ffd6f53-8113-442d-ae05-b642460e6277" containerName="extract" Jun 08 13:47:29.106973 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:29.106957 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-shpwj" Jun 08 13:47:29.109745 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:29.109721 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 08 13:47:29.109893 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:29.109881 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 08 13:47:29.110104 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:29.110091 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-pzt4g\"" Jun 08 13:47:29.121826 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:29.121806 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-shpwj"] Jun 08 13:47:29.232507 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:29.232481 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f52l\" (UniqueName: \"kubernetes.io/projected/7b511eab-3bd5-4d44-ab78-6ca87945b9d7-kube-api-access-2f52l\") pod \"cert-manager-operator-controller-manager-57757f7cfc-shpwj\" (UID: \"7b511eab-3bd5-4d44-ab78-6ca87945b9d7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-shpwj" Jun 08 13:47:29.232634 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:29.232511 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b511eab-3bd5-4d44-ab78-6ca87945b9d7-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-shpwj\" (UID: \"7b511eab-3bd5-4d44-ab78-6ca87945b9d7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-shpwj" Jun 08 13:47:29.333774 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:29.333737 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f52l\" (UniqueName: \"kubernetes.io/projected/7b511eab-3bd5-4d44-ab78-6ca87945b9d7-kube-api-access-2f52l\") pod \"cert-manager-operator-controller-manager-57757f7cfc-shpwj\" (UID: \"7b511eab-3bd5-4d44-ab78-6ca87945b9d7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-shpwj" Jun 08 13:47:29.333879 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:29.333799 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b511eab-3bd5-4d44-ab78-6ca87945b9d7-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-shpwj\" (UID: \"7b511eab-3bd5-4d44-ab78-6ca87945b9d7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-shpwj" Jun 08 13:47:29.334108 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:29.334094 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b511eab-3bd5-4d44-ab78-6ca87945b9d7-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-shpwj\" (UID: \"7b511eab-3bd5-4d44-ab78-6ca87945b9d7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-shpwj" Jun 08 13:47:29.348078 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:29.348048 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f52l\" (UniqueName: \"kubernetes.io/projected/7b511eab-3bd5-4d44-ab78-6ca87945b9d7-kube-api-access-2f52l\") pod \"cert-manager-operator-controller-manager-57757f7cfc-shpwj\" (UID: \"7b511eab-3bd5-4d44-ab78-6ca87945b9d7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-shpwj" Jun 08 13:47:29.416067 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:29.416048 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-shpwj" Jun 08 13:47:29.546024 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:29.545892 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-shpwj"] Jun 08 13:47:29.548451 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:47:29.548427 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b511eab_3bd5_4d44_ab78_6ca87945b9d7.slice/crio-7b8d11175349e5eb680d670c09de425a22e1814d0bce3aa6f2163912311e654c WatchSource:0}: Error finding container 7b8d11175349e5eb680d670c09de425a22e1814d0bce3aa6f2163912311e654c: Status 404 returned error can't find the container with id 7b8d11175349e5eb680d670c09de425a22e1814d0bce3aa6f2163912311e654c Jun 08 13:47:29.733608 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:29.733531 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-shpwj" event={"ID":"7b511eab-3bd5-4d44-ab78-6ca87945b9d7","Type":"ContainerStarted","Data":"7b8d11175349e5eb680d670c09de425a22e1814d0bce3aa6f2163912311e654c"} Jun 08 13:47:30.887896 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:30.887859 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:30.987618 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:30.987587 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:32.747629 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:32.747591 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-shpwj" event={"ID":"7b511eab-3bd5-4d44-ab78-6ca87945b9d7","Type":"ContainerStarted","Data":"4f3c58f832a36f27edddba787b14eed4472b1e0290035ed8bafd39da51a6cce7"} Jun 08 13:47:32.769415 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:32.769371 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-shpwj" podStartSLOduration=0.995817198 podStartE2EDuration="3.769358284s" totalImagesPullingTime="2.773541086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:47:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:47:32.766875911 +0000 UTC m=+266.747904182" watchObservedRunningTime="2026-06-08 13:47:32.769358284 +0000 UTC m=+266.750386554" Jun 08 13:47:33.015939 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:33.015840 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:33.128014 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:33.127986 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:33.235691 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:33.235658 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:33.446271 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:33.446239 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwmjs5"] Jun 08 13:47:33.449774 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:33.449748 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwmjs5" Jun 08 13:47:33.455311 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:33.455289 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 13:47:33.455423 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:33.455308 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 13:47:33.456514 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:33.456442 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jb7sc\"" Jun 08 13:47:33.458971 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:33.458952 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwmjs5"] Jun 08 13:47:33.565936 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:33.565908 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/775baebd-b1a4-4309-826b-d98e12e5c23a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwmjs5\" (UID: \"775baebd-b1a4-4309-826b-d98e12e5c23a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwmjs5" Jun 08 13:47:33.566097 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:33.565981 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdftt\" (UniqueName: \"kubernetes.io/projected/775baebd-b1a4-4309-826b-d98e12e5c23a-kube-api-access-rdftt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwmjs5\" (UID: \"775baebd-b1a4-4309-826b-d98e12e5c23a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwmjs5" Jun 08 13:47:33.566097 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:33.566012 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/775baebd-b1a4-4309-826b-d98e12e5c23a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwmjs5\" (UID: \"775baebd-b1a4-4309-826b-d98e12e5c23a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwmjs5" Jun 08 13:47:33.667097 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:33.667071 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdftt\" (UniqueName: \"kubernetes.io/projected/775baebd-b1a4-4309-826b-d98e12e5c23a-kube-api-access-rdftt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwmjs5\" (UID: \"775baebd-b1a4-4309-826b-d98e12e5c23a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwmjs5" Jun 08 13:47:33.667273 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:33.667100 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/775baebd-b1a4-4309-826b-d98e12e5c23a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwmjs5\" (UID: \"775baebd-b1a4-4309-826b-d98e12e5c23a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwmjs5" Jun 08 13:47:33.667273 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:33.667144 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/775baebd-b1a4-4309-826b-d98e12e5c23a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwmjs5\" (UID: \"775baebd-b1a4-4309-826b-d98e12e5c23a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwmjs5" Jun 08 13:47:33.667554 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:33.667533 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/775baebd-b1a4-4309-826b-d98e12e5c23a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwmjs5\" (UID: \"775baebd-b1a4-4309-826b-d98e12e5c23a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwmjs5" Jun 08 13:47:33.667604 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:33.667540 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/775baebd-b1a4-4309-826b-d98e12e5c23a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwmjs5\" (UID: \"775baebd-b1a4-4309-826b-d98e12e5c23a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwmjs5" Jun 08 13:47:33.682164 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:33.682145 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdftt\" (UniqueName: \"kubernetes.io/projected/775baebd-b1a4-4309-826b-d98e12e5c23a-kube-api-access-rdftt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwmjs5\" (UID: \"775baebd-b1a4-4309-826b-d98e12e5c23a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwmjs5" Jun 08 13:47:33.759688 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:33.759636 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwmjs5" Jun 08 13:47:33.884658 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:33.884626 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwmjs5"] Jun 08 13:47:33.887503 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:47:33.887475 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod775baebd_b1a4_4309_826b_d98e12e5c23a.slice/crio-25f4ad9a7324c076d7d742ce8873e494b0ab3771c39477e80db051a7c785cab4 WatchSource:0}: Error finding container 25f4ad9a7324c076d7d742ce8873e494b0ab3771c39477e80db051a7c785cab4: Status 404 returned error can't find the container with id 25f4ad9a7324c076d7d742ce8873e494b0ab3771c39477e80db051a7c785cab4 Jun 08 13:47:34.756404 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:34.756374 2561 generic.go:356] "Generic (PLEG): container finished" podID="775baebd-b1a4-4309-826b-d98e12e5c23a" containerID="9f5a6c799a2e640db7aca027f7d340e7a0697cfc0e9be38de6401839a0cc7d93" exitCode=0 Jun 08 13:47:34.756615 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:34.756440 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwmjs5" event={"ID":"775baebd-b1a4-4309-826b-d98e12e5c23a","Type":"ContainerDied","Data":"9f5a6c799a2e640db7aca027f7d340e7a0697cfc0e9be38de6401839a0cc7d93"} Jun 08 13:47:34.756615 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:34.756497 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwmjs5" event={"ID":"775baebd-b1a4-4309-826b-d98e12e5c23a","Type":"ContainerStarted","Data":"25f4ad9a7324c076d7d742ce8873e494b0ab3771c39477e80db051a7c785cab4"} Jun 08 13:47:36.302535 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:36.302501 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:36.904324 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:36.904290 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:37.668110 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:37.668074 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:37.731112 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:37.731082 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:37.771117 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:37.771092 2561 generic.go:356] "Generic (PLEG): container finished" podID="775baebd-b1a4-4309-826b-d98e12e5c23a" containerID="ff545c80510dab9bc921394601f7aca3a918b1ddc9693aaa7cbeaa54756f4696" exitCode=0 Jun 08 13:47:37.771224 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:37.771128 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwmjs5" event={"ID":"775baebd-b1a4-4309-826b-d98e12e5c23a","Type":"ContainerDied","Data":"ff545c80510dab9bc921394601f7aca3a918b1ddc9693aaa7cbeaa54756f4696"} Jun 08 13:47:38.777886 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:38.777853 2561 generic.go:356] "Generic (PLEG): container finished" podID="775baebd-b1a4-4309-826b-d98e12e5c23a" containerID="9d7e97ad9ab00bcad4525179c74d31238d011ff6f4d8e1dedd2e70404c173b04" exitCode=0 Jun 08 13:47:38.778284 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:38.777945 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwmjs5" event={"ID":"775baebd-b1a4-4309-826b-d98e12e5c23a","Type":"ContainerDied","Data":"9d7e97ad9ab00bcad4525179c74d31238d011ff6f4d8e1dedd2e70404c173b04"} Jun 08 13:47:39.905407 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:39.905386 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwmjs5" Jun 08 13:47:40.015518 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:40.015490 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/775baebd-b1a4-4309-826b-d98e12e5c23a-bundle\") pod \"775baebd-b1a4-4309-826b-d98e12e5c23a\" (UID: \"775baebd-b1a4-4309-826b-d98e12e5c23a\") " Jun 08 13:47:40.015662 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:40.015545 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/775baebd-b1a4-4309-826b-d98e12e5c23a-util\") pod \"775baebd-b1a4-4309-826b-d98e12e5c23a\" (UID: \"775baebd-b1a4-4309-826b-d98e12e5c23a\") " Jun 08 13:47:40.015662 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:40.015585 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdftt\" (UniqueName: \"kubernetes.io/projected/775baebd-b1a4-4309-826b-d98e12e5c23a-kube-api-access-rdftt\") pod \"775baebd-b1a4-4309-826b-d98e12e5c23a\" (UID: \"775baebd-b1a4-4309-826b-d98e12e5c23a\") " Jun 08 13:47:40.015905 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:40.015884 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/775baebd-b1a4-4309-826b-d98e12e5c23a-bundle" (OuterVolumeSpecName: "bundle") pod "775baebd-b1a4-4309-826b-d98e12e5c23a" (UID: "775baebd-b1a4-4309-826b-d98e12e5c23a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:47:40.017563 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:40.017537 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/775baebd-b1a4-4309-826b-d98e12e5c23a-kube-api-access-rdftt" (OuterVolumeSpecName: "kube-api-access-rdftt") pod "775baebd-b1a4-4309-826b-d98e12e5c23a" (UID: "775baebd-b1a4-4309-826b-d98e12e5c23a"). InnerVolumeSpecName "kube-api-access-rdftt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:47:40.020130 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:40.020107 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/775baebd-b1a4-4309-826b-d98e12e5c23a-util" (OuterVolumeSpecName: "util") pod "775baebd-b1a4-4309-826b-d98e12e5c23a" (UID: "775baebd-b1a4-4309-826b-d98e12e5c23a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:47:40.116675 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:40.116605 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/775baebd-b1a4-4309-826b-d98e12e5c23a-bundle\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:47:40.116675 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:40.116630 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/775baebd-b1a4-4309-826b-d98e12e5c23a-util\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:47:40.116675 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:40.116638 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdftt\" (UniqueName: \"kubernetes.io/projected/775baebd-b1a4-4309-826b-d98e12e5c23a-kube-api-access-rdftt\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:47:40.697451 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:40.697419 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-lwj6j"] Jun 08 13:47:40.697692 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:40.697681 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="775baebd-b1a4-4309-826b-d98e12e5c23a" containerName="extract" Jun 08 13:47:40.697733 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:40.697693 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="775baebd-b1a4-4309-826b-d98e12e5c23a" containerName="extract" Jun 08 13:47:40.697733 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:40.697710 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="775baebd-b1a4-4309-826b-d98e12e5c23a" containerName="util" Jun 08 13:47:40.697733 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:40.697715 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="775baebd-b1a4-4309-826b-d98e12e5c23a" containerName="util" Jun 08 13:47:40.697733 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:40.697724 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="775baebd-b1a4-4309-826b-d98e12e5c23a" containerName="pull" Jun 08 13:47:40.697733 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:40.697729 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="775baebd-b1a4-4309-826b-d98e12e5c23a" containerName="pull" Jun 08 13:47:40.697906 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:40.697801 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="775baebd-b1a4-4309-826b-d98e12e5c23a" containerName="extract" Jun 08 13:47:40.701848 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:40.701830 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-lwj6j" Jun 08 13:47:40.704558 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:40.704538 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 08 13:47:40.704678 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:40.704593 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-b2wb4\"" Jun 08 13:47:40.705713 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:40.705695 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 08 13:47:40.712132 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:40.712111 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-lwj6j"] Jun 08 13:47:40.788050 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:40.787987 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwmjs5" event={"ID":"775baebd-b1a4-4309-826b-d98e12e5c23a","Type":"ContainerDied","Data":"25f4ad9a7324c076d7d742ce8873e494b0ab3771c39477e80db051a7c785cab4"} Jun 08 13:47:40.788050 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:40.788029 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="25f4ad9a7324c076d7d742ce8873e494b0ab3771c39477e80db051a7c785cab4" Jun 08 13:47:40.788050 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:40.788043 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwmjs5" Jun 08 13:47:40.822575 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:40.822551 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ac2dcc7-bf6f-4a38-a3da-62c3b8dfa4f1-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-lwj6j\" (UID: \"7ac2dcc7-bf6f-4a38-a3da-62c3b8dfa4f1\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-lwj6j" Jun 08 13:47:40.822680 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:40.822587 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lhfb\" (UniqueName: \"kubernetes.io/projected/7ac2dcc7-bf6f-4a38-a3da-62c3b8dfa4f1-kube-api-access-9lhfb\") pod \"cert-manager-cainjector-5d99449ffd-lwj6j\" (UID: \"7ac2dcc7-bf6f-4a38-a3da-62c3b8dfa4f1\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-lwj6j" Jun 08 13:47:40.922880 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:40.922857 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lhfb\" (UniqueName: \"kubernetes.io/projected/7ac2dcc7-bf6f-4a38-a3da-62c3b8dfa4f1-kube-api-access-9lhfb\") pod \"cert-manager-cainjector-5d99449ffd-lwj6j\" (UID: \"7ac2dcc7-bf6f-4a38-a3da-62c3b8dfa4f1\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-lwj6j" Jun 08 13:47:40.923135 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:40.922914 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ac2dcc7-bf6f-4a38-a3da-62c3b8dfa4f1-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-lwj6j\" (UID: \"7ac2dcc7-bf6f-4a38-a3da-62c3b8dfa4f1\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-lwj6j" Jun 08 13:47:40.931562 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:40.931538 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ac2dcc7-bf6f-4a38-a3da-62c3b8dfa4f1-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-lwj6j\" (UID: \"7ac2dcc7-bf6f-4a38-a3da-62c3b8dfa4f1\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-lwj6j" Jun 08 13:47:40.931731 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:40.931713 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lhfb\" (UniqueName: \"kubernetes.io/projected/7ac2dcc7-bf6f-4a38-a3da-62c3b8dfa4f1-kube-api-access-9lhfb\") pod \"cert-manager-cainjector-5d99449ffd-lwj6j\" (UID: \"7ac2dcc7-bf6f-4a38-a3da-62c3b8dfa4f1\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-lwj6j" Jun 08 13:47:41.017613 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:41.017589 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-lwj6j" Jun 08 13:47:41.143462 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:41.143437 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-lwj6j"] Jun 08 13:47:41.145149 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:47:41.145120 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ac2dcc7_bf6f_4a38_a3da_62c3b8dfa4f1.slice/crio-448ee04d2fcf624050045ac1048e632e03e1b2f398f58e0834d7215c3e595b93 WatchSource:0}: Error finding container 448ee04d2fcf624050045ac1048e632e03e1b2f398f58e0834d7215c3e595b93: Status 404 returned error can't find the container with id 448ee04d2fcf624050045ac1048e632e03e1b2f398f58e0834d7215c3e595b93 Jun 08 13:47:41.793409 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:41.793379 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-lwj6j" event={"ID":"7ac2dcc7-bf6f-4a38-a3da-62c3b8dfa4f1","Type":"ContainerStarted","Data":"448ee04d2fcf624050045ac1048e632e03e1b2f398f58e0834d7215c3e595b93"} Jun 08 13:47:43.335733 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:43.335684 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:43.803861 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:43.803823 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-lwj6j" event={"ID":"7ac2dcc7-bf6f-4a38-a3da-62c3b8dfa4f1","Type":"ContainerStarted","Data":"f0e7da04471fe56850f1fc80cbb942d9c5b708ce386007b1c7a50d766a89dcf3"} Jun 08 13:47:43.819841 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:43.819799 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-lwj6j" podStartSLOduration=1.490053626 podStartE2EDuration="3.819785434s" totalImagesPullingTime="2.329731808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:47:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:47:43.818929367 +0000 UTC m=+277.799957639" watchObservedRunningTime="2026-06-08 13:47:43.819785434 +0000 UTC m=+277.800813699" Jun 08 13:47:44.144790 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:44.144725 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:44.205232 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:44.205204 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:44.911607 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:44.911572 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:49.085442 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:49.085408 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:49.190835 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:49.190797 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:53.830617 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:53.830582 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-kg8mk"] Jun 08 13:47:53.875910 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:53.875882 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-kg8mk" Jun 08 13:47:53.875910 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:53.875896 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-kg8mk"] Jun 08 13:47:53.878985 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:53.878964 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-mhtsm\"" Jun 08 13:47:54.015285 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:54.015255 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97c551bd-4726-43ce-8281-a003c4d78758-bound-sa-token\") pod \"cert-manager-59c77684cc-kg8mk\" (UID: \"97c551bd-4726-43ce-8281-a003c4d78758\") " pod="cert-manager/cert-manager-59c77684cc-kg8mk" Jun 08 13:47:54.015419 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:54.015323 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8fqs\" (UniqueName: \"kubernetes.io/projected/97c551bd-4726-43ce-8281-a003c4d78758-kube-api-access-g8fqs\") pod \"cert-manager-59c77684cc-kg8mk\" (UID: \"97c551bd-4726-43ce-8281-a003c4d78758\") " pod="cert-manager/cert-manager-59c77684cc-kg8mk" Jun 08 13:47:54.116066 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:54.116004 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97c551bd-4726-43ce-8281-a003c4d78758-bound-sa-token\") pod \"cert-manager-59c77684cc-kg8mk\" (UID: \"97c551bd-4726-43ce-8281-a003c4d78758\") " pod="cert-manager/cert-manager-59c77684cc-kg8mk" Jun 08 13:47:54.116066 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:54.116050 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8fqs\" (UniqueName: \"kubernetes.io/projected/97c551bd-4726-43ce-8281-a003c4d78758-kube-api-access-g8fqs\") pod \"cert-manager-59c77684cc-kg8mk\" (UID: \"97c551bd-4726-43ce-8281-a003c4d78758\") " pod="cert-manager/cert-manager-59c77684cc-kg8mk" Jun 08 13:47:54.124426 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:54.124394 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97c551bd-4726-43ce-8281-a003c4d78758-bound-sa-token\") pod \"cert-manager-59c77684cc-kg8mk\" (UID: \"97c551bd-4726-43ce-8281-a003c4d78758\") " pod="cert-manager/cert-manager-59c77684cc-kg8mk" Jun 08 13:47:54.124540 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:54.124465 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8fqs\" (UniqueName: \"kubernetes.io/projected/97c551bd-4726-43ce-8281-a003c4d78758-kube-api-access-g8fqs\") pod \"cert-manager-59c77684cc-kg8mk\" (UID: \"97c551bd-4726-43ce-8281-a003c4d78758\") " pod="cert-manager/cert-manager-59c77684cc-kg8mk" Jun 08 13:47:54.184416 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:54.184391 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-kg8mk" Jun 08 13:47:54.320942 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:54.320919 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-kg8mk"] Jun 08 13:47:54.322881 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:47:54.322855 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97c551bd_4726_43ce_8281_a003c4d78758.slice/crio-966209bd1e13425655e3b55687178fe6e064ad3d67bfbb2cb9a69033d61bfbb2 WatchSource:0}: Error finding container 966209bd1e13425655e3b55687178fe6e064ad3d67bfbb2cb9a69033d61bfbb2: Status 404 returned error can't find the container with id 966209bd1e13425655e3b55687178fe6e064ad3d67bfbb2cb9a69033d61bfbb2 Jun 08 13:47:54.851060 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:54.851028 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-kg8mk" event={"ID":"97c551bd-4726-43ce-8281-a003c4d78758","Type":"ContainerStarted","Data":"3d1fad0a4665657ed8561099546fd06037bb4ea85ab7d5dac8b216461b049107"} Jun 08 13:47:54.851396 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:54.851069 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-kg8mk" event={"ID":"97c551bd-4726-43ce-8281-a003c4d78758","Type":"ContainerStarted","Data":"966209bd1e13425655e3b55687178fe6e064ad3d67bfbb2cb9a69033d61bfbb2"} Jun 08 13:47:55.950254 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:55.950213 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:56.052774 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:56.052726 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:57.978110 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:57.978072 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:58.748474 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:58.748420 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-kg8mk" podStartSLOduration=5.748405238 podStartE2EDuration="5.748405238s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:47:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:47:54.867899772 +0000 UTC m=+288.848928046" watchObservedRunningTime="2026-06-08 13:47:58.748405238 +0000 UTC m=+292.729433509" Jun 08 13:47:58.749170 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:58.749151 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvbdq"] Jun 08 13:47:58.751378 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:58.751364 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvbdq" Jun 08 13:47:58.754181 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:58.754158 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 13:47:58.755267 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:58.755249 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 13:47:58.755370 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:58.755251 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jb7sc\"" Jun 08 13:47:58.761989 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:58.761969 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvbdq"] Jun 08 13:47:58.851426 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:58.851394 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4975850e-9401-4a04-a119-f4e531e8ee60-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvbdq\" (UID: \"4975850e-9401-4a04-a119-f4e531e8ee60\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvbdq" Jun 08 13:47:58.851583 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:58.851433 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lzgz\" (UniqueName: \"kubernetes.io/projected/4975850e-9401-4a04-a119-f4e531e8ee60-kube-api-access-4lzgz\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvbdq\" (UID: \"4975850e-9401-4a04-a119-f4e531e8ee60\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvbdq" Jun 08 13:47:58.851583 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:58.851471 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4975850e-9401-4a04-a119-f4e531e8ee60-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvbdq\" (UID: \"4975850e-9401-4a04-a119-f4e531e8ee60\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvbdq" Jun 08 13:47:58.952801 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:58.952754 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4975850e-9401-4a04-a119-f4e531e8ee60-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvbdq\" (UID: \"4975850e-9401-4a04-a119-f4e531e8ee60\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvbdq" Jun 08 13:47:58.952910 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:58.952870 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4975850e-9401-4a04-a119-f4e531e8ee60-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvbdq\" (UID: \"4975850e-9401-4a04-a119-f4e531e8ee60\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvbdq" Jun 08 13:47:58.952974 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:58.952908 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lzgz\" (UniqueName: \"kubernetes.io/projected/4975850e-9401-4a04-a119-f4e531e8ee60-kube-api-access-4lzgz\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvbdq\" (UID: \"4975850e-9401-4a04-a119-f4e531e8ee60\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvbdq" Jun 08 13:47:58.953183 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:58.953159 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4975850e-9401-4a04-a119-f4e531e8ee60-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvbdq\" (UID: \"4975850e-9401-4a04-a119-f4e531e8ee60\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvbdq" Jun 08 13:47:58.953183 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:58.953173 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4975850e-9401-4a04-a119-f4e531e8ee60-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvbdq\" (UID: \"4975850e-9401-4a04-a119-f4e531e8ee60\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvbdq" Jun 08 13:47:58.961735 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:58.961711 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lzgz\" (UniqueName: \"kubernetes.io/projected/4975850e-9401-4a04-a119-f4e531e8ee60-kube-api-access-4lzgz\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvbdq\" (UID: \"4975850e-9401-4a04-a119-f4e531e8ee60\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvbdq" Jun 08 13:47:59.060807 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:59.060738 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvbdq" Jun 08 13:47:59.189932 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:59.189904 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvbdq"] Jun 08 13:47:59.191660 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:47:59.191632 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4975850e_9401_4a04_a119_f4e531e8ee60.slice/crio-4d10fad9fc7c1e37cdf34b87a1cabb165bf74f07157d865e21adfd1845b8d958 WatchSource:0}: Error finding container 4d10fad9fc7c1e37cdf34b87a1cabb165bf74f07157d865e21adfd1845b8d958: Status 404 returned error can't find the container with id 4d10fad9fc7c1e37cdf34b87a1cabb165bf74f07157d865e21adfd1845b8d958 Jun 08 13:47:59.875368 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:59.875332 2561 generic.go:356] "Generic (PLEG): container finished" podID="4975850e-9401-4a04-a119-f4e531e8ee60" containerID="ab526a834f75bc78eac867fa82885af8e31a856767f21fcf28395919a61f1a15" exitCode=0 Jun 08 13:47:59.875541 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:59.875417 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvbdq" event={"ID":"4975850e-9401-4a04-a119-f4e531e8ee60","Type":"ContainerDied","Data":"ab526a834f75bc78eac867fa82885af8e31a856767f21fcf28395919a61f1a15"} Jun 08 13:47:59.875541 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:47:59.875461 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvbdq" event={"ID":"4975850e-9401-4a04-a119-f4e531e8ee60","Type":"ContainerStarted","Data":"4d10fad9fc7c1e37cdf34b87a1cabb165bf74f07157d865e21adfd1845b8d958"} Jun 08 13:48:00.880933 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:00.880853 2561 generic.go:356] "Generic (PLEG): container finished" podID="4975850e-9401-4a04-a119-f4e531e8ee60" containerID="34f4d5541953c406d4bd291f96ce27dc1a1d67ad75b3400640006e3187bdde9a" exitCode=0 Jun 08 13:48:00.880933 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:00.880909 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvbdq" event={"ID":"4975850e-9401-4a04-a119-f4e531e8ee60","Type":"ContainerDied","Data":"34f4d5541953c406d4bd291f96ce27dc1a1d67ad75b3400640006e3187bdde9a"} Jun 08 13:48:00.950581 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:00.950551 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:01.887171 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:01.887140 2561 generic.go:356] "Generic (PLEG): container finished" podID="4975850e-9401-4a04-a119-f4e531e8ee60" containerID="fa284804716e98f5efbf72d159113091fe324b50c658aa361b9c226065a72d6b" exitCode=0 Jun 08 13:48:01.887608 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:01.887224 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvbdq" event={"ID":"4975850e-9401-4a04-a119-f4e531e8ee60","Type":"ContainerDied","Data":"fa284804716e98f5efbf72d159113091fe324b50c658aa361b9c226065a72d6b"} Jun 08 13:48:03.012104 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:03.012083 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvbdq" Jun 08 13:48:03.186412 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:03.186340 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4975850e-9401-4a04-a119-f4e531e8ee60-bundle\") pod \"4975850e-9401-4a04-a119-f4e531e8ee60\" (UID: \"4975850e-9401-4a04-a119-f4e531e8ee60\") " Jun 08 13:48:03.186412 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:03.186383 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4lzgz\" (UniqueName: \"kubernetes.io/projected/4975850e-9401-4a04-a119-f4e531e8ee60-kube-api-access-4lzgz\") pod \"4975850e-9401-4a04-a119-f4e531e8ee60\" (UID: \"4975850e-9401-4a04-a119-f4e531e8ee60\") " Jun 08 13:48:03.186412 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:03.186411 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4975850e-9401-4a04-a119-f4e531e8ee60-util\") pod \"4975850e-9401-4a04-a119-f4e531e8ee60\" (UID: \"4975850e-9401-4a04-a119-f4e531e8ee60\") " Jun 08 13:48:03.187036 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:03.187007 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4975850e-9401-4a04-a119-f4e531e8ee60-bundle" (OuterVolumeSpecName: "bundle") pod "4975850e-9401-4a04-a119-f4e531e8ee60" (UID: "4975850e-9401-4a04-a119-f4e531e8ee60"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:48:03.188354 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:03.188332 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4975850e-9401-4a04-a119-f4e531e8ee60-kube-api-access-4lzgz" (OuterVolumeSpecName: "kube-api-access-4lzgz") pod "4975850e-9401-4a04-a119-f4e531e8ee60" (UID: "4975850e-9401-4a04-a119-f4e531e8ee60"). InnerVolumeSpecName "kube-api-access-4lzgz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:48:03.191864 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:03.191830 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4975850e-9401-4a04-a119-f4e531e8ee60-util" (OuterVolumeSpecName: "util") pod "4975850e-9401-4a04-a119-f4e531e8ee60" (UID: "4975850e-9401-4a04-a119-f4e531e8ee60"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:48:03.287870 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:03.287847 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lzgz\" (UniqueName: \"kubernetes.io/projected/4975850e-9401-4a04-a119-f4e531e8ee60-kube-api-access-4lzgz\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:48:03.287870 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:03.287870 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4975850e-9401-4a04-a119-f4e531e8ee60-util\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:48:03.287999 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:03.287881 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4975850e-9401-4a04-a119-f4e531e8ee60-bundle\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:48:03.899689 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:03.899655 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvbdq" event={"ID":"4975850e-9401-4a04-a119-f4e531e8ee60","Type":"ContainerDied","Data":"4d10fad9fc7c1e37cdf34b87a1cabb165bf74f07157d865e21adfd1845b8d958"} Jun 08 13:48:03.899915 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:03.899701 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d10fad9fc7c1e37cdf34b87a1cabb165bf74f07157d865e21adfd1845b8d958" Jun 08 13:48:03.899915 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:03.899708 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvbdq" Jun 08 13:48:06.417818 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:06.417791 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l7lbv_0453a3c5-bb95-4060-bd97-67aba216bcc6/console-operator/2.log" Jun 08 13:48:06.418972 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:06.418950 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l7lbv_0453a3c5-bb95-4060-bd97-67aba216bcc6/console-operator/2.log" Jun 08 13:48:06.429262 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:06.429242 2561 kubelet.go:1648] "Image garbage collection succeeded" Jun 08 13:48:10.276446 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:10.276409 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:10.380648 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:10.380622 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:10.999122 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:10.999079 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:11.245298 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.245266 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:11.378163 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.378070 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:11.424954 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.424928 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85cc8d7945-vh4sk"] Jun 08 13:48:11.425240 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.425227 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4975850e-9401-4a04-a119-f4e531e8ee60" containerName="pull" Jun 08 13:48:11.425290 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.425241 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4975850e-9401-4a04-a119-f4e531e8ee60" containerName="pull" Jun 08 13:48:11.425290 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.425258 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4975850e-9401-4a04-a119-f4e531e8ee60" containerName="util" Jun 08 13:48:11.425290 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.425263 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4975850e-9401-4a04-a119-f4e531e8ee60" containerName="util" Jun 08 13:48:11.425290 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.425279 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4975850e-9401-4a04-a119-f4e531e8ee60" containerName="extract" Jun 08 13:48:11.425290 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.425284 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4975850e-9401-4a04-a119-f4e531e8ee60" containerName="extract" Jun 08 13:48:11.425455 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.425334 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4975850e-9401-4a04-a119-f4e531e8ee60" containerName="extract" Jun 08 13:48:11.428274 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.428258 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-vh4sk" Jun 08 13:48:11.434582 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.434195 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 08 13:48:11.434582 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.434340 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 08 13:48:11.434582 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.434405 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 08 13:48:11.434782 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.434591 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-smp67\"" Jun 08 13:48:11.434782 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.434713 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 08 13:48:11.472146 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.472123 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85cc8d7945-vh4sk"] Jun 08 13:48:11.546605 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.546585 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c39fdb72-2311-4d04-9ad5-60d435297dff-tmp\") pod \"opendatahub-operator-controller-manager-85cc8d7945-vh4sk\" (UID: \"c39fdb72-2311-4d04-9ad5-60d435297dff\") " pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-vh4sk" Jun 08 13:48:11.546716 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.546617 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9lrp\" (UniqueName: \"kubernetes.io/projected/c39fdb72-2311-4d04-9ad5-60d435297dff-kube-api-access-n9lrp\") pod \"opendatahub-operator-controller-manager-85cc8d7945-vh4sk\" (UID: \"c39fdb72-2311-4d04-9ad5-60d435297dff\") " pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-vh4sk" Jun 08 13:48:11.546716 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.546649 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c39fdb72-2311-4d04-9ad5-60d435297dff-manifests\") pod \"opendatahub-operator-controller-manager-85cc8d7945-vh4sk\" (UID: \"c39fdb72-2311-4d04-9ad5-60d435297dff\") " pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-vh4sk" Jun 08 13:48:11.546837 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.546745 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c39fdb72-2311-4d04-9ad5-60d435297dff-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85cc8d7945-vh4sk\" (UID: \"c39fdb72-2311-4d04-9ad5-60d435297dff\") " pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-vh4sk" Jun 08 13:48:11.546837 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.546829 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c39fdb72-2311-4d04-9ad5-60d435297dff-webhook-cert\") pod \"opendatahub-operator-controller-manager-85cc8d7945-vh4sk\" (UID: \"c39fdb72-2311-4d04-9ad5-60d435297dff\") " pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-vh4sk" Jun 08 13:48:11.648044 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.648022 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c39fdb72-2311-4d04-9ad5-60d435297dff-manifests\") pod \"opendatahub-operator-controller-manager-85cc8d7945-vh4sk\" (UID: \"c39fdb72-2311-4d04-9ad5-60d435297dff\") " pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-vh4sk" Jun 08 13:48:11.648163 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.648065 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c39fdb72-2311-4d04-9ad5-60d435297dff-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85cc8d7945-vh4sk\" (UID: \"c39fdb72-2311-4d04-9ad5-60d435297dff\") " pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-vh4sk" Jun 08 13:48:11.648261 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.648239 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c39fdb72-2311-4d04-9ad5-60d435297dff-webhook-cert\") pod \"opendatahub-operator-controller-manager-85cc8d7945-vh4sk\" (UID: \"c39fdb72-2311-4d04-9ad5-60d435297dff\") " pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-vh4sk" Jun 08 13:48:11.648352 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.648334 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c39fdb72-2311-4d04-9ad5-60d435297dff-tmp\") pod \"opendatahub-operator-controller-manager-85cc8d7945-vh4sk\" (UID: \"c39fdb72-2311-4d04-9ad5-60d435297dff\") " pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-vh4sk" Jun 08 13:48:11.648440 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.648365 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9lrp\" (UniqueName: \"kubernetes.io/projected/c39fdb72-2311-4d04-9ad5-60d435297dff-kube-api-access-n9lrp\") pod \"opendatahub-operator-controller-manager-85cc8d7945-vh4sk\" (UID: \"c39fdb72-2311-4d04-9ad5-60d435297dff\") " pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-vh4sk" Jun 08 13:48:11.648498 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.648445 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c39fdb72-2311-4d04-9ad5-60d435297dff-manifests\") pod \"opendatahub-operator-controller-manager-85cc8d7945-vh4sk\" (UID: \"c39fdb72-2311-4d04-9ad5-60d435297dff\") " pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-vh4sk" Jun 08 13:48:11.650583 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.650557 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c39fdb72-2311-4d04-9ad5-60d435297dff-tmp\") pod \"opendatahub-operator-controller-manager-85cc8d7945-vh4sk\" (UID: \"c39fdb72-2311-4d04-9ad5-60d435297dff\") " pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-vh4sk" Jun 08 13:48:11.650684 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.650645 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c39fdb72-2311-4d04-9ad5-60d435297dff-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85cc8d7945-vh4sk\" (UID: \"c39fdb72-2311-4d04-9ad5-60d435297dff\") " pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-vh4sk" Jun 08 13:48:11.650684 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.650665 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c39fdb72-2311-4d04-9ad5-60d435297dff-webhook-cert\") pod \"opendatahub-operator-controller-manager-85cc8d7945-vh4sk\" (UID: \"c39fdb72-2311-4d04-9ad5-60d435297dff\") " pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-vh4sk" Jun 08 13:48:11.659495 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.659477 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9lrp\" (UniqueName: \"kubernetes.io/projected/c39fdb72-2311-4d04-9ad5-60d435297dff-kube-api-access-n9lrp\") pod \"opendatahub-operator-controller-manager-85cc8d7945-vh4sk\" (UID: \"c39fdb72-2311-4d04-9ad5-60d435297dff\") " pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-vh4sk" Jun 08 13:48:11.715448 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.715415 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:11.738332 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.738313 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-vh4sk" Jun 08 13:48:11.858310 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.858271 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:11.901755 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.901736 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85cc8d7945-vh4sk"] Jun 08 13:48:11.903802 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:48:11.903778 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc39fdb72_2311_4d04_9ad5_60d435297dff.slice/crio-c50398d8f5cd24fb3f3829ca3c3146e8918024a4f6cc34d63869d431156aa149 WatchSource:0}: Error finding container c50398d8f5cd24fb3f3829ca3c3146e8918024a4f6cc34d63869d431156aa149: Status 404 returned error can't find the container with id c50398d8f5cd24fb3f3829ca3c3146e8918024a4f6cc34d63869d431156aa149 Jun 08 13:48:11.905507 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.905491 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 13:48:11.940620 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.940598 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-vh4sk" event={"ID":"c39fdb72-2311-4d04-9ad5-60d435297dff","Type":"ContainerStarted","Data":"c50398d8f5cd24fb3f3829ca3c3146e8918024a4f6cc34d63869d431156aa149"} Jun 08 13:48:11.951106 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:11.951073 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:12.036566 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:12.036540 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:12.136108 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:12.136083 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:14.958477 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:14.958399 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-vh4sk" event={"ID":"c39fdb72-2311-4d04-9ad5-60d435297dff","Type":"ContainerStarted","Data":"8efc83f73dfe8dea45cdd40b6977eecd9e02ce9d12f0a5c91e012f99c3395496"} Jun 08 13:48:15.964187 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:15.964109 2561 generic.go:356] "Generic (PLEG): container finished" podID="c39fdb72-2311-4d04-9ad5-60d435297dff" containerID="8efc83f73dfe8dea45cdd40b6977eecd9e02ce9d12f0a5c91e012f99c3395496" exitCode=0 Jun 08 13:48:15.964555 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:15.964195 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-vh4sk" event={"ID":"c39fdb72-2311-4d04-9ad5-60d435297dff","Type":"ContainerDied","Data":"8efc83f73dfe8dea45cdd40b6977eecd9e02ce9d12f0a5c91e012f99c3395496"} Jun 08 13:48:16.970680 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:16.970644 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-vh4sk" event={"ID":"c39fdb72-2311-4d04-9ad5-60d435297dff","Type":"ContainerStarted","Data":"6a51c358347fd0008f6bd8a21004c234a4e36bfd90623c1d83a3dc90cbb7fbee"} Jun 08 13:48:16.971111 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:16.970857 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-vh4sk" Jun 08 13:48:17.000896 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:17.000846 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-vh4sk" podStartSLOduration=1.991562361 podStartE2EDuration="6.000832858s" totalImagesPullingTime="3.033227833s" totalInitContainerRuntime="976.042664ms" isStatefulPod=false podCreationTimestamp="2026-06-08 13:48:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:48:16.998145442 +0000 UTC m=+310.979173712" watchObservedRunningTime="2026-06-08 13:48:17.000832858 +0000 UTC m=+310.981861128" Jun 08 13:48:21.951742 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:21.951706 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:22.060356 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:22.060320 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:22.784870 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:22.784837 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:22.886071 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:22.886041 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:27.978342 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:27.978303 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-85cc8d7945-vh4sk" Jun 08 13:48:30.258266 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:30.258224 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:31.513596 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:31.513563 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-ckl6w"] Jun 08 13:48:31.522396 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:31.522373 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-ckl6w" Jun 08 13:48:31.528040 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:31.528018 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-nvrpc\"" Jun 08 13:48:31.528470 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:31.528452 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 08 13:48:31.546560 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:31.546538 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-ckl6w"] Jun 08 13:48:31.546665 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:31.546609 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:31.588689 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:31.588666 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae648dcc-6082-4f23-81c5-e36c3ccfadac-cert\") pod \"odh-model-controller-6dc94f689f-ckl6w\" (UID: \"ae648dcc-6082-4f23-81c5-e36c3ccfadac\") " pod="opendatahub/odh-model-controller-6dc94f689f-ckl6w" Jun 08 13:48:31.588808 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:31.588698 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptg4t\" (UniqueName: \"kubernetes.io/projected/ae648dcc-6082-4f23-81c5-e36c3ccfadac-kube-api-access-ptg4t\") pod \"odh-model-controller-6dc94f689f-ckl6w\" (UID: \"ae648dcc-6082-4f23-81c5-e36c3ccfadac\") " pod="opendatahub/odh-model-controller-6dc94f689f-ckl6w" Jun 08 13:48:31.689194 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:31.689160 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptg4t\" (UniqueName: \"kubernetes.io/projected/ae648dcc-6082-4f23-81c5-e36c3ccfadac-kube-api-access-ptg4t\") pod \"odh-model-controller-6dc94f689f-ckl6w\" (UID: \"ae648dcc-6082-4f23-81c5-e36c3ccfadac\") " pod="opendatahub/odh-model-controller-6dc94f689f-ckl6w" Jun 08 13:48:31.689354 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:31.689276 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae648dcc-6082-4f23-81c5-e36c3ccfadac-cert\") pod \"odh-model-controller-6dc94f689f-ckl6w\" (UID: \"ae648dcc-6082-4f23-81c5-e36c3ccfadac\") " pod="opendatahub/odh-model-controller-6dc94f689f-ckl6w" Jun 08 13:48:31.689425 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:48:31.689390 2561 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 08 13:48:31.689482 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:48:31.689471 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae648dcc-6082-4f23-81c5-e36c3ccfadac-cert podName:ae648dcc-6082-4f23-81c5-e36c3ccfadac nodeName:}" failed. No retries permitted until 2026-06-08 13:48:32.189447577 +0000 UTC m=+326.170475824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ae648dcc-6082-4f23-81c5-e36c3ccfadac-cert") pod "odh-model-controller-6dc94f689f-ckl6w" (UID: "ae648dcc-6082-4f23-81c5-e36c3ccfadac") : secret "odh-model-controller-webhook-cert" not found Jun 08 13:48:31.713383 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:31.713355 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptg4t\" (UniqueName: \"kubernetes.io/projected/ae648dcc-6082-4f23-81c5-e36c3ccfadac-kube-api-access-ptg4t\") pod \"odh-model-controller-6dc94f689f-ckl6w\" (UID: \"ae648dcc-6082-4f23-81c5-e36c3ccfadac\") " pod="opendatahub/odh-model-controller-6dc94f689f-ckl6w" Jun 08 13:48:31.734287 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:31.734256 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:31.980980 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:31.980947 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:32.147044 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:32.147001 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:32.193070 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:32.193043 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae648dcc-6082-4f23-81c5-e36c3ccfadac-cert\") pod \"odh-model-controller-6dc94f689f-ckl6w\" (UID: \"ae648dcc-6082-4f23-81c5-e36c3ccfadac\") " pod="opendatahub/odh-model-controller-6dc94f689f-ckl6w" Jun 08 13:48:32.195324 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:32.195302 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae648dcc-6082-4f23-81c5-e36c3ccfadac-cert\") pod \"odh-model-controller-6dc94f689f-ckl6w\" (UID: \"ae648dcc-6082-4f23-81c5-e36c3ccfadac\") " pod="opendatahub/odh-model-controller-6dc94f689f-ckl6w" Jun 08 13:48:32.433751 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:32.433718 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-ckl6w" Jun 08 13:48:32.574870 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:32.574777 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-ckl6w"] Jun 08 13:48:32.577384 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:48:32.577360 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae648dcc_6082_4f23_81c5_e36c3ccfadac.slice/crio-1cbecc57600fdf63170b2b962e88989c0154f1eee283f5ce6a0523bf93e6a570 WatchSource:0}: Error finding container 1cbecc57600fdf63170b2b962e88989c0154f1eee283f5ce6a0523bf93e6a570: Status 404 returned error can't find the container with id 1cbecc57600fdf63170b2b962e88989c0154f1eee283f5ce6a0523bf93e6a570 Jun 08 13:48:32.852726 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:32.852647 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-4ljw4"] Jun 08 13:48:32.857201 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:32.857183 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-4ljw4" Jun 08 13:48:32.858618 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:32.858589 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:32.860666 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:32.860647 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 08 13:48:32.877734 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:32.877713 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-4ljw4"] Jun 08 13:48:32.897918 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:32.897892 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvdn5\" (UniqueName: \"kubernetes.io/projected/dc424145-96e7-4507-8b7f-a13e18bc28e1-kube-api-access-zvdn5\") pod \"model-serving-api-5dd488fc48-4ljw4\" (UID: \"dc424145-96e7-4507-8b7f-a13e18bc28e1\") " pod="opendatahub/model-serving-api-5dd488fc48-4ljw4" Jun 08 13:48:32.898027 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:32.897940 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc424145-96e7-4507-8b7f-a13e18bc28e1-tls-certs\") pod \"model-serving-api-5dd488fc48-4ljw4\" (UID: \"dc424145-96e7-4507-8b7f-a13e18bc28e1\") " pod="opendatahub/model-serving-api-5dd488fc48-4ljw4" Jun 08 13:48:32.959447 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:32.959421 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:32.998888 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:32.998865 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvdn5\" (UniqueName: \"kubernetes.io/projected/dc424145-96e7-4507-8b7f-a13e18bc28e1-kube-api-access-zvdn5\") pod \"model-serving-api-5dd488fc48-4ljw4\" (UID: \"dc424145-96e7-4507-8b7f-a13e18bc28e1\") " pod="opendatahub/model-serving-api-5dd488fc48-4ljw4" Jun 08 13:48:32.999017 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:32.998924 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc424145-96e7-4507-8b7f-a13e18bc28e1-tls-certs\") pod \"model-serving-api-5dd488fc48-4ljw4\" (UID: \"dc424145-96e7-4507-8b7f-a13e18bc28e1\") " pod="opendatahub/model-serving-api-5dd488fc48-4ljw4" Jun 08 13:48:33.001407 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:33.001383 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc424145-96e7-4507-8b7f-a13e18bc28e1-tls-certs\") pod \"model-serving-api-5dd488fc48-4ljw4\" (UID: \"dc424145-96e7-4507-8b7f-a13e18bc28e1\") " pod="opendatahub/model-serving-api-5dd488fc48-4ljw4" Jun 08 13:48:33.010500 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:33.010469 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvdn5\" (UniqueName: \"kubernetes.io/projected/dc424145-96e7-4507-8b7f-a13e18bc28e1-kube-api-access-zvdn5\") pod \"model-serving-api-5dd488fc48-4ljw4\" (UID: \"dc424145-96e7-4507-8b7f-a13e18bc28e1\") " pod="opendatahub/model-serving-api-5dd488fc48-4ljw4" Jun 08 13:48:33.045807 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:33.045775 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-ckl6w" event={"ID":"ae648dcc-6082-4f23-81c5-e36c3ccfadac","Type":"ContainerStarted","Data":"1cbecc57600fdf63170b2b962e88989c0154f1eee283f5ce6a0523bf93e6a570"} Jun 08 13:48:33.167431 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:33.167400 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-4ljw4" Jun 08 13:48:33.345984 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:33.345948 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-4ljw4"] Jun 08 13:48:33.349812 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:48:33.349778 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc424145_96e7_4507_8b7f_a13e18bc28e1.slice/crio-bf207f4997b7bb398bd7676606ca4e98e42720f789044b4a133a9a1288ff0676 WatchSource:0}: Error finding container bf207f4997b7bb398bd7676606ca4e98e42720f789044b4a133a9a1288ff0676: Status 404 returned error can't find the container with id bf207f4997b7bb398bd7676606ca4e98e42720f789044b4a133a9a1288ff0676 Jun 08 13:48:33.862334 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:33.862299 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:33.926895 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:33.926848 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:34.057159 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:34.057079 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-4ljw4" event={"ID":"dc424145-96e7-4507-8b7f-a13e18bc28e1","Type":"ContainerStarted","Data":"bf207f4997b7bb398bd7676606ca4e98e42720f789044b4a133a9a1288ff0676"} Jun 08 13:48:37.072640 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:37.072597 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-4ljw4" event={"ID":"dc424145-96e7-4507-8b7f-a13e18bc28e1","Type":"ContainerStarted","Data":"4289d8ff4229297652bf95643f779bf7344ed262e9268e9b8c2016c4e84f006a"} Jun 08 13:48:37.073152 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:37.072784 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-4ljw4" Jun 08 13:48:37.074203 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:37.074177 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-ckl6w" event={"ID":"ae648dcc-6082-4f23-81c5-e36c3ccfadac","Type":"ContainerStarted","Data":"bd037fb85d60cc49c84a46d5177b078a77b7af4b8e29f392572a47e5a53af877"} Jun 08 13:48:37.074296 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:37.074233 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-ckl6w" Jun 08 13:48:37.090525 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:37.090476 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-4ljw4" podStartSLOduration=1.92789717 podStartE2EDuration="5.090464656s" totalImagesPullingTime="3.162567486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:48:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:48:37.089391307 +0000 UTC m=+331.070419594" watchObservedRunningTime="2026-06-08 13:48:37.090464656 +0000 UTC m=+331.071492924" Jun 08 13:48:37.107285 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:37.107238 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-ckl6w" podStartSLOduration=2.213741581 podStartE2EDuration="6.107221793s" totalImagesPullingTime="3.893480212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:48:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:48:37.104844469 +0000 UTC m=+331.085872777" watchObservedRunningTime="2026-06-08 13:48:37.107221793 +0000 UTC m=+331.088250062" Jun 08 13:48:41.614047 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:41.614011 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:41.662864 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:41.662833 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-29g7k"] Jun 08 13:48:41.666332 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:41.666314 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-29g7k" Jun 08 13:48:41.669001 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:41.668977 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 08 13:48:41.669109 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:41.669032 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-tl5qg\"" Jun 08 13:48:41.677539 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:41.677517 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-sgp8p"] Jun 08 13:48:41.680830 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:41.680811 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-sgp8p" Jun 08 13:48:41.681405 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:41.681383 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-29g7k"] Jun 08 13:48:41.683424 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:41.683402 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 08 13:48:41.683528 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:41.683458 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-dzl2p\"" Jun 08 13:48:41.698198 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:41.698174 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-sgp8p"] Jun 08 13:48:41.712825 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:41.712798 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:41.761726 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:41.761704 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ecccf64-9845-4d0d-8677-0fae665cc1aa-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-sgp8p\" (UID: \"0ecccf64-9845-4d0d-8677-0fae665cc1aa\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-sgp8p" Jun 08 13:48:41.761865 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:41.761744 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crgl9\" (UniqueName: \"kubernetes.io/projected/0ecccf64-9845-4d0d-8677-0fae665cc1aa-kube-api-access-crgl9\") pod \"llmisvc-controller-manager-864bfd7bc9-sgp8p\" (UID: \"0ecccf64-9845-4d0d-8677-0fae665cc1aa\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-sgp8p" Jun 08 13:48:41.761865 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:41.761854 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw5j9\" (UniqueName: \"kubernetes.io/projected/34d74f96-dd06-414a-a3cc-cb38bc3a0cfd-kube-api-access-jw5j9\") pod \"kserve-controller-manager-69fc866d76-29g7k\" (UID: \"34d74f96-dd06-414a-a3cc-cb38bc3a0cfd\") " pod="opendatahub/kserve-controller-manager-69fc866d76-29g7k" Jun 08 13:48:41.761973 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:41.761901 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34d74f96-dd06-414a-a3cc-cb38bc3a0cfd-cert\") pod \"kserve-controller-manager-69fc866d76-29g7k\" (UID: \"34d74f96-dd06-414a-a3cc-cb38bc3a0cfd\") " pod="opendatahub/kserve-controller-manager-69fc866d76-29g7k" Jun 08 13:48:41.862985 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:41.862964 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crgl9\" (UniqueName: \"kubernetes.io/projected/0ecccf64-9845-4d0d-8677-0fae665cc1aa-kube-api-access-crgl9\") pod \"llmisvc-controller-manager-864bfd7bc9-sgp8p\" (UID: \"0ecccf64-9845-4d0d-8677-0fae665cc1aa\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-sgp8p" Jun 08 13:48:41.863103 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:41.863019 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw5j9\" (UniqueName: \"kubernetes.io/projected/34d74f96-dd06-414a-a3cc-cb38bc3a0cfd-kube-api-access-jw5j9\") pod \"kserve-controller-manager-69fc866d76-29g7k\" (UID: \"34d74f96-dd06-414a-a3cc-cb38bc3a0cfd\") " pod="opendatahub/kserve-controller-manager-69fc866d76-29g7k" Jun 08 13:48:41.863103 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:41.863050 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34d74f96-dd06-414a-a3cc-cb38bc3a0cfd-cert\") pod \"kserve-controller-manager-69fc866d76-29g7k\" (UID: \"34d74f96-dd06-414a-a3cc-cb38bc3a0cfd\") " pod="opendatahub/kserve-controller-manager-69fc866d76-29g7k" Jun 08 13:48:41.863103 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:41.863086 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ecccf64-9845-4d0d-8677-0fae665cc1aa-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-sgp8p\" (UID: \"0ecccf64-9845-4d0d-8677-0fae665cc1aa\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-sgp8p" Jun 08 13:48:41.863268 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:48:41.863221 2561 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 08 13:48:41.863407 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:48:41.863363 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d74f96-dd06-414a-a3cc-cb38bc3a0cfd-cert podName:34d74f96-dd06-414a-a3cc-cb38bc3a0cfd nodeName:}" failed. No retries permitted until 2026-06-08 13:48:42.363311997 +0000 UTC m=+336.344340253 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/34d74f96-dd06-414a-a3cc-cb38bc3a0cfd-cert") pod "kserve-controller-manager-69fc866d76-29g7k" (UID: "34d74f96-dd06-414a-a3cc-cb38bc3a0cfd") : secret "kserve-webhook-server-cert" not found Jun 08 13:48:41.865869 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:41.865820 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ecccf64-9845-4d0d-8677-0fae665cc1aa-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-sgp8p\" (UID: \"0ecccf64-9845-4d0d-8677-0fae665cc1aa\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-sgp8p" Jun 08 13:48:41.883554 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:41.883534 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crgl9\" (UniqueName: \"kubernetes.io/projected/0ecccf64-9845-4d0d-8677-0fae665cc1aa-kube-api-access-crgl9\") pod \"llmisvc-controller-manager-864bfd7bc9-sgp8p\" (UID: \"0ecccf64-9845-4d0d-8677-0fae665cc1aa\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-sgp8p" Jun 08 13:48:41.891222 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:41.891203 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw5j9\" (UniqueName: \"kubernetes.io/projected/34d74f96-dd06-414a-a3cc-cb38bc3a0cfd-kube-api-access-jw5j9\") pod \"kserve-controller-manager-69fc866d76-29g7k\" (UID: \"34d74f96-dd06-414a-a3cc-cb38bc3a0cfd\") " pod="opendatahub/kserve-controller-manager-69fc866d76-29g7k" Jun 08 13:48:41.973422 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:41.973396 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:41.990564 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:41.990541 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-sgp8p" Jun 08 13:48:42.148316 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.148285 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:42.159844 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.159822 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-sgp8p"] Jun 08 13:48:42.161177 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:48:42.161154 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0ecccf64_9845_4d0d_8677_0fae665cc1aa.slice/crio-c903d770e4778160d415edc4218bc021d93c827b29696a603f8421961c84076b WatchSource:0}: Error finding container c903d770e4778160d415edc4218bc021d93c827b29696a603f8421961c84076b: Status 404 returned error can't find the container with id c903d770e4778160d415edc4218bc021d93c827b29696a603f8421961c84076b Jun 08 13:48:42.252446 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.252416 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-576c89d9d8-cwc7x"] Jun 08 13:48:42.257169 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.257142 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-576c89d9d8-cwc7x" Jun 08 13:48:42.261525 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.261496 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-bbjdz\"" Jun 08 13:48:42.261726 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.261704 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 08 13:48:42.261874 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.261856 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 08 13:48:42.266433 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.266409 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ea87952-aa57-4d1c-92dd-ef35ae4a61dd-tmp\") pod \"kube-auth-proxy-576c89d9d8-cwc7x\" (UID: \"7ea87952-aa57-4d1c-92dd-ef35ae4a61dd\") " pod="openshift-ingress/kube-auth-proxy-576c89d9d8-cwc7x" Jun 08 13:48:42.266549 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.266531 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ea87952-aa57-4d1c-92dd-ef35ae4a61dd-tls-certs\") pod \"kube-auth-proxy-576c89d9d8-cwc7x\" (UID: \"7ea87952-aa57-4d1c-92dd-ef35ae4a61dd\") " pod="openshift-ingress/kube-auth-proxy-576c89d9d8-cwc7x" Jun 08 13:48:42.266598 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.266571 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t45fn\" (UniqueName: \"kubernetes.io/projected/7ea87952-aa57-4d1c-92dd-ef35ae4a61dd-kube-api-access-t45fn\") pod \"kube-auth-proxy-576c89d9d8-cwc7x\" (UID: \"7ea87952-aa57-4d1c-92dd-ef35ae4a61dd\") " pod="openshift-ingress/kube-auth-proxy-576c89d9d8-cwc7x" Jun 08 13:48:42.274344 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.274320 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:42.300126 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.300105 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-576c89d9d8-cwc7x"] Jun 08 13:48:42.301998 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.301978 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sn2fb"] Jun 08 13:48:42.306007 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.305986 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sn2fb" Jun 08 13:48:42.309874 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.309852 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 13:48:42.309874 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.309854 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jb7sc\"" Jun 08 13:48:42.310286 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.310266 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 13:48:42.320912 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.320893 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sn2fb"] Jun 08 13:48:42.367806 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.367755 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a24fe5dc-0e55-4d4b-9b29-d7d2292f037d-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sn2fb\" (UID: \"a24fe5dc-0e55-4d4b-9b29-d7d2292f037d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sn2fb" Jun 08 13:48:42.368050 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.368033 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a24fe5dc-0e55-4d4b-9b29-d7d2292f037d-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sn2fb\" (UID: \"a24fe5dc-0e55-4d4b-9b29-d7d2292f037d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sn2fb" Jun 08 13:48:42.368193 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.368179 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ea87952-aa57-4d1c-92dd-ef35ae4a61dd-tls-certs\") pod \"kube-auth-proxy-576c89d9d8-cwc7x\" (UID: \"7ea87952-aa57-4d1c-92dd-ef35ae4a61dd\") " pod="openshift-ingress/kube-auth-proxy-576c89d9d8-cwc7x" Jun 08 13:48:42.368300 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.368286 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t45fn\" (UniqueName: \"kubernetes.io/projected/7ea87952-aa57-4d1c-92dd-ef35ae4a61dd-kube-api-access-t45fn\") pod \"kube-auth-proxy-576c89d9d8-cwc7x\" (UID: \"7ea87952-aa57-4d1c-92dd-ef35ae4a61dd\") " pod="openshift-ingress/kube-auth-proxy-576c89d9d8-cwc7x" Jun 08 13:48:42.368420 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.368407 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34d74f96-dd06-414a-a3cc-cb38bc3a0cfd-cert\") pod \"kserve-controller-manager-69fc866d76-29g7k\" (UID: \"34d74f96-dd06-414a-a3cc-cb38bc3a0cfd\") " pod="opendatahub/kserve-controller-manager-69fc866d76-29g7k" Jun 08 13:48:42.368540 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.368526 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6lpm\" (UniqueName: \"kubernetes.io/projected/a24fe5dc-0e55-4d4b-9b29-d7d2292f037d-kube-api-access-t6lpm\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sn2fb\" (UID: \"a24fe5dc-0e55-4d4b-9b29-d7d2292f037d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sn2fb" Jun 08 13:48:42.368638 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.368625 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ea87952-aa57-4d1c-92dd-ef35ae4a61dd-tmp\") pod \"kube-auth-proxy-576c89d9d8-cwc7x\" (UID: \"7ea87952-aa57-4d1c-92dd-ef35ae4a61dd\") " pod="openshift-ingress/kube-auth-proxy-576c89d9d8-cwc7x" Jun 08 13:48:42.372238 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.372192 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ea87952-aa57-4d1c-92dd-ef35ae4a61dd-tls-certs\") pod \"kube-auth-proxy-576c89d9d8-cwc7x\" (UID: \"7ea87952-aa57-4d1c-92dd-ef35ae4a61dd\") " pod="openshift-ingress/kube-auth-proxy-576c89d9d8-cwc7x" Jun 08 13:48:42.376043 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.375991 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ea87952-aa57-4d1c-92dd-ef35ae4a61dd-tmp\") pod \"kube-auth-proxy-576c89d9d8-cwc7x\" (UID: \"7ea87952-aa57-4d1c-92dd-ef35ae4a61dd\") " pod="openshift-ingress/kube-auth-proxy-576c89d9d8-cwc7x" Jun 08 13:48:42.376917 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.376219 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34d74f96-dd06-414a-a3cc-cb38bc3a0cfd-cert\") pod \"kserve-controller-manager-69fc866d76-29g7k\" (UID: \"34d74f96-dd06-414a-a3cc-cb38bc3a0cfd\") " pod="opendatahub/kserve-controller-manager-69fc866d76-29g7k" Jun 08 13:48:42.385279 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.385259 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t45fn\" (UniqueName: \"kubernetes.io/projected/7ea87952-aa57-4d1c-92dd-ef35ae4a61dd-kube-api-access-t45fn\") pod \"kube-auth-proxy-576c89d9d8-cwc7x\" (UID: \"7ea87952-aa57-4d1c-92dd-ef35ae4a61dd\") " pod="openshift-ingress/kube-auth-proxy-576c89d9d8-cwc7x" Jun 08 13:48:42.469172 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.469117 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6lpm\" (UniqueName: \"kubernetes.io/projected/a24fe5dc-0e55-4d4b-9b29-d7d2292f037d-kube-api-access-t6lpm\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sn2fb\" (UID: \"a24fe5dc-0e55-4d4b-9b29-d7d2292f037d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sn2fb" Jun 08 13:48:42.469172 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.469155 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a24fe5dc-0e55-4d4b-9b29-d7d2292f037d-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sn2fb\" (UID: \"a24fe5dc-0e55-4d4b-9b29-d7d2292f037d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sn2fb" Jun 08 13:48:42.469293 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.469195 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a24fe5dc-0e55-4d4b-9b29-d7d2292f037d-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sn2fb\" (UID: \"a24fe5dc-0e55-4d4b-9b29-d7d2292f037d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sn2fb" Jun 08 13:48:42.469524 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.469507 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a24fe5dc-0e55-4d4b-9b29-d7d2292f037d-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sn2fb\" (UID: \"a24fe5dc-0e55-4d4b-9b29-d7d2292f037d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sn2fb" Jun 08 13:48:42.469562 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.469528 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a24fe5dc-0e55-4d4b-9b29-d7d2292f037d-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sn2fb\" (UID: \"a24fe5dc-0e55-4d4b-9b29-d7d2292f037d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sn2fb" Jun 08 13:48:42.517127 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.517101 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6lpm\" (UniqueName: \"kubernetes.io/projected/a24fe5dc-0e55-4d4b-9b29-d7d2292f037d-kube-api-access-t6lpm\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sn2fb\" (UID: \"a24fe5dc-0e55-4d4b-9b29-d7d2292f037d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sn2fb" Jun 08 13:48:42.567425 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.567400 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-576c89d9d8-cwc7x" Jun 08 13:48:42.576625 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.576597 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-29g7k" Jun 08 13:48:42.617015 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.616880 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sn2fb" Jun 08 13:48:42.741727 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.741695 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-576c89d9d8-cwc7x"] Jun 08 13:48:42.745060 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:48:42.745034 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ea87952_aa57_4d1c_92dd_ef35ae4a61dd.slice/crio-f7ef719bc13597c5b15d79d21626b33ffd41a60f1a00fc70f8a162a97022ac3d WatchSource:0}: Error finding container f7ef719bc13597c5b15d79d21626b33ffd41a60f1a00fc70f8a162a97022ac3d: Status 404 returned error can't find the container with id f7ef719bc13597c5b15d79d21626b33ffd41a60f1a00fc70f8a162a97022ac3d Jun 08 13:48:42.767402 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.767372 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-29g7k"] Jun 08 13:48:42.768577 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:48:42.768548 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34d74f96_dd06_414a_a3cc_cb38bc3a0cfd.slice/crio-983791a9f1db1d3e48eb146a534eab13d666aebeda3890ffeefa958528469f6a WatchSource:0}: Error finding container 983791a9f1db1d3e48eb146a534eab13d666aebeda3890ffeefa958528469f6a: Status 404 returned error can't find the container with id 983791a9f1db1d3e48eb146a534eab13d666aebeda3890ffeefa958528469f6a Jun 08 13:48:42.787882 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.787853 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sn2fb"] Jun 08 13:48:42.790558 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:48:42.790536 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda24fe5dc_0e55_4d4b_9b29_d7d2292f037d.slice/crio-26adc3fbac0496b56868439ad7c2269b3b839f6b87060bbef0a79a60b55dd156 WatchSource:0}: Error finding container 26adc3fbac0496b56868439ad7c2269b3b839f6b87060bbef0a79a60b55dd156: Status 404 returned error can't find the container with id 26adc3fbac0496b56868439ad7c2269b3b839f6b87060bbef0a79a60b55dd156 Jun 08 13:48:42.910526 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:42.910493 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:43.065365 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:43.065275 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:43.105206 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:43.105169 2561 generic.go:356] "Generic (PLEG): container finished" podID="a24fe5dc-0e55-4d4b-9b29-d7d2292f037d" containerID="dd8cd017b88742f917572f7e87fecaa0212bf69dfb364c1661eebc8838567066" exitCode=0 Jun 08 13:48:43.105389 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:43.105269 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sn2fb" event={"ID":"a24fe5dc-0e55-4d4b-9b29-d7d2292f037d","Type":"ContainerDied","Data":"dd8cd017b88742f917572f7e87fecaa0212bf69dfb364c1661eebc8838567066"} Jun 08 13:48:43.105389 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:43.105340 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sn2fb" event={"ID":"a24fe5dc-0e55-4d4b-9b29-d7d2292f037d","Type":"ContainerStarted","Data":"26adc3fbac0496b56868439ad7c2269b3b839f6b87060bbef0a79a60b55dd156"} Jun 08 13:48:43.106972 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:43.106906 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-sgp8p" event={"ID":"0ecccf64-9845-4d0d-8677-0fae665cc1aa","Type":"ContainerStarted","Data":"c903d770e4778160d415edc4218bc021d93c827b29696a603f8421961c84076b"} Jun 08 13:48:43.108171 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:43.108140 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-29g7k" event={"ID":"34d74f96-dd06-414a-a3cc-cb38bc3a0cfd","Type":"ContainerStarted","Data":"983791a9f1db1d3e48eb146a534eab13d666aebeda3890ffeefa958528469f6a"} Jun 08 13:48:43.109919 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:43.109897 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-576c89d9d8-cwc7x" event={"ID":"7ea87952-aa57-4d1c-92dd-ef35ae4a61dd","Type":"ContainerStarted","Data":"f7ef719bc13597c5b15d79d21626b33ffd41a60f1a00fc70f8a162a97022ac3d"} Jun 08 13:48:43.285980 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:43.285855 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:44.119821 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:44.119717 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sn2fb" event={"ID":"a24fe5dc-0e55-4d4b-9b29-d7d2292f037d","Type":"ContainerStarted","Data":"6be99b81871f2910eae2fbb001063f2fedf5cb89c4995b93a59b0fb10aaeaa21"} Jun 08 13:48:45.129635 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:45.129587 2561 generic.go:356] "Generic (PLEG): container finished" podID="a24fe5dc-0e55-4d4b-9b29-d7d2292f037d" containerID="6be99b81871f2910eae2fbb001063f2fedf5cb89c4995b93a59b0fb10aaeaa21" exitCode=0 Jun 08 13:48:45.130116 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:45.129717 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sn2fb" event={"ID":"a24fe5dc-0e55-4d4b-9b29-d7d2292f037d","Type":"ContainerDied","Data":"6be99b81871f2910eae2fbb001063f2fedf5cb89c4995b93a59b0fb10aaeaa21"} Jun 08 13:48:47.145888 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:47.145853 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-29g7k" event={"ID":"34d74f96-dd06-414a-a3cc-cb38bc3a0cfd","Type":"ContainerStarted","Data":"33de98c86212fd91a8b0cfb7904a5fa296cd43876b14a9d62c5d8cd36658dd26"} Jun 08 13:48:47.146337 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:47.145918 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-29g7k" Jun 08 13:48:47.147448 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:47.147424 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-576c89d9d8-cwc7x" event={"ID":"7ea87952-aa57-4d1c-92dd-ef35ae4a61dd","Type":"ContainerStarted","Data":"611f6497a1a6615a28ea0d68e68d56c01bd1a40d28c5af4e69908fdda747360c"} Jun 08 13:48:47.149438 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:47.149417 2561 generic.go:356] "Generic (PLEG): container finished" podID="a24fe5dc-0e55-4d4b-9b29-d7d2292f037d" containerID="6be14f922183fa5ac4433210b7eadf65d621cc59e169670347f8643e9fd37aa0" exitCode=0 Jun 08 13:48:47.149508 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:47.149488 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sn2fb" event={"ID":"a24fe5dc-0e55-4d4b-9b29-d7d2292f037d","Type":"ContainerDied","Data":"6be14f922183fa5ac4433210b7eadf65d621cc59e169670347f8643e9fd37aa0"} Jun 08 13:48:47.150794 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:47.150775 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-sgp8p" event={"ID":"0ecccf64-9845-4d0d-8677-0fae665cc1aa","Type":"ContainerStarted","Data":"e53bf28fb4b09e07466a737930414aed69268544cce0e34ad6f79dbd8b5e4fc2"} Jun 08 13:48:47.150890 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:47.150878 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-sgp8p" Jun 08 13:48:47.192047 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:47.192005 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-29g7k" podStartSLOduration=2.837818512 podStartE2EDuration="6.191992115s" totalImagesPullingTime="3.354173603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:48:47.188880591 +0000 UTC m=+341.169908876" watchObservedRunningTime="2026-06-08 13:48:47.191992115 +0000 UTC m=+341.173020416" Jun 08 13:48:47.226086 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:47.226045 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-sgp8p" podStartSLOduration=2.273801289 podStartE2EDuration="6.226028387s" totalImagesPullingTime="3.952227098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:48:47.223913958 +0000 UTC m=+341.204942227" watchObservedRunningTime="2026-06-08 13:48:47.226028387 +0000 UTC m=+341.207056658" Jun 08 13:48:47.362781 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:47.362717 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-576c89d9d8-cwc7x" podStartSLOduration=1.986399124 podStartE2EDuration="5.362701959s" totalImagesPullingTime="3.376302835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:48:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:48:47.305038467 +0000 UTC m=+341.286066737" watchObservedRunningTime="2026-06-08 13:48:47.362701959 +0000 UTC m=+341.343730229" Jun 08 13:48:48.081228 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:48.081198 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-ckl6w" Jun 08 13:48:48.083281 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:48.083260 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-4ljw4" Jun 08 13:48:48.292342 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:48.292315 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sn2fb" Jun 08 13:48:48.312728 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:48.312700 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a24fe5dc-0e55-4d4b-9b29-d7d2292f037d-util\") pod \"a24fe5dc-0e55-4d4b-9b29-d7d2292f037d\" (UID: \"a24fe5dc-0e55-4d4b-9b29-d7d2292f037d\") " Jun 08 13:48:48.312874 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:48.312806 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a24fe5dc-0e55-4d4b-9b29-d7d2292f037d-bundle\") pod \"a24fe5dc-0e55-4d4b-9b29-d7d2292f037d\" (UID: \"a24fe5dc-0e55-4d4b-9b29-d7d2292f037d\") " Jun 08 13:48:48.312874 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:48.312849 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6lpm\" (UniqueName: \"kubernetes.io/projected/a24fe5dc-0e55-4d4b-9b29-d7d2292f037d-kube-api-access-t6lpm\") pod \"a24fe5dc-0e55-4d4b-9b29-d7d2292f037d\" (UID: \"a24fe5dc-0e55-4d4b-9b29-d7d2292f037d\") " Jun 08 13:48:48.313889 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:48.313866 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a24fe5dc-0e55-4d4b-9b29-d7d2292f037d-bundle" (OuterVolumeSpecName: "bundle") pod "a24fe5dc-0e55-4d4b-9b29-d7d2292f037d" (UID: "a24fe5dc-0e55-4d4b-9b29-d7d2292f037d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:48:48.315452 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:48.315400 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a24fe5dc-0e55-4d4b-9b29-d7d2292f037d-kube-api-access-t6lpm" (OuterVolumeSpecName: "kube-api-access-t6lpm") pod "a24fe5dc-0e55-4d4b-9b29-d7d2292f037d" (UID: "a24fe5dc-0e55-4d4b-9b29-d7d2292f037d"). InnerVolumeSpecName "kube-api-access-t6lpm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:48:48.319222 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:48.319194 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a24fe5dc-0e55-4d4b-9b29-d7d2292f037d-util" (OuterVolumeSpecName: "util") pod "a24fe5dc-0e55-4d4b-9b29-d7d2292f037d" (UID: "a24fe5dc-0e55-4d4b-9b29-d7d2292f037d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:48:48.413592 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:48.413566 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a24fe5dc-0e55-4d4b-9b29-d7d2292f037d-util\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:48:48.413592 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:48.413590 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a24fe5dc-0e55-4d4b-9b29-d7d2292f037d-bundle\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:48:48.413732 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:48.413599 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6lpm\" (UniqueName: \"kubernetes.io/projected/a24fe5dc-0e55-4d4b-9b29-d7d2292f037d-kube-api-access-t6lpm\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:48:49.162754 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:49.162729 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sn2fb" Jun 08 13:48:49.162947 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:49.162775 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sn2fb" event={"ID":"a24fe5dc-0e55-4d4b-9b29-d7d2292f037d","Type":"ContainerDied","Data":"26adc3fbac0496b56868439ad7c2269b3b839f6b87060bbef0a79a60b55dd156"} Jun 08 13:48:49.162947 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:49.162820 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26adc3fbac0496b56868439ad7c2269b3b839f6b87060bbef0a79a60b55dd156" Jun 08 13:48:55.606540 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:55.606453 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:55.821620 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:55.821585 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:57.206452 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:57.206419 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avv42m"] Jun 08 13:48:57.206868 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:57.206854 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a24fe5dc-0e55-4d4b-9b29-d7d2292f037d" containerName="pull" Jun 08 13:48:57.206868 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:57.206870 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a24fe5dc-0e55-4d4b-9b29-d7d2292f037d" containerName="pull" Jun 08 13:48:57.206952 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:57.206878 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a24fe5dc-0e55-4d4b-9b29-d7d2292f037d" containerName="extract" Jun 08 13:48:57.206952 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:57.206885 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a24fe5dc-0e55-4d4b-9b29-d7d2292f037d" containerName="extract" Jun 08 13:48:57.206952 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:57.206914 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a24fe5dc-0e55-4d4b-9b29-d7d2292f037d" containerName="util" Jun 08 13:48:57.206952 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:57.206921 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a24fe5dc-0e55-4d4b-9b29-d7d2292f037d" containerName="util" Jun 08 13:48:57.207064 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:57.206986 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a24fe5dc-0e55-4d4b-9b29-d7d2292f037d" containerName="extract" Jun 08 13:48:57.210678 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:57.210661 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avv42m" Jun 08 13:48:57.217788 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:57.217752 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jb7sc\"" Jun 08 13:48:57.217894 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:57.217809 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 13:48:57.222953 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:57.222934 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 13:48:57.252155 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:57.252131 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avv42m"] Jun 08 13:48:57.278393 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:57.278370 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6b307bc-f679-45e3-b83f-a7abf2a3e49a-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avv42m\" (UID: \"c6b307bc-f679-45e3-b83f-a7abf2a3e49a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avv42m" Jun 08 13:48:57.278542 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:57.278414 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6b307bc-f679-45e3-b83f-a7abf2a3e49a-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avv42m\" (UID: \"c6b307bc-f679-45e3-b83f-a7abf2a3e49a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avv42m" Jun 08 13:48:57.278542 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:57.278454 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4bdb\" (UniqueName: \"kubernetes.io/projected/c6b307bc-f679-45e3-b83f-a7abf2a3e49a-kube-api-access-z4bdb\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avv42m\" (UID: \"c6b307bc-f679-45e3-b83f-a7abf2a3e49a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avv42m" Jun 08 13:48:57.379560 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:57.379530 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4bdb\" (UniqueName: \"kubernetes.io/projected/c6b307bc-f679-45e3-b83f-a7abf2a3e49a-kube-api-access-z4bdb\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avv42m\" (UID: \"c6b307bc-f679-45e3-b83f-a7abf2a3e49a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avv42m" Jun 08 13:48:57.379707 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:57.379579 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6b307bc-f679-45e3-b83f-a7abf2a3e49a-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avv42m\" (UID: \"c6b307bc-f679-45e3-b83f-a7abf2a3e49a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avv42m" Jun 08 13:48:57.379707 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:57.379688 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6b307bc-f679-45e3-b83f-a7abf2a3e49a-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avv42m\" (UID: \"c6b307bc-f679-45e3-b83f-a7abf2a3e49a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avv42m" Jun 08 13:48:57.380031 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:57.380015 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6b307bc-f679-45e3-b83f-a7abf2a3e49a-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avv42m\" (UID: \"c6b307bc-f679-45e3-b83f-a7abf2a3e49a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avv42m" Jun 08 13:48:57.380091 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:57.380067 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6b307bc-f679-45e3-b83f-a7abf2a3e49a-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avv42m\" (UID: \"c6b307bc-f679-45e3-b83f-a7abf2a3e49a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avv42m" Jun 08 13:48:57.421517 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:57.421491 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4bdb\" (UniqueName: \"kubernetes.io/projected/c6b307bc-f679-45e3-b83f-a7abf2a3e49a-kube-api-access-z4bdb\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avv42m\" (UID: \"c6b307bc-f679-45e3-b83f-a7abf2a3e49a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avv42m" Jun 08 13:48:57.520101 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:57.520022 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avv42m" Jun 08 13:48:57.680248 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:57.680223 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avv42m"] Jun 08 13:48:57.683037 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:48:57.682964 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6b307bc_f679_45e3_b83f_a7abf2a3e49a.slice/crio-7d9849d7a88835aa5f5ffb3f976e93fea06ecaa83b1968f34607466c14daf05e WatchSource:0}: Error finding container 7d9849d7a88835aa5f5ffb3f976e93fea06ecaa83b1968f34607466c14daf05e: Status 404 returned error can't find the container with id 7d9849d7a88835aa5f5ffb3f976e93fea06ecaa83b1968f34607466c14daf05e Jun 08 13:48:58.011027 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:58.010987 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:58.206257 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:58.206223 2561 generic.go:356] "Generic (PLEG): container finished" podID="c6b307bc-f679-45e3-b83f-a7abf2a3e49a" containerID="11e76f36fce4ea1332f479ee884cad545a9ca6a7ac9cd04b8470ac78aad18f18" exitCode=0 Jun 08 13:48:58.206451 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:58.206312 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avv42m" event={"ID":"c6b307bc-f679-45e3-b83f-a7abf2a3e49a","Type":"ContainerDied","Data":"11e76f36fce4ea1332f479ee884cad545a9ca6a7ac9cd04b8470ac78aad18f18"} Jun 08 13:48:58.206451 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:58.206370 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avv42m" event={"ID":"c6b307bc-f679-45e3-b83f-a7abf2a3e49a","Type":"ContainerStarted","Data":"7d9849d7a88835aa5f5ffb3f976e93fea06ecaa83b1968f34607466c14daf05e"} Jun 08 13:48:58.270379 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:58.270352 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:58.524464 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:58.524349 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:58.817082 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:58.816998 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:59.188810 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:59.188755 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:59.403507 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:59.403467 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:59.410744 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:59.410720 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7cc5c547d9-49ng9"] Jun 08 13:48:59.422106 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:59.422086 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7cc5c547d9-49ng9" Jun 08 13:48:59.427377 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:59.427349 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 08 13:48:59.427489 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:59.427412 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-82nxf\"" Jun 08 13:48:59.441547 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:59.441496 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7cc5c547d9-49ng9"] Jun 08 13:48:59.497087 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:59.497062 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxlr2\" (UniqueName: \"kubernetes.io/projected/da9b7e87-b6b4-420b-8761-e977279d50bc-kube-api-access-kxlr2\") pod \"dashboard-redirect-7cc5c547d9-49ng9\" (UID: \"da9b7e87-b6b4-420b-8761-e977279d50bc\") " pod="opendatahub/dashboard-redirect-7cc5c547d9-49ng9" Jun 08 13:48:59.497242 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:59.497127 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/da9b7e87-b6b4-420b-8761-e977279d50bc-redirect-config\") pod \"dashboard-redirect-7cc5c547d9-49ng9\" (UID: \"da9b7e87-b6b4-420b-8761-e977279d50bc\") " pod="opendatahub/dashboard-redirect-7cc5c547d9-49ng9" Jun 08 13:48:59.597970 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:59.597942 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxlr2\" (UniqueName: \"kubernetes.io/projected/da9b7e87-b6b4-420b-8761-e977279d50bc-kube-api-access-kxlr2\") pod \"dashboard-redirect-7cc5c547d9-49ng9\" (UID: \"da9b7e87-b6b4-420b-8761-e977279d50bc\") " pod="opendatahub/dashboard-redirect-7cc5c547d9-49ng9" Jun 08 13:48:59.598138 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:59.598000 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/da9b7e87-b6b4-420b-8761-e977279d50bc-redirect-config\") pod \"dashboard-redirect-7cc5c547d9-49ng9\" (UID: \"da9b7e87-b6b4-420b-8761-e977279d50bc\") " pod="opendatahub/dashboard-redirect-7cc5c547d9-49ng9" Jun 08 13:48:59.598589 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:59.598571 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/da9b7e87-b6b4-420b-8761-e977279d50bc-redirect-config\") pod \"dashboard-redirect-7cc5c547d9-49ng9\" (UID: \"da9b7e87-b6b4-420b-8761-e977279d50bc\") " pod="opendatahub/dashboard-redirect-7cc5c547d9-49ng9" Jun 08 13:48:59.617683 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:59.617652 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxlr2\" (UniqueName: \"kubernetes.io/projected/da9b7e87-b6b4-420b-8761-e977279d50bc-kube-api-access-kxlr2\") pod \"dashboard-redirect-7cc5c547d9-49ng9\" (UID: \"da9b7e87-b6b4-420b-8761-e977279d50bc\") " pod="opendatahub/dashboard-redirect-7cc5c547d9-49ng9" Jun 08 13:48:59.674570 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:59.674520 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:59.732973 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:59.732914 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7cc5c547d9-49ng9" Jun 08 13:48:59.959537 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:48:59.959515 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7cc5c547d9-49ng9"] Jun 08 13:48:59.961621 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:48:59.961585 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda9b7e87_b6b4_420b_8761_e977279d50bc.slice/crio-46c977f9becda61df8d6cd3b202efe152d5d398f4bf4bc4fdb15de651d4e4631 WatchSource:0}: Error finding container 46c977f9becda61df8d6cd3b202efe152d5d398f4bf4bc4fdb15de651d4e4631: Status 404 returned error can't find the container with id 46c977f9becda61df8d6cd3b202efe152d5d398f4bf4bc4fdb15de651d4e4631 Jun 08 13:49:00.220906 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:00.220872 2561 generic.go:356] "Generic (PLEG): container finished" podID="c6b307bc-f679-45e3-b83f-a7abf2a3e49a" containerID="b77c52082f9f72c982a8025897914878864395bffb7250826b9dee74894b787c" exitCode=0 Jun 08 13:49:00.221085 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:00.220954 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avv42m" event={"ID":"c6b307bc-f679-45e3-b83f-a7abf2a3e49a","Type":"ContainerDied","Data":"b77c52082f9f72c982a8025897914878864395bffb7250826b9dee74894b787c"} Jun 08 13:49:00.222191 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:00.222165 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7cc5c547d9-49ng9" event={"ID":"da9b7e87-b6b4-420b-8761-e977279d50bc","Type":"ContainerStarted","Data":"46c977f9becda61df8d6cd3b202efe152d5d398f4bf4bc4fdb15de651d4e4631"} Jun 08 13:49:00.625552 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:00.625525 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-d88hf"] Jun 08 13:49:00.640570 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:00.640552 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-d88hf" Jun 08 13:49:00.645701 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:00.645680 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-kc5w8\"" Jun 08 13:49:00.646299 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:00.646284 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 08 13:49:00.647475 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:00.647269 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 08 13:49:00.653743 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:00.653724 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-d88hf"] Jun 08 13:49:00.709580 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:00.709556 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/895094f3-3b52-4a9f-b7b3-7494437cd4ca-operator-config\") pod \"servicemesh-operator3-57f65f65fb-d88hf\" (UID: \"895094f3-3b52-4a9f-b7b3-7494437cd4ca\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-d88hf" Jun 08 13:49:00.709721 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:00.709701 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkvfk\" (UniqueName: \"kubernetes.io/projected/895094f3-3b52-4a9f-b7b3-7494437cd4ca-kube-api-access-qkvfk\") pod \"servicemesh-operator3-57f65f65fb-d88hf\" (UID: \"895094f3-3b52-4a9f-b7b3-7494437cd4ca\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-d88hf" Jun 08 13:49:00.810184 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:00.810117 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkvfk\" (UniqueName: \"kubernetes.io/projected/895094f3-3b52-4a9f-b7b3-7494437cd4ca-kube-api-access-qkvfk\") pod \"servicemesh-operator3-57f65f65fb-d88hf\" (UID: \"895094f3-3b52-4a9f-b7b3-7494437cd4ca\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-d88hf" Jun 08 13:49:00.810184 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:00.810150 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/895094f3-3b52-4a9f-b7b3-7494437cd4ca-operator-config\") pod \"servicemesh-operator3-57f65f65fb-d88hf\" (UID: \"895094f3-3b52-4a9f-b7b3-7494437cd4ca\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-d88hf" Jun 08 13:49:00.813309 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:00.813290 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/895094f3-3b52-4a9f-b7b3-7494437cd4ca-operator-config\") pod \"servicemesh-operator3-57f65f65fb-d88hf\" (UID: \"895094f3-3b52-4a9f-b7b3-7494437cd4ca\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-d88hf" Jun 08 13:49:00.829649 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:00.829627 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkvfk\" (UniqueName: \"kubernetes.io/projected/895094f3-3b52-4a9f-b7b3-7494437cd4ca-kube-api-access-qkvfk\") pod \"servicemesh-operator3-57f65f65fb-d88hf\" (UID: \"895094f3-3b52-4a9f-b7b3-7494437cd4ca\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-d88hf" Jun 08 13:49:00.950029 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:00.950000 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-d88hf" Jun 08 13:49:01.125716 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:01.125690 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-d88hf"] Jun 08 13:49:01.126411 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:49:01.126390 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod895094f3_3b52_4a9f_b7b3_7494437cd4ca.slice/crio-fe42eea005208444298afc3afcf09973504560c851a4fb9c1cec504fc82320eb WatchSource:0}: Error finding container fe42eea005208444298afc3afcf09973504560c851a4fb9c1cec504fc82320eb: Status 404 returned error can't find the container with id fe42eea005208444298afc3afcf09973504560c851a4fb9c1cec504fc82320eb Jun 08 13:49:01.230508 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:01.230472 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-d88hf" event={"ID":"895094f3-3b52-4a9f-b7b3-7494437cd4ca","Type":"ContainerStarted","Data":"fe42eea005208444298afc3afcf09973504560c851a4fb9c1cec504fc82320eb"} Jun 08 13:49:01.233218 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:01.233187 2561 generic.go:356] "Generic (PLEG): container finished" podID="c6b307bc-f679-45e3-b83f-a7abf2a3e49a" containerID="69b0e00520b518041996fef1129d254f00134652150fd9fe26a451bcd6aab1d5" exitCode=0 Jun 08 13:49:01.233349 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:01.233224 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avv42m" event={"ID":"c6b307bc-f679-45e3-b83f-a7abf2a3e49a","Type":"ContainerDied","Data":"69b0e00520b518041996fef1129d254f00134652150fd9fe26a451bcd6aab1d5"} Jun 08 13:49:02.719862 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:02.719828 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avv42m" Jun 08 13:49:02.727135 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:02.727115 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6b307bc-f679-45e3-b83f-a7abf2a3e49a-bundle\") pod \"c6b307bc-f679-45e3-b83f-a7abf2a3e49a\" (UID: \"c6b307bc-f679-45e3-b83f-a7abf2a3e49a\") " Jun 08 13:49:02.727959 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:02.727939 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6b307bc-f679-45e3-b83f-a7abf2a3e49a-bundle" (OuterVolumeSpecName: "bundle") pod "c6b307bc-f679-45e3-b83f-a7abf2a3e49a" (UID: "c6b307bc-f679-45e3-b83f-a7abf2a3e49a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:49:02.828124 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:02.828095 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4bdb\" (UniqueName: \"kubernetes.io/projected/c6b307bc-f679-45e3-b83f-a7abf2a3e49a-kube-api-access-z4bdb\") pod \"c6b307bc-f679-45e3-b83f-a7abf2a3e49a\" (UID: \"c6b307bc-f679-45e3-b83f-a7abf2a3e49a\") " Jun 08 13:49:02.828310 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:02.828131 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6b307bc-f679-45e3-b83f-a7abf2a3e49a-util\") pod \"c6b307bc-f679-45e3-b83f-a7abf2a3e49a\" (UID: \"c6b307bc-f679-45e3-b83f-a7abf2a3e49a\") " Jun 08 13:49:02.828381 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:02.828325 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6b307bc-f679-45e3-b83f-a7abf2a3e49a-bundle\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:49:02.830120 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:02.830096 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6b307bc-f679-45e3-b83f-a7abf2a3e49a-kube-api-access-z4bdb" (OuterVolumeSpecName: "kube-api-access-z4bdb") pod "c6b307bc-f679-45e3-b83f-a7abf2a3e49a" (UID: "c6b307bc-f679-45e3-b83f-a7abf2a3e49a"). InnerVolumeSpecName "kube-api-access-z4bdb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:49:02.928850 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:02.928827 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4bdb\" (UniqueName: \"kubernetes.io/projected/c6b307bc-f679-45e3-b83f-a7abf2a3e49a-kube-api-access-z4bdb\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:49:03.250016 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:03.249983 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avv42m" event={"ID":"c6b307bc-f679-45e3-b83f-a7abf2a3e49a","Type":"ContainerDied","Data":"7d9849d7a88835aa5f5ffb3f976e93fea06ecaa83b1968f34607466c14daf05e"} Jun 08 13:49:03.250173 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:03.250032 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762avv42m" Jun 08 13:49:03.250173 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:03.250038 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d9849d7a88835aa5f5ffb3f976e93fea06ecaa83b1968f34607466c14daf05e" Jun 08 13:49:03.822415 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:03.822374 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6b307bc-f679-45e3-b83f-a7abf2a3e49a-util" (OuterVolumeSpecName: "util") pod "c6b307bc-f679-45e3-b83f-a7abf2a3e49a" (UID: "c6b307bc-f679-45e3-b83f-a7abf2a3e49a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:49:03.836312 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:03.836283 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6b307bc-f679-45e3-b83f-a7abf2a3e49a-util\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:49:04.259303 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:04.259269 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7cc5c547d9-49ng9" event={"ID":"da9b7e87-b6b4-420b-8761-e977279d50bc","Type":"ContainerStarted","Data":"0edcbd48089894f75576fe5814b84da9bc801f79470d589983dc8814cd0b1e81"} Jun 08 13:49:05.266434 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:05.266369 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-d88hf" event={"ID":"895094f3-3b52-4a9f-b7b3-7494437cd4ca","Type":"ContainerStarted","Data":"f0457cf43d42923f472f4ac00bf1c41479f5ead11ffa3af8ce9668ed9ed911ab"} Jun 08 13:49:05.321113 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:05.321063 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7cc5c547d9-49ng9" podStartSLOduration=3.157257844 podStartE2EDuration="6.321044531s" totalImagesPullingTime="3.163786687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:48:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:49:04.296716895 +0000 UTC m=+358.277745163" watchObservedRunningTime="2026-06-08 13:49:05.321044531 +0000 UTC m=+359.302072799" Jun 08 13:49:05.321503 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:05.321483 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-d88hf" podStartSLOduration=1.578237781 podStartE2EDuration="5.321476289s" totalImagesPullingTime="3.743238508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:49:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:49:05.318154129 +0000 UTC m=+359.299182419" watchObservedRunningTime="2026-06-08 13:49:05.321476289 +0000 UTC m=+359.302504558" Jun 08 13:49:06.271455 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:06.271429 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-d88hf" Jun 08 13:49:08.587851 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.587808 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-c97s2"] Jun 08 13:49:08.588287 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.588145 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6b307bc-f679-45e3-b83f-a7abf2a3e49a" containerName="pull" Jun 08 13:49:08.588287 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.588157 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6b307bc-f679-45e3-b83f-a7abf2a3e49a" containerName="pull" Jun 08 13:49:08.588287 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.588173 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6b307bc-f679-45e3-b83f-a7abf2a3e49a" containerName="util" Jun 08 13:49:08.588287 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.588179 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6b307bc-f679-45e3-b83f-a7abf2a3e49a" containerName="util" Jun 08 13:49:08.588287 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.588190 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6b307bc-f679-45e3-b83f-a7abf2a3e49a" containerName="extract" Jun 08 13:49:08.588287 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.588195 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6b307bc-f679-45e3-b83f-a7abf2a3e49a" containerName="extract" Jun 08 13:49:08.588287 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.588253 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6b307bc-f679-45e3-b83f-a7abf2a3e49a" containerName="extract" Jun 08 13:49:08.591359 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.591337 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c97s2" Jun 08 13:49:08.599585 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.599565 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 08 13:49:08.599964 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.599948 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 08 13:49:08.599964 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.599958 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 08 13:49:08.600239 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.600221 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 08 13:49:08.600239 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.600232 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-z959h\"" Jun 08 13:49:08.624696 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.624667 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:08.630421 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.630401 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-c97s2"] Jun 08 13:49:08.674074 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.674050 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0727bf58-fe74-4801-b4b1-e717f5e39ead-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-c97s2\" (UID: \"0727bf58-fe74-4801-b4b1-e717f5e39ead\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c97s2" Jun 08 13:49:08.674197 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.674087 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0727bf58-fe74-4801-b4b1-e717f5e39ead-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-c97s2\" (UID: \"0727bf58-fe74-4801-b4b1-e717f5e39ead\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c97s2" Jun 08 13:49:08.674264 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.674208 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0727bf58-fe74-4801-b4b1-e717f5e39ead-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-c97s2\" (UID: \"0727bf58-fe74-4801-b4b1-e717f5e39ead\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c97s2" Jun 08 13:49:08.674264 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.674234 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lht8\" (UniqueName: \"kubernetes.io/projected/0727bf58-fe74-4801-b4b1-e717f5e39ead-kube-api-access-7lht8\") pod \"istiod-openshift-gateway-75c67f8887-c97s2\" (UID: \"0727bf58-fe74-4801-b4b1-e717f5e39ead\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c97s2" Jun 08 13:49:08.674371 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.674276 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0727bf58-fe74-4801-b4b1-e717f5e39ead-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-c97s2\" (UID: \"0727bf58-fe74-4801-b4b1-e717f5e39ead\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c97s2" Jun 08 13:49:08.674371 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.674310 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0727bf58-fe74-4801-b4b1-e717f5e39ead-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-c97s2\" (UID: \"0727bf58-fe74-4801-b4b1-e717f5e39ead\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c97s2" Jun 08 13:49:08.674371 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.674345 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0727bf58-fe74-4801-b4b1-e717f5e39ead-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-c97s2\" (UID: \"0727bf58-fe74-4801-b4b1-e717f5e39ead\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c97s2" Jun 08 13:49:08.775247 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.775222 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0727bf58-fe74-4801-b4b1-e717f5e39ead-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-c97s2\" (UID: \"0727bf58-fe74-4801-b4b1-e717f5e39ead\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c97s2" Jun 08 13:49:08.775382 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.775249 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0727bf58-fe74-4801-b4b1-e717f5e39ead-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-c97s2\" (UID: \"0727bf58-fe74-4801-b4b1-e717f5e39ead\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c97s2" Jun 08 13:49:08.775455 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.775409 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0727bf58-fe74-4801-b4b1-e717f5e39ead-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-c97s2\" (UID: \"0727bf58-fe74-4801-b4b1-e717f5e39ead\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c97s2" Jun 08 13:49:08.775510 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.775458 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lht8\" (UniqueName: \"kubernetes.io/projected/0727bf58-fe74-4801-b4b1-e717f5e39ead-kube-api-access-7lht8\") pod \"istiod-openshift-gateway-75c67f8887-c97s2\" (UID: \"0727bf58-fe74-4801-b4b1-e717f5e39ead\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c97s2" Jun 08 13:49:08.775510 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.775503 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0727bf58-fe74-4801-b4b1-e717f5e39ead-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-c97s2\" (UID: \"0727bf58-fe74-4801-b4b1-e717f5e39ead\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c97s2" Jun 08 13:49:08.775613 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.775536 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0727bf58-fe74-4801-b4b1-e717f5e39ead-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-c97s2\" (UID: \"0727bf58-fe74-4801-b4b1-e717f5e39ead\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c97s2" Jun 08 13:49:08.775613 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.775569 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0727bf58-fe74-4801-b4b1-e717f5e39ead-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-c97s2\" (UID: \"0727bf58-fe74-4801-b4b1-e717f5e39ead\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c97s2" Jun 08 13:49:08.776234 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.776208 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0727bf58-fe74-4801-b4b1-e717f5e39ead-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-c97s2\" (UID: \"0727bf58-fe74-4801-b4b1-e717f5e39ead\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c97s2" Jun 08 13:49:08.777708 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.777689 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0727bf58-fe74-4801-b4b1-e717f5e39ead-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-c97s2\" (UID: \"0727bf58-fe74-4801-b4b1-e717f5e39ead\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c97s2" Jun 08 13:49:08.777833 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.777807 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0727bf58-fe74-4801-b4b1-e717f5e39ead-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-c97s2\" (UID: \"0727bf58-fe74-4801-b4b1-e717f5e39ead\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c97s2" Jun 08 13:49:08.777899 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.777813 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0727bf58-fe74-4801-b4b1-e717f5e39ead-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-c97s2\" (UID: \"0727bf58-fe74-4801-b4b1-e717f5e39ead\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c97s2" Jun 08 13:49:08.777899 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.777857 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0727bf58-fe74-4801-b4b1-e717f5e39ead-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-c97s2\" (UID: \"0727bf58-fe74-4801-b4b1-e717f5e39ead\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c97s2" Jun 08 13:49:08.785459 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.785435 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:08.788218 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.788201 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0727bf58-fe74-4801-b4b1-e717f5e39ead-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-c97s2\" (UID: \"0727bf58-fe74-4801-b4b1-e717f5e39ead\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c97s2" Jun 08 13:49:08.788581 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.788561 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lht8\" (UniqueName: \"kubernetes.io/projected/0727bf58-fe74-4801-b4b1-e717f5e39ead-kube-api-access-7lht8\") pod \"istiod-openshift-gateway-75c67f8887-c97s2\" (UID: \"0727bf58-fe74-4801-b4b1-e717f5e39ead\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c97s2" Jun 08 13:49:08.901193 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:08.901166 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c97s2" Jun 08 13:49:09.110662 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:09.110637 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-c97s2"] Jun 08 13:49:09.112707 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:49:09.112681 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0727bf58_fe74_4801_b4b1_e717f5e39ead.slice/crio-b2d80e7ddb9e60852c85c8bc4a6eb426728705882ba7173652b30eb87000b580 WatchSource:0}: Error finding container b2d80e7ddb9e60852c85c8bc4a6eb426728705882ba7173652b30eb87000b580: Status 404 returned error can't find the container with id b2d80e7ddb9e60852c85c8bc4a6eb426728705882ba7173652b30eb87000b580 Jun 08 13:49:09.202305 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:09.202197 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:09.294441 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:09.294398 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c97s2" event={"ID":"0727bf58-fe74-4801-b4b1-e717f5e39ead","Type":"ContainerStarted","Data":"b2d80e7ddb9e60852c85c8bc4a6eb426728705882ba7173652b30eb87000b580"} Jun 08 13:49:09.486652 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:09.486562 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:09.816414 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:09.816338 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:12.694195 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:12.694160 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 13:49:12.694455 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:12.694225 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 13:49:13.239331 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:13.239292 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:13.320435 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:13.320403 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c97s2" event={"ID":"0727bf58-fe74-4801-b4b1-e717f5e39ead","Type":"ContainerStarted","Data":"2171d459e850c2ec7ce9049a29a2e5c2aae1f7e63b694245d8b28b9937a47d5c"} Jun 08 13:49:13.320631 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:13.320476 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c97s2" Jun 08 13:49:13.322298 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:13.322251 2561 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-c97s2 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 08 13:49:13.322432 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:13.322354 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c97s2" podUID="0727bf58-fe74-4801-b4b1-e717f5e39ead" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 13:49:13.339018 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:13.338985 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:13.347455 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:13.347406 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c97s2" podStartSLOduration=1.768295307 podStartE2EDuration="5.347392859s" totalImagesPullingTime="3.579097552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:49:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:49:13.343966519 +0000 UTC m=+367.324994788" watchObservedRunningTime="2026-06-08 13:49:13.347392859 +0000 UTC m=+367.328421128" Jun 08 13:49:13.546173 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:13.546080 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:13.807165 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:13.807080 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:13.899409 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:13.899380 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:14.326183 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:14.326153 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c97s2" Jun 08 13:49:14.799997 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:14.799969 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:17.278865 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:17.278838 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-d88hf" Jun 08 13:49:18.159190 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:18.159161 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-sgp8p" Jun 08 13:49:18.162185 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:18.162162 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-29g7k" Jun 08 13:49:31.432517 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:31.432463 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:31.532573 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:31.532523 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:31.805085 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:31.804982 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:31.899366 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:31.899330 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:32.005714 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:32.005683 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:33.477750 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:33.477715 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:33.577408 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:33.577383 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:47.323398 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:47.323364 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr"] Jun 08 13:49:47.344513 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:47.344481 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr"] Jun 08 13:49:47.344651 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:47.344619 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr" Jun 08 13:49:47.347598 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:47.347574 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ds8z6\"" Jun 08 13:49:47.347723 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:47.347616 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 08 13:49:47.348801 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:47.348786 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 08 13:49:47.496573 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:47.496544 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fdbeac15-42f8-44da-9b0e-05082c488dc8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr\" (UID: \"fdbeac15-42f8-44da-9b0e-05082c488dc8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr" Jun 08 13:49:47.496730 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:47.496590 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fdbeac15-42f8-44da-9b0e-05082c488dc8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr\" (UID: \"fdbeac15-42f8-44da-9b0e-05082c488dc8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr" Jun 08 13:49:47.496730 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:47.496653 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbfr4\" (UniqueName: \"kubernetes.io/projected/fdbeac15-42f8-44da-9b0e-05082c488dc8-kube-api-access-wbfr4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr\" (UID: \"fdbeac15-42f8-44da-9b0e-05082c488dc8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr" Jun 08 13:49:47.603096 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:47.603026 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fdbeac15-42f8-44da-9b0e-05082c488dc8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr\" (UID: \"fdbeac15-42f8-44da-9b0e-05082c488dc8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr" Jun 08 13:49:47.603096 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:47.603056 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fdbeac15-42f8-44da-9b0e-05082c488dc8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr\" (UID: \"fdbeac15-42f8-44da-9b0e-05082c488dc8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr" Jun 08 13:49:47.603303 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:47.603097 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbfr4\" (UniqueName: \"kubernetes.io/projected/fdbeac15-42f8-44da-9b0e-05082c488dc8-kube-api-access-wbfr4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr\" (UID: \"fdbeac15-42f8-44da-9b0e-05082c488dc8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr" Jun 08 13:49:47.603462 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:47.603431 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fdbeac15-42f8-44da-9b0e-05082c488dc8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr\" (UID: \"fdbeac15-42f8-44da-9b0e-05082c488dc8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr" Jun 08 13:49:47.603545 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:47.603502 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fdbeac15-42f8-44da-9b0e-05082c488dc8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr\" (UID: \"fdbeac15-42f8-44da-9b0e-05082c488dc8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr" Jun 08 13:49:47.612326 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:47.612304 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbfr4\" (UniqueName: \"kubernetes.io/projected/fdbeac15-42f8-44da-9b0e-05082c488dc8-kube-api-access-wbfr4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr\" (UID: \"fdbeac15-42f8-44da-9b0e-05082c488dc8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr" Jun 08 13:49:47.654491 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:47.654472 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr" Jun 08 13:49:47.785938 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:47.785912 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr"] Jun 08 13:49:47.787806 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:49:47.787755 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdbeac15_42f8_44da_9b0e_05082c488dc8.slice/crio-a5685f884db6f5ba1c518d2e271b2429fcb83d6cdb640b9fe50531b84e479fd2 WatchSource:0}: Error finding container a5685f884db6f5ba1c518d2e271b2429fcb83d6cdb640b9fe50531b84e479fd2: Status 404 returned error can't find the container with id a5685f884db6f5ba1c518d2e271b2429fcb83d6cdb640b9fe50531b84e479fd2 Jun 08 13:49:47.914555 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:47.914531 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5"] Jun 08 13:49:47.918063 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:47.918047 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5" Jun 08 13:49:47.927340 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:47.927319 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5"] Jun 08 13:49:48.107149 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.107122 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0522c72-75db-4010-adc3-f21e71690dc1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5\" (UID: \"b0522c72-75db-4010-adc3-f21e71690dc1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5" Jun 08 13:49:48.107149 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.107160 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0522c72-75db-4010-adc3-f21e71690dc1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5\" (UID: \"b0522c72-75db-4010-adc3-f21e71690dc1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5" Jun 08 13:49:48.107362 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.107191 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w244j\" (UniqueName: \"kubernetes.io/projected/b0522c72-75db-4010-adc3-f21e71690dc1-kube-api-access-w244j\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5\" (UID: \"b0522c72-75db-4010-adc3-f21e71690dc1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5" Jun 08 13:49:48.207849 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.207757 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0522c72-75db-4010-adc3-f21e71690dc1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5\" (UID: \"b0522c72-75db-4010-adc3-f21e71690dc1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5" Jun 08 13:49:48.207849 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.207820 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0522c72-75db-4010-adc3-f21e71690dc1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5\" (UID: \"b0522c72-75db-4010-adc3-f21e71690dc1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5" Jun 08 13:49:48.208070 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.207853 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w244j\" (UniqueName: \"kubernetes.io/projected/b0522c72-75db-4010-adc3-f21e71690dc1-kube-api-access-w244j\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5\" (UID: \"b0522c72-75db-4010-adc3-f21e71690dc1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5" Jun 08 13:49:48.208211 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.208188 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0522c72-75db-4010-adc3-f21e71690dc1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5\" (UID: \"b0522c72-75db-4010-adc3-f21e71690dc1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5" Jun 08 13:49:48.208262 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.208228 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0522c72-75db-4010-adc3-f21e71690dc1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5\" (UID: \"b0522c72-75db-4010-adc3-f21e71690dc1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5" Jun 08 13:49:48.219985 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.219961 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w244j\" (UniqueName: \"kubernetes.io/projected/b0522c72-75db-4010-adc3-f21e71690dc1-kube-api-access-w244j\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5\" (UID: \"b0522c72-75db-4010-adc3-f21e71690dc1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5" Jun 08 13:49:48.256789 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.256757 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5" Jun 08 13:49:48.313876 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.313372 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp"] Jun 08 13:49:48.321206 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.321178 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp" Jun 08 13:49:48.326617 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.326593 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp"] Jun 08 13:49:48.393484 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.393462 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5"] Jun 08 13:49:48.394797 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:49:48.394757 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0522c72_75db_4010_adc3_f21e71690dc1.slice/crio-96763f0d5ec37db10089e1304c5ae2bbde4a835eb878c8ea2d29888018f9a461 WatchSource:0}: Error finding container 96763f0d5ec37db10089e1304c5ae2bbde4a835eb878c8ea2d29888018f9a461: Status 404 returned error can't find the container with id 96763f0d5ec37db10089e1304c5ae2bbde4a835eb878c8ea2d29888018f9a461 Jun 08 13:49:48.503336 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.503312 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5" event={"ID":"b0522c72-75db-4010-adc3-f21e71690dc1","Type":"ContainerStarted","Data":"b9fc39699b6c8c5e5e113a2c5cd56c98fcb7c46f4d5d5177e2c08f86f6c8c542"} Jun 08 13:49:48.503477 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.503352 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5" event={"ID":"b0522c72-75db-4010-adc3-f21e71690dc1","Type":"ContainerStarted","Data":"96763f0d5ec37db10089e1304c5ae2bbde4a835eb878c8ea2d29888018f9a461"} Jun 08 13:49:48.504861 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.504837 2561 generic.go:356] "Generic (PLEG): container finished" podID="fdbeac15-42f8-44da-9b0e-05082c488dc8" containerID="3d533b45e1c04a567bc3a33d0032e30480a1a3ffb9d4883d7ce8d979ce62b507" exitCode=0 Jun 08 13:49:48.504930 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.504876 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr" event={"ID":"fdbeac15-42f8-44da-9b0e-05082c488dc8","Type":"ContainerDied","Data":"3d533b45e1c04a567bc3a33d0032e30480a1a3ffb9d4883d7ce8d979ce62b507"} Jun 08 13:49:48.504930 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.504903 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr" event={"ID":"fdbeac15-42f8-44da-9b0e-05082c488dc8","Type":"ContainerStarted","Data":"a5685f884db6f5ba1c518d2e271b2429fcb83d6cdb640b9fe50531b84e479fd2"} Jun 08 13:49:48.510408 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.510386 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba63d5c3-f1a4-4819-8bee-4756cede16eb-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp\" (UID: \"ba63d5c3-f1a4-4819-8bee-4756cede16eb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp" Jun 08 13:49:48.510507 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.510426 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba63d5c3-f1a4-4819-8bee-4756cede16eb-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp\" (UID: \"ba63d5c3-f1a4-4819-8bee-4756cede16eb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp" Jun 08 13:49:48.510507 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.510453 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8l4m\" (UniqueName: \"kubernetes.io/projected/ba63d5c3-f1a4-4819-8bee-4756cede16eb-kube-api-access-q8l4m\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp\" (UID: \"ba63d5c3-f1a4-4819-8bee-4756cede16eb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp" Jun 08 13:49:48.611551 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.611524 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba63d5c3-f1a4-4819-8bee-4756cede16eb-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp\" (UID: \"ba63d5c3-f1a4-4819-8bee-4756cede16eb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp" Jun 08 13:49:48.611666 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.611591 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba63d5c3-f1a4-4819-8bee-4756cede16eb-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp\" (UID: \"ba63d5c3-f1a4-4819-8bee-4756cede16eb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp" Jun 08 13:49:48.611735 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.611658 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8l4m\" (UniqueName: \"kubernetes.io/projected/ba63d5c3-f1a4-4819-8bee-4756cede16eb-kube-api-access-q8l4m\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp\" (UID: \"ba63d5c3-f1a4-4819-8bee-4756cede16eb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp" Jun 08 13:49:48.612006 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.611980 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba63d5c3-f1a4-4819-8bee-4756cede16eb-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp\" (UID: \"ba63d5c3-f1a4-4819-8bee-4756cede16eb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp" Jun 08 13:49:48.612087 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.612031 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba63d5c3-f1a4-4819-8bee-4756cede16eb-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp\" (UID: \"ba63d5c3-f1a4-4819-8bee-4756cede16eb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp" Jun 08 13:49:48.623392 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.623365 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8l4m\" (UniqueName: \"kubernetes.io/projected/ba63d5c3-f1a4-4819-8bee-4756cede16eb-kube-api-access-q8l4m\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp\" (UID: \"ba63d5c3-f1a4-4819-8bee-4756cede16eb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp" Jun 08 13:49:48.632126 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.632109 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp" Jun 08 13:49:48.718406 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.718140 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps"] Jun 08 13:49:48.726206 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.726186 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps" Jun 08 13:49:48.731309 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.731283 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps"] Jun 08 13:49:48.770863 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.770840 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp"] Jun 08 13:49:48.772551 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:49:48.772525 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba63d5c3_f1a4_4819_8bee_4756cede16eb.slice/crio-1967bfa78056789cdef738ddd0fbaf49d4d9173b0be27f6387480fdcb1c46a43 WatchSource:0}: Error finding container 1967bfa78056789cdef738ddd0fbaf49d4d9173b0be27f6387480fdcb1c46a43: Status 404 returned error can't find the container with id 1967bfa78056789cdef738ddd0fbaf49d4d9173b0be27f6387480fdcb1c46a43 Jun 08 13:49:48.914201 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.914175 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg5fl\" (UniqueName: \"kubernetes.io/projected/495a65a8-dc4f-4bda-be1f-271aabdadb43-kube-api-access-qg5fl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps\" (UID: \"495a65a8-dc4f-4bda-be1f-271aabdadb43\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps" Jun 08 13:49:48.914300 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.914214 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/495a65a8-dc4f-4bda-be1f-271aabdadb43-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps\" (UID: \"495a65a8-dc4f-4bda-be1f-271aabdadb43\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps" Jun 08 13:49:48.914338 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:48.914308 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/495a65a8-dc4f-4bda-be1f-271aabdadb43-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps\" (UID: \"495a65a8-dc4f-4bda-be1f-271aabdadb43\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps" Jun 08 13:49:49.015541 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:49.015508 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg5fl\" (UniqueName: \"kubernetes.io/projected/495a65a8-dc4f-4bda-be1f-271aabdadb43-kube-api-access-qg5fl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps\" (UID: \"495a65a8-dc4f-4bda-be1f-271aabdadb43\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps" Jun 08 13:49:49.015665 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:49.015550 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/495a65a8-dc4f-4bda-be1f-271aabdadb43-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps\" (UID: \"495a65a8-dc4f-4bda-be1f-271aabdadb43\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps" Jun 08 13:49:49.015665 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:49.015620 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/495a65a8-dc4f-4bda-be1f-271aabdadb43-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps\" (UID: \"495a65a8-dc4f-4bda-be1f-271aabdadb43\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps" Jun 08 13:49:49.015949 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:49.015927 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/495a65a8-dc4f-4bda-be1f-271aabdadb43-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps\" (UID: \"495a65a8-dc4f-4bda-be1f-271aabdadb43\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps" Jun 08 13:49:49.016004 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:49.015979 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/495a65a8-dc4f-4bda-be1f-271aabdadb43-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps\" (UID: \"495a65a8-dc4f-4bda-be1f-271aabdadb43\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps" Jun 08 13:49:49.024568 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:49.024498 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg5fl\" (UniqueName: \"kubernetes.io/projected/495a65a8-dc4f-4bda-be1f-271aabdadb43-kube-api-access-qg5fl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps\" (UID: \"495a65a8-dc4f-4bda-be1f-271aabdadb43\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps" Jun 08 13:49:49.039369 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:49.039350 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps" Jun 08 13:49:49.176586 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:49.176559 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps"] Jun 08 13:49:49.182404 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:49:49.182374 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod495a65a8_dc4f_4bda_be1f_271aabdadb43.slice/crio-d056a6db378aaaf177f30fd965252aa03f5323907e13458de2267c5b7072c3c6 WatchSource:0}: Error finding container d056a6db378aaaf177f30fd965252aa03f5323907e13458de2267c5b7072c3c6: Status 404 returned error can't find the container with id d056a6db378aaaf177f30fd965252aa03f5323907e13458de2267c5b7072c3c6 Jun 08 13:49:49.511657 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:49.511632 2561 generic.go:356] "Generic (PLEG): container finished" podID="fdbeac15-42f8-44da-9b0e-05082c488dc8" containerID="1cf9dade9fe1b5dd1fdc7341d5e476fab3e899ddd689bec83f19090d869102f9" exitCode=0 Jun 08 13:49:49.511989 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:49.511714 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr" event={"ID":"fdbeac15-42f8-44da-9b0e-05082c488dc8","Type":"ContainerDied","Data":"1cf9dade9fe1b5dd1fdc7341d5e476fab3e899ddd689bec83f19090d869102f9"} Jun 08 13:49:49.513344 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:49.513325 2561 generic.go:356] "Generic (PLEG): container finished" podID="495a65a8-dc4f-4bda-be1f-271aabdadb43" containerID="2837153d5c835209ffce675e939afb297f4dc0a35d2ecbcb4bdedbb57ffd9a88" exitCode=0 Jun 08 13:49:49.513430 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:49.513406 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps" event={"ID":"495a65a8-dc4f-4bda-be1f-271aabdadb43","Type":"ContainerDied","Data":"2837153d5c835209ffce675e939afb297f4dc0a35d2ecbcb4bdedbb57ffd9a88"} Jun 08 13:49:49.513501 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:49.513455 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps" event={"ID":"495a65a8-dc4f-4bda-be1f-271aabdadb43","Type":"ContainerStarted","Data":"d056a6db378aaaf177f30fd965252aa03f5323907e13458de2267c5b7072c3c6"} Jun 08 13:49:49.515334 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:49.515311 2561 generic.go:356] "Generic (PLEG): container finished" podID="b0522c72-75db-4010-adc3-f21e71690dc1" containerID="b9fc39699b6c8c5e5e113a2c5cd56c98fcb7c46f4d5d5177e2c08f86f6c8c542" exitCode=0 Jun 08 13:49:49.515334 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:49.515333 2561 generic.go:356] "Generic (PLEG): container finished" podID="b0522c72-75db-4010-adc3-f21e71690dc1" containerID="eb942de7b69e06659d64b64f0e35317c74b06ad300ecb5120a349a055bc90e4a" exitCode=0 Jun 08 13:49:49.515518 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:49.515389 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5" event={"ID":"b0522c72-75db-4010-adc3-f21e71690dc1","Type":"ContainerDied","Data":"b9fc39699b6c8c5e5e113a2c5cd56c98fcb7c46f4d5d5177e2c08f86f6c8c542"} Jun 08 13:49:49.515518 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:49.515449 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5" event={"ID":"b0522c72-75db-4010-adc3-f21e71690dc1","Type":"ContainerDied","Data":"eb942de7b69e06659d64b64f0e35317c74b06ad300ecb5120a349a055bc90e4a"} Jun 08 13:49:49.517181 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:49.517158 2561 generic.go:356] "Generic (PLEG): container finished" podID="ba63d5c3-f1a4-4819-8bee-4756cede16eb" containerID="c3f06fb99aa1be47619b4cfa9b011ace4ec14341eda8abeea619fbff07287849" exitCode=0 Jun 08 13:49:49.517299 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:49.517282 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp" event={"ID":"ba63d5c3-f1a4-4819-8bee-4756cede16eb","Type":"ContainerDied","Data":"c3f06fb99aa1be47619b4cfa9b011ace4ec14341eda8abeea619fbff07287849"} Jun 08 13:49:49.517364 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:49.517316 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp" event={"ID":"ba63d5c3-f1a4-4819-8bee-4756cede16eb","Type":"ContainerStarted","Data":"1967bfa78056789cdef738ddd0fbaf49d4d9173b0be27f6387480fdcb1c46a43"} Jun 08 13:49:50.524178 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:50.524118 2561 generic.go:356] "Generic (PLEG): container finished" podID="495a65a8-dc4f-4bda-be1f-271aabdadb43" containerID="82a6662b71b60832e69e51a7f2c94b39feb5f4db6680252c7fcd2c0ff739eaa3" exitCode=0 Jun 08 13:49:50.524511 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:50.524210 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps" event={"ID":"495a65a8-dc4f-4bda-be1f-271aabdadb43","Type":"ContainerDied","Data":"82a6662b71b60832e69e51a7f2c94b39feb5f4db6680252c7fcd2c0ff739eaa3"} Jun 08 13:49:50.526497 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:50.526471 2561 generic.go:356] "Generic (PLEG): container finished" podID="b0522c72-75db-4010-adc3-f21e71690dc1" containerID="a97e50da46928c49a8bf9ae5c646c6d3516312436a6afd91406c83c9a3cc19ed" exitCode=0 Jun 08 13:49:50.526600 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:50.526526 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5" event={"ID":"b0522c72-75db-4010-adc3-f21e71690dc1","Type":"ContainerDied","Data":"a97e50da46928c49a8bf9ae5c646c6d3516312436a6afd91406c83c9a3cc19ed"} Jun 08 13:49:50.528309 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:50.528288 2561 generic.go:356] "Generic (PLEG): container finished" podID="ba63d5c3-f1a4-4819-8bee-4756cede16eb" containerID="65150df73ebd0409fe8937f450377f474291122d1bf0f4cb1801e06b4f003428" exitCode=0 Jun 08 13:49:50.528412 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:50.528365 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp" event={"ID":"ba63d5c3-f1a4-4819-8bee-4756cede16eb","Type":"ContainerDied","Data":"65150df73ebd0409fe8937f450377f474291122d1bf0f4cb1801e06b4f003428"} Jun 08 13:49:50.530879 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:50.530863 2561 generic.go:356] "Generic (PLEG): container finished" podID="fdbeac15-42f8-44da-9b0e-05082c488dc8" containerID="f781599e5055116f56acade6a8311c0be45f61d4e7e4777b8772f698607e73af" exitCode=0 Jun 08 13:49:50.530969 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:50.530892 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr" event={"ID":"fdbeac15-42f8-44da-9b0e-05082c488dc8","Type":"ContainerDied","Data":"f781599e5055116f56acade6a8311c0be45f61d4e7e4777b8772f698607e73af"} Jun 08 13:49:51.538041 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:51.538009 2561 generic.go:356] "Generic (PLEG): container finished" podID="495a65a8-dc4f-4bda-be1f-271aabdadb43" containerID="6fe31833299fd9da8d285dd2d38b612f06bb86d25d14dee3bbe6a663471baadf" exitCode=0 Jun 08 13:49:51.538537 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:51.538094 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps" event={"ID":"495a65a8-dc4f-4bda-be1f-271aabdadb43","Type":"ContainerDied","Data":"6fe31833299fd9da8d285dd2d38b612f06bb86d25d14dee3bbe6a663471baadf"} Jun 08 13:49:51.540092 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:51.540068 2561 generic.go:356] "Generic (PLEG): container finished" podID="ba63d5c3-f1a4-4819-8bee-4756cede16eb" containerID="7159c46300bc68850f5eb68fca7cecb9e37842262fde26dfea4b0c650f947a3c" exitCode=0 Jun 08 13:49:51.540235 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:51.540146 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp" event={"ID":"ba63d5c3-f1a4-4819-8bee-4756cede16eb","Type":"ContainerDied","Data":"7159c46300bc68850f5eb68fca7cecb9e37842262fde26dfea4b0c650f947a3c"} Jun 08 13:49:51.671997 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:51.671973 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5" Jun 08 13:49:51.705484 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:51.705463 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr" Jun 08 13:49:51.838471 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:51.838406 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fdbeac15-42f8-44da-9b0e-05082c488dc8-bundle\") pod \"fdbeac15-42f8-44da-9b0e-05082c488dc8\" (UID: \"fdbeac15-42f8-44da-9b0e-05082c488dc8\") " Jun 08 13:49:51.838471 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:51.838436 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w244j\" (UniqueName: \"kubernetes.io/projected/b0522c72-75db-4010-adc3-f21e71690dc1-kube-api-access-w244j\") pod \"b0522c72-75db-4010-adc3-f21e71690dc1\" (UID: \"b0522c72-75db-4010-adc3-f21e71690dc1\") " Jun 08 13:49:51.838648 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:51.838476 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0522c72-75db-4010-adc3-f21e71690dc1-bundle\") pod \"b0522c72-75db-4010-adc3-f21e71690dc1\" (UID: \"b0522c72-75db-4010-adc3-f21e71690dc1\") " Jun 08 13:49:51.838648 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:51.838507 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0522c72-75db-4010-adc3-f21e71690dc1-util\") pod \"b0522c72-75db-4010-adc3-f21e71690dc1\" (UID: \"b0522c72-75db-4010-adc3-f21e71690dc1\") " Jun 08 13:49:51.838648 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:51.838565 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fdbeac15-42f8-44da-9b0e-05082c488dc8-util\") pod \"fdbeac15-42f8-44da-9b0e-05082c488dc8\" (UID: \"fdbeac15-42f8-44da-9b0e-05082c488dc8\") " Jun 08 13:49:51.838648 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:51.838582 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbfr4\" (UniqueName: \"kubernetes.io/projected/fdbeac15-42f8-44da-9b0e-05082c488dc8-kube-api-access-wbfr4\") pod \"fdbeac15-42f8-44da-9b0e-05082c488dc8\" (UID: \"fdbeac15-42f8-44da-9b0e-05082c488dc8\") " Jun 08 13:49:51.839031 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:51.839004 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdbeac15-42f8-44da-9b0e-05082c488dc8-bundle" (OuterVolumeSpecName: "bundle") pod "fdbeac15-42f8-44da-9b0e-05082c488dc8" (UID: "fdbeac15-42f8-44da-9b0e-05082c488dc8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:49:51.839200 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:51.839178 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0522c72-75db-4010-adc3-f21e71690dc1-bundle" (OuterVolumeSpecName: "bundle") pod "b0522c72-75db-4010-adc3-f21e71690dc1" (UID: "b0522c72-75db-4010-adc3-f21e71690dc1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:49:51.840675 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:51.840651 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0522c72-75db-4010-adc3-f21e71690dc1-kube-api-access-w244j" (OuterVolumeSpecName: "kube-api-access-w244j") pod "b0522c72-75db-4010-adc3-f21e71690dc1" (UID: "b0522c72-75db-4010-adc3-f21e71690dc1"). InnerVolumeSpecName "kube-api-access-w244j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:49:51.841090 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:51.841076 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdbeac15-42f8-44da-9b0e-05082c488dc8-kube-api-access-wbfr4" (OuterVolumeSpecName: "kube-api-access-wbfr4") pod "fdbeac15-42f8-44da-9b0e-05082c488dc8" (UID: "fdbeac15-42f8-44da-9b0e-05082c488dc8"). InnerVolumeSpecName "kube-api-access-wbfr4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:49:51.845007 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:51.844988 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0522c72-75db-4010-adc3-f21e71690dc1-util" (OuterVolumeSpecName: "util") pod "b0522c72-75db-4010-adc3-f21e71690dc1" (UID: "b0522c72-75db-4010-adc3-f21e71690dc1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:49:51.846298 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:51.846274 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdbeac15-42f8-44da-9b0e-05082c488dc8-util" (OuterVolumeSpecName: "util") pod "fdbeac15-42f8-44da-9b0e-05082c488dc8" (UID: "fdbeac15-42f8-44da-9b0e-05082c488dc8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:49:51.939609 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:51.939586 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fdbeac15-42f8-44da-9b0e-05082c488dc8-util\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:49:51.939698 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:51.939609 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbfr4\" (UniqueName: \"kubernetes.io/projected/fdbeac15-42f8-44da-9b0e-05082c488dc8-kube-api-access-wbfr4\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:49:51.939698 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:51.939620 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fdbeac15-42f8-44da-9b0e-05082c488dc8-bundle\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:49:51.939698 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:51.939629 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w244j\" (UniqueName: \"kubernetes.io/projected/b0522c72-75db-4010-adc3-f21e71690dc1-kube-api-access-w244j\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:49:51.939698 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:51.939636 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0522c72-75db-4010-adc3-f21e71690dc1-bundle\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:49:51.939698 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:51.939645 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0522c72-75db-4010-adc3-f21e71690dc1-util\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:49:52.552740 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:52.552709 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr" Jun 08 13:49:52.553145 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:52.552735 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr" event={"ID":"fdbeac15-42f8-44da-9b0e-05082c488dc8","Type":"ContainerDied","Data":"a5685f884db6f5ba1c518d2e271b2429fcb83d6cdb640b9fe50531b84e479fd2"} Jun 08 13:49:52.553145 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:52.552822 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a5685f884db6f5ba1c518d2e271b2429fcb83d6cdb640b9fe50531b84e479fd2" Jun 08 13:49:52.554986 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:52.554955 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5" event={"ID":"b0522c72-75db-4010-adc3-f21e71690dc1","Type":"ContainerDied","Data":"96763f0d5ec37db10089e1304c5ae2bbde4a835eb878c8ea2d29888018f9a461"} Jun 08 13:49:52.555107 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:52.555002 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96763f0d5ec37db10089e1304c5ae2bbde4a835eb878c8ea2d29888018f9a461" Jun 08 13:49:52.555151 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:52.555134 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5" Jun 08 13:49:52.708539 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:52.708518 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps" Jun 08 13:49:52.710609 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:52.710593 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp" Jun 08 13:49:52.744993 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:52.744906 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba63d5c3-f1a4-4819-8bee-4756cede16eb-bundle\") pod \"ba63d5c3-f1a4-4819-8bee-4756cede16eb\" (UID: \"ba63d5c3-f1a4-4819-8bee-4756cede16eb\") " Jun 08 13:49:52.744993 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:52.744968 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qg5fl\" (UniqueName: \"kubernetes.io/projected/495a65a8-dc4f-4bda-be1f-271aabdadb43-kube-api-access-qg5fl\") pod \"495a65a8-dc4f-4bda-be1f-271aabdadb43\" (UID: \"495a65a8-dc4f-4bda-be1f-271aabdadb43\") " Jun 08 13:49:52.745156 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:52.745011 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/495a65a8-dc4f-4bda-be1f-271aabdadb43-util\") pod \"495a65a8-dc4f-4bda-be1f-271aabdadb43\" (UID: \"495a65a8-dc4f-4bda-be1f-271aabdadb43\") " Jun 08 13:49:52.745156 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:52.745067 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8l4m\" (UniqueName: \"kubernetes.io/projected/ba63d5c3-f1a4-4819-8bee-4756cede16eb-kube-api-access-q8l4m\") pod \"ba63d5c3-f1a4-4819-8bee-4756cede16eb\" (UID: \"ba63d5c3-f1a4-4819-8bee-4756cede16eb\") " Jun 08 13:49:52.745156 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:52.745107 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba63d5c3-f1a4-4819-8bee-4756cede16eb-util\") pod \"ba63d5c3-f1a4-4819-8bee-4756cede16eb\" (UID: \"ba63d5c3-f1a4-4819-8bee-4756cede16eb\") " Jun 08 13:49:52.747898 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:52.745175 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/495a65a8-dc4f-4bda-be1f-271aabdadb43-bundle\") pod \"495a65a8-dc4f-4bda-be1f-271aabdadb43\" (UID: \"495a65a8-dc4f-4bda-be1f-271aabdadb43\") " Jun 08 13:49:52.747898 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:52.746459 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba63d5c3-f1a4-4819-8bee-4756cede16eb-bundle" (OuterVolumeSpecName: "bundle") pod "ba63d5c3-f1a4-4819-8bee-4756cede16eb" (UID: "ba63d5c3-f1a4-4819-8bee-4756cede16eb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:49:52.747898 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:52.747177 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba63d5c3-f1a4-4819-8bee-4756cede16eb-bundle\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:49:52.747898 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:52.747407 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/495a65a8-dc4f-4bda-be1f-271aabdadb43-bundle" (OuterVolumeSpecName: "bundle") pod "495a65a8-dc4f-4bda-be1f-271aabdadb43" (UID: "495a65a8-dc4f-4bda-be1f-271aabdadb43"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:49:52.752354 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:52.752194 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/495a65a8-dc4f-4bda-be1f-271aabdadb43-kube-api-access-qg5fl" (OuterVolumeSpecName: "kube-api-access-qg5fl") pod "495a65a8-dc4f-4bda-be1f-271aabdadb43" (UID: "495a65a8-dc4f-4bda-be1f-271aabdadb43"). InnerVolumeSpecName "kube-api-access-qg5fl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:49:52.752354 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:52.752268 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba63d5c3-f1a4-4819-8bee-4756cede16eb-kube-api-access-q8l4m" (OuterVolumeSpecName: "kube-api-access-q8l4m") pod "ba63d5c3-f1a4-4819-8bee-4756cede16eb" (UID: "ba63d5c3-f1a4-4819-8bee-4756cede16eb"). InnerVolumeSpecName "kube-api-access-q8l4m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:49:52.755129 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:52.755098 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/495a65a8-dc4f-4bda-be1f-271aabdadb43-util" (OuterVolumeSpecName: "util") pod "495a65a8-dc4f-4bda-be1f-271aabdadb43" (UID: "495a65a8-dc4f-4bda-be1f-271aabdadb43"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:49:52.755675 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:52.755646 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba63d5c3-f1a4-4819-8bee-4756cede16eb-util" (OuterVolumeSpecName: "util") pod "ba63d5c3-f1a4-4819-8bee-4756cede16eb" (UID: "ba63d5c3-f1a4-4819-8bee-4756cede16eb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:49:52.848304 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:52.848280 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qg5fl\" (UniqueName: \"kubernetes.io/projected/495a65a8-dc4f-4bda-be1f-271aabdadb43-kube-api-access-qg5fl\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:49:52.848304 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:52.848302 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/495a65a8-dc4f-4bda-be1f-271aabdadb43-util\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:49:52.848441 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:52.848312 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8l4m\" (UniqueName: \"kubernetes.io/projected/ba63d5c3-f1a4-4819-8bee-4756cede16eb-kube-api-access-q8l4m\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:49:52.848441 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:52.848321 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba63d5c3-f1a4-4819-8bee-4756cede16eb-util\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:49:52.848441 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:52.848329 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/495a65a8-dc4f-4bda-be1f-271aabdadb43-bundle\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:49:53.562607 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:53.562571 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps" event={"ID":"495a65a8-dc4f-4bda-be1f-271aabdadb43","Type":"ContainerDied","Data":"d056a6db378aaaf177f30fd965252aa03f5323907e13458de2267c5b7072c3c6"} Jun 08 13:49:53.563036 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:53.562630 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d056a6db378aaaf177f30fd965252aa03f5323907e13458de2267c5b7072c3c6" Jun 08 13:49:53.563036 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:53.562631 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps" Jun 08 13:49:53.564454 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:53.564431 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp" Jun 08 13:49:53.564454 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:53.564436 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp" event={"ID":"ba63d5c3-f1a4-4819-8bee-4756cede16eb","Type":"ContainerDied","Data":"1967bfa78056789cdef738ddd0fbaf49d4d9173b0be27f6387480fdcb1c46a43"} Jun 08 13:49:53.564651 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:53.564476 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1967bfa78056789cdef738ddd0fbaf49d4d9173b0be27f6387480fdcb1c46a43" Jun 08 13:49:54.600160 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:54.600127 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:54.998247 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:54.998217 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:56.283940 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:56.283904 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:59.411547 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:49:59.411514 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:03.308190 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:03.308154 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:04.268456 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:04.268425 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:05.659325 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.659298 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-4pqlh"] Jun 08 13:50:05.659699 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.659616 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="495a65a8-dc4f-4bda-be1f-271aabdadb43" containerName="util" Jun 08 13:50:05.659699 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.659627 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="495a65a8-dc4f-4bda-be1f-271aabdadb43" containerName="util" Jun 08 13:50:05.659699 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.659637 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdbeac15-42f8-44da-9b0e-05082c488dc8" containerName="extract" Jun 08 13:50:05.659699 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.659642 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdbeac15-42f8-44da-9b0e-05082c488dc8" containerName="extract" Jun 08 13:50:05.659699 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.659649 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba63d5c3-f1a4-4819-8bee-4756cede16eb" containerName="pull" Jun 08 13:50:05.659699 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.659655 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba63d5c3-f1a4-4819-8bee-4756cede16eb" containerName="pull" Jun 08 13:50:05.659699 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.659664 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba63d5c3-f1a4-4819-8bee-4756cede16eb" containerName="extract" Jun 08 13:50:05.659699 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.659668 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba63d5c3-f1a4-4819-8bee-4756cede16eb" containerName="extract" Jun 08 13:50:05.659699 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.659678 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="495a65a8-dc4f-4bda-be1f-271aabdadb43" containerName="extract" Jun 08 13:50:05.659699 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.659683 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="495a65a8-dc4f-4bda-be1f-271aabdadb43" containerName="extract" Jun 08 13:50:05.659699 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.659690 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba63d5c3-f1a4-4819-8bee-4756cede16eb" containerName="util" Jun 08 13:50:05.659699 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.659695 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba63d5c3-f1a4-4819-8bee-4756cede16eb" containerName="util" Jun 08 13:50:05.659699 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.659704 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0522c72-75db-4010-adc3-f21e71690dc1" containerName="util" Jun 08 13:50:05.660115 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.659709 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0522c72-75db-4010-adc3-f21e71690dc1" containerName="util" Jun 08 13:50:05.660115 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.659719 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0522c72-75db-4010-adc3-f21e71690dc1" containerName="extract" Jun 08 13:50:05.660115 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.659723 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0522c72-75db-4010-adc3-f21e71690dc1" containerName="extract" Jun 08 13:50:05.660115 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.659732 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdbeac15-42f8-44da-9b0e-05082c488dc8" containerName="util" Jun 08 13:50:05.660115 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.659737 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdbeac15-42f8-44da-9b0e-05082c488dc8" containerName="util" Jun 08 13:50:05.660115 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.659744 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="495a65a8-dc4f-4bda-be1f-271aabdadb43" containerName="pull" Jun 08 13:50:05.660115 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.659749 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="495a65a8-dc4f-4bda-be1f-271aabdadb43" containerName="pull" Jun 08 13:50:05.660115 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.659755 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdbeac15-42f8-44da-9b0e-05082c488dc8" containerName="pull" Jun 08 13:50:05.660115 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.659773 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdbeac15-42f8-44da-9b0e-05082c488dc8" containerName="pull" Jun 08 13:50:05.660115 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.659780 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0522c72-75db-4010-adc3-f21e71690dc1" containerName="pull" Jun 08 13:50:05.660115 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.659784 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0522c72-75db-4010-adc3-f21e71690dc1" containerName="pull" Jun 08 13:50:05.660115 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.659834 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdbeac15-42f8-44da-9b0e-05082c488dc8" containerName="extract" Jun 08 13:50:05.660115 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.659840 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba63d5c3-f1a4-4819-8bee-4756cede16eb" containerName="extract" Jun 08 13:50:05.660115 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.659850 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0522c72-75db-4010-adc3-f21e71690dc1" containerName="extract" Jun 08 13:50:05.660115 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.659856 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="495a65a8-dc4f-4bda-be1f-271aabdadb43" containerName="extract" Jun 08 13:50:05.662957 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.662936 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4pqlh" Jun 08 13:50:05.665822 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.665801 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 08 13:50:05.665921 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.665827 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 08 13:50:05.666886 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.666868 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-zlwzz\"" Jun 08 13:50:05.666982 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.666895 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 08 13:50:05.675030 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.675011 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-4pqlh"] Jun 08 13:50:05.749391 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.749367 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwmgf\" (UniqueName: \"kubernetes.io/projected/867278ef-5321-45af-9185-82605c390596-kube-api-access-xwmgf\") pod \"dns-operator-controller-manager-864dd78c4c-4pqlh\" (UID: \"867278ef-5321-45af-9185-82605c390596\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4pqlh" Jun 08 13:50:05.850621 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.850596 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwmgf\" (UniqueName: \"kubernetes.io/projected/867278ef-5321-45af-9185-82605c390596-kube-api-access-xwmgf\") pod \"dns-operator-controller-manager-864dd78c4c-4pqlh\" (UID: \"867278ef-5321-45af-9185-82605c390596\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4pqlh" Jun 08 13:50:05.889873 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.883690 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwmgf\" (UniqueName: \"kubernetes.io/projected/867278ef-5321-45af-9185-82605c390596-kube-api-access-xwmgf\") pod \"dns-operator-controller-manager-864dd78c4c-4pqlh\" (UID: \"867278ef-5321-45af-9185-82605c390596\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4pqlh" Jun 08 13:50:05.973509 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:05.973454 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4pqlh" Jun 08 13:50:06.117457 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:06.117422 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:06.119158 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:06.119130 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-4pqlh"] Jun 08 13:50:06.119949 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:50:06.119924 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod867278ef_5321_45af_9185_82605c390596.slice/crio-da226d3588e336557c083e09f5f1e88449e34b300f747cc9c0bef4726e1216bf WatchSource:0}: Error finding container da226d3588e336557c083e09f5f1e88449e34b300f747cc9c0bef4726e1216bf: Status 404 returned error can't find the container with id da226d3588e336557c083e09f5f1e88449e34b300f747cc9c0bef4726e1216bf Jun 08 13:50:06.283060 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:06.282978 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:06.633197 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:06.633124 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4pqlh" event={"ID":"867278ef-5321-45af-9185-82605c390596","Type":"ContainerStarted","Data":"da226d3588e336557c083e09f5f1e88449e34b300f747cc9c0bef4726e1216bf"} Jun 08 13:50:08.175828 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:08.175802 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 08 13:50:08.646204 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:08.646171 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4pqlh" event={"ID":"867278ef-5321-45af-9185-82605c390596","Type":"ContainerStarted","Data":"69da891d7f8d2d10c6b49beac529921866ce352cf0a666c4f2ddd5f473795d2a"} Jun 08 13:50:08.646358 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:08.646279 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4pqlh" Jun 08 13:50:08.685370 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:08.685197 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4pqlh" podStartSLOduration=1.635503047 podStartE2EDuration="3.685177289s" totalImagesPullingTime="2.049674242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:50:08.678755147 +0000 UTC m=+422.659783415" watchObservedRunningTime="2026-06-08 13:50:08.685177289 +0000 UTC m=+422.666205559" Jun 08 13:50:08.722708 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:08.722677 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:10.025785 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:10.025735 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:10.126734 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:10.126697 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:10.525286 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:10.525255 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:10.659844 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:10.659807 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:14.092844 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:14.092807 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:14.258823 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:14.258788 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:14.684107 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:14.684071 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:14.864842 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:14.864792 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:15.475683 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:15.475652 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d746b54dd-2f47d"] Jun 08 13:50:15.479553 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:15.479530 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d746b54dd-2f47d" Jun 08 13:50:15.529499 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:15.529470 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/035accbb-8959-4e6a-bbfb-873b6c1c79b5-console-config\") pod \"console-d746b54dd-2f47d\" (UID: \"035accbb-8959-4e6a-bbfb-873b6c1c79b5\") " pod="openshift-console/console-d746b54dd-2f47d" Jun 08 13:50:15.529599 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:15.529514 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/035accbb-8959-4e6a-bbfb-873b6c1c79b5-console-serving-cert\") pod \"console-d746b54dd-2f47d\" (UID: \"035accbb-8959-4e6a-bbfb-873b6c1c79b5\") " pod="openshift-console/console-d746b54dd-2f47d" Jun 08 13:50:15.529599 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:15.529532 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/035accbb-8959-4e6a-bbfb-873b6c1c79b5-console-oauth-config\") pod \"console-d746b54dd-2f47d\" (UID: \"035accbb-8959-4e6a-bbfb-873b6c1c79b5\") " pod="openshift-console/console-d746b54dd-2f47d" Jun 08 13:50:15.529599 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:15.529569 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nkg9\" (UniqueName: \"kubernetes.io/projected/035accbb-8959-4e6a-bbfb-873b6c1c79b5-kube-api-access-4nkg9\") pod \"console-d746b54dd-2f47d\" (UID: \"035accbb-8959-4e6a-bbfb-873b6c1c79b5\") " pod="openshift-console/console-d746b54dd-2f47d" Jun 08 13:50:15.529725 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:15.529619 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/035accbb-8959-4e6a-bbfb-873b6c1c79b5-trusted-ca-bundle\") pod \"console-d746b54dd-2f47d\" (UID: \"035accbb-8959-4e6a-bbfb-873b6c1c79b5\") " pod="openshift-console/console-d746b54dd-2f47d" Jun 08 13:50:15.529725 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:15.529670 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/035accbb-8959-4e6a-bbfb-873b6c1c79b5-oauth-serving-cert\") pod \"console-d746b54dd-2f47d\" (UID: \"035accbb-8959-4e6a-bbfb-873b6c1c79b5\") " pod="openshift-console/console-d746b54dd-2f47d" Jun 08 13:50:15.529725 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:15.529699 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/035accbb-8959-4e6a-bbfb-873b6c1c79b5-service-ca\") pod \"console-d746b54dd-2f47d\" (UID: \"035accbb-8959-4e6a-bbfb-873b6c1c79b5\") " pod="openshift-console/console-d746b54dd-2f47d" Jun 08 13:50:15.588083 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:15.588061 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d746b54dd-2f47d"] Jun 08 13:50:15.625033 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:15.625002 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:15.630943 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:15.630918 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/035accbb-8959-4e6a-bbfb-873b6c1c79b5-oauth-serving-cert\") pod \"console-d746b54dd-2f47d\" (UID: \"035accbb-8959-4e6a-bbfb-873b6c1c79b5\") " pod="openshift-console/console-d746b54dd-2f47d" Jun 08 13:50:15.631049 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:15.630948 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/035accbb-8959-4e6a-bbfb-873b6c1c79b5-service-ca\") pod \"console-d746b54dd-2f47d\" (UID: \"035accbb-8959-4e6a-bbfb-873b6c1c79b5\") " pod="openshift-console/console-d746b54dd-2f47d" Jun 08 13:50:15.631049 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:15.630983 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/035accbb-8959-4e6a-bbfb-873b6c1c79b5-console-config\") pod \"console-d746b54dd-2f47d\" (UID: \"035accbb-8959-4e6a-bbfb-873b6c1c79b5\") " pod="openshift-console/console-d746b54dd-2f47d" Jun 08 13:50:15.631049 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:15.631013 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/035accbb-8959-4e6a-bbfb-873b6c1c79b5-console-serving-cert\") pod \"console-d746b54dd-2f47d\" (UID: \"035accbb-8959-4e6a-bbfb-873b6c1c79b5\") " pod="openshift-console/console-d746b54dd-2f47d" Jun 08 13:50:15.631206 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:15.631140 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/035accbb-8959-4e6a-bbfb-873b6c1c79b5-console-oauth-config\") pod \"console-d746b54dd-2f47d\" (UID: \"035accbb-8959-4e6a-bbfb-873b6c1c79b5\") " pod="openshift-console/console-d746b54dd-2f47d" Jun 08 13:50:15.631206 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:15.631174 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nkg9\" (UniqueName: \"kubernetes.io/projected/035accbb-8959-4e6a-bbfb-873b6c1c79b5-kube-api-access-4nkg9\") pod \"console-d746b54dd-2f47d\" (UID: \"035accbb-8959-4e6a-bbfb-873b6c1c79b5\") " pod="openshift-console/console-d746b54dd-2f47d" Jun 08 13:50:15.631320 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:15.631208 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/035accbb-8959-4e6a-bbfb-873b6c1c79b5-trusted-ca-bundle\") pod \"console-d746b54dd-2f47d\" (UID: \"035accbb-8959-4e6a-bbfb-873b6c1c79b5\") " pod="openshift-console/console-d746b54dd-2f47d" Jun 08 13:50:15.632184 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:15.632151 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/035accbb-8959-4e6a-bbfb-873b6c1c79b5-console-config\") pod \"console-d746b54dd-2f47d\" (UID: \"035accbb-8959-4e6a-bbfb-873b6c1c79b5\") " pod="openshift-console/console-d746b54dd-2f47d" Jun 08 13:50:15.632419 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:15.632398 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/035accbb-8959-4e6a-bbfb-873b6c1c79b5-service-ca\") pod \"console-d746b54dd-2f47d\" (UID: \"035accbb-8959-4e6a-bbfb-873b6c1c79b5\") " pod="openshift-console/console-d746b54dd-2f47d" Jun 08 13:50:15.632419 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:15.632410 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/035accbb-8959-4e6a-bbfb-873b6c1c79b5-oauth-serving-cert\") pod \"console-d746b54dd-2f47d\" (UID: \"035accbb-8959-4e6a-bbfb-873b6c1c79b5\") " pod="openshift-console/console-d746b54dd-2f47d" Jun 08 13:50:15.632589 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:15.632509 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/035accbb-8959-4e6a-bbfb-873b6c1c79b5-trusted-ca-bundle\") pod \"console-d746b54dd-2f47d\" (UID: \"035accbb-8959-4e6a-bbfb-873b6c1c79b5\") " pod="openshift-console/console-d746b54dd-2f47d" Jun 08 13:50:15.634106 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:15.634083 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/035accbb-8959-4e6a-bbfb-873b6c1c79b5-console-oauth-config\") pod \"console-d746b54dd-2f47d\" (UID: \"035accbb-8959-4e6a-bbfb-873b6c1c79b5\") " pod="openshift-console/console-d746b54dd-2f47d" Jun 08 13:50:15.640070 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:15.640050 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/035accbb-8959-4e6a-bbfb-873b6c1c79b5-console-serving-cert\") pod \"console-d746b54dd-2f47d\" (UID: \"035accbb-8959-4e6a-bbfb-873b6c1c79b5\") " pod="openshift-console/console-d746b54dd-2f47d" Jun 08 13:50:15.648668 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:15.648646 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nkg9\" (UniqueName: \"kubernetes.io/projected/035accbb-8959-4e6a-bbfb-873b6c1c79b5-kube-api-access-4nkg9\") pod \"console-d746b54dd-2f47d\" (UID: \"035accbb-8959-4e6a-bbfb-873b6c1c79b5\") " pod="openshift-console/console-d746b54dd-2f47d" Jun 08 13:50:15.785421 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:15.785354 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:15.789220 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:15.789205 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d746b54dd-2f47d" Jun 08 13:50:15.936502 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:15.936473 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d746b54dd-2f47d"] Jun 08 13:50:15.937990 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:50:15.937960 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod035accbb_8959_4e6a_bbfb_873b6c1c79b5.slice/crio-bf523621d7ff9bc51faf8d30e78a6a5f3007cf617f2092ac97c2d9ee1186962b WatchSource:0}: Error finding container bf523621d7ff9bc51faf8d30e78a6a5f3007cf617f2092ac97c2d9ee1186962b: Status 404 returned error can't find the container with id bf523621d7ff9bc51faf8d30e78a6a5f3007cf617f2092ac97c2d9ee1186962b Jun 08 13:50:16.693796 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:16.693755 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d746b54dd-2f47d" event={"ID":"035accbb-8959-4e6a-bbfb-873b6c1c79b5","Type":"ContainerStarted","Data":"13938eb95de39df5375c48d8b8f86bb500e8195dc60e396dac8c643c941a93c2"} Jun 08 13:50:16.694262 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:16.693815 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d746b54dd-2f47d" event={"ID":"035accbb-8959-4e6a-bbfb-873b6c1c79b5","Type":"ContainerStarted","Data":"bf523621d7ff9bc51faf8d30e78a6a5f3007cf617f2092ac97c2d9ee1186962b"} Jun 08 13:50:16.729206 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:16.729155 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d746b54dd-2f47d" podStartSLOduration=1.72914009 podStartE2EDuration="1.72914009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:50:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:50:16.724706178 +0000 UTC m=+430.705734447" watchObservedRunningTime="2026-06-08 13:50:16.72914009 +0000 UTC m=+430.710168358" Jun 08 13:50:19.654241 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:19.654210 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4pqlh" Jun 08 13:50:20.860104 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:20.860067 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:20.979102 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:20.979060 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:24.545956 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:24.545924 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rlpmb"] Jun 08 13:50:24.550755 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:24.550735 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rlpmb" Jun 08 13:50:24.554854 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:24.554838 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-h5c6d\"" Jun 08 13:50:24.572664 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:24.572644 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rlpmb"] Jun 08 13:50:24.698931 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:24.698905 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8775d6f4-4289-4225-8124-4eda401ca94c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-rlpmb\" (UID: \"8775d6f4-4289-4225-8124-4eda401ca94c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rlpmb" Jun 08 13:50:24.699050 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:24.698950 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7ljs\" (UniqueName: \"kubernetes.io/projected/8775d6f4-4289-4225-8124-4eda401ca94c-kube-api-access-t7ljs\") pod \"kuadrant-operator-controller-manager-55467d9f7-rlpmb\" (UID: \"8775d6f4-4289-4225-8124-4eda401ca94c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rlpmb" Jun 08 13:50:24.800460 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:24.800392 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7ljs\" (UniqueName: \"kubernetes.io/projected/8775d6f4-4289-4225-8124-4eda401ca94c-kube-api-access-t7ljs\") pod \"kuadrant-operator-controller-manager-55467d9f7-rlpmb\" (UID: \"8775d6f4-4289-4225-8124-4eda401ca94c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rlpmb" Jun 08 13:50:24.800564 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:24.800518 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8775d6f4-4289-4225-8124-4eda401ca94c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-rlpmb\" (UID: \"8775d6f4-4289-4225-8124-4eda401ca94c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rlpmb" Jun 08 13:50:24.800900 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:24.800884 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8775d6f4-4289-4225-8124-4eda401ca94c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-rlpmb\" (UID: \"8775d6f4-4289-4225-8124-4eda401ca94c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rlpmb" Jun 08 13:50:24.808134 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:24.808107 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rlpmb"] Jun 08 13:50:24.808325 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:50:24.808305 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-t7ljs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rlpmb" podUID="8775d6f4-4289-4225-8124-4eda401ca94c" Jun 08 13:50:24.816721 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:24.816699 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rlpmb"] Jun 08 13:50:24.820297 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:50:24.820277 2561 projected.go:196] Error preparing data for projected volume kube-api-access-t7ljs for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rlpmb: failed to fetch token: pods "kuadrant-operator-controller-manager-55467d9f7-rlpmb" not found Jun 08 13:50:24.820388 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:50:24.820335 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8775d6f4-4289-4225-8124-4eda401ca94c-kube-api-access-t7ljs podName:8775d6f4-4289-4225-8124-4eda401ca94c nodeName:}" failed. No retries permitted until 2026-06-08 13:50:25.320320225 +0000 UTC m=+439.301348477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-t7ljs" (UniqueName: "kubernetes.io/projected/8775d6f4-4289-4225-8124-4eda401ca94c-kube-api-access-t7ljs") pod "kuadrant-operator-controller-manager-55467d9f7-rlpmb" (UID: "8775d6f4-4289-4225-8124-4eda401ca94c") : failed to fetch token: pods "kuadrant-operator-controller-manager-55467d9f7-rlpmb" not found Jun 08 13:50:24.841253 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:24.841226 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-62chj"] Jun 08 13:50:24.844904 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:24.844886 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-62chj" Jun 08 13:50:24.864320 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:24.864298 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-62chj"] Jun 08 13:50:24.901336 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:24.901309 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thz9x\" (UniqueName: \"kubernetes.io/projected/c91655db-1562-44cf-b2d2-13d90c6b690a-kube-api-access-thz9x\") pod \"kuadrant-operator-controller-manager-55467d9f7-62chj\" (UID: \"c91655db-1562-44cf-b2d2-13d90c6b690a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-62chj" Jun 08 13:50:24.901471 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:24.901425 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c91655db-1562-44cf-b2d2-13d90c6b690a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-62chj\" (UID: \"c91655db-1562-44cf-b2d2-13d90c6b690a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-62chj" Jun 08 13:50:25.002919 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:25.002890 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thz9x\" (UniqueName: \"kubernetes.io/projected/c91655db-1562-44cf-b2d2-13d90c6b690a-kube-api-access-thz9x\") pod \"kuadrant-operator-controller-manager-55467d9f7-62chj\" (UID: \"c91655db-1562-44cf-b2d2-13d90c6b690a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-62chj" Jun 08 13:50:25.003083 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:25.002956 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c91655db-1562-44cf-b2d2-13d90c6b690a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-62chj\" (UID: \"c91655db-1562-44cf-b2d2-13d90c6b690a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-62chj" Jun 08 13:50:25.003322 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:25.003305 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c91655db-1562-44cf-b2d2-13d90c6b690a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-62chj\" (UID: \"c91655db-1562-44cf-b2d2-13d90c6b690a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-62chj" Jun 08 13:50:25.012756 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:25.012730 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thz9x\" (UniqueName: \"kubernetes.io/projected/c91655db-1562-44cf-b2d2-13d90c6b690a-kube-api-access-thz9x\") pod \"kuadrant-operator-controller-manager-55467d9f7-62chj\" (UID: \"c91655db-1562-44cf-b2d2-13d90c6b690a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-62chj" Jun 08 13:50:25.155569 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:25.155544 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-62chj" Jun 08 13:50:25.310456 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:25.310417 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-62chj"] Jun 08 13:50:25.316213 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:50:25.316184 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc91655db_1562_44cf_b2d2_13d90c6b690a.slice/crio-e4af5e7c76ab87e338db8c7a35028f49068eb8b31034c672cba461bb34361f7d WatchSource:0}: Error finding container e4af5e7c76ab87e338db8c7a35028f49068eb8b31034c672cba461bb34361f7d: Status 404 returned error can't find the container with id e4af5e7c76ab87e338db8c7a35028f49068eb8b31034c672cba461bb34361f7d Jun 08 13:50:25.396093 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:25.396061 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:25.406322 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:25.406269 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7ljs\" (UniqueName: \"kubernetes.io/projected/8775d6f4-4289-4225-8124-4eda401ca94c-kube-api-access-t7ljs\") pod \"kuadrant-operator-controller-manager-55467d9f7-rlpmb\" (UID: \"8775d6f4-4289-4225-8124-4eda401ca94c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rlpmb" Jun 08 13:50:25.409513 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:50:25.409496 2561 projected.go:196] Error preparing data for projected volume kube-api-access-t7ljs for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rlpmb: failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-rlpmb" not found Jun 08 13:50:25.409593 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:50:25.409550 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8775d6f4-4289-4225-8124-4eda401ca94c-kube-api-access-t7ljs podName:8775d6f4-4289-4225-8124-4eda401ca94c nodeName:}" failed. No retries permitted until 2026-06-08 13:50:26.40953616 +0000 UTC m=+440.390564407 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-t7ljs" (UniqueName: "kubernetes.io/projected/8775d6f4-4289-4225-8124-4eda401ca94c-kube-api-access-t7ljs") pod "kuadrant-operator-controller-manager-55467d9f7-rlpmb" (UID: "8775d6f4-4289-4225-8124-4eda401ca94c") : failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-rlpmb" not found Jun 08 13:50:25.557396 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:25.557365 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:25.744699 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:25.744638 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rlpmb" Jun 08 13:50:25.744851 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:25.744635 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-62chj" event={"ID":"c91655db-1562-44cf-b2d2-13d90c6b690a","Type":"ContainerStarted","Data":"e4af5e7c76ab87e338db8c7a35028f49068eb8b31034c672cba461bb34361f7d"} Jun 08 13:50:25.747497 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:50:25.747463 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-rlpmb\" is forbidden: User \"system:node:ip-10-0-132-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-92.ec2.internal' and this object" podUID="8775d6f4-4289-4225-8124-4eda401ca94c" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rlpmb" Jun 08 13:50:25.751550 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:25.751533 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rlpmb" Jun 08 13:50:25.754277 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:50:25.754256 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-rlpmb\" is forbidden: User \"system:node:ip-10-0-132-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-92.ec2.internal' and this object" podUID="8775d6f4-4289-4225-8124-4eda401ca94c" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rlpmb" Jun 08 13:50:25.789532 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:25.789512 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d746b54dd-2f47d" Jun 08 13:50:25.789628 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:25.789549 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d746b54dd-2f47d" Jun 08 13:50:25.794342 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:25.794316 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d746b54dd-2f47d" Jun 08 13:50:25.809052 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:25.809028 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8775d6f4-4289-4225-8124-4eda401ca94c-extensions-socket-volume\") pod \"8775d6f4-4289-4225-8124-4eda401ca94c\" (UID: \"8775d6f4-4289-4225-8124-4eda401ca94c\") " Jun 08 13:50:25.809292 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:25.809268 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8775d6f4-4289-4225-8124-4eda401ca94c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8775d6f4-4289-4225-8124-4eda401ca94c" (UID: "8775d6f4-4289-4225-8124-4eda401ca94c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:50:25.809395 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:25.809377 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8775d6f4-4289-4225-8124-4eda401ca94c-extensions-socket-volume\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:50:25.809435 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:25.809401 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7ljs\" (UniqueName: \"kubernetes.io/projected/8775d6f4-4289-4225-8124-4eda401ca94c-kube-api-access-t7ljs\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:50:25.856506 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:50:25.856474 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-rlpmb\" is forbidden: User \"system:node:ip-10-0-132-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-92.ec2.internal' and this object" podUID="8775d6f4-4289-4225-8124-4eda401ca94c" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rlpmb" Jun 08 13:50:26.476949 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:50:26.476918 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-rlpmb\" is forbidden: User \"system:node:ip-10-0-132-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-92.ec2.internal' and this object" podUID="8775d6f4-4289-4225-8124-4eda401ca94c" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rlpmb" Jun 08 13:50:26.477327 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:26.477308 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8775d6f4-4289-4225-8124-4eda401ca94c" path="/var/lib/kubelet/pods/8775d6f4-4289-4225-8124-4eda401ca94c/volumes" Jun 08 13:50:26.750675 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:26.750600 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rlpmb" Jun 08 13:50:26.755469 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:26.755438 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d746b54dd-2f47d" Jun 08 13:50:26.756342 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:50:26.756307 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-rlpmb\" is forbidden: User \"system:node:ip-10-0-132-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-92.ec2.internal' and this object" podUID="8775d6f4-4289-4225-8124-4eda401ca94c" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rlpmb" Jun 08 13:50:26.781099 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:50:26.781059 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-rlpmb\" is forbidden: User \"system:node:ip-10-0-132-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-92.ec2.internal' and this object" podUID="8775d6f4-4289-4225-8124-4eda401ca94c" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rlpmb" Jun 08 13:50:26.822457 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:26.821790 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b8c6787fd-48pdt"] Jun 08 13:50:26.825020 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:50:26.824981 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-rlpmb\" is forbidden: User \"system:node:ip-10-0-132-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-92.ec2.internal' and this object" podUID="8775d6f4-4289-4225-8124-4eda401ca94c" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rlpmb" Jun 08 13:50:26.997635 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:26.997590 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:27.098686 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:27.098596 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:27.297597 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:27.297568 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:29.268826 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:29.268785 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:29.449611 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:29.449572 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:29.575131 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:29.575043 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:30.775871 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:30.775830 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-62chj" event={"ID":"c91655db-1562-44cf-b2d2-13d90c6b690a","Type":"ContainerStarted","Data":"3867491cc3d2ceebcc667d10b429fb6fbb601140b75b558245380a6fd1f012fa"} Jun 08 13:50:30.776336 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:30.775968 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-62chj" Jun 08 13:50:30.805171 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:30.805128 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-62chj" podStartSLOduration=1.803976151 podStartE2EDuration="6.805115033s" totalImagesPullingTime="5.001138882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:50:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:50:30.804606486 +0000 UTC m=+444.785634774" watchObservedRunningTime="2026-06-08 13:50:30.805115033 +0000 UTC m=+444.786143302" Jun 08 13:50:32.047503 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:32.047464 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:32.151298 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:32.151260 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:38.739507 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:38.739472 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:38.859596 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:38.859567 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:41.783904 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:41.783878 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-62chj" Jun 08 13:50:43.392914 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:43.392879 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:43.489304 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:43.489263 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:47.134053 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:47.134022 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:47.243061 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:47.243026 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:47.708876 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:47.708849 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:47.808325 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:47.808292 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:51.526561 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:51.526525 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:51.623700 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:51.623674 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:51.851955 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:51.851874 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5b8c6787fd-48pdt" podUID="4d70e045-d0e7-48cc-acef-672815f9666a" containerName="console" containerID="cri-o://b2bdd7418a4864f344760e75581ee7a693879dd6ae62f91e64b52506e7178796" gracePeriod=15 Jun 08 13:50:52.103164 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:52.103103 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b8c6787fd-48pdt" Jun 08 13:50:52.134698 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:52.134672 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d70e045-d0e7-48cc-acef-672815f9666a-console-config\") pod \"4d70e045-d0e7-48cc-acef-672815f9666a\" (UID: \"4d70e045-d0e7-48cc-acef-672815f9666a\") " Jun 08 13:50:52.134849 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:52.134708 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d70e045-d0e7-48cc-acef-672815f9666a-trusted-ca-bundle\") pod \"4d70e045-d0e7-48cc-acef-672815f9666a\" (UID: \"4d70e045-d0e7-48cc-acef-672815f9666a\") " Jun 08 13:50:52.134849 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:52.134728 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d70e045-d0e7-48cc-acef-672815f9666a-console-oauth-config\") pod \"4d70e045-d0e7-48cc-acef-672815f9666a\" (UID: \"4d70e045-d0e7-48cc-acef-672815f9666a\") " Jun 08 13:50:52.134849 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:52.134784 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d70e045-d0e7-48cc-acef-672815f9666a-service-ca\") pod \"4d70e045-d0e7-48cc-acef-672815f9666a\" (UID: \"4d70e045-d0e7-48cc-acef-672815f9666a\") " Jun 08 13:50:52.134849 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:52.134829 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d70e045-d0e7-48cc-acef-672815f9666a-console-serving-cert\") pod \"4d70e045-d0e7-48cc-acef-672815f9666a\" (UID: \"4d70e045-d0e7-48cc-acef-672815f9666a\") " Jun 08 13:50:52.135083 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:52.134898 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtxsd\" (UniqueName: \"kubernetes.io/projected/4d70e045-d0e7-48cc-acef-672815f9666a-kube-api-access-mtxsd\") pod \"4d70e045-d0e7-48cc-acef-672815f9666a\" (UID: \"4d70e045-d0e7-48cc-acef-672815f9666a\") " Jun 08 13:50:52.135083 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:52.134927 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d70e045-d0e7-48cc-acef-672815f9666a-oauth-serving-cert\") pod \"4d70e045-d0e7-48cc-acef-672815f9666a\" (UID: \"4d70e045-d0e7-48cc-acef-672815f9666a\") " Jun 08 13:50:52.135189 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:52.135124 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d70e045-d0e7-48cc-acef-672815f9666a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4d70e045-d0e7-48cc-acef-672815f9666a" (UID: "4d70e045-d0e7-48cc-acef-672815f9666a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:50:52.135189 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:52.135135 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d70e045-d0e7-48cc-acef-672815f9666a-console-config" (OuterVolumeSpecName: "console-config") pod "4d70e045-d0e7-48cc-acef-672815f9666a" (UID: "4d70e045-d0e7-48cc-acef-672815f9666a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:50:52.135296 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:52.135199 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d70e045-d0e7-48cc-acef-672815f9666a-service-ca" (OuterVolumeSpecName: "service-ca") pod "4d70e045-d0e7-48cc-acef-672815f9666a" (UID: "4d70e045-d0e7-48cc-acef-672815f9666a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:50:52.135296 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:52.135225 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d70e045-d0e7-48cc-acef-672815f9666a-console-config\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:50:52.135296 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:52.135243 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d70e045-d0e7-48cc-acef-672815f9666a-trusted-ca-bundle\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:50:52.135441 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:52.135422 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d70e045-d0e7-48cc-acef-672815f9666a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4d70e045-d0e7-48cc-acef-672815f9666a" (UID: "4d70e045-d0e7-48cc-acef-672815f9666a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:50:52.136914 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:52.136888 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d70e045-d0e7-48cc-acef-672815f9666a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4d70e045-d0e7-48cc-acef-672815f9666a" (UID: "4d70e045-d0e7-48cc-acef-672815f9666a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:50:52.137007 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:52.136912 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d70e045-d0e7-48cc-acef-672815f9666a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4d70e045-d0e7-48cc-acef-672815f9666a" (UID: "4d70e045-d0e7-48cc-acef-672815f9666a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:50:52.137060 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:52.137043 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d70e045-d0e7-48cc-acef-672815f9666a-kube-api-access-mtxsd" (OuterVolumeSpecName: "kube-api-access-mtxsd") pod "4d70e045-d0e7-48cc-acef-672815f9666a" (UID: "4d70e045-d0e7-48cc-acef-672815f9666a"). InnerVolumeSpecName "kube-api-access-mtxsd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:50:52.236029 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:52.236002 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d70e045-d0e7-48cc-acef-672815f9666a-console-oauth-config\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:50:52.236029 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:52.236025 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d70e045-d0e7-48cc-acef-672815f9666a-service-ca\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:50:52.236029 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:52.236034 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d70e045-d0e7-48cc-acef-672815f9666a-console-serving-cert\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:50:52.236233 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:52.236043 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtxsd\" (UniqueName: \"kubernetes.io/projected/4d70e045-d0e7-48cc-acef-672815f9666a-kube-api-access-mtxsd\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:50:52.236233 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:52.236052 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d70e045-d0e7-48cc-acef-672815f9666a-oauth-serving-cert\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:50:52.891692 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:52.891665 2561 generic.go:356] "Generic (PLEG): container finished" podID="4d70e045-d0e7-48cc-acef-672815f9666a" containerID="b2bdd7418a4864f344760e75581ee7a693879dd6ae62f91e64b52506e7178796" exitCode=0 Jun 08 13:50:52.892124 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:52.891715 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b8c6787fd-48pdt" Jun 08 13:50:52.892124 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:52.891744 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b8c6787fd-48pdt" event={"ID":"4d70e045-d0e7-48cc-acef-672815f9666a","Type":"ContainerDied","Data":"b2bdd7418a4864f344760e75581ee7a693879dd6ae62f91e64b52506e7178796"} Jun 08 13:50:52.892124 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:52.891831 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b8c6787fd-48pdt" event={"ID":"4d70e045-d0e7-48cc-acef-672815f9666a","Type":"ContainerDied","Data":"0bb46c2fb35420a4421a1bb08345025a1be0a3ef7ce45463fb45ad646a33e2e0"} Jun 08 13:50:52.892124 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:52.891853 2561 scope.go:117] "RemoveContainer" containerID="b2bdd7418a4864f344760e75581ee7a693879dd6ae62f91e64b52506e7178796" Jun 08 13:50:52.900850 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:52.900833 2561 scope.go:117] "RemoveContainer" containerID="b2bdd7418a4864f344760e75581ee7a693879dd6ae62f91e64b52506e7178796" Jun 08 13:50:52.901123 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:50:52.901105 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2bdd7418a4864f344760e75581ee7a693879dd6ae62f91e64b52506e7178796\": container with ID starting with b2bdd7418a4864f344760e75581ee7a693879dd6ae62f91e64b52506e7178796 not found: ID does not exist" containerID="b2bdd7418a4864f344760e75581ee7a693879dd6ae62f91e64b52506e7178796" Jun 08 13:50:52.901199 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:52.901130 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2bdd7418a4864f344760e75581ee7a693879dd6ae62f91e64b52506e7178796"} err="failed to get container status \"b2bdd7418a4864f344760e75581ee7a693879dd6ae62f91e64b52506e7178796\": rpc error: code = NotFound desc = could not find container \"b2bdd7418a4864f344760e75581ee7a693879dd6ae62f91e64b52506e7178796\": container with ID starting with b2bdd7418a4864f344760e75581ee7a693879dd6ae62f91e64b52506e7178796 not found: ID does not exist" Jun 08 13:50:52.917725 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:52.917702 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b8c6787fd-48pdt"] Jun 08 13:50:52.921632 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:52.921613 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b8c6787fd-48pdt"] Jun 08 13:50:54.481574 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:54.481542 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d70e045-d0e7-48cc-acef-672815f9666a" path="/var/lib/kubelet/pods/4d70e045-d0e7-48cc-acef-672815f9666a/volumes" Jun 08 13:50:54.800108 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:54.800029 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-62chj"] Jun 08 13:50:54.800324 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:54.800276 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-62chj" podUID="c91655db-1562-44cf-b2d2-13d90c6b690a" containerName="manager" containerID="cri-o://3867491cc3d2ceebcc667d10b429fb6fbb601140b75b558245380a6fd1f012fa" gracePeriod=10 Jun 08 13:50:55.058295 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:55.058239 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-62chj" Jun 08 13:50:55.155698 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:55.155667 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thz9x\" (UniqueName: \"kubernetes.io/projected/c91655db-1562-44cf-b2d2-13d90c6b690a-kube-api-access-thz9x\") pod \"c91655db-1562-44cf-b2d2-13d90c6b690a\" (UID: \"c91655db-1562-44cf-b2d2-13d90c6b690a\") " Jun 08 13:50:55.155896 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:55.155720 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c91655db-1562-44cf-b2d2-13d90c6b690a-extensions-socket-volume\") pod \"c91655db-1562-44cf-b2d2-13d90c6b690a\" (UID: \"c91655db-1562-44cf-b2d2-13d90c6b690a\") " Jun 08 13:50:55.156171 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:55.156148 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c91655db-1562-44cf-b2d2-13d90c6b690a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c91655db-1562-44cf-b2d2-13d90c6b690a" (UID: "c91655db-1562-44cf-b2d2-13d90c6b690a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:50:55.157582 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:55.157558 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c91655db-1562-44cf-b2d2-13d90c6b690a-kube-api-access-thz9x" (OuterVolumeSpecName: "kube-api-access-thz9x") pod "c91655db-1562-44cf-b2d2-13d90c6b690a" (UID: "c91655db-1562-44cf-b2d2-13d90c6b690a"). InnerVolumeSpecName "kube-api-access-thz9x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:50:55.256598 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:55.256576 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thz9x\" (UniqueName: \"kubernetes.io/projected/c91655db-1562-44cf-b2d2-13d90c6b690a-kube-api-access-thz9x\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:50:55.256598 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:55.256597 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c91655db-1562-44cf-b2d2-13d90c6b690a-extensions-socket-volume\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:50:55.910264 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:55.910228 2561 generic.go:356] "Generic (PLEG): container finished" podID="c91655db-1562-44cf-b2d2-13d90c6b690a" containerID="3867491cc3d2ceebcc667d10b429fb6fbb601140b75b558245380a6fd1f012fa" exitCode=0 Jun 08 13:50:55.910722 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:55.910278 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-62chj" Jun 08 13:50:55.910722 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:55.910321 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-62chj" event={"ID":"c91655db-1562-44cf-b2d2-13d90c6b690a","Type":"ContainerDied","Data":"3867491cc3d2ceebcc667d10b429fb6fbb601140b75b558245380a6fd1f012fa"} Jun 08 13:50:55.910722 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:55.910387 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-62chj" event={"ID":"c91655db-1562-44cf-b2d2-13d90c6b690a","Type":"ContainerDied","Data":"e4af5e7c76ab87e338db8c7a35028f49068eb8b31034c672cba461bb34361f7d"} Jun 08 13:50:55.910722 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:55.910419 2561 scope.go:117] "RemoveContainer" containerID="3867491cc3d2ceebcc667d10b429fb6fbb601140b75b558245380a6fd1f012fa" Jun 08 13:50:55.920754 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:55.920738 2561 scope.go:117] "RemoveContainer" containerID="3867491cc3d2ceebcc667d10b429fb6fbb601140b75b558245380a6fd1f012fa" Jun 08 13:50:55.921041 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:50:55.921023 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3867491cc3d2ceebcc667d10b429fb6fbb601140b75b558245380a6fd1f012fa\": container with ID starting with 3867491cc3d2ceebcc667d10b429fb6fbb601140b75b558245380a6fd1f012fa not found: ID does not exist" containerID="3867491cc3d2ceebcc667d10b429fb6fbb601140b75b558245380a6fd1f012fa" Jun 08 13:50:55.921112 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:55.921054 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3867491cc3d2ceebcc667d10b429fb6fbb601140b75b558245380a6fd1f012fa"} err="failed to get container status \"3867491cc3d2ceebcc667d10b429fb6fbb601140b75b558245380a6fd1f012fa\": rpc error: code = NotFound desc = could not find container \"3867491cc3d2ceebcc667d10b429fb6fbb601140b75b558245380a6fd1f012fa\": container with ID starting with 3867491cc3d2ceebcc667d10b429fb6fbb601140b75b558245380a6fd1f012fa not found: ID does not exist" Jun 08 13:50:55.953317 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:55.953297 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-62chj"] Jun 08 13:50:55.966944 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:55.966924 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-62chj"] Jun 08 13:50:56.477864 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:56.477832 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c91655db-1562-44cf-b2d2-13d90c6b690a" path="/var/lib/kubelet/pods/c91655db-1562-44cf-b2d2-13d90c6b690a/volumes" Jun 08 13:50:57.567858 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:57.567806 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:57.666257 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:57.666226 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:58.237778 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.237742 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs"] Jun 08 13:50:58.238192 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.238176 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c91655db-1562-44cf-b2d2-13d90c6b690a" containerName="manager" Jun 08 13:50:58.238285 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.238195 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c91655db-1562-44cf-b2d2-13d90c6b690a" containerName="manager" Jun 08 13:50:58.238285 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.238208 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d70e045-d0e7-48cc-acef-672815f9666a" containerName="console" Jun 08 13:50:58.238285 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.238217 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d70e045-d0e7-48cc-acef-672815f9666a" containerName="console" Jun 08 13:50:58.238468 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.238304 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c91655db-1562-44cf-b2d2-13d90c6b690a" containerName="manager" Jun 08 13:50:58.238468 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.238321 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d70e045-d0e7-48cc-acef-672815f9666a" containerName="console" Jun 08 13:50:58.241612 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.241593 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:50:58.248365 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.248345 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-ktvwd\"" Jun 08 13:50:58.283654 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.283626 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fead1cc9-ff82-431e-a8e3-4e9f1577d0c1-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-vpprs\" (UID: \"fead1cc9-ff82-431e-a8e3-4e9f1577d0c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:50:58.283802 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.283684 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fead1cc9-ff82-431e-a8e3-4e9f1577d0c1-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-vpprs\" (UID: \"fead1cc9-ff82-431e-a8e3-4e9f1577d0c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:50:58.283802 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.283722 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fead1cc9-ff82-431e-a8e3-4e9f1577d0c1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-vpprs\" (UID: \"fead1cc9-ff82-431e-a8e3-4e9f1577d0c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:50:58.283802 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.283744 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fead1cc9-ff82-431e-a8e3-4e9f1577d0c1-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-vpprs\" (UID: \"fead1cc9-ff82-431e-a8e3-4e9f1577d0c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:50:58.283948 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.283827 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fead1cc9-ff82-431e-a8e3-4e9f1577d0c1-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-vpprs\" (UID: \"fead1cc9-ff82-431e-a8e3-4e9f1577d0c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:50:58.283948 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.283855 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fead1cc9-ff82-431e-a8e3-4e9f1577d0c1-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-vpprs\" (UID: \"fead1cc9-ff82-431e-a8e3-4e9f1577d0c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:50:58.283948 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.283875 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srj4m\" (UniqueName: \"kubernetes.io/projected/fead1cc9-ff82-431e-a8e3-4e9f1577d0c1-kube-api-access-srj4m\") pod \"maas-default-gateway-openshift-default-8559cd5744-vpprs\" (UID: \"fead1cc9-ff82-431e-a8e3-4e9f1577d0c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:50:58.283948 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.283895 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fead1cc9-ff82-431e-a8e3-4e9f1577d0c1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-vpprs\" (UID: \"fead1cc9-ff82-431e-a8e3-4e9f1577d0c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:50:58.283948 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.283916 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fead1cc9-ff82-431e-a8e3-4e9f1577d0c1-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-vpprs\" (UID: \"fead1cc9-ff82-431e-a8e3-4e9f1577d0c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:50:58.291111 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.291090 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs"] Jun 08 13:50:58.359580 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.359539 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:58.384998 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.384970 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fead1cc9-ff82-431e-a8e3-4e9f1577d0c1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-vpprs\" (UID: \"fead1cc9-ff82-431e-a8e3-4e9f1577d0c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:50:58.385117 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.385007 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fead1cc9-ff82-431e-a8e3-4e9f1577d0c1-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-vpprs\" (UID: \"fead1cc9-ff82-431e-a8e3-4e9f1577d0c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:50:58.385170 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.385143 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fead1cc9-ff82-431e-a8e3-4e9f1577d0c1-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-vpprs\" (UID: \"fead1cc9-ff82-431e-a8e3-4e9f1577d0c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:50:58.385213 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.385186 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fead1cc9-ff82-431e-a8e3-4e9f1577d0c1-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-vpprs\" (UID: \"fead1cc9-ff82-431e-a8e3-4e9f1577d0c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:50:58.385252 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.385219 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srj4m\" (UniqueName: \"kubernetes.io/projected/fead1cc9-ff82-431e-a8e3-4e9f1577d0c1-kube-api-access-srj4m\") pod \"maas-default-gateway-openshift-default-8559cd5744-vpprs\" (UID: \"fead1cc9-ff82-431e-a8e3-4e9f1577d0c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:50:58.385300 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.385252 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fead1cc9-ff82-431e-a8e3-4e9f1577d0c1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-vpprs\" (UID: \"fead1cc9-ff82-431e-a8e3-4e9f1577d0c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:50:58.385300 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.385288 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fead1cc9-ff82-431e-a8e3-4e9f1577d0c1-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-vpprs\" (UID: \"fead1cc9-ff82-431e-a8e3-4e9f1577d0c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:50:58.385570 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.385546 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fead1cc9-ff82-431e-a8e3-4e9f1577d0c1-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-vpprs\" (UID: \"fead1cc9-ff82-431e-a8e3-4e9f1577d0c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:50:58.385651 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.385588 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fead1cc9-ff82-431e-a8e3-4e9f1577d0c1-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-vpprs\" (UID: \"fead1cc9-ff82-431e-a8e3-4e9f1577d0c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:50:58.385710 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.385691 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fead1cc9-ff82-431e-a8e3-4e9f1577d0c1-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-vpprs\" (UID: \"fead1cc9-ff82-431e-a8e3-4e9f1577d0c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:50:58.385801 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.385789 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fead1cc9-ff82-431e-a8e3-4e9f1577d0c1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-vpprs\" (UID: \"fead1cc9-ff82-431e-a8e3-4e9f1577d0c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:50:58.385865 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.385791 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fead1cc9-ff82-431e-a8e3-4e9f1577d0c1-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-vpprs\" (UID: \"fead1cc9-ff82-431e-a8e3-4e9f1577d0c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:50:58.385980 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.385958 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fead1cc9-ff82-431e-a8e3-4e9f1577d0c1-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-vpprs\" (UID: \"fead1cc9-ff82-431e-a8e3-4e9f1577d0c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:50:58.386043 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.386007 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fead1cc9-ff82-431e-a8e3-4e9f1577d0c1-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-vpprs\" (UID: \"fead1cc9-ff82-431e-a8e3-4e9f1577d0c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:50:58.387559 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.387540 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fead1cc9-ff82-431e-a8e3-4e9f1577d0c1-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-vpprs\" (UID: \"fead1cc9-ff82-431e-a8e3-4e9f1577d0c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:50:58.387780 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.387747 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fead1cc9-ff82-431e-a8e3-4e9f1577d0c1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-vpprs\" (UID: \"fead1cc9-ff82-431e-a8e3-4e9f1577d0c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:50:58.400360 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.400338 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fead1cc9-ff82-431e-a8e3-4e9f1577d0c1-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-vpprs\" (UID: \"fead1cc9-ff82-431e-a8e3-4e9f1577d0c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:50:58.403952 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.403926 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srj4m\" (UniqueName: \"kubernetes.io/projected/fead1cc9-ff82-431e-a8e3-4e9f1577d0c1-kube-api-access-srj4m\") pod \"maas-default-gateway-openshift-default-8559cd5744-vpprs\" (UID: \"fead1cc9-ff82-431e-a8e3-4e9f1577d0c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:50:58.465083 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.465048 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:58.553721 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.553648 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:50:58.700259 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.700235 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs"] Jun 08 13:50:58.701527 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:50:58.701504 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfead1cc9_ff82_431e_a8e3_4e9f1577d0c1.slice/crio-2b01f38ccf9a57c8ca309de194747aa15a02b091d195b0e5403df0342f397972 WatchSource:0}: Error finding container 2b01f38ccf9a57c8ca309de194747aa15a02b091d195b0e5403df0342f397972: Status 404 returned error can't find the container with id 2b01f38ccf9a57c8ca309de194747aa15a02b091d195b0e5403df0342f397972 Jun 08 13:50:58.929574 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:50:58.929543 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" event={"ID":"fead1cc9-ff82-431e-a8e3-4e9f1577d0c1","Type":"ContainerStarted","Data":"2b01f38ccf9a57c8ca309de194747aa15a02b091d195b0e5403df0342f397972"} Jun 08 13:51:01.395036 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:01.395001 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 13:51:01.395340 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:01.395069 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 13:51:01.395340 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:01.395096 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 13:51:01.689579 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:01.689552 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:01.948434 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:01.948352 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" event={"ID":"fead1cc9-ff82-431e-a8e3-4e9f1577d0c1","Type":"ContainerStarted","Data":"b313bc01f61a55a0f9b7d03846d98c0a131a2bb3936bd9bc90d1ed1159a7bcdd"} Jun 08 13:51:01.970356 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:01.970306 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" podStartSLOduration=1.278985854 podStartE2EDuration="3.970289533s" totalImagesPullingTime="2.691303679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:50:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:51:01.969059126 +0000 UTC m=+475.950087395" watchObservedRunningTime="2026-06-08 13:51:01.970289533 +0000 UTC m=+475.951317801" Jun 08 13:51:02.323224 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:02.323135 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:02.415695 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:02.415654 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:02.554188 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:02.554159 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:51:02.558624 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:02.558605 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:51:02.953985 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:02.953957 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:51:02.954882 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:02.954862 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:51:10.303162 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:10.303130 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:10.357139 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:10.357101 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:16.056111 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:16.056066 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:16.057664 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:16.057641 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zpkmn"] Jun 08 13:51:16.060693 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:16.060677 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpkmn" Jun 08 13:51:16.063179 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:16.063160 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ds8z6\"" Jun 08 13:51:16.063289 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:16.063162 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 08 13:51:16.068885 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:16.068862 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zpkmn"] Jun 08 13:51:16.135399 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:16.135362 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5f17e0f-9e50-446a-896a-a5a4b796d531-config-file\") pod \"limitador-limitador-64c94fd64f-zpkmn\" (UID: \"e5f17e0f-9e50-446a-896a-a5a4b796d531\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zpkmn" Jun 08 13:51:16.135582 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:16.135511 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m8wm\" (UniqueName: \"kubernetes.io/projected/e5f17e0f-9e50-446a-896a-a5a4b796d531-kube-api-access-9m8wm\") pod \"limitador-limitador-64c94fd64f-zpkmn\" (UID: \"e5f17e0f-9e50-446a-896a-a5a4b796d531\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zpkmn" Jun 08 13:51:16.153578 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:16.153540 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zpkmn"] Jun 08 13:51:16.163081 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:16.163049 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:16.236232 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:16.236203 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m8wm\" (UniqueName: \"kubernetes.io/projected/e5f17e0f-9e50-446a-896a-a5a4b796d531-kube-api-access-9m8wm\") pod \"limitador-limitador-64c94fd64f-zpkmn\" (UID: \"e5f17e0f-9e50-446a-896a-a5a4b796d531\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zpkmn" Jun 08 13:51:16.236352 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:16.236265 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5f17e0f-9e50-446a-896a-a5a4b796d531-config-file\") pod \"limitador-limitador-64c94fd64f-zpkmn\" (UID: \"e5f17e0f-9e50-446a-896a-a5a4b796d531\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zpkmn" Jun 08 13:51:16.236884 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:16.236870 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5f17e0f-9e50-446a-896a-a5a4b796d531-config-file\") pod \"limitador-limitador-64c94fd64f-zpkmn\" (UID: \"e5f17e0f-9e50-446a-896a-a5a4b796d531\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zpkmn" Jun 08 13:51:16.244567 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:16.244544 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m8wm\" (UniqueName: \"kubernetes.io/projected/e5f17e0f-9e50-446a-896a-a5a4b796d531-kube-api-access-9m8wm\") pod \"limitador-limitador-64c94fd64f-zpkmn\" (UID: \"e5f17e0f-9e50-446a-896a-a5a4b796d531\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zpkmn" Jun 08 13:51:16.264721 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:16.264690 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:16.373514 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:16.373448 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpkmn" Jun 08 13:51:16.506956 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:16.506935 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zpkmn"] Jun 08 13:51:16.508678 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:51:16.508648 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5f17e0f_9e50_446a_896a_a5a4b796d531.slice/crio-4da468ce0f31dd0e4d02e99532d1184e47cab0a8a3cd7ab37a74ff67e4288e06 WatchSource:0}: Error finding container 4da468ce0f31dd0e4d02e99532d1184e47cab0a8a3cd7ab37a74ff67e4288e06: Status 404 returned error can't find the container with id 4da468ce0f31dd0e4d02e99532d1184e47cab0a8a3cd7ab37a74ff67e4288e06 Jun 08 13:51:16.880726 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:16.880684 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:16.942337 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:16.942283 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:17.032588 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:17.032512 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpkmn" event={"ID":"e5f17e0f-9e50-446a-896a-a5a4b796d531","Type":"ContainerStarted","Data":"4da468ce0f31dd0e4d02e99532d1184e47cab0a8a3cd7ab37a74ff67e4288e06"} Jun 08 13:51:19.046154 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:19.046113 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpkmn" event={"ID":"e5f17e0f-9e50-446a-896a-a5a4b796d531","Type":"ContainerStarted","Data":"adec69ee71df5c82b55ab8c211f7eefa6cdd8ce8dd9eb2e9421ee715749340e0"} Jun 08 13:51:19.046533 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:19.046245 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpkmn" Jun 08 13:51:19.066019 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:19.065976 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpkmn" podStartSLOduration=0.630193291 podStartE2EDuration="3.065962329s" totalImagesPullingTime="2.435769038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:51:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:51:19.063937457 +0000 UTC m=+493.044965744" watchObservedRunningTime="2026-06-08 13:51:19.065962329 +0000 UTC m=+493.046990598" Jun 08 13:51:30.052838 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:30.052810 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpkmn" Jun 08 13:51:30.945707 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:30.945672 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zpkmn"] Jun 08 13:51:30.945905 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:30.945863 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpkmn" podUID="e5f17e0f-9e50-446a-896a-a5a4b796d531" containerName="limitador" containerID="cri-o://adec69ee71df5c82b55ab8c211f7eefa6cdd8ce8dd9eb2e9421ee715749340e0" gracePeriod=30 Jun 08 13:51:31.492940 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:31.492919 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpkmn" Jun 08 13:51:31.664420 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:31.664391 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9m8wm\" (UniqueName: \"kubernetes.io/projected/e5f17e0f-9e50-446a-896a-a5a4b796d531-kube-api-access-9m8wm\") pod \"e5f17e0f-9e50-446a-896a-a5a4b796d531\" (UID: \"e5f17e0f-9e50-446a-896a-a5a4b796d531\") " Jun 08 13:51:31.664635 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:31.664515 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5f17e0f-9e50-446a-896a-a5a4b796d531-config-file\") pod \"e5f17e0f-9e50-446a-896a-a5a4b796d531\" (UID: \"e5f17e0f-9e50-446a-896a-a5a4b796d531\") " Jun 08 13:51:31.664857 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:31.664832 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5f17e0f-9e50-446a-896a-a5a4b796d531-config-file" (OuterVolumeSpecName: "config-file") pod "e5f17e0f-9e50-446a-896a-a5a4b796d531" (UID: "e5f17e0f-9e50-446a-896a-a5a4b796d531"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:51:31.666546 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:31.666524 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5f17e0f-9e50-446a-896a-a5a4b796d531-kube-api-access-9m8wm" (OuterVolumeSpecName: "kube-api-access-9m8wm") pod "e5f17e0f-9e50-446a-896a-a5a4b796d531" (UID: "e5f17e0f-9e50-446a-896a-a5a4b796d531"). InnerVolumeSpecName "kube-api-access-9m8wm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:51:31.765917 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:31.765893 2561 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5f17e0f-9e50-446a-896a-a5a4b796d531-config-file\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:51:31.765917 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:31.765914 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9m8wm\" (UniqueName: \"kubernetes.io/projected/e5f17e0f-9e50-446a-896a-a5a4b796d531-kube-api-access-9m8wm\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:51:32.121278 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:32.121186 2561 generic.go:356] "Generic (PLEG): container finished" podID="e5f17e0f-9e50-446a-896a-a5a4b796d531" containerID="adec69ee71df5c82b55ab8c211f7eefa6cdd8ce8dd9eb2e9421ee715749340e0" exitCode=0 Jun 08 13:51:32.121278 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:32.121229 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpkmn" Jun 08 13:51:32.121486 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:32.121271 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpkmn" event={"ID":"e5f17e0f-9e50-446a-896a-a5a4b796d531","Type":"ContainerDied","Data":"adec69ee71df5c82b55ab8c211f7eefa6cdd8ce8dd9eb2e9421ee715749340e0"} Jun 08 13:51:32.121486 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:32.121320 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpkmn" event={"ID":"e5f17e0f-9e50-446a-896a-a5a4b796d531","Type":"ContainerDied","Data":"4da468ce0f31dd0e4d02e99532d1184e47cab0a8a3cd7ab37a74ff67e4288e06"} Jun 08 13:51:32.121486 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:32.121342 2561 scope.go:117] "RemoveContainer" containerID="adec69ee71df5c82b55ab8c211f7eefa6cdd8ce8dd9eb2e9421ee715749340e0" Jun 08 13:51:32.130378 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:32.130364 2561 scope.go:117] "RemoveContainer" containerID="adec69ee71df5c82b55ab8c211f7eefa6cdd8ce8dd9eb2e9421ee715749340e0" Jun 08 13:51:32.130605 ip-10-0-132-92 kubenswrapper[2561]: E0608 13:51:32.130589 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adec69ee71df5c82b55ab8c211f7eefa6cdd8ce8dd9eb2e9421ee715749340e0\": container with ID starting with adec69ee71df5c82b55ab8c211f7eefa6cdd8ce8dd9eb2e9421ee715749340e0 not found: ID does not exist" containerID="adec69ee71df5c82b55ab8c211f7eefa6cdd8ce8dd9eb2e9421ee715749340e0" Jun 08 13:51:32.130655 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:32.130611 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adec69ee71df5c82b55ab8c211f7eefa6cdd8ce8dd9eb2e9421ee715749340e0"} err="failed to get container status \"adec69ee71df5c82b55ab8c211f7eefa6cdd8ce8dd9eb2e9421ee715749340e0\": rpc error: code = NotFound desc = could not find container \"adec69ee71df5c82b55ab8c211f7eefa6cdd8ce8dd9eb2e9421ee715749340e0\": container with ID starting with adec69ee71df5c82b55ab8c211f7eefa6cdd8ce8dd9eb2e9421ee715749340e0 not found: ID does not exist" Jun 08 13:51:32.143796 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:32.143745 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zpkmn"] Jun 08 13:51:32.148172 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:32.148151 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zpkmn"] Jun 08 13:51:32.476576 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:32.476546 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5f17e0f-9e50-446a-896a-a5a4b796d531" path="/var/lib/kubelet/pods/e5f17e0f-9e50-446a-896a-a5a4b796d531/volumes" Jun 08 13:51:34.007146 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:34.007112 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-rczhn"] Jun 08 13:51:34.007714 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:34.007694 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5f17e0f-9e50-446a-896a-a5a4b796d531" containerName="limitador" Jun 08 13:51:34.007784 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:34.007718 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5f17e0f-9e50-446a-896a-a5a4b796d531" containerName="limitador" Jun 08 13:51:34.007849 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:34.007836 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5f17e0f-9e50-446a-896a-a5a4b796d531" containerName="limitador" Jun 08 13:51:34.014957 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:34.014929 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-rczhn" Jun 08 13:51:34.017786 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:34.017736 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-rczhn"] Jun 08 13:51:34.017940 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:34.017924 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 08 13:51:34.039941 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:34.039910 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:34.182103 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:34.182074 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/40450016-b933-4fa7-83c6-9d3a3b48522e-data\") pod \"postgres-69fb4594cf-rczhn\" (UID: \"40450016-b933-4fa7-83c6-9d3a3b48522e\") " pod="opendatahub/postgres-69fb4594cf-rczhn" Jun 08 13:51:34.182245 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:34.182118 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgj5d\" (UniqueName: \"kubernetes.io/projected/40450016-b933-4fa7-83c6-9d3a3b48522e-kube-api-access-mgj5d\") pod \"postgres-69fb4594cf-rczhn\" (UID: \"40450016-b933-4fa7-83c6-9d3a3b48522e\") " pod="opendatahub/postgres-69fb4594cf-rczhn" Jun 08 13:51:34.283089 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:34.283028 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/40450016-b933-4fa7-83c6-9d3a3b48522e-data\") pod \"postgres-69fb4594cf-rczhn\" (UID: \"40450016-b933-4fa7-83c6-9d3a3b48522e\") " pod="opendatahub/postgres-69fb4594cf-rczhn" Jun 08 13:51:34.283089 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:34.283063 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgj5d\" (UniqueName: \"kubernetes.io/projected/40450016-b933-4fa7-83c6-9d3a3b48522e-kube-api-access-mgj5d\") pod \"postgres-69fb4594cf-rczhn\" (UID: \"40450016-b933-4fa7-83c6-9d3a3b48522e\") " pod="opendatahub/postgres-69fb4594cf-rczhn" Jun 08 13:51:34.283383 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:34.283365 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/40450016-b933-4fa7-83c6-9d3a3b48522e-data\") pod \"postgres-69fb4594cf-rczhn\" (UID: \"40450016-b933-4fa7-83c6-9d3a3b48522e\") " pod="opendatahub/postgres-69fb4594cf-rczhn" Jun 08 13:51:34.292279 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:34.292255 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgj5d\" (UniqueName: \"kubernetes.io/projected/40450016-b933-4fa7-83c6-9d3a3b48522e-kube-api-access-mgj5d\") pod \"postgres-69fb4594cf-rczhn\" (UID: \"40450016-b933-4fa7-83c6-9d3a3b48522e\") " pod="opendatahub/postgres-69fb4594cf-rczhn" Jun 08 13:51:34.327137 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:34.327115 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-rczhn" Jun 08 13:51:34.458430 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:34.458402 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-rczhn"] Jun 08 13:51:34.459324 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:51:34.459297 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40450016_b933_4fa7_83c6_9d3a3b48522e.slice/crio-93244540721b258d2aa21d00b5de3e82aa831a791374c80ec905872de5bfadcb WatchSource:0}: Error finding container 93244540721b258d2aa21d00b5de3e82aa831a791374c80ec905872de5bfadcb: Status 404 returned error can't find the container with id 93244540721b258d2aa21d00b5de3e82aa831a791374c80ec905872de5bfadcb Jun 08 13:51:35.142833 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:35.142797 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-rczhn" event={"ID":"40450016-b933-4fa7-83c6-9d3a3b48522e","Type":"ContainerStarted","Data":"93244540721b258d2aa21d00b5de3e82aa831a791374c80ec905872de5bfadcb"} Jun 08 13:51:37.155855 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:37.155822 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-rczhn" event={"ID":"40450016-b933-4fa7-83c6-9d3a3b48522e","Type":"ContainerStarted","Data":"0c61f1638c42841eba63d7783287aa020a19e8a7a5eed6c7b0ad99c339e5517f"} Jun 08 13:51:37.156247 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:37.155937 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-rczhn" Jun 08 13:51:37.175176 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:37.175133 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-rczhn" podStartSLOduration=2.348911359 podStartE2EDuration="4.175119897s" totalImagesPullingTime="1.826208538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:51:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:51:37.173881412 +0000 UTC m=+511.154909681" watchObservedRunningTime="2026-06-08 13:51:37.175119897 +0000 UTC m=+511.156148194" Jun 08 13:51:43.195514 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:43.195480 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-rczhn" Jun 08 13:51:43.595560 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:43.595462 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:43.739888 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:43.739858 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:43.903605 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:43.903552 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:45.456552 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:45.456518 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74898fsc"] Jun 08 13:51:45.460329 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:45.460310 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74898fsc" Jun 08 13:51:45.463477 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:45.463460 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 13:51:45.464382 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:45.464366 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jb7sc\"" Jun 08 13:51:45.464479 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:45.464394 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 13:51:45.472595 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:45.472575 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74898fsc"] Jun 08 13:51:45.580929 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:45.580904 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70dd77ce-4d30-4099-8af9-d32431f0eb5b-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74898fsc\" (UID: \"70dd77ce-4d30-4099-8af9-d32431f0eb5b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74898fsc" Jun 08 13:51:45.581047 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:45.580949 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70dd77ce-4d30-4099-8af9-d32431f0eb5b-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74898fsc\" (UID: \"70dd77ce-4d30-4099-8af9-d32431f0eb5b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74898fsc" Jun 08 13:51:45.581047 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:45.581030 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsq2l\" (UniqueName: \"kubernetes.io/projected/70dd77ce-4d30-4099-8af9-d32431f0eb5b-kube-api-access-jsq2l\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74898fsc\" (UID: \"70dd77ce-4d30-4099-8af9-d32431f0eb5b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74898fsc" Jun 08 13:51:45.681635 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:45.681603 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70dd77ce-4d30-4099-8af9-d32431f0eb5b-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74898fsc\" (UID: \"70dd77ce-4d30-4099-8af9-d32431f0eb5b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74898fsc" Jun 08 13:51:45.681746 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:45.681649 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70dd77ce-4d30-4099-8af9-d32431f0eb5b-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74898fsc\" (UID: \"70dd77ce-4d30-4099-8af9-d32431f0eb5b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74898fsc" Jun 08 13:51:45.681746 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:45.681703 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsq2l\" (UniqueName: \"kubernetes.io/projected/70dd77ce-4d30-4099-8af9-d32431f0eb5b-kube-api-access-jsq2l\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74898fsc\" (UID: \"70dd77ce-4d30-4099-8af9-d32431f0eb5b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74898fsc" Jun 08 13:51:45.682059 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:45.682039 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70dd77ce-4d30-4099-8af9-d32431f0eb5b-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74898fsc\" (UID: \"70dd77ce-4d30-4099-8af9-d32431f0eb5b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74898fsc" Jun 08 13:51:45.682126 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:45.682092 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70dd77ce-4d30-4099-8af9-d32431f0eb5b-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74898fsc\" (UID: \"70dd77ce-4d30-4099-8af9-d32431f0eb5b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74898fsc" Jun 08 13:51:45.690328 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:45.690306 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsq2l\" (UniqueName: \"kubernetes.io/projected/70dd77ce-4d30-4099-8af9-d32431f0eb5b-kube-api-access-jsq2l\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74898fsc\" (UID: \"70dd77ce-4d30-4099-8af9-d32431f0eb5b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74898fsc" Jun 08 13:51:45.769917 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:45.769862 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74898fsc" Jun 08 13:51:45.903687 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:45.903663 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74898fsc"] Jun 08 13:51:45.905162 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:51:45.905136 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70dd77ce_4d30_4099_8af9_d32431f0eb5b.slice/crio-186c789c4d4c78c9f089f5220dc33b637133b9141213516671d64f14f2c698a4 WatchSource:0}: Error finding container 186c789c4d4c78c9f089f5220dc33b637133b9141213516671d64f14f2c698a4: Status 404 returned error can't find the container with id 186c789c4d4c78c9f089f5220dc33b637133b9141213516671d64f14f2c698a4 Jun 08 13:51:46.205046 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:46.205019 2561 generic.go:356] "Generic (PLEG): container finished" podID="70dd77ce-4d30-4099-8af9-d32431f0eb5b" containerID="3291f8b0675de63852664553f17ada53bc304fdb946e67b7c1ab2ed96c505bc6" exitCode=0 Jun 08 13:51:46.205209 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:46.205102 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74898fsc" event={"ID":"70dd77ce-4d30-4099-8af9-d32431f0eb5b","Type":"ContainerDied","Data":"3291f8b0675de63852664553f17ada53bc304fdb946e67b7c1ab2ed96c505bc6"} Jun 08 13:51:46.205209 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:46.205156 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74898fsc" event={"ID":"70dd77ce-4d30-4099-8af9-d32431f0eb5b","Type":"ContainerStarted","Data":"186c789c4d4c78c9f089f5220dc33b637133b9141213516671d64f14f2c698a4"} Jun 08 13:51:47.213553 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:47.213516 2561 generic.go:356] "Generic (PLEG): container finished" podID="70dd77ce-4d30-4099-8af9-d32431f0eb5b" containerID="0834ba15a9483c61c5bcd5703225f55bbf5c8551f1e8390f9f18ab699670ecbf" exitCode=0 Jun 08 13:51:47.213966 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:47.213594 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74898fsc" event={"ID":"70dd77ce-4d30-4099-8af9-d32431f0eb5b","Type":"ContainerDied","Data":"0834ba15a9483c61c5bcd5703225f55bbf5c8551f1e8390f9f18ab699670ecbf"} Jun 08 13:51:48.222102 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:48.222073 2561 generic.go:356] "Generic (PLEG): container finished" podID="70dd77ce-4d30-4099-8af9-d32431f0eb5b" containerID="e96aa48d5da85260906f3001c1c39e5cb90c7e8f918bb64dccc76442bf7a052f" exitCode=0 Jun 08 13:51:48.222462 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:48.222136 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74898fsc" event={"ID":"70dd77ce-4d30-4099-8af9-d32431f0eb5b","Type":"ContainerDied","Data":"e96aa48d5da85260906f3001c1c39e5cb90c7e8f918bb64dccc76442bf7a052f"} Jun 08 13:51:49.372453 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:49.372427 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74898fsc" Jun 08 13:51:49.418180 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:49.418154 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70dd77ce-4d30-4099-8af9-d32431f0eb5b-bundle\") pod \"70dd77ce-4d30-4099-8af9-d32431f0eb5b\" (UID: \"70dd77ce-4d30-4099-8af9-d32431f0eb5b\") " Jun 08 13:51:49.418339 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:49.418220 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70dd77ce-4d30-4099-8af9-d32431f0eb5b-util\") pod \"70dd77ce-4d30-4099-8af9-d32431f0eb5b\" (UID: \"70dd77ce-4d30-4099-8af9-d32431f0eb5b\") " Jun 08 13:51:49.418339 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:49.418256 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jsq2l\" (UniqueName: \"kubernetes.io/projected/70dd77ce-4d30-4099-8af9-d32431f0eb5b-kube-api-access-jsq2l\") pod \"70dd77ce-4d30-4099-8af9-d32431f0eb5b\" (UID: \"70dd77ce-4d30-4099-8af9-d32431f0eb5b\") " Jun 08 13:51:49.418664 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:49.418639 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70dd77ce-4d30-4099-8af9-d32431f0eb5b-bundle" (OuterVolumeSpecName: "bundle") pod "70dd77ce-4d30-4099-8af9-d32431f0eb5b" (UID: "70dd77ce-4d30-4099-8af9-d32431f0eb5b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:51:49.420268 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:49.420242 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70dd77ce-4d30-4099-8af9-d32431f0eb5b-kube-api-access-jsq2l" (OuterVolumeSpecName: "kube-api-access-jsq2l") pod "70dd77ce-4d30-4099-8af9-d32431f0eb5b" (UID: "70dd77ce-4d30-4099-8af9-d32431f0eb5b"). InnerVolumeSpecName "kube-api-access-jsq2l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:51:49.424460 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:49.424429 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70dd77ce-4d30-4099-8af9-d32431f0eb5b-util" (OuterVolumeSpecName: "util") pod "70dd77ce-4d30-4099-8af9-d32431f0eb5b" (UID: "70dd77ce-4d30-4099-8af9-d32431f0eb5b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:51:49.518957 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:49.518898 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70dd77ce-4d30-4099-8af9-d32431f0eb5b-bundle\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:51:49.518957 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:49.518920 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70dd77ce-4d30-4099-8af9-d32431f0eb5b-util\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:51:49.518957 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:49.518933 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jsq2l\" (UniqueName: \"kubernetes.io/projected/70dd77ce-4d30-4099-8af9-d32431f0eb5b-kube-api-access-jsq2l\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\"" Jun 08 13:51:50.235004 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:50.234969 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74898fsc" event={"ID":"70dd77ce-4d30-4099-8af9-d32431f0eb5b","Type":"ContainerDied","Data":"186c789c4d4c78c9f089f5220dc33b637133b9141213516671d64f14f2c698a4"} Jun 08 13:51:50.235170 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:50.235026 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="186c789c4d4c78c9f089f5220dc33b637133b9141213516671d64f14f2c698a4" Jun 08 13:51:50.235170 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:50.234977 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74898fsc" Jun 08 13:51:53.432941 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:53.432904 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-vrkz4"] Jun 08 13:51:53.433481 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:53.433463 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70dd77ce-4d30-4099-8af9-d32431f0eb5b" containerName="util" Jun 08 13:51:53.433531 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:53.433483 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="70dd77ce-4d30-4099-8af9-d32431f0eb5b" containerName="util" Jun 08 13:51:53.433531 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:53.433491 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70dd77ce-4d30-4099-8af9-d32431f0eb5b" containerName="pull" Jun 08 13:51:53.433531 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:53.433497 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="70dd77ce-4d30-4099-8af9-d32431f0eb5b" containerName="pull" Jun 08 13:51:53.433531 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:53.433517 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70dd77ce-4d30-4099-8af9-d32431f0eb5b" containerName="extract" Jun 08 13:51:53.433531 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:53.433523 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="70dd77ce-4d30-4099-8af9-d32431f0eb5b" containerName="extract" Jun 08 13:51:53.433682 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:53.433590 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="70dd77ce-4d30-4099-8af9-d32431f0eb5b" containerName="extract" Jun 08 13:51:53.437056 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:53.437038 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-vrkz4" Jun 08 13:51:53.439846 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:53.439823 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 08 13:51:53.439970 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:53.439846 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-zk9cl\"" Jun 08 13:51:53.439970 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:53.439908 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 08 13:51:53.448862 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:53.448839 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-vrkz4"] Jun 08 13:51:53.551243 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:53.551213 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pblx2\" (UniqueName: \"kubernetes.io/projected/badb9ec1-1329-4a60-89a3-020cbf9616c3-kube-api-access-pblx2\") pod \"keycloak-operator-d67dbbb48-vrkz4\" (UID: \"badb9ec1-1329-4a60-89a3-020cbf9616c3\") " pod="keycloak-system/keycloak-operator-d67dbbb48-vrkz4" Jun 08 13:51:53.651868 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:53.651832 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pblx2\" (UniqueName: \"kubernetes.io/projected/badb9ec1-1329-4a60-89a3-020cbf9616c3-kube-api-access-pblx2\") pod \"keycloak-operator-d67dbbb48-vrkz4\" (UID: \"badb9ec1-1329-4a60-89a3-020cbf9616c3\") " pod="keycloak-system/keycloak-operator-d67dbbb48-vrkz4" Jun 08 13:51:53.662674 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:53.662643 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pblx2\" (UniqueName: \"kubernetes.io/projected/badb9ec1-1329-4a60-89a3-020cbf9616c3-kube-api-access-pblx2\") pod \"keycloak-operator-d67dbbb48-vrkz4\" (UID: \"badb9ec1-1329-4a60-89a3-020cbf9616c3\") " pod="keycloak-system/keycloak-operator-d67dbbb48-vrkz4" Jun 08 13:51:53.749670 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:53.749607 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-vrkz4" Jun 08 13:51:53.884856 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:53.884826 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-vrkz4"] Jun 08 13:51:53.885732 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:51:53.885708 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbadb9ec1_1329_4a60_89a3_020cbf9616c3.slice/crio-4ef20c0c2bdad6630a243a7fabf7f987b5746de1a2867b38495ad3099e9fe496 WatchSource:0}: Error finding container 4ef20c0c2bdad6630a243a7fabf7f987b5746de1a2867b38495ad3099e9fe496: Status 404 returned error can't find the container with id 4ef20c0c2bdad6630a243a7fabf7f987b5746de1a2867b38495ad3099e9fe496 Jun 08 13:51:54.262314 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:54.262268 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-vrkz4" event={"ID":"badb9ec1-1329-4a60-89a3-020cbf9616c3","Type":"ContainerStarted","Data":"4ef20c0c2bdad6630a243a7fabf7f987b5746de1a2867b38495ad3099e9fe496"} Jun 08 13:51:59.303142 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:59.303095 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-vrkz4" event={"ID":"badb9ec1-1329-4a60-89a3-020cbf9616c3","Type":"ContainerStarted","Data":"863dd9376edbfe15376f2d2b98cc78726efbcb1557d6f05e772178afc510b4a7"} Jun 08 13:51:59.327178 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:51:59.327117 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-vrkz4" podStartSLOduration=1.6927710500000002 podStartE2EDuration="6.327098587s" totalImagesPullingTime="4.634327537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:51:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:51:59.322212811 +0000 UTC m=+533.303241081" watchObservedRunningTime="2026-06-08 13:51:59.327098587 +0000 UTC m=+533.308126859" Jun 08 13:52:07.258698 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:52:07.258658 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:52:07.356685 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:52:07.356640 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:52:28.621698 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:52:28.621657 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:52:28.722858 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:52:28.722820 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:52:36.820197 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:52:36.820165 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:52:37.029090 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:52:37.029052 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:52:42.546654 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:52:42.546623 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:52:42.646755 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:52:42.646722 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:52:42.738736 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:52:42.738709 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:52:43.403377 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:52:43.403336 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:52:44.912737 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:52:44.912692 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:52:46.679296 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:52:46.679241 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:52:46.782141 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:52:46.782109 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:53:06.463023 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:06.462989 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l7lbv_0453a3c5-bb95-4060-bd97-67aba216bcc6/console-operator/2.log" Jun 08 13:53:06.464872 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:06.464847 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l7lbv_0453a3c5-bb95-4060-bd97-67aba216bcc6/console-operator/2.log" Jun 08 13:53:17.757938 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:17.757903 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:53:18.130807 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:18.130713 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:53:18.239594 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:18.239561 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:53:18.343840 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:18.343809 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:53:18.389595 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:18.389571 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-9btx6"] Jun 08 13:53:18.393021 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:18.393002 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-9btx6" Jun 08 13:53:18.397653 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:18.397632 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-xdw6d\"" Jun 08 13:53:18.397818 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:18.397801 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 08 13:53:18.408383 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:18.408359 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-9btx6"] Jun 08 13:53:18.534834 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:18.534800 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99b2j\" (UniqueName: \"kubernetes.io/projected/6aa4d585-f6f4-4cf2-b459-bc6f3cde72d5-kube-api-access-99b2j\") pod \"payload-processing-7c6c859784-9btx6\" (UID: \"6aa4d585-f6f4-4cf2-b459-bc6f3cde72d5\") " pod="openshift-ingress/payload-processing-7c6c859784-9btx6" Jun 08 13:53:18.635841 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:18.635809 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99b2j\" (UniqueName: \"kubernetes.io/projected/6aa4d585-f6f4-4cf2-b459-bc6f3cde72d5-kube-api-access-99b2j\") pod \"payload-processing-7c6c859784-9btx6\" (UID: \"6aa4d585-f6f4-4cf2-b459-bc6f3cde72d5\") " pod="openshift-ingress/payload-processing-7c6c859784-9btx6" Jun 08 13:53:18.644946 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:18.644882 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99b2j\" (UniqueName: \"kubernetes.io/projected/6aa4d585-f6f4-4cf2-b459-bc6f3cde72d5-kube-api-access-99b2j\") pod \"payload-processing-7c6c859784-9btx6\" (UID: \"6aa4d585-f6f4-4cf2-b459-bc6f3cde72d5\") " pod="openshift-ingress/payload-processing-7c6c859784-9btx6" Jun 08 13:53:18.703723 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:18.703692 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-9btx6" Jun 08 13:53:18.861833 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:18.861729 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-9btx6"] Jun 08 13:53:18.862958 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:53:18.862914 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aa4d585_f6f4_4cf2_b459_bc6f3cde72d5.slice/crio-48c97c697c75efb77d0e3260bdf5a181451a5d2704d42ecf8d14bab20dbac52b WatchSource:0}: Error finding container 48c97c697c75efb77d0e3260bdf5a181451a5d2704d42ecf8d14bab20dbac52b: Status 404 returned error can't find the container with id 48c97c697c75efb77d0e3260bdf5a181451a5d2704d42ecf8d14bab20dbac52b Jun 08 13:53:18.865017 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:18.864997 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 13:53:19.751357 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:19.751319 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-9btx6" event={"ID":"6aa4d585-f6f4-4cf2-b459-bc6f3cde72d5","Type":"ContainerStarted","Data":"48c97c697c75efb77d0e3260bdf5a181451a5d2704d42ecf8d14bab20dbac52b"} Jun 08 13:53:21.766147 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:21.766048 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-9btx6" event={"ID":"6aa4d585-f6f4-4cf2-b459-bc6f3cde72d5","Type":"ContainerStarted","Data":"8d6a00ba31a580fdba62028506c65b192e0822811bfaf444fd187a677274c4da"} Jun 08 13:53:21.766558 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:21.766208 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-9btx6" Jun 08 13:53:21.784139 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:21.784100 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-9btx6" podStartSLOduration=1.21399153 podStartE2EDuration="3.784087345s" totalImagesPullingTime="2.570095815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:53:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:53:21.783287188 +0000 UTC m=+615.764315478" watchObservedRunningTime="2026-06-08 13:53:21.784087345 +0000 UTC m=+615.765115614" Jun 08 13:53:26.795696 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:26.795660 2561 generic.go:356] "Generic (PLEG): container finished" podID="fead1cc9-ff82-431e-a8e3-4e9f1577d0c1" containerID="b313bc01f61a55a0f9b7d03846d98c0a131a2bb3936bd9bc90d1ed1159a7bcdd" exitCode=0 Jun 08 13:53:26.796128 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:26.795733 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" event={"ID":"fead1cc9-ff82-431e-a8e3-4e9f1577d0c1","Type":"ContainerDied","Data":"b313bc01f61a55a0f9b7d03846d98c0a131a2bb3936bd9bc90d1ed1159a7bcdd"} Jun 08 13:53:26.796128 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:26.796064 2561 scope.go:117] "RemoveContainer" containerID="b313bc01f61a55a0f9b7d03846d98c0a131a2bb3936bd9bc90d1ed1159a7bcdd" Jun 08 13:53:26.797033 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:26.797007 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 13:53:26.797100 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:26.797077 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 13:53:26.797155 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:26.797120 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 13:53:27.806794 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:27.806409 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" event={"ID":"fead1cc9-ff82-431e-a8e3-4e9f1577d0c1","Type":"ContainerStarted","Data":"a01002ce4aa5f1481beaf1d3b6db5743241c0bbce93de66394ed9d2f32adc919"} Jun 08 13:53:28.554416 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:28.554388 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:53:28.555684 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:28.555658 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-vpprs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jun 08 13:53:28.555824 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:28.555715 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" podUID="fead1cc9-ff82-431e-a8e3-4e9f1577d0c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jun 08 13:53:29.554594 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:29.554558 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-vpprs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jun 08 13:53:29.555007 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:29.554610 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" podUID="fead1cc9-ff82-431e-a8e3-4e9f1577d0c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jun 08 13:53:30.554258 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:30.554226 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-vpprs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jun 08 13:53:30.554437 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:30.554275 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" podUID="fead1cc9-ff82-431e-a8e3-4e9f1577d0c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jun 08 13:53:31.569627 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:31.569592 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:53:31.570084 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:31.570012 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:53:31.570755 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:31.570735 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-vpprs" Jun 08 13:53:32.774403 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:53:32.774373 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-9btx6" Jun 08 13:54:08.714005 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:08.713921 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:54:10.130722 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:10.130684 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:54:23.438905 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:23.438868 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:54:28.862457 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:28.862423 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:54:32.545149 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:32.545110 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:54:32.611391 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:32.611361 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:54:43.820239 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:43.820207 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv"] Jun 08 13:54:43.823909 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:43.823893 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv" Jun 08 13:54:43.829527 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:43.829503 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 08 13:54:43.829527 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:43.829522 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 08 13:54:43.831016 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:43.830994 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2fd7t\"" Jun 08 13:54:43.831119 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:43.831101 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 08 13:54:43.841040 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:43.841017 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv"] Jun 08 13:54:43.874229 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:43.874195 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:54:43.928876 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:43.928848 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b98cae30-a14a-4e50-9e57-313af81fe11e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv\" (UID: \"b98cae30-a14a-4e50-9e57-313af81fe11e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv" Jun 08 13:54:43.929024 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:43.928911 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b98cae30-a14a-4e50-9e57-313af81fe11e-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv\" (UID: \"b98cae30-a14a-4e50-9e57-313af81fe11e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv" Jun 08 13:54:43.929024 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:43.928984 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b98cae30-a14a-4e50-9e57-313af81fe11e-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv\" (UID: \"b98cae30-a14a-4e50-9e57-313af81fe11e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv" Jun 08 13:54:43.929024 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:43.929010 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b98cae30-a14a-4e50-9e57-313af81fe11e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv\" (UID: \"b98cae30-a14a-4e50-9e57-313af81fe11e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv" Jun 08 13:54:43.929136 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:43.929049 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd6td\" (UniqueName: \"kubernetes.io/projected/b98cae30-a14a-4e50-9e57-313af81fe11e-kube-api-access-cd6td\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv\" (UID: \"b98cae30-a14a-4e50-9e57-313af81fe11e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv" Jun 08 13:54:43.929136 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:43.929070 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b98cae30-a14a-4e50-9e57-313af81fe11e-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv\" (UID: \"b98cae30-a14a-4e50-9e57-313af81fe11e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv" Jun 08 13:54:44.030329 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:44.030303 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b98cae30-a14a-4e50-9e57-313af81fe11e-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv\" (UID: \"b98cae30-a14a-4e50-9e57-313af81fe11e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv" Jun 08 13:54:44.030329 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:44.030332 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b98cae30-a14a-4e50-9e57-313af81fe11e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv\" (UID: \"b98cae30-a14a-4e50-9e57-313af81fe11e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv" Jun 08 13:54:44.030505 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:44.030367 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd6td\" (UniqueName: \"kubernetes.io/projected/b98cae30-a14a-4e50-9e57-313af81fe11e-kube-api-access-cd6td\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv\" (UID: \"b98cae30-a14a-4e50-9e57-313af81fe11e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv" Jun 08 13:54:44.030505 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:44.030428 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b98cae30-a14a-4e50-9e57-313af81fe11e-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv\" (UID: \"b98cae30-a14a-4e50-9e57-313af81fe11e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv" Jun 08 13:54:44.030505 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:44.030489 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b98cae30-a14a-4e50-9e57-313af81fe11e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv\" (UID: \"b98cae30-a14a-4e50-9e57-313af81fe11e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv" Jun 08 13:54:44.030626 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:44.030548 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b98cae30-a14a-4e50-9e57-313af81fe11e-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv\" (UID: \"b98cae30-a14a-4e50-9e57-313af81fe11e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv" Jun 08 13:54:44.030813 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:44.030749 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b98cae30-a14a-4e50-9e57-313af81fe11e-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv\" (UID: \"b98cae30-a14a-4e50-9e57-313af81fe11e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv" Jun 08 13:54:44.030813 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:44.030798 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b98cae30-a14a-4e50-9e57-313af81fe11e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv\" (UID: \"b98cae30-a14a-4e50-9e57-313af81fe11e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv" Jun 08 13:54:44.031015 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:44.030874 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b98cae30-a14a-4e50-9e57-313af81fe11e-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv\" (UID: \"b98cae30-a14a-4e50-9e57-313af81fe11e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv" Jun 08 13:54:44.032716 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:44.032695 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b98cae30-a14a-4e50-9e57-313af81fe11e-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv\" (UID: \"b98cae30-a14a-4e50-9e57-313af81fe11e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv" Jun 08 13:54:44.033106 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:44.033087 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b98cae30-a14a-4e50-9e57-313af81fe11e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv\" (UID: \"b98cae30-a14a-4e50-9e57-313af81fe11e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv" Jun 08 13:54:44.043025 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:44.043007 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd6td\" (UniqueName: \"kubernetes.io/projected/b98cae30-a14a-4e50-9e57-313af81fe11e-kube-api-access-cd6td\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv\" (UID: \"b98cae30-a14a-4e50-9e57-313af81fe11e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv" Jun 08 13:54:44.134719 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:44.134690 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv" Jun 08 13:54:44.278365 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:44.278338 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv"] Jun 08 13:54:44.279942 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:54:44.279913 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb98cae30_a14a_4e50_9e57_313af81fe11e.slice/crio-d249c9f9b06311388c3fb2648d0af3406f1080986af0ec870a7e8a539cf61b1b WatchSource:0}: Error finding container d249c9f9b06311388c3fb2648d0af3406f1080986af0ec870a7e8a539cf61b1b: Status 404 returned error can't find the container with id d249c9f9b06311388c3fb2648d0af3406f1080986af0ec870a7e8a539cf61b1b Jun 08 13:54:45.263032 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:45.262990 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv" event={"ID":"b98cae30-a14a-4e50-9e57-313af81fe11e","Type":"ContainerStarted","Data":"d249c9f9b06311388c3fb2648d0af3406f1080986af0ec870a7e8a539cf61b1b"} Jun 08 13:54:48.288317 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:48.288281 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv" event={"ID":"b98cae30-a14a-4e50-9e57-313af81fe11e","Type":"ContainerStarted","Data":"07820c184fb552956c306d1f533c66356556a115f12dd83447a1c53212cb0f06"} Jun 08 13:54:58.685620 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:54:58.685533 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:55:01.885519 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:01.885485 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:55:09.191488 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:09.191432 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:55:13.054187 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:13.054154 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:55:16.176618 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:16.176586 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-w4x77"] Jun 08 13:55:16.180354 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:16.180339 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-w4x77" Jun 08 13:55:16.183241 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:16.183216 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 08 13:55:16.193242 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:16.193219 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-w4x77"] Jun 08 13:55:16.206816 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:16.206788 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:55:16.303302 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:16.303268 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ccafefc7-3bda-421e-a436-9bc958815ae6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-w4x77\" (UID: \"ccafefc7-3bda-421e-a436-9bc958815ae6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-w4x77" Jun 08 13:55:16.303434 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:16.303342 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd5jm\" (UniqueName: \"kubernetes.io/projected/ccafefc7-3bda-421e-a436-9bc958815ae6-kube-api-access-xd5jm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-w4x77\" (UID: \"ccafefc7-3bda-421e-a436-9bc958815ae6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-w4x77" Jun 08 13:55:16.303434 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:16.303376 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccafefc7-3bda-421e-a436-9bc958815ae6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-w4x77\" (UID: \"ccafefc7-3bda-421e-a436-9bc958815ae6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-w4x77" Jun 08 13:55:16.303434 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:16.303398 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ccafefc7-3bda-421e-a436-9bc958815ae6-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-w4x77\" (UID: \"ccafefc7-3bda-421e-a436-9bc958815ae6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-w4x77" Jun 08 13:55:16.303620 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:16.303488 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ccafefc7-3bda-421e-a436-9bc958815ae6-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-w4x77\" (UID: \"ccafefc7-3bda-421e-a436-9bc958815ae6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-w4x77" Jun 08 13:55:16.303620 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:16.303513 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ccafefc7-3bda-421e-a436-9bc958815ae6-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-w4x77\" (UID: \"ccafefc7-3bda-421e-a436-9bc958815ae6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-w4x77" Jun 08 13:55:16.404184 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:16.404154 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd5jm\" (UniqueName: \"kubernetes.io/projected/ccafefc7-3bda-421e-a436-9bc958815ae6-kube-api-access-xd5jm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-w4x77\" (UID: \"ccafefc7-3bda-421e-a436-9bc958815ae6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-w4x77" Jun 08 13:55:16.404184 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:16.404190 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccafefc7-3bda-421e-a436-9bc958815ae6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-w4x77\" (UID: \"ccafefc7-3bda-421e-a436-9bc958815ae6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-w4x77" Jun 08 13:55:16.404403 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:16.404223 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ccafefc7-3bda-421e-a436-9bc958815ae6-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-w4x77\" (UID: \"ccafefc7-3bda-421e-a436-9bc958815ae6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-w4x77" Jun 08 13:55:16.404403 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:16.404249 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ccafefc7-3bda-421e-a436-9bc958815ae6-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-w4x77\" (UID: \"ccafefc7-3bda-421e-a436-9bc958815ae6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-w4x77" Jun 08 13:55:16.404403 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:16.404265 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ccafefc7-3bda-421e-a436-9bc958815ae6-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-w4x77\" (UID: \"ccafefc7-3bda-421e-a436-9bc958815ae6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-w4x77" Jun 08 13:55:16.404403 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:16.404286 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ccafefc7-3bda-421e-a436-9bc958815ae6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-w4x77\" (UID: \"ccafefc7-3bda-421e-a436-9bc958815ae6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-w4x77" Jun 08 13:55:16.404714 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:16.404685 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ccafefc7-3bda-421e-a436-9bc958815ae6-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-w4x77\" (UID: \"ccafefc7-3bda-421e-a436-9bc958815ae6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-w4x77" Jun 08 13:55:16.404875 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:16.404716 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ccafefc7-3bda-421e-a436-9bc958815ae6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-w4x77\" (UID: \"ccafefc7-3bda-421e-a436-9bc958815ae6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-w4x77" Jun 08 13:55:16.404875 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:16.404786 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ccafefc7-3bda-421e-a436-9bc958815ae6-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-w4x77\" (UID: \"ccafefc7-3bda-421e-a436-9bc958815ae6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-w4x77" Jun 08 13:55:16.407310 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:16.407290 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ccafefc7-3bda-421e-a436-9bc958815ae6-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-w4x77\" (UID: \"ccafefc7-3bda-421e-a436-9bc958815ae6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-w4x77" Jun 08 13:55:16.407593 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:16.407575 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccafefc7-3bda-421e-a436-9bc958815ae6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-w4x77\" (UID: \"ccafefc7-3bda-421e-a436-9bc958815ae6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-w4x77" Jun 08 13:55:16.412552 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:16.412529 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd5jm\" (UniqueName: \"kubernetes.io/projected/ccafefc7-3bda-421e-a436-9bc958815ae6-kube-api-access-xd5jm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-w4x77\" (UID: \"ccafefc7-3bda-421e-a436-9bc958815ae6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-w4x77" Jun 08 13:55:16.490756 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:16.490701 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-w4x77" Jun 08 13:55:16.631493 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:16.631466 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-w4x77"] Jun 08 13:55:16.632280 ip-10-0-132-92 kubenswrapper[2561]: W0608 13:55:16.632255 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccafefc7_3bda_421e_a436_9bc958815ae6.slice/crio-5821441182bd76c1490031d96da75cf5464a8a1735b9edcee6bd143084e39350 WatchSource:0}: Error finding container 5821441182bd76c1490031d96da75cf5464a8a1735b9edcee6bd143084e39350: Status 404 returned error can't find the container with id 5821441182bd76c1490031d96da75cf5464a8a1735b9edcee6bd143084e39350 Jun 08 13:55:17.459815 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:17.459783 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-w4x77" event={"ID":"ccafefc7-3bda-421e-a436-9bc958815ae6","Type":"ContainerStarted","Data":"9442373e60db8f7066a6aaaea25b22d1f413f260c01facdec473f0509e2d899a"} Jun 08 13:55:17.460185 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:17.459823 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-w4x77" event={"ID":"ccafefc7-3bda-421e-a436-9bc958815ae6","Type":"ContainerStarted","Data":"5821441182bd76c1490031d96da75cf5464a8a1735b9edcee6bd143084e39350"} Jun 08 13:55:26.186929 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:26.186871 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:55:53.660689 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:53.660656 2561 generic.go:356] "Generic (PLEG): container finished" podID="b98cae30-a14a-4e50-9e57-313af81fe11e" containerID="07820c184fb552956c306d1f533c66356556a115f12dd83447a1c53212cb0f06" exitCode=0 Jun 08 13:55:53.661102 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:53.660705 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv" event={"ID":"b98cae30-a14a-4e50-9e57-313af81fe11e","Type":"ContainerDied","Data":"07820c184fb552956c306d1f533c66356556a115f12dd83447a1c53212cb0f06"} Jun 08 13:55:55.677145 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:55.677112 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv" event={"ID":"b98cae30-a14a-4e50-9e57-313af81fe11e","Type":"ContainerStarted","Data":"9186d3994f5d0c6f2f76d89f0f54603cec5cb5eb376a7301f119fedde450c7b7"} Jun 08 13:55:55.699618 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:55.699571 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv" podStartSLOduration=2.933939085 podStartE2EDuration="1m12.699556589s" totalImagesPullingTime="4.323227784s" totalInitContainerRuntime="1m5.44238972s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:54:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:55:55.697405627 +0000 UTC m=+769.678433907" watchObservedRunningTime="2026-06-08 13:55:55.699556589 +0000 UTC m=+769.680584858" Jun 08 13:55:55.933388 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:55:55.933289 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:56:04.135096 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:56:04.135056 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv" Jun 08 13:56:04.135587 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:56:04.135131 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv" Jun 08 13:56:04.147380 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:56:04.147356 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv" Jun 08 13:56:04.739210 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:56:04.739179 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv" Jun 08 13:56:08.751012 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:56:08.750975 2561 generic.go:356] "Generic (PLEG): container finished" podID="ccafefc7-3bda-421e-a436-9bc958815ae6" containerID="9442373e60db8f7066a6aaaea25b22d1f413f260c01facdec473f0509e2d899a" exitCode=0 Jun 08 13:56:08.751403 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:56:08.751012 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-w4x77" event={"ID":"ccafefc7-3bda-421e-a436-9bc958815ae6","Type":"ContainerDied","Data":"9442373e60db8f7066a6aaaea25b22d1f413f260c01facdec473f0509e2d899a"} Jun 08 13:56:09.765391 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:56:09.765356 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-w4x77" event={"ID":"ccafefc7-3bda-421e-a436-9bc958815ae6","Type":"ContainerStarted","Data":"180aa7a2f9f83c9c31abbe2fb2ca1a7f361a173085c2728b23a15f671d835a38"} Jun 08 13:56:09.798883 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:56:09.798838 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-w4x77" podStartSLOduration=2.210364643 podStartE2EDuration="53.79882425s" totalImagesPullingTime="303.571032ms" totalInitContainerRuntime="51.284888575s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:55:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:56:09.797498881 +0000 UTC m=+783.778527173" watchObservedRunningTime="2026-06-08 13:56:09.79882425 +0000 UTC m=+783.779852527" Jun 08 13:56:16.491107 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:56:16.491078 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-w4x77" Jun 08 13:56:16.491107 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:56:16.491115 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-w4x77" Jun 08 13:56:16.503863 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:56:16.503834 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-w4x77" Jun 08 13:56:16.819508 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:56:16.819422 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-w4x77" Jun 08 13:56:22.948899 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:56:22.948856 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:56:23.047958 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:56:23.047923 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:56:24.276572 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:56:24.276529 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:56:24.377581 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:56:24.377548 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:57:52.632174 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:57:52.632136 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:57:54.111238 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:57:54.111205 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:58:06.507862 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:58:06.507835 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l7lbv_0453a3c5-bb95-4060-bd97-67aba216bcc6/console-operator/2.log" Jun 08 13:58:06.509094 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:58:06.509071 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l7lbv_0453a3c5-bb95-4060-bd97-67aba216bcc6/console-operator/2.log" Jun 08 13:58:34.160002 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:58:34.159963 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:58:34.263065 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:58:34.263029 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:58:42.695292 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:58:42.695253 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:58:48.539681 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:58:48.539644 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:58:48.641170 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:58:48.641141 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:59:20.705411 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:59:20.705367 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:59:21.709229 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:59:21.709198 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:59:44.754882 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:59:44.754789 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:59:50.475507 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:59:50.475470 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:59:50.534411 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:59:50.534379 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:59:50.639681 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:59:50.639640 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:59:50.726289 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:59:50.726209 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:59:50.870949 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:59:50.870914 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:59:50.967097 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:59:50.967059 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 13:59:54.612703 ip-10-0-132-92 kubenswrapper[2561]: I0608 13:59:54.612664 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:00:07.465639 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:00:07.465602 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:00:07.571109 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:00:07.571060 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:00:07.696620 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:00:07.696590 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:00:13.617444 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:00:13.617406 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:00:13.717296 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:00:13.717263 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:00:14.236013 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:00:14.235968 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:00:14.335954 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:00:14.335926 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:00:21.752220 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:00:21.752174 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:00:21.849987 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:00:21.849952 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:00:21.949331 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:00:21.949292 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:00:22.050124 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:00:22.049989 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:00:38.542258 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:00:38.542217 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:00:38.653628 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:00:38.653589 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:00:38.766718 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:00:38.766683 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:00:44.755672 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:00:44.755633 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:00:44.830986 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:00:44.830958 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:01:05.177997 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:01:05.177940 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:01:05.272776 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:01:05.272728 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:01:05.390428 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:01:05.390390 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:01:11.303638 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:01:11.303603 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:01:11.366011 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:01:11.365976 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:01:11.460643 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:01:11.460598 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:01:11.556710 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:01:11.556623 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:01:11.664124 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:01:11.664092 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:01:17.463611 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:01:17.463580 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:01:17.529303 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:01:17.529263 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:03:06.546054 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:03:06.546020 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l7lbv_0453a3c5-bb95-4060-bd97-67aba216bcc6/console-operator/2.log" Jun 08 14:03:06.548524 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:03:06.548504 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l7lbv_0453a3c5-bb95-4060-bd97-67aba216bcc6/console-operator/2.log" Jun 08 14:03:50.032428 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:03:50.032377 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:03:50.096849 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:03:50.096821 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:04:18.281252 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:04:18.281152 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:05:44.545681 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:05:44.545588 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:05:45.709286 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:05:45.709246 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:08:06.584969 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:08:06.584940 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l7lbv_0453a3c5-bb95-4060-bd97-67aba216bcc6/console-operator/2.log" Jun 08 14:08:06.590599 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:08:06.590575 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l7lbv_0453a3c5-bb95-4060-bd97-67aba216bcc6/console-operator/2.log" Jun 08 14:09:52.410122 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:09:52.410089 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:12:33.199032 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:12:33.199005 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:12:34.169605 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:12:34.169567 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:13:06.625557 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:13:06.625531 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l7lbv_0453a3c5-bb95-4060-bd97-67aba216bcc6/console-operator/2.log" Jun 08 14:13:06.631983 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:13:06.631960 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l7lbv_0453a3c5-bb95-4060-bd97-67aba216bcc6/console-operator/2.log" Jun 08 14:15:34.260698 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:15:34.260664 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:17:41.653107 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:17:41.653021 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:18:06.663488 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:18:06.663454 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l7lbv_0453a3c5-bb95-4060-bd97-67aba216bcc6/console-operator/2.log" Jun 08 14:18:06.677389 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:18:06.677367 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l7lbv_0453a3c5-bb95-4060-bd97-67aba216bcc6/console-operator/2.log" Jun 08 14:18:13.767987 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:18:13.767953 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:18:19.180107 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:18:19.180073 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:18:43.444090 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:18:43.444047 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:18:56.528129 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:18:56.528048 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:18:58.240341 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:18:58.240306 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:18:58.303956 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:18:58.303926 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:18:58.392066 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:18:58.392034 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:18:58.490234 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:18:58.490156 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:19:02.643354 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:02.643327 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:19:04.493406 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:04.493374 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:19:04.670224 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:04.670191 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:19:04.770168 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:04.770082 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:19:06.820528 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:06.820500 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:19:10.568683 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:10.568648 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:19:10.670230 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:10.670199 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:19:10.804924 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:10.804892 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:19:10.890719 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:10.890685 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:19:11.000902 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:11.000869 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:19:11.101386 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:11.101357 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:19:14.605480 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:14.605454 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:19:17.087368 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:17.087337 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:19:18.339395 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:18.339360 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:19:18.436093 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:18.436054 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:19:20.006645 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:20.006612 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:19:25.665122 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:25.665091 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:19:25.754185 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:25.754148 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:19:36.578302 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:36.578260 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7cc5c547d9-49ng9_da9b7e87-b6b4-420b-8761-e977279d50bc/nginx/0.log" Jun 08 14:19:36.809483 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:36.809451 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-29g7k_34d74f96-dd06-414a-a3cc-cb38bc3a0cfd/manager/0.log" Jun 08 14:19:36.925139 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:36.925115 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-sgp8p_0ecccf64-9845-4d0d-8677-0fae665cc1aa/manager/0.log" Jun 08 14:19:37.545666 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:37.545643 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-4ljw4_dc424145-96e7-4507-8b7f-a13e18bc28e1/server/0.log" Jun 08 14:19:37.673778 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:37.673734 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-ckl6w_ae648dcc-6082-4f23-81c5-e36c3ccfadac/manager/0.log" Jun 08 14:19:38.066258 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:38.066231 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85cc8d7945-vh4sk_c39fdb72-2311-4d04-9ad5-60d435297dff/copy-manifests/0.log" Jun 08 14:19:38.080914 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:38.080888 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85cc8d7945-vh4sk_c39fdb72-2311-4d04-9ad5-60d435297dff/manager/0.log" Jun 08 14:19:38.205989 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:38.205965 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-rczhn_40450016-b933-4fa7-83c6-9d3a3b48522e/postgres/0.log" Jun 08 14:19:38.975818 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:38.975728 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr_fdbeac15-42f8-44da-9b0e-05082c488dc8/extract/0.log" Jun 08 14:19:38.982537 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:38.982516 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr_fdbeac15-42f8-44da-9b0e-05082c488dc8/util/0.log" Jun 08 14:19:38.989181 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:38.989160 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr_fdbeac15-42f8-44da-9b0e-05082c488dc8/pull/0.log" Jun 08 14:19:39.109571 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:39.109540 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps_495a65a8-dc4f-4bda-be1f-271aabdadb43/util/0.log" Jun 08 14:19:39.117626 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:39.117607 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps_495a65a8-dc4f-4bda-be1f-271aabdadb43/pull/0.log" Jun 08 14:19:39.125875 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:39.125841 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps_495a65a8-dc4f-4bda-be1f-271aabdadb43/extract/0.log" Jun 08 14:19:39.242619 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:39.242547 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5_b0522c72-75db-4010-adc3-f21e71690dc1/util/0.log" Jun 08 14:19:39.250403 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:39.250382 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5_b0522c72-75db-4010-adc3-f21e71690dc1/pull/0.log" Jun 08 14:19:39.258679 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:39.258658 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5_b0522c72-75db-4010-adc3-f21e71690dc1/extract/0.log" Jun 08 14:19:39.372182 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:39.372165 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp_ba63d5c3-f1a4-4819-8bee-4756cede16eb/util/0.log" Jun 08 14:19:39.380090 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:39.380070 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp_ba63d5c3-f1a4-4819-8bee-4756cede16eb/pull/0.log" Jun 08 14:19:39.388337 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:39.388317 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp_ba63d5c3-f1a4-4819-8bee-4756cede16eb/extract/0.log" Jun 08 14:19:39.757601 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:39.757578 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-4pqlh_867278ef-5321-45af-9185-82605c390596/manager/0.log" Jun 08 14:19:40.883446 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:40.883418 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-c97s2_0727bf58-fe74-4801-b4b1-e717f5e39ead/discovery/0.log" Jun 08 14:19:41.005136 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:41.005100 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-576c89d9d8-cwc7x_7ea87952-aa57-4d1c-92dd-ef35ae4a61dd/kube-auth-proxy/0.log" Jun 08 14:19:41.257427 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:41.257397 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-vpprs_fead1cc9-ff82-431e-a8e3-4e9f1577d0c1/istio-proxy/1.log" Jun 08 14:19:41.509664 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:41.509560 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-9btx6_6aa4d585-f6f4-4cf2-b459-bc6f3cde72d5/payload-processing/0.log" Jun 08 14:19:41.627680 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:41.627636 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76c77975cf-zh8wm_3977f3b1-efb9-45fb-8c63-9f7c504f8eed/router/0.log" Jun 08 14:19:42.241937 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:42.241893 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv_b98cae30-a14a-4e50-9e57-313af81fe11e/storage-initializer/0.log" Jun 08 14:19:42.250059 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:42.250034 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-pz9hv_b98cae30-a14a-4e50-9e57-313af81fe11e/main/0.log" Jun 08 14:19:42.627701 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:42.627626 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-w4x77_ccafefc7-3bda-421e-a436-9bc958815ae6/storage-initializer/0.log" Jun 08 14:19:42.636574 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:42.636550 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-w4x77_ccafefc7-3bda-421e-a436-9bc958815ae6/main/0.log" Jun 08 14:19:46.866552 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:46.866519 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:19:46.945496 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:46.945452 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:19:50.152827 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:50.152801 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kzr55_43325f79-05b7-4adc-b726-9dbf5b9e5b68/global-pull-secret-syncer/0.log" Jun 08 14:19:50.249755 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:50.249722 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" Jun 08 14:19:50.340992 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:50.340966 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-92.ec2.internal_4e0e67f7045596994bc0d64a2b9588c2/haproxy/0.log" Jun 08 14:19:51.987840 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:51.987809 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fw8m_42ec3ccf-8ea7-4b23-810a-59696755f5ca/konnectivity-agent/0.log" limit=1024 Jun 08 14:19:54.063682 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:54.063648 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-d88hf_895094f3-3b52-4a9f-b7b3-7494437cd4ca/sail-operator/0.log" Jun 08 14:19:54.907892 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:54.907865 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr_fdbeac15-42f8-44da-9b0e-05082c488dc8/extract/0.log" Jun 08 14:19:54.940437 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:54.940418 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr_fdbeac15-42f8-44da-9b0e-05082c488dc8/util/0.log" Jun 08 14:19:54.980066 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:54.980045 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j57gr_fdbeac15-42f8-44da-9b0e-05082c488dc8/pull/0.log" Jun 08 14:19:55.030424 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:55.030401 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps_495a65a8-dc4f-4bda-be1f-271aabdadb43/extract/0.log" Jun 08 14:19:55.074752 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:55.074728 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps_495a65a8-dc4f-4bda-be1f-271aabdadb43/util/0.log" Jun 08 14:19:55.128669 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:55.128642 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqjps_495a65a8-dc4f-4bda-be1f-271aabdadb43/pull/0.log" Jun 08 14:19:55.173847 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:55.173784 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5_b0522c72-75db-4010-adc3-f21e71690dc1/extract/0.log" Jun 08 14:19:55.206377 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:55.206352 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5_b0522c72-75db-4010-adc3-f21e71690dc1/util/0.log" Jun 08 14:19:55.231000 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:55.230974 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fp6g5_b0522c72-75db-4010-adc3-f21e71690dc1/pull/0.log" Jun 08 14:19:55.268116 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:55.268094 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp_ba63d5c3-f1a4-4819-8bee-4756cede16eb/extract/0.log" Jun 08 14:19:55.294051 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:55.294031 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp_ba63d5c3-f1a4-4819-8bee-4756cede16eb/util/0.log" Jun 08 14:19:55.317098 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:55.317080 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rnslp_ba63d5c3-f1a4-4819-8bee-4756cede16eb/pull/0.log" Jun 08 14:19:55.639680 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:55.639660 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-4pqlh_867278ef-5321-45af-9185-82605c390596/manager/0.log" Jun 08 14:19:57.637188 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:57.637161 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-fzt4k_3a631351-b41a-4d67-952f-96bb322cddc9/cluster-monitoring-operator/0.log" Jun 08 14:19:58.282304 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:58.282233 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vfjhj_f5e8500c-e54b-4307-83b7-1f39f63165f2/node-exporter/0.log" Jun 08 14:19:58.306108 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:58.306089 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vfjhj_f5e8500c-e54b-4307-83b7-1f39f63165f2/kube-rbac-proxy/0.log" Jun 08 14:19:58.329156 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:19:58.329137 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vfjhj_f5e8500c-e54b-4307-83b7-1f39f63165f2/init-textfile/0.log" Jun 08 14:20:00.163875 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:00.163846 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-k4lxx_0ba77c5b-eaff-4674-9cd8-897e0da339b4/networking-console-plugin/0.log" Jun 08 14:20:00.878812 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:00.878786 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l7lbv_0453a3c5-bb95-4060-bd97-67aba216bcc6/console-operator/2.log" Jun 08 14:20:00.882302 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:00.882283 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l7lbv_0453a3c5-bb95-4060-bd97-67aba216bcc6/console-operator/3.log" Jun 08 14:20:01.520466 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:01.520444 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d746b54dd-2f47d_035accbb-8959-4e6a-bbfb-873b6c1c79b5/console/0.log" Jun 08 14:20:01.555832 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:01.555811 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-hlzqv_06d98bf2-a0f5-4c6d-be96-16118f0967cd/download-server/0.log" Jun 08 14:20:01.733747 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:01.733718 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dlgqx/perf-node-gather-daemonset-8hk7n"] Jun 08 14:20:01.737431 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:01.737414 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-8hk7n" Jun 08 14:20:01.744127 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:01.744021 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dlgqx\"/\"kube-root-ca.crt\"" Jun 08 14:20:01.744279 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:01.744263 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dlgqx\"/\"openshift-service-ca.crt\"" Jun 08 14:20:01.745526 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:01.745512 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dlgqx\"/\"default-dockercfg-kzp2z\"" Jun 08 14:20:01.755889 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:01.755869 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dlgqx/perf-node-gather-daemonset-8hk7n"] Jun 08 14:20:01.784566 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:01.784508 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5b5d1ec5-b456-4e1e-85eb-4bc05286f3fc-podres\") pod \"perf-node-gather-daemonset-8hk7n\" (UID: \"5b5d1ec5-b456-4e1e-85eb-4bc05286f3fc\") " pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-8hk7n" Jun 08 14:20:01.784671 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:01.784610 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b5d1ec5-b456-4e1e-85eb-4bc05286f3fc-sys\") pod \"perf-node-gather-daemonset-8hk7n\" (UID: \"5b5d1ec5-b456-4e1e-85eb-4bc05286f3fc\") " pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-8hk7n" Jun 08 14:20:01.784671 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:01.784643 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5b5d1ec5-b456-4e1e-85eb-4bc05286f3fc-lib-modules\") pod \"perf-node-gather-daemonset-8hk7n\" (UID: \"5b5d1ec5-b456-4e1e-85eb-4bc05286f3fc\") " pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-8hk7n" Jun 08 14:20:01.784802 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:01.784675 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5b5d1ec5-b456-4e1e-85eb-4bc05286f3fc-proc\") pod \"perf-node-gather-daemonset-8hk7n\" (UID: \"5b5d1ec5-b456-4e1e-85eb-4bc05286f3fc\") " pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-8hk7n" Jun 08 14:20:01.784802 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:01.784698 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pv4c\" (UniqueName: \"kubernetes.io/projected/5b5d1ec5-b456-4e1e-85eb-4bc05286f3fc-kube-api-access-8pv4c\") pod \"perf-node-gather-daemonset-8hk7n\" (UID: \"5b5d1ec5-b456-4e1e-85eb-4bc05286f3fc\") " pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-8hk7n" Jun 08 14:20:01.885315 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:01.885288 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b5d1ec5-b456-4e1e-85eb-4bc05286f3fc-sys\") pod \"perf-node-gather-daemonset-8hk7n\" (UID: \"5b5d1ec5-b456-4e1e-85eb-4bc05286f3fc\") " pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-8hk7n" Jun 08 14:20:01.885437 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:01.885324 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5b5d1ec5-b456-4e1e-85eb-4bc05286f3fc-lib-modules\") pod \"perf-node-gather-daemonset-8hk7n\" (UID: \"5b5d1ec5-b456-4e1e-85eb-4bc05286f3fc\") " pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-8hk7n" Jun 08 14:20:01.885437 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:01.885348 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5b5d1ec5-b456-4e1e-85eb-4bc05286f3fc-proc\") pod \"perf-node-gather-daemonset-8hk7n\" (UID: \"5b5d1ec5-b456-4e1e-85eb-4bc05286f3fc\") " pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-8hk7n" Jun 08 14:20:01.885437 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:01.885375 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pv4c\" (UniqueName: \"kubernetes.io/projected/5b5d1ec5-b456-4e1e-85eb-4bc05286f3fc-kube-api-access-8pv4c\") pod \"perf-node-gather-daemonset-8hk7n\" (UID: \"5b5d1ec5-b456-4e1e-85eb-4bc05286f3fc\") " pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-8hk7n" Jun 08 14:20:01.885437 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:01.885417 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5b5d1ec5-b456-4e1e-85eb-4bc05286f3fc-podres\") pod \"perf-node-gather-daemonset-8hk7n\" (UID: \"5b5d1ec5-b456-4e1e-85eb-4bc05286f3fc\") " pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-8hk7n" Jun 08 14:20:01.885635 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:01.885455 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5b5d1ec5-b456-4e1e-85eb-4bc05286f3fc-lib-modules\") pod \"perf-node-gather-daemonset-8hk7n\" (UID: \"5b5d1ec5-b456-4e1e-85eb-4bc05286f3fc\") " pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-8hk7n" Jun 08 14:20:01.885635 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:01.885471 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b5d1ec5-b456-4e1e-85eb-4bc05286f3fc-sys\") pod \"perf-node-gather-daemonset-8hk7n\" (UID: \"5b5d1ec5-b456-4e1e-85eb-4bc05286f3fc\") " pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-8hk7n" Jun 08 14:20:01.885635 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:01.885476 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5b5d1ec5-b456-4e1e-85eb-4bc05286f3fc-proc\") pod \"perf-node-gather-daemonset-8hk7n\" (UID: \"5b5d1ec5-b456-4e1e-85eb-4bc05286f3fc\") " pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-8hk7n" Jun 08 14:20:01.885635 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:01.885563 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5b5d1ec5-b456-4e1e-85eb-4bc05286f3fc-podres\") pod \"perf-node-gather-daemonset-8hk7n\" (UID: \"5b5d1ec5-b456-4e1e-85eb-4bc05286f3fc\") " pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-8hk7n" Jun 08 14:20:01.895437 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:01.895416 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pv4c\" (UniqueName: \"kubernetes.io/projected/5b5d1ec5-b456-4e1e-85eb-4bc05286f3fc-kube-api-access-8pv4c\") pod \"perf-node-gather-daemonset-8hk7n\" (UID: \"5b5d1ec5-b456-4e1e-85eb-4bc05286f3fc\") " pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-8hk7n" Jun 08 14:20:02.047469 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:02.047386 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-8hk7n" Jun 08 14:20:02.190379 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:02.190354 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dlgqx/perf-node-gather-daemonset-8hk7n"] Jun 08 14:20:02.191254 ip-10-0-132-92 kubenswrapper[2561]: W0608 14:20:02.191227 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5b5d1ec5_b456_4e1e_85eb_4bc05286f3fc.slice/crio-50bb3550ebc3ab37f3126b344559ac90f379f1824cac9ceb6b44cc99da8776c7 WatchSource:0}: Error finding container 50bb3550ebc3ab37f3126b344559ac90f379f1824cac9ceb6b44cc99da8776c7: Status 404 returned error can't find the container with id 50bb3550ebc3ab37f3126b344559ac90f379f1824cac9ceb6b44cc99da8776c7 Jun 08 14:20:02.412588 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:02.412564 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-4grq5_070c0e0e-a4fd-40bb-bc17-b8eacbedd81a/volume-data-source-validator/0.log" Jun 08 14:20:03.120291 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:03.120251 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-8hk7n" event={"ID":"5b5d1ec5-b456-4e1e-85eb-4bc05286f3fc","Type":"ContainerStarted","Data":"7e42868dfd6c40a1cfa0a1f3ea387f92af12f3d3cf574e2e103d4e5c8b8c6f22"} Jun 08 14:20:03.120688 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:03.120315 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-8hk7n" event={"ID":"5b5d1ec5-b456-4e1e-85eb-4bc05286f3fc","Type":"ContainerStarted","Data":"50bb3550ebc3ab37f3126b344559ac90f379f1824cac9ceb6b44cc99da8776c7"} Jun 08 14:20:03.120688 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:03.120346 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-8hk7n" Jun 08 14:20:03.140471 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:03.140414 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-8hk7n" podStartSLOduration=2.140398753 podStartE2EDuration="2.140398753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 14:20:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 14:20:03.138554036 +0000 UTC m=+2217.119582306" watchObservedRunningTime="2026-06-08 14:20:03.140398753 +0000 UTC m=+2217.121427022" Jun 08 14:20:03.776752 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:03.776727 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hfcp7_08f23d9b-da1c-4813-a46c-833263139241/dns/0.log" Jun 08 14:20:03.809266 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:03.809241 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hfcp7_08f23d9b-da1c-4813-a46c-833263139241/kube-rbac-proxy/0.log" Jun 08 14:20:03.900352 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:03.900329 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qms2k_f4563444-4752-4896-a848-acb40549ebe0/dns-node-resolver/0.log" Jun 08 14:20:04.509841 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:04.509811 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-55c2s_bf0a4a64-6cd7-489d-8aa8-635b662f64e9/node-ca/0.log" Jun 08 14:20:05.686854 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:05.686825 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-c97s2_0727bf58-fe74-4801-b4b1-e717f5e39ead/discovery/0.log" Jun 08 14:20:05.708801 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:05.708758 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-576c89d9d8-cwc7x_7ea87952-aa57-4d1c-92dd-ef35ae4a61dd/kube-auth-proxy/0.log" Jun 08 14:20:05.769878 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:05.769858 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-vpprs_fead1cc9-ff82-431e-a8e3-4e9f1577d0c1/istio-proxy/0.log" Jun 08 14:20:05.801065 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:05.801042 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-vpprs_fead1cc9-ff82-431e-a8e3-4e9f1577d0c1/istio-proxy/1.log" Jun 08 14:20:05.906826 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:05.906809 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-9btx6_6aa4d585-f6f4-4cf2-b459-bc6f3cde72d5/payload-processing/0.log" Jun 08 14:20:05.931877 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:05.931859 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76c77975cf-zh8wm_3977f3b1-efb9-45fb-8c63-9f7c504f8eed/router/0.log" Jun 08 14:20:06.618372 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:06.618346 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-28v6r_da03cecf-0ab0-48c7-bd1b-ba9d7d1798b6/serve-healthcheck-canary/0.log" Jun 08 14:20:07.229708 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:07.229679 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-2v2bz_10b62eb7-d904-4652-bb5a-a6cb57c7df03/insights-operator/0.log" Jun 08 14:20:07.231023 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:07.230992 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-2v2bz_10b62eb7-d904-4652-bb5a-a6cb57c7df03/insights-operator/1.log" Jun 08 14:20:07.337847 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:07.337819 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ktp77_c35905bc-2626-4781-bc7a-9087bf5466d8/kube-rbac-proxy/0.log" Jun 08 14:20:07.364352 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:07.364330 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ktp77_c35905bc-2626-4781-bc7a-9087bf5466d8/exporter/0.log" Jun 08 14:20:07.389558 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:07.389540 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ktp77_c35905bc-2626-4781-bc7a-9087bf5466d8/extractor/0.log" Jun 08 14:20:09.136118 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:09.136088 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dlgqx/perf-node-gather-daemonset-8hk7n" Jun 08 14:20:09.830251 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:09.830219 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7cc5c547d9-49ng9_da9b7e87-b6b4-420b-8761-e977279d50bc/nginx/0.log" Jun 08 14:20:09.894838 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:09.894803 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-29g7k_34d74f96-dd06-414a-a3cc-cb38bc3a0cfd/manager/0.log" Jun 08 14:20:09.985574 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:09.985550 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-sgp8p_0ecccf64-9845-4d0d-8677-0fae665cc1aa/manager/0.log" Jun 08 14:20:10.189091 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:10.189063 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-4ljw4_dc424145-96e7-4507-8b7f-a13e18bc28e1/server/0.log" Jun 08 14:20:10.249010 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:10.248912 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-ckl6w_ae648dcc-6082-4f23-81c5-e36c3ccfadac/manager/0.log" Jun 08 14:20:10.484699 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:10.484626 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85cc8d7945-vh4sk_c39fdb72-2311-4d04-9ad5-60d435297dff/manager/0.log" Jun 08 14:20:10.506417 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:10.506398 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85cc8d7945-vh4sk_c39fdb72-2311-4d04-9ad5-60d435297dff/copy-manifests/0.log" Jun 08 14:20:10.539450 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:10.539431 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-rczhn_40450016-b933-4fa7-83c6-9d3a3b48522e/postgres/0.log" Jun 08 14:20:15.462827 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:15.462796 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-c97s2_0727bf58-fe74-4801-b4b1-e717f5e39ead/discovery/0.log" Jun 08 14:20:15.475217 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:15.475194 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-576c89d9d8-cwc7x_7ea87952-aa57-4d1c-92dd-ef35ae4a61dd/kube-auth-proxy/0.log" Jun 08 14:20:15.517890 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:15.517868 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-vpprs_fead1cc9-ff82-431e-a8e3-4e9f1577d0c1/istio-proxy/0.log" Jun 08 14:20:15.551359 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:15.551336 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-vpprs_fead1cc9-ff82-431e-a8e3-4e9f1577d0c1/istio-proxy/1.log" Jun 08 14:20:15.641901 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:15.641879 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-9btx6_6aa4d585-f6f4-4cf2-b459-bc6f3cde72d5/payload-processing/0.log" Jun 08 14:20:15.656790 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:15.656771 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76c77975cf-zh8wm_3977f3b1-efb9-45fb-8c63-9f7c504f8eed/router/0.log" Jun 08 14:20:17.119300 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:17.119271 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-c97s2_0727bf58-fe74-4801-b4b1-e717f5e39ead/discovery/0.log" Jun 08 14:20:17.130288 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:17.130262 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-576c89d9d8-cwc7x_7ea87952-aa57-4d1c-92dd-ef35ae4a61dd/kube-auth-proxy/0.log" Jun 08 14:20:17.212523 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:17.212495 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-vpprs_fead1cc9-ff82-431e-a8e3-4e9f1577d0c1/istio-proxy/0.log" Jun 08 14:20:17.235214 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:17.235191 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-vpprs_fead1cc9-ff82-431e-a8e3-4e9f1577d0c1/istio-proxy/1.log" Jun 08 14:20:17.363577 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:17.363545 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-9btx6_6aa4d585-f6f4-4cf2-b459-bc6f3cde72d5/payload-processing/0.log" Jun 08 14:20:17.392729 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:17.392704 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76c77975cf-zh8wm_3977f3b1-efb9-45fb-8c63-9f7c504f8eed/router/0.log" Jun 08 14:20:18.431119 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:18.431087 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-vx96x_1bf3f3fe-50d8-424f-81f2-b1c3bc33620e/kube-storage-version-migrator-operator/1.log" Jun 08 14:20:18.431960 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:18.431946 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-vx96x_1bf3f3fe-50d8-424f-81f2-b1c3bc33620e/kube-storage-version-migrator-operator/0.log" Jun 08 14:20:19.284778 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:19.284731 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-c97s2_0727bf58-fe74-4801-b4b1-e717f5e39ead/discovery/0.log" Jun 08 14:20:19.296397 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:19.296375 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-576c89d9d8-cwc7x_7ea87952-aa57-4d1c-92dd-ef35ae4a61dd/kube-auth-proxy/0.log" Jun 08 14:20:19.336371 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:19.336347 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-vpprs_fead1cc9-ff82-431e-a8e3-4e9f1577d0c1/istio-proxy/0.log" Jun 08 14:20:19.372555 ip-10-0-132-92 kubenswrapper[2561]: I0608 14:20:19.372529 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-vpprs_fead1cc9-ff82-431e-a8e3-4e9f1577d0c1/istio-proxy/1.log"