Jun 15 01:36:07.952868 ip-10-0-137-147 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 15 01:36:07.952882 ip-10-0-137-147 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 15 01:36:07.952891 ip-10-0-137-147 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 15 01:36:07.953308 ip-10-0-137-147 systemd[1]: Failed to start Kubernetes Kubelet. Jun 15 01:36:18.074161 ip-10-0-137-147 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jun 15 01:36:18.074174 ip-10-0-137-147 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 9c41324530724395a520684114d54331 -- Jun 15 01:38:24.032956 ip-10-0-137-147 systemd[1]: Starting Kubernetes Kubelet... Jun 15 01:38:24.391993 ip-10-0-137-147 kubenswrapper[2551]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 01:38:24.391993 ip-10-0-137-147 kubenswrapper[2551]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 15 01:38:24.391993 ip-10-0-137-147 kubenswrapper[2551]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 01:38:24.391993 ip-10-0-137-147 kubenswrapper[2551]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 15 01:38:24.391993 ip-10-0-137-147 kubenswrapper[2551]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 01:38:24.394446 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.394365 2551 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 15 01:38:24.401529 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401507 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 01:38:24.401529 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401526 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 01:38:24.401529 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401530 2551 feature_gate.go:328] unrecognized feature gate: Example Jun 15 01:38:24.401529 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401533 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 01:38:24.401529 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401537 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 01:38:24.401730 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401540 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 01:38:24.401730 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401543 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 01:38:24.401730 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401546 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 01:38:24.401730 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401549 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 01:38:24.401730 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401552 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 01:38:24.401730 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401555 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 01:38:24.401730 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401558 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 01:38:24.401730 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401561 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 01:38:24.401730 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401563 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 01:38:24.401730 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401566 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 01:38:24.401730 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401569 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 01:38:24.401730 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401572 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 01:38:24.401730 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401575 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 01:38:24.401730 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401577 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 01:38:24.401730 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401580 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 01:38:24.401730 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401583 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 01:38:24.401730 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401585 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 01:38:24.401730 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401588 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 01:38:24.401730 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401591 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 01:38:24.401730 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401594 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 01:38:24.402213 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401597 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 01:38:24.402213 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401600 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 01:38:24.402213 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401602 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 01:38:24.402213 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401605 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 01:38:24.402213 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401608 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 01:38:24.402213 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401612 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 01:38:24.402213 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401617 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 01:38:24.402213 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401620 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 01:38:24.402213 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401688 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 01:38:24.402213 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401692 2551 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 01:38:24.402213 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401695 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 01:38:24.402213 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401698 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 01:38:24.402213 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401700 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 01:38:24.402213 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401704 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 01:38:24.402213 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401707 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 01:38:24.402213 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401709 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 01:38:24.402213 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401712 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 01:38:24.402213 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401714 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 01:38:24.402213 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401717 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 01:38:24.402213 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401720 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 01:38:24.402756 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401722 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 01:38:24.402756 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401724 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 01:38:24.402756 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401727 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 01:38:24.402756 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401732 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 01:38:24.402756 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401734 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 01:38:24.402756 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401737 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 01:38:24.402756 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401741 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 01:38:24.402756 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401743 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 01:38:24.402756 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401746 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 01:38:24.402756 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401749 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 01:38:24.402756 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401752 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 01:38:24.402756 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401754 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 01:38:24.402756 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401757 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 01:38:24.402756 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401760 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 01:38:24.402756 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401762 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 01:38:24.402756 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401765 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 01:38:24.402756 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401767 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 01:38:24.402756 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401770 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 01:38:24.402756 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401773 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 01:38:24.402756 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401776 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 01:38:24.403236 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401778 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 01:38:24.403236 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401781 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 01:38:24.403236 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401783 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 01:38:24.403236 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401786 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 01:38:24.403236 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401788 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 01:38:24.403236 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401794 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 01:38:24.403236 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401797 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 01:38:24.403236 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401800 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 01:38:24.403236 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401803 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 01:38:24.403236 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401805 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 01:38:24.403236 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401808 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 01:38:24.403236 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401811 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 01:38:24.403236 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401813 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 01:38:24.403236 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401816 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 01:38:24.403236 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401819 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 01:38:24.403236 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401823 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 01:38:24.403236 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401825 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 01:38:24.403236 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401828 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 01:38:24.403236 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401833 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 01:38:24.403700 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401836 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 01:38:24.403700 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401839 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 01:38:24.403700 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401842 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 01:38:24.403700 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401845 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 01:38:24.403700 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401848 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 01:38:24.403700 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401851 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 01:38:24.403700 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401854 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 01:38:24.403700 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401857 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 01:38:24.403700 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401860 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 01:38:24.403700 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401863 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 01:38:24.403700 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401866 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 01:38:24.403700 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401869 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 01:38:24.403700 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401871 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 01:38:24.403700 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401874 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 01:38:24.403700 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.401877 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 01:38:24.403700 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403220 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 01:38:24.403700 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403228 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 01:38:24.403700 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403231 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 01:38:24.403700 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403235 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 01:38:24.404165 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403239 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 01:38:24.404165 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403242 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 01:38:24.404165 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403245 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 01:38:24.404165 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403248 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 01:38:24.404165 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403251 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 01:38:24.404165 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403254 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 01:38:24.404165 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403256 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 01:38:24.404165 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403259 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 01:38:24.404165 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403261 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 01:38:24.404165 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403264 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 01:38:24.404165 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403266 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 01:38:24.404165 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403269 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 01:38:24.404165 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403272 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 01:38:24.404165 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403275 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 01:38:24.404165 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403278 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 01:38:24.404165 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403280 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 01:38:24.404165 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403283 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 01:38:24.404165 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403286 2551 feature_gate.go:328] unrecognized feature gate: Example Jun 15 01:38:24.404165 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403288 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 01:38:24.404165 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403291 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 01:38:24.404676 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403293 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 01:38:24.404676 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403296 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 01:38:24.404676 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403298 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 01:38:24.404676 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403301 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 01:38:24.404676 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403303 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 01:38:24.404676 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403306 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 01:38:24.404676 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403308 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 01:38:24.404676 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403310 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 01:38:24.404676 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403314 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 01:38:24.404676 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403316 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 01:38:24.404676 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403319 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 01:38:24.404676 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403322 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 01:38:24.404676 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403325 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 01:38:24.404676 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403328 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 01:38:24.404676 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403330 2551 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 01:38:24.404676 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403334 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 01:38:24.404676 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403338 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 01:38:24.404676 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403341 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 01:38:24.404676 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403344 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 01:38:24.404676 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403346 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 01:38:24.405162 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403349 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 01:38:24.405162 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403353 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 01:38:24.405162 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403356 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 01:38:24.405162 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403358 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 01:38:24.405162 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403361 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 01:38:24.405162 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403364 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 01:38:24.405162 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403367 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 01:38:24.405162 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403369 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 01:38:24.405162 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403372 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 01:38:24.405162 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403374 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 01:38:24.405162 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403377 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 01:38:24.405162 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403379 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 01:38:24.405162 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403382 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 01:38:24.405162 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403384 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 01:38:24.405162 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403387 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 01:38:24.405162 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403389 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 01:38:24.405162 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403391 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 01:38:24.405162 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403394 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 01:38:24.405162 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403398 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 01:38:24.405648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403401 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 01:38:24.405648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403404 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 01:38:24.405648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403406 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 01:38:24.405648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403409 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 01:38:24.405648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403412 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 01:38:24.405648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403415 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 01:38:24.405648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403419 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 01:38:24.405648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403421 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 01:38:24.405648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403424 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 01:38:24.405648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403427 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 01:38:24.405648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403429 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 01:38:24.405648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403431 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 01:38:24.405648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403434 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 01:38:24.405648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403436 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 01:38:24.405648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403439 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 01:38:24.405648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403442 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 01:38:24.405648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403444 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 01:38:24.405648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403447 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 01:38:24.405648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403449 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 01:38:24.405648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403452 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 01:38:24.406155 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403455 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 01:38:24.406155 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403458 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 01:38:24.406155 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403460 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 01:38:24.406155 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403463 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 01:38:24.406155 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403466 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 01:38:24.406155 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403468 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 01:38:24.406155 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403471 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 01:38:24.406155 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403473 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 01:38:24.406155 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403476 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 01:38:24.406155 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403478 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 01:38:24.406155 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403481 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 01:38:24.406155 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403483 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 01:38:24.406155 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403486 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 01:38:24.406155 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403488 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 01:38:24.406155 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403492 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 01:38:24.406155 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403496 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 01:38:24.406155 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403890 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 01:38:24.406155 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403895 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 01:38:24.406155 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403899 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 01:38:24.406607 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403902 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 01:38:24.406607 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403904 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 01:38:24.406607 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403908 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 01:38:24.406607 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403910 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 01:38:24.406607 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403913 2551 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 01:38:24.406607 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403915 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 01:38:24.406607 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403918 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 01:38:24.406607 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403921 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 01:38:24.406607 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403923 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 01:38:24.406607 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403925 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 01:38:24.406607 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403928 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 01:38:24.406607 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403930 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 01:38:24.406607 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403934 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 01:38:24.406607 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403938 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 01:38:24.406607 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403942 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 01:38:24.406607 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403944 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 01:38:24.406607 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403947 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 01:38:24.406607 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403949 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 01:38:24.406607 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403952 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 01:38:24.406607 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403954 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 01:38:24.407104 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403958 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 01:38:24.407104 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403961 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 01:38:24.407104 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403965 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 01:38:24.407104 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403968 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 01:38:24.407104 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403971 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 01:38:24.407104 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403974 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 01:38:24.407104 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403976 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 01:38:24.407104 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403979 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 01:38:24.407104 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403982 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 01:38:24.407104 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403985 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 01:38:24.407104 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403988 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 01:38:24.407104 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403991 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 01:38:24.407104 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403994 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 01:38:24.407104 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403996 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 01:38:24.407104 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.403999 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 01:38:24.407104 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404002 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 01:38:24.407104 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404004 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 01:38:24.407104 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404007 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 01:38:24.407104 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404009 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 01:38:24.407590 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404012 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 01:38:24.407590 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404014 2551 feature_gate.go:328] unrecognized feature gate: Example Jun 15 01:38:24.407590 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404017 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 01:38:24.407590 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404019 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 01:38:24.407590 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404022 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 01:38:24.407590 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404024 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 01:38:24.407590 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404027 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 01:38:24.407590 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404030 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 01:38:24.407590 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404032 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 01:38:24.407590 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404035 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 01:38:24.407590 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404037 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 01:38:24.407590 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404040 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 01:38:24.407590 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404042 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 01:38:24.407590 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404045 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 01:38:24.407590 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404047 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 01:38:24.407590 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404051 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 01:38:24.407590 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404054 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 01:38:24.407590 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404057 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 01:38:24.407590 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404060 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 01:38:24.408068 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404063 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 01:38:24.408068 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404066 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 01:38:24.408068 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404069 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 01:38:24.408068 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404072 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 01:38:24.408068 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404075 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 01:38:24.408068 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404078 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 01:38:24.408068 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404080 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 01:38:24.408068 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404084 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 01:38:24.408068 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404087 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 01:38:24.408068 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404089 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 01:38:24.408068 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404092 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 01:38:24.408068 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404094 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 01:38:24.408068 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404097 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 01:38:24.408068 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404099 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 01:38:24.408068 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404102 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 01:38:24.408068 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404104 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 01:38:24.408068 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404107 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 01:38:24.408068 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404109 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 01:38:24.408068 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404112 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 01:38:24.408068 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404114 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 01:38:24.408538 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404117 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 01:38:24.408538 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404120 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 01:38:24.408538 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404123 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 01:38:24.408538 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404125 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 01:38:24.408538 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404128 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 01:38:24.408538 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404131 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 01:38:24.408538 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404134 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 01:38:24.408538 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404136 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 01:38:24.408538 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404139 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 01:38:24.408538 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404141 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 01:38:24.408538 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404144 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 01:38:24.408538 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404146 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 01:38:24.408538 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404149 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 01:38:24.408538 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404151 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 01:38:24.408538 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404153 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 01:38:24.408538 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404156 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 01:38:24.408538 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404159 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 01:38:24.408538 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404161 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 01:38:24.408538 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404237 2551 flags.go:64] FLAG: --address="0.0.0.0" Jun 15 01:38:24.408538 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404244 2551 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 15 01:38:24.408538 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404250 2551 flags.go:64] FLAG: --anonymous-auth="true" Jun 15 01:38:24.409083 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404254 2551 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 15 01:38:24.409083 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404258 2551 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 15 01:38:24.409083 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404261 2551 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 15 01:38:24.409083 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404265 2551 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 15 01:38:24.409083 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404269 2551 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 15 01:38:24.409083 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404273 2551 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 15 01:38:24.409083 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404275 2551 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 15 01:38:24.409083 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404279 2551 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 15 01:38:24.409083 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404282 2551 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 15 01:38:24.409083 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404285 2551 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 15 01:38:24.409083 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404288 2551 flags.go:64] FLAG: --cgroup-root="" Jun 15 01:38:24.409083 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404291 2551 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 15 01:38:24.409083 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404294 2551 flags.go:64] FLAG: --client-ca-file="" Jun 15 01:38:24.409083 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404298 2551 flags.go:64] FLAG: --cloud-provider="external" Jun 15 01:38:24.409083 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404303 2551 flags.go:64] FLAG: --cluster-dns="[]" Jun 15 01:38:24.409083 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404307 2551 flags.go:64] FLAG: --cluster-domain="" Jun 15 01:38:24.409083 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404310 2551 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 15 01:38:24.409083 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404313 2551 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 15 01:38:24.409083 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404316 2551 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 15 01:38:24.409083 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404319 2551 flags.go:64] FLAG: --container-log-max-files="5" Jun 15 01:38:24.409083 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404323 2551 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 15 01:38:24.409083 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404326 2551 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 15 01:38:24.409083 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404329 2551 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 15 01:38:24.409642 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404332 2551 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 15 01:38:24.409642 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404335 2551 flags.go:64] FLAG: --contention-profiling="false" Jun 15 01:38:24.409642 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404339 2551 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 15 01:38:24.409642 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404342 2551 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 15 01:38:24.409642 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404345 2551 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 15 01:38:24.409642 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404348 2551 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 15 01:38:24.409642 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404352 2551 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 15 01:38:24.409642 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404355 2551 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 15 01:38:24.409642 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404358 2551 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 15 01:38:24.409642 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404361 2551 flags.go:64] FLAG: --enable-load-reader="false" Jun 15 01:38:24.409642 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404364 2551 flags.go:64] FLAG: --enable-server="true" Jun 15 01:38:24.409642 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404367 2551 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 15 01:38:24.409642 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404371 2551 flags.go:64] FLAG: --event-burst="100" Jun 15 01:38:24.409642 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404374 2551 flags.go:64] FLAG: --event-qps="50" Jun 15 01:38:24.409642 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404377 2551 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 15 01:38:24.409642 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404380 2551 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 15 01:38:24.409642 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404383 2551 flags.go:64] FLAG: --eviction-hard="" Jun 15 01:38:24.409642 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404386 2551 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 15 01:38:24.409642 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404389 2551 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 15 01:38:24.409642 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404392 2551 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 15 01:38:24.409642 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404395 2551 flags.go:64] FLAG: --eviction-soft="" Jun 15 01:38:24.409642 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404398 2551 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 15 01:38:24.409642 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404401 2551 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 15 01:38:24.409642 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404407 2551 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 15 01:38:24.409642 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404410 2551 flags.go:64] FLAG: --experimental-mounter-path="" Jun 15 01:38:24.410255 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404413 2551 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 15 01:38:24.410255 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404416 2551 flags.go:64] FLAG: --fail-swap-on="true" Jun 15 01:38:24.410255 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404419 2551 flags.go:64] FLAG: --feature-gates="" Jun 15 01:38:24.410255 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404423 2551 flags.go:64] FLAG: --file-check-frequency="20s" Jun 15 01:38:24.410255 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404425 2551 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 15 01:38:24.410255 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404428 2551 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 15 01:38:24.410255 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404432 2551 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 15 01:38:24.410255 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404434 2551 flags.go:64] FLAG: --healthz-port="10248" Jun 15 01:38:24.410255 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404437 2551 flags.go:64] FLAG: --help="false" Jun 15 01:38:24.410255 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404441 2551 flags.go:64] FLAG: --hostname-override="ip-10-0-137-147.ec2.internal" Jun 15 01:38:24.410255 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404444 2551 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 15 01:38:24.410255 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404447 2551 flags.go:64] FLAG: --http-check-frequency="20s" Jun 15 01:38:24.410255 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404450 2551 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 15 01:38:24.410255 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404454 2551 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 15 01:38:24.410255 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404457 2551 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 15 01:38:24.410255 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404460 2551 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 15 01:38:24.410255 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404463 2551 flags.go:64] FLAG: --image-service-endpoint="" Jun 15 01:38:24.410255 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404466 2551 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 15 01:38:24.410255 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404468 2551 flags.go:64] FLAG: --kube-api-burst="100" Jun 15 01:38:24.410255 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404471 2551 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 15 01:38:24.410255 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404474 2551 flags.go:64] FLAG: --kube-api-qps="50" Jun 15 01:38:24.410255 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404477 2551 flags.go:64] FLAG: --kube-reserved="" Jun 15 01:38:24.410255 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404480 2551 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 15 01:38:24.410255 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404482 2551 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 15 01:38:24.410857 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404485 2551 flags.go:64] FLAG: --kubelet-cgroups="" Jun 15 01:38:24.410857 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404488 2551 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 15 01:38:24.410857 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404491 2551 flags.go:64] FLAG: --lock-file="" Jun 15 01:38:24.410857 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404494 2551 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 15 01:38:24.410857 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404497 2551 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 15 01:38:24.410857 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404500 2551 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 15 01:38:24.410857 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404506 2551 flags.go:64] FLAG: --log-json-split-stream="false" Jun 15 01:38:24.410857 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404510 2551 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 15 01:38:24.410857 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404513 2551 flags.go:64] FLAG: --log-text-split-stream="false" Jun 15 01:38:24.410857 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404515 2551 flags.go:64] FLAG: --logging-format="text" Jun 15 01:38:24.410857 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404518 2551 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 15 01:38:24.410857 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404521 2551 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 15 01:38:24.410857 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404524 2551 flags.go:64] FLAG: --manifest-url="" Jun 15 01:38:24.410857 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404527 2551 flags.go:64] FLAG: --manifest-url-header="" Jun 15 01:38:24.410857 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404531 2551 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 15 01:38:24.410857 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404534 2551 flags.go:64] FLAG: --max-open-files="1000000" Jun 15 01:38:24.410857 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404538 2551 flags.go:64] FLAG: --max-pods="110" Jun 15 01:38:24.410857 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404542 2551 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 15 01:38:24.410857 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404545 2551 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 15 01:38:24.410857 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404548 2551 flags.go:64] FLAG: --memory-manager-policy="None" Jun 15 01:38:24.410857 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404551 2551 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 15 01:38:24.410857 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404553 2551 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 15 01:38:24.410857 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404556 2551 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 15 01:38:24.410857 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404559 2551 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 15 01:38:24.410857 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404565 2551 flags.go:64] FLAG: --node-status-max-images="50" Jun 15 01:38:24.411964 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404568 2551 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 15 01:38:24.411964 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404572 2551 flags.go:64] FLAG: --oom-score-adj="-999" Jun 15 01:38:24.411964 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404575 2551 flags.go:64] FLAG: --pod-cidr="" Jun 15 01:38:24.411964 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404577 2551 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 15 01:38:24.411964 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404582 2551 flags.go:64] FLAG: --pod-manifest-path="" Jun 15 01:38:24.411964 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404585 2551 flags.go:64] FLAG: --pod-max-pids="-1" Jun 15 01:38:24.411964 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404588 2551 flags.go:64] FLAG: --pods-per-core="0" Jun 15 01:38:24.411964 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404591 2551 flags.go:64] FLAG: --port="10250" Jun 15 01:38:24.411964 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404594 2551 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 15 01:38:24.411964 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404597 2551 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02f1aad8c5448f0fd" Jun 15 01:38:24.411964 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404600 2551 flags.go:64] FLAG: --qos-reserved="" Jun 15 01:38:24.411964 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404603 2551 flags.go:64] FLAG: --read-only-port="10255" Jun 15 01:38:24.411964 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404606 2551 flags.go:64] FLAG: --register-node="true" Jun 15 01:38:24.411964 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404609 2551 flags.go:64] FLAG: --register-with-taints="" Jun 15 01:38:24.411964 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404614 2551 flags.go:64] FLAG: --registry-burst="10" Jun 15 01:38:24.411964 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404617 2551 flags.go:64] FLAG: --registry-qps="5" Jun 15 01:38:24.411964 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404620 2551 flags.go:64] FLAG: --reserved-cpus="" Jun 15 01:38:24.411964 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404636 2551 flags.go:64] FLAG: --reserved-memory="" Jun 15 01:38:24.411964 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404640 2551 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 15 01:38:24.411964 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404644 2551 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 15 01:38:24.411964 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404646 2551 flags.go:64] FLAG: --rotate-certificates="false" Jun 15 01:38:24.411964 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404649 2551 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 15 01:38:24.411964 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404652 2551 flags.go:64] FLAG: --runonce="false" Jun 15 01:38:24.411964 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404655 2551 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 15 01:38:24.411964 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404659 2551 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 15 01:38:24.413048 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404662 2551 flags.go:64] FLAG: --seccomp-default="false" Jun 15 01:38:24.413048 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404665 2551 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 15 01:38:24.413048 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404668 2551 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 15 01:38:24.413048 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404671 2551 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 15 01:38:24.413048 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404674 2551 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 15 01:38:24.413048 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404677 2551 flags.go:64] FLAG: --storage-driver-password="root" Jun 15 01:38:24.413048 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404680 2551 flags.go:64] FLAG: --storage-driver-secure="false" Jun 15 01:38:24.413048 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404683 2551 flags.go:64] FLAG: --storage-driver-table="stats" Jun 15 01:38:24.413048 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404686 2551 flags.go:64] FLAG: --storage-driver-user="root" Jun 15 01:38:24.413048 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404689 2551 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 15 01:38:24.413048 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404692 2551 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 15 01:38:24.413048 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404695 2551 flags.go:64] FLAG: --system-cgroups="" Jun 15 01:38:24.413048 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404698 2551 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 15 01:38:24.413048 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404703 2551 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 15 01:38:24.413048 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404706 2551 flags.go:64] FLAG: --tls-cert-file="" Jun 15 01:38:24.413048 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404708 2551 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 15 01:38:24.413048 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404713 2551 flags.go:64] FLAG: --tls-min-version="" Jun 15 01:38:24.413048 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404715 2551 flags.go:64] FLAG: --tls-private-key-file="" Jun 15 01:38:24.413048 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404718 2551 flags.go:64] FLAG: --topology-manager-policy="none" Jun 15 01:38:24.413048 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404721 2551 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 15 01:38:24.413048 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404724 2551 flags.go:64] FLAG: --topology-manager-scope="container" Jun 15 01:38:24.413048 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404728 2551 flags.go:64] FLAG: --v="2" Jun 15 01:38:24.413048 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404732 2551 flags.go:64] FLAG: --version="false" Jun 15 01:38:24.413048 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404736 2551 flags.go:64] FLAG: --vmodule="" Jun 15 01:38:24.413048 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404739 2551 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 15 01:38:24.414199 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.404742 2551 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 15 01:38:24.414199 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404851 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 01:38:24.414199 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404855 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 01:38:24.414199 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404858 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 01:38:24.414199 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404860 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 01:38:24.414199 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404863 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 01:38:24.414199 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404868 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 01:38:24.414199 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404870 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 01:38:24.414199 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404873 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 01:38:24.414199 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404875 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 01:38:24.414199 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404878 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 01:38:24.414199 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404881 2551 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 01:38:24.414199 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404883 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 01:38:24.414199 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404886 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 01:38:24.414199 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404888 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 01:38:24.414199 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404891 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 01:38:24.414199 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404893 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 01:38:24.414199 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404896 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 01:38:24.414199 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404898 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 01:38:24.415016 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404901 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 01:38:24.415016 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404903 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 01:38:24.415016 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404906 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 01:38:24.415016 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404909 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 01:38:24.415016 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404911 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 01:38:24.415016 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404914 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 01:38:24.415016 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404916 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 01:38:24.415016 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404918 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 01:38:24.415016 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404922 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 01:38:24.415016 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404926 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 01:38:24.415016 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404929 2551 feature_gate.go:328] unrecognized feature gate: Example Jun 15 01:38:24.415016 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404932 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 01:38:24.415016 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404938 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 01:38:24.415016 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404942 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 01:38:24.415016 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404945 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 01:38:24.415016 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404949 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 01:38:24.415016 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404952 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 01:38:24.415016 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404954 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 01:38:24.415016 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404957 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 01:38:24.415482 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404961 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 01:38:24.415482 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404964 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 01:38:24.415482 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404967 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 01:38:24.415482 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404970 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 01:38:24.415482 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404973 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 01:38:24.415482 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404976 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 01:38:24.415482 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404979 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 01:38:24.415482 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404982 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 01:38:24.415482 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404984 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 01:38:24.415482 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404987 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 01:38:24.415482 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404989 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 01:38:24.415482 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404992 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 01:38:24.415482 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404995 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 01:38:24.415482 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.404997 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 01:38:24.415482 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405000 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 01:38:24.415482 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405003 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 01:38:24.415482 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405005 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 01:38:24.415482 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405008 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 01:38:24.415482 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405010 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 01:38:24.415482 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405013 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 01:38:24.416314 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405015 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 01:38:24.416314 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405018 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 01:38:24.416314 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405021 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 01:38:24.416314 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405025 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 01:38:24.416314 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405028 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 01:38:24.416314 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405031 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 01:38:24.416314 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405035 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 01:38:24.416314 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405037 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 01:38:24.416314 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405040 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 01:38:24.416314 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405042 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 01:38:24.416314 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405045 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 01:38:24.416314 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405047 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 01:38:24.416314 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405051 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 01:38:24.416314 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405054 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 01:38:24.416314 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405056 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 01:38:24.416314 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405059 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 01:38:24.416314 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405061 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 01:38:24.416314 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405064 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 01:38:24.416314 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405067 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 01:38:24.416314 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405069 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 01:38:24.417038 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405071 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 01:38:24.417038 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405074 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 01:38:24.417038 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405076 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 01:38:24.417038 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405079 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 01:38:24.417038 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405081 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 01:38:24.417038 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405084 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 01:38:24.417038 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405086 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 01:38:24.417038 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405089 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 01:38:24.417038 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405091 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 01:38:24.417038 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405094 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 01:38:24.417038 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405096 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 01:38:24.417038 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405098 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 01:38:24.417038 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405101 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 01:38:24.417038 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405103 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 01:38:24.417038 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405106 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 01:38:24.417038 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405109 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 01:38:24.417038 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405111 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 01:38:24.417038 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405114 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 01:38:24.417038 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405117 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 01:38:24.417038 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405119 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 01:38:24.417580 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405122 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 01:38:24.417580 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.405125 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 01:38:24.417580 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.406048 2551 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 01:38:24.417580 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.413469 2551 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 15 01:38:24.417580 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.413491 2551 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 15 01:38:24.417580 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.413517 2551 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 15 01:38:24.417580 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.413526 2551 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 15 01:38:24.417580 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413608 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 01:38:24.417580 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413615 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 01:38:24.417580 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413620 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 01:38:24.417580 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413641 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 01:38:24.417580 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413646 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 01:38:24.417580 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413650 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 01:38:24.417580 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413657 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 01:38:24.418054 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413662 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 01:38:24.418054 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413667 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 01:38:24.418054 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413672 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 01:38:24.418054 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413676 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 01:38:24.418054 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413680 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 01:38:24.418054 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413685 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 01:38:24.418054 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413689 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 01:38:24.418054 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413694 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 01:38:24.418054 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413698 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 01:38:24.418054 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413702 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 01:38:24.418054 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413706 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 01:38:24.418054 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413711 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 01:38:24.418054 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413715 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 01:38:24.418054 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413719 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 01:38:24.418054 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413724 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 01:38:24.418054 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413729 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 01:38:24.418054 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413733 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 01:38:24.418054 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413738 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 01:38:24.418054 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413742 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 01:38:24.418551 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413746 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 01:38:24.418551 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413750 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 01:38:24.418551 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413757 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 01:38:24.418551 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413769 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 01:38:24.418551 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413774 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 01:38:24.418551 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413780 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 01:38:24.418551 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413784 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 01:38:24.418551 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413789 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 01:38:24.418551 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413794 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 01:38:24.418551 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413798 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 01:38:24.418551 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413803 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 01:38:24.418551 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413807 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 01:38:24.418551 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413811 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 01:38:24.418551 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413815 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 01:38:24.418551 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413819 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 01:38:24.418551 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413823 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 01:38:24.418551 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413827 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 01:38:24.418551 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413832 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 01:38:24.418551 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413836 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 01:38:24.418551 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413840 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 01:38:24.419125 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413845 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 01:38:24.419125 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413849 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 01:38:24.419125 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413853 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 01:38:24.419125 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413857 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 01:38:24.419125 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413861 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 01:38:24.419125 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413866 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 01:38:24.419125 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413870 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 01:38:24.419125 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413874 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 01:38:24.419125 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413879 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 01:38:24.419125 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413883 2551 feature_gate.go:328] unrecognized feature gate: Example Jun 15 01:38:24.419125 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413887 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 01:38:24.419125 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413891 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 01:38:24.419125 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413895 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 01:38:24.419125 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413899 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 01:38:24.419125 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413903 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 01:38:24.419125 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413908 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 01:38:24.419125 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413913 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 01:38:24.419125 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413917 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 01:38:24.419125 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413921 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 01:38:24.419125 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413925 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 01:38:24.419642 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413929 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 01:38:24.419642 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413933 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 01:38:24.419642 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413937 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 01:38:24.419642 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413941 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 01:38:24.419642 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413948 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 01:38:24.419642 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413953 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 01:38:24.419642 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413958 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 01:38:24.419642 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413963 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 01:38:24.419642 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413967 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 01:38:24.419642 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413972 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 01:38:24.419642 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413976 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 01:38:24.419642 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413980 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 01:38:24.419642 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413984 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 01:38:24.419642 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413988 2551 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 01:38:24.419642 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413992 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 01:38:24.419642 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.413997 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 01:38:24.419642 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414001 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 01:38:24.419642 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414005 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 01:38:24.419642 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414010 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 01:38:24.419642 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414013 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 01:38:24.420190 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414018 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 01:38:24.420190 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414022 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 01:38:24.420190 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414026 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 01:38:24.420190 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414030 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 01:38:24.420190 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414035 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 01:38:24.420190 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414039 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 01:38:24.420190 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414043 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 01:38:24.420190 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414048 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 01:38:24.420190 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414052 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 01:38:24.420190 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414056 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 01:38:24.420190 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414061 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 01:38:24.420190 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414065 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 01:38:24.420190 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414069 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 01:38:24.420190 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.414077 2551 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 01:38:24.420572 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414248 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 01:38:24.420572 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414256 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 01:38:24.420572 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414261 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 01:38:24.420572 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414265 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 01:38:24.420572 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414270 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 01:38:24.420572 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414275 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 01:38:24.420572 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414280 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 01:38:24.420572 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414284 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 01:38:24.420572 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414289 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 01:38:24.420572 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414293 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 01:38:24.420572 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414297 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 01:38:24.420572 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414301 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 01:38:24.420572 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414305 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 01:38:24.420572 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414309 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 01:38:24.420572 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414314 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 01:38:24.420572 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414318 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 01:38:24.420572 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414322 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 01:38:24.420572 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414326 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 01:38:24.420572 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414330 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 01:38:24.420572 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414334 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 01:38:24.421161 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414338 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 01:38:24.421161 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414343 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 01:38:24.421161 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414347 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 01:38:24.421161 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414351 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 01:38:24.421161 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414355 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 01:38:24.421161 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414362 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 01:38:24.421161 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414368 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 01:38:24.421161 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414375 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 01:38:24.421161 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414381 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 01:38:24.421161 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414386 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 01:38:24.421161 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414390 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 01:38:24.421161 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414395 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 01:38:24.421161 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414400 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 01:38:24.421161 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414404 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 01:38:24.421161 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414409 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 01:38:24.421161 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414413 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 01:38:24.421161 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414417 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 01:38:24.421161 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414421 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 01:38:24.421161 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414425 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 01:38:24.421648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414429 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 01:38:24.421648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414433 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 01:38:24.421648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414437 2551 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 01:38:24.421648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414441 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 01:38:24.421648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414445 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 01:38:24.421648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414450 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 01:38:24.421648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414454 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 01:38:24.421648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414458 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 01:38:24.421648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414462 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 01:38:24.421648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414466 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 01:38:24.421648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414471 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 01:38:24.421648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414475 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 01:38:24.421648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414479 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 01:38:24.421648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414483 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 01:38:24.421648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414488 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 01:38:24.421648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414492 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 01:38:24.421648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414496 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 01:38:24.421648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414500 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 01:38:24.421648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414504 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 01:38:24.421648 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414508 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 01:38:24.422259 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414512 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 01:38:24.422259 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414516 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 01:38:24.422259 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414521 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 01:38:24.422259 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414525 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 01:38:24.422259 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414530 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 01:38:24.422259 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414534 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 01:38:24.422259 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414538 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 01:38:24.422259 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414542 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 01:38:24.422259 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414546 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 01:38:24.422259 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414550 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 01:38:24.422259 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414554 2551 feature_gate.go:328] unrecognized feature gate: Example Jun 15 01:38:24.422259 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414560 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 01:38:24.422259 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414564 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 01:38:24.422259 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414568 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 01:38:24.422259 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414572 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 01:38:24.422259 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414576 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 01:38:24.422259 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414580 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 01:38:24.422259 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414584 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 01:38:24.422259 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414588 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 01:38:24.422259 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414592 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 01:38:24.423123 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414597 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 01:38:24.423123 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414601 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 01:38:24.423123 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414605 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 01:38:24.423123 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414609 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 01:38:24.423123 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414613 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 01:38:24.423123 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414617 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 01:38:24.423123 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414621 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 01:38:24.423123 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414645 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 01:38:24.423123 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414650 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 01:38:24.423123 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414654 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 01:38:24.423123 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414658 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 01:38:24.423123 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414663 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 01:38:24.423123 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414667 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 01:38:24.423123 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414671 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 01:38:24.423123 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414675 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 01:38:24.423123 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414681 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 01:38:24.423123 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414685 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 01:38:24.423123 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414690 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 01:38:24.423123 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414696 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 01:38:24.423123 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:24.414700 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 01:38:24.423742 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.414708 2551 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 01:38:24.423742 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.414850 2551 server.go:962] "Client rotation is on, will bootstrap in background" Jun 15 01:38:24.423742 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.418544 2551 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 15 01:38:24.423742 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.419963 2551 server.go:1019] "Starting client certificate rotation" Jun 15 01:38:24.423742 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.420062 2551 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 15 01:38:24.423742 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.420092 2551 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 15 01:38:24.423742 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.422542 2551 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 15 01:38:24.429121 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.429102 2551 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 15 01:38:24.437529 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.437514 2551 log.go:25] "Validated CRI v1 runtime API" Jun 15 01:38:24.441955 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.441939 2551 log.go:25] "Validated CRI v1 image API" Jun 15 01:38:24.443431 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.443416 2551 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 15 01:38:24.446400 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.446373 2551 fs.go:135] Filesystem UUIDs: map[178b6e33-6a23-4136-9515-fee51210577e:/dev/nvme0n1p4 79af89e9-ce8a-485f-b209-1899060f6821:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 15 01:38:24.446471 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.446398 2551 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 15 01:38:24.450527 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.450422 2551 manager.go:216] Machine: {Timestamp:2026-06-15 01:38:24.449944355 +0000 UTC m=+0.308767013 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3112337 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b3060f1ba1507a5a3cb40cdfa326c SystemUUID:ec2b3060-f1ba-1507-a5a3-cb40cdfa326c BootID:9c413245-3072-4395-a520-684114d54331 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:33:e3:48:2b:ad Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:33:e3:48:2b:ad Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:08:f3:c2:3f:d5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 15 01:38:24.450527 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.450521 2551 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 15 01:38:24.450651 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.450586 2551 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 15 01:38:24.452699 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.452679 2551 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 15 01:38:24.453255 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.453232 2551 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 15 01:38:24.453383 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.453259 2551 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-147.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 15 01:38:24.454069 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.454060 2551 topology_manager.go:138] "Creating topology manager with none policy" Jun 15 01:38:24.454109 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.454072 2551 container_manager_linux.go:309] "Creating device plugin manager" Jun 15 01:38:24.454109 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.454080 2551 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 15 01:38:24.454700 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.454688 2551 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 15 01:38:24.455904 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.455893 2551 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 15 01:38:24.459763 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.459751 2551 state_mem.go:36] "Initialized new in-memory state store" Jun 15 01:38:24.459883 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.459873 2551 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 15 01:38:24.459924 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.459901 2551 kubelet.go:486] "Attempting to sync node with API server" Jun 15 01:38:24.459924 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.459911 2551 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 15 01:38:24.459924 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.459921 2551 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 15 01:38:24.460029 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.459930 2551 kubelet.go:398] "Adding apiserver pod source" Jun 15 01:38:24.460029 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.459938 2551 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 15 01:38:24.460392 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.460367 2551 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 15 01:38:24.460510 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.460401 2551 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 15 01:38:24.462399 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.462375 2551 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 15 01:38:24.463798 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.463785 2551 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 15 01:38:24.463880 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.463814 2551 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 15 01:38:24.464010 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.464000 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 15 01:38:24.464046 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.464015 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 15 01:38:24.464046 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.464021 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 15 01:38:24.464046 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.464027 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 15 01:38:24.464046 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.464035 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 15 01:38:24.464046 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.464040 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 15 01:38:24.464543 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.464532 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 15 01:38:24.464543 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.464542 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 15 01:38:24.464605 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.464555 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 15 01:38:24.464605 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.464564 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 15 01:38:24.464605 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.464572 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 15 01:38:24.464605 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.464580 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 15 01:38:24.464818 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.464805 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 15 01:38:24.464849 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.464823 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 15 01:38:24.469478 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.469459 2551 server.go:1268] "Started kubelet" Jun 15 01:38:24.469593 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.469571 2551 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 15 01:38:24.469658 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.469612 2551 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 15 01:38:24.469833 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:24.469807 2551 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-147.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 15 01:38:24.469974 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.469827 2551 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 15 01:38:24.469974 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.469903 2551 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-147.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 15 01:38:24.469974 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:24.469965 2551 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 15 01:38:24.470557 ip-10-0-137-147 systemd[1]: Started Kubernetes Kubelet. Jun 15 01:38:24.471259 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.471235 2551 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 15 01:38:24.472012 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.471997 2551 server.go:310] "Adding debug handlers to kubelet server" Jun 15 01:38:24.474511 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:24.473604 2551 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-147.ec2.internal.18b91d7253b23586 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-147.ec2.internal,UID:ip-10-0-137-147.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-147.ec2.internal,},FirstTimestamp:2026-06-15 01:38:24.46940711 +0000 UTC m=+0.328229770,LastTimestamp:2026-06-15 01:38:24.46940711 +0000 UTC m=+0.328229770,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-147.ec2.internal,}" Jun 15 01:38:24.475537 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:24.475512 2551 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 15 01:38:24.477052 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.477031 2551 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 15 01:38:24.477052 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.477045 2551 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 15 01:38:24.477181 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:24.477100 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-147.ec2.internal\" not found" Jun 15 01:38:24.477720 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.477701 2551 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 15 01:38:24.477812 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.477703 2551 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 15 01:38:24.477812 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.477743 2551 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 15 01:38:24.477926 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.477849 2551 reconstruct.go:97] "Volume reconstruction finished" Jun 15 01:38:24.477926 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.477859 2551 reconciler.go:29] "Reconciler: start to sync state" Jun 15 01:38:24.478065 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.478053 2551 factory.go:55] Registering systemd factory Jun 15 01:38:24.478134 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.478071 2551 factory.go:223] Registration of the systemd container factory successfully Jun 15 01:38:24.478277 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.478264 2551 factory.go:153] Registering CRI-O factory Jun 15 01:38:24.478318 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.478278 2551 factory.go:223] Registration of the crio container factory successfully Jun 15 01:38:24.478354 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.478343 2551 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 15 01:38:24.478383 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.478369 2551 factory.go:103] Registering Raw factory Jun 15 01:38:24.478412 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.478384 2551 manager.go:1196] Started watching for new ooms in manager Jun 15 01:38:24.478832 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.478822 2551 manager.go:349] Starting recovery of all containers Jun 15 01:38:24.485018 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.484884 2551 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 15 01:38:24.485845 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:24.485815 2551 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 15 01:38:24.485925 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:24.485838 2551 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-147.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 15 01:38:24.490105 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.490090 2551 manager.go:354] Recovery completed Jun 15 01:38:24.495756 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.495743 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 01:38:24.496415 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.496400 2551 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tkzj5" Jun 15 01:38:24.497674 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.497658 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-147.ec2.internal" event="NodeHasSufficientMemory" Jun 15 01:38:24.497739 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.497686 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-147.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 01:38:24.497739 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.497696 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-147.ec2.internal" event="NodeHasSufficientPID" Jun 15 01:38:24.498247 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.498235 2551 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 15 01:38:24.498247 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.498244 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 01:38:24.498328 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.498247 2551 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 15 01:38:24.498328 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.498311 2551 state_mem.go:36] "Initialized new in-memory state store" Jun 15 01:38:24.498915 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.498900 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-147.ec2.internal" event="NodeHasSufficientMemory" Jun 15 01:38:24.498965 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.498924 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-147.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 01:38:24.498965 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.498939 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-147.ec2.internal" event="NodeHasSufficientPID" Jun 15 01:38:24.500039 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:24.499958 2551 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-147.ec2.internal.18b91d725561840d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-147.ec2.internal,UID:ip-10-0-137-147.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-147.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-147.ec2.internal,},FirstTimestamp:2026-06-15 01:38:24.497673229 +0000 UTC m=+0.356495887,LastTimestamp:2026-06-15 01:38:24.497673229 +0000 UTC m=+0.356495887,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-147.ec2.internal,}" Jun 15 01:38:24.500399 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.500383 2551 policy_none.go:49] "None policy: Start" Jun 15 01:38:24.500399 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.500401 2551 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 15 01:38:24.500501 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.500411 2551 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 15 01:38:24.501509 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.501495 2551 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tkzj5" Jun 15 01:38:24.502321 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.502309 2551 policy_none.go:47] "Start" Jun 15 01:38:24.535201 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.535187 2551 manager.go:337] "Starting Device Plugin manager" Jun 15 01:38:24.554482 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:24.535221 2551 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 15 01:38:24.554482 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.535230 2551 server.go:87] "Starting device plugin registration server" Jun 15 01:38:24.554482 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.535425 2551 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 15 01:38:24.554482 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.535438 2551 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 15 01:38:24.554482 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.535499 2551 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 15 01:38:24.554482 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.535570 2551 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 15 01:38:24.554482 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.535578 2551 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 15 01:38:24.554482 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:24.536202 2551 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 15 01:38:24.554482 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:24.536253 2551 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-147.ec2.internal\" not found" Jun 15 01:38:24.554482 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.540193 2551 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 15 01:38:24.554482 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.540229 2551 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 15 01:38:24.554482 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.540248 2551 kubelet.go:2448] "Starting kubelet main sync loop" Jun 15 01:38:24.554482 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:24.540279 2551 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 15 01:38:24.554482 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.542647 2551 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 01:38:24.635576 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.635542 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 01:38:24.636332 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.636319 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-147.ec2.internal" event="NodeHasSufficientMemory" Jun 15 01:38:24.636384 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.636345 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-147.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 01:38:24.636384 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.636355 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-147.ec2.internal" event="NodeHasSufficientPID" Jun 15 01:38:24.636384 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.636375 2551 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-147.ec2.internal" Jun 15 01:38:24.640352 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.640334 2551 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-147.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-147.ec2.internal"] Jun 15 01:38:24.640395 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.640389 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 01:38:24.641083 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.641069 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-147.ec2.internal" event="NodeHasSufficientMemory" Jun 15 01:38:24.641157 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.641092 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-147.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 01:38:24.641157 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.641101 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-147.ec2.internal" event="NodeHasSufficientPID" Jun 15 01:38:24.643323 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.643292 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 01:38:24.643402 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.643389 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-147.ec2.internal" Jun 15 01:38:24.643436 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.643431 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 01:38:24.643932 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.643905 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-147.ec2.internal" event="NodeHasSufficientMemory" Jun 15 01:38:24.643932 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.643926 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-147.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 01:38:24.644058 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.643937 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-147.ec2.internal" event="NodeHasSufficientPID" Jun 15 01:38:24.644602 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.644587 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-147.ec2.internal" event="NodeHasSufficientMemory" Jun 15 01:38:24.644602 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.644605 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-147.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 01:38:24.644807 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.644613 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-147.ec2.internal" event="NodeHasSufficientPID" Jun 15 01:38:24.645145 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.645129 2551 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-147.ec2.internal" Jun 15 01:38:24.645210 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:24.645152 2551 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-147.ec2.internal\": node \"ip-10-0-137-147.ec2.internal\" not found" Jun 15 01:38:24.646758 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.646740 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-147.ec2.internal" Jun 15 01:38:24.646841 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.646774 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 01:38:24.647446 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.647432 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-147.ec2.internal" event="NodeHasSufficientMemory" Jun 15 01:38:24.647523 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.647457 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-147.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 01:38:24.647523 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.647468 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-147.ec2.internal" event="NodeHasSufficientPID" Jun 15 01:38:24.669757 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:24.669739 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-147.ec2.internal\" not found" Jun 15 01:38:24.672142 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:24.672127 2551 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-147.ec2.internal\" not found" node="ip-10-0-137-147.ec2.internal" Jun 15 01:38:24.676211 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:24.676197 2551 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-147.ec2.internal\" not found" node="ip-10-0-137-147.ec2.internal" Jun 15 01:38:24.679081 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.679065 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4a0fa8a0ec9211c9d89de751bfc47d7e-config\") pod \"kube-apiserver-proxy-ip-10-0-137-147.ec2.internal\" (UID: \"4a0fa8a0ec9211c9d89de751bfc47d7e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-147.ec2.internal" Jun 15 01:38:24.679151 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.679088 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ee0c27a8e8d9329ff25e55ac588e856f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-147.ec2.internal\" (UID: \"ee0c27a8e8d9329ff25e55ac588e856f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-147.ec2.internal" Jun 15 01:38:24.679151 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.679105 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee0c27a8e8d9329ff25e55ac588e856f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-147.ec2.internal\" (UID: \"ee0c27a8e8d9329ff25e55ac588e856f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-147.ec2.internal" Jun 15 01:38:24.770017 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:24.769990 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-147.ec2.internal\" not found" Jun 15 01:38:24.779260 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.779239 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4a0fa8a0ec9211c9d89de751bfc47d7e-config\") pod \"kube-apiserver-proxy-ip-10-0-137-147.ec2.internal\" (UID: \"4a0fa8a0ec9211c9d89de751bfc47d7e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-147.ec2.internal" Jun 15 01:38:24.779332 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.779273 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ee0c27a8e8d9329ff25e55ac588e856f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-147.ec2.internal\" (UID: \"ee0c27a8e8d9329ff25e55ac588e856f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-147.ec2.internal" Jun 15 01:38:24.779332 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.779299 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee0c27a8e8d9329ff25e55ac588e856f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-147.ec2.internal\" (UID: \"ee0c27a8e8d9329ff25e55ac588e856f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-147.ec2.internal" Jun 15 01:38:24.779332 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.779300 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4a0fa8a0ec9211c9d89de751bfc47d7e-config\") pod \"kube-apiserver-proxy-ip-10-0-137-147.ec2.internal\" (UID: \"4a0fa8a0ec9211c9d89de751bfc47d7e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-147.ec2.internal" Jun 15 01:38:24.779451 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.779354 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee0c27a8e8d9329ff25e55ac588e856f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-147.ec2.internal\" (UID: \"ee0c27a8e8d9329ff25e55ac588e856f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-147.ec2.internal" Jun 15 01:38:24.779451 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.779351 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ee0c27a8e8d9329ff25e55ac588e856f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-147.ec2.internal\" (UID: \"ee0c27a8e8d9329ff25e55ac588e856f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-147.ec2.internal" Jun 15 01:38:24.870430 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:24.870396 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-147.ec2.internal\" not found" Jun 15 01:38:24.971192 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:24.971137 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-147.ec2.internal\" not found" Jun 15 01:38:24.974316 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.974299 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-147.ec2.internal" Jun 15 01:38:24.979369 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:24.979352 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-147.ec2.internal" Jun 15 01:38:25.072146 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:25.072113 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-147.ec2.internal\" not found" Jun 15 01:38:25.172647 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:25.172610 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-147.ec2.internal\" not found" Jun 15 01:38:25.273101 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:25.273031 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-147.ec2.internal\" not found" Jun 15 01:38:25.331593 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:25.331570 2551 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 01:38:25.373602 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:25.373579 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-147.ec2.internal\" not found" Jun 15 01:38:25.419188 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:25.419163 2551 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 15 01:38:25.419760 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:25.419290 2551 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 15 01:38:25.419760 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:25.419347 2551 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 15 01:38:25.474195 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:25.474166 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-147.ec2.internal\" not found" Jun 15 01:38:25.504724 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:25.504697 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a0fa8a0ec9211c9d89de751bfc47d7e.slice/crio-23b914abadde56e8ae1af6966f8dfd69ccb3a94df7c8b1d982eeccf2cd0e0c92 WatchSource:0}: Error finding container 23b914abadde56e8ae1af6966f8dfd69ccb3a94df7c8b1d982eeccf2cd0e0c92: Status 404 returned error can't find the container with id 23b914abadde56e8ae1af6966f8dfd69ccb3a94df7c8b1d982eeccf2cd0e0c92 Jun 15 01:38:25.504909 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:25.504894 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee0c27a8e8d9329ff25e55ac588e856f.slice/crio-84039f471e9f4d870e381442e73afe9bde7b99c7f9452b389464efb4db605393 WatchSource:0}: Error finding container 84039f471e9f4d870e381442e73afe9bde7b99c7f9452b389464efb4db605393: Status 404 returned error can't find the container with id 84039f471e9f4d870e381442e73afe9bde7b99c7f9452b389464efb4db605393 Jun 15 01:38:25.506004 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:25.505981 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-14 01:33:24 +0000 UTC" deadline="2028-01-20 14:26:59.549621619 +0000 UTC" Jun 15 01:38:25.506004 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:25.506002 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14028h48m34.043623194s" Jun 15 01:38:25.509474 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:25.509451 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 01:38:25.545181 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:25.545100 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-147.ec2.internal" event={"ID":"4a0fa8a0ec9211c9d89de751bfc47d7e","Type":"ContainerStarted","Data":"23b914abadde56e8ae1af6966f8dfd69ccb3a94df7c8b1d982eeccf2cd0e0c92"} Jun 15 01:38:25.546023 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:25.546004 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-147.ec2.internal" event={"ID":"ee0c27a8e8d9329ff25e55ac588e856f","Type":"ContainerStarted","Data":"84039f471e9f4d870e381442e73afe9bde7b99c7f9452b389464efb4db605393"} Jun 15 01:38:25.575166 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:25.575144 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-147.ec2.internal\" not found" Jun 15 01:38:25.637729 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:25.637709 2551 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 01:38:25.677928 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:25.677907 2551 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-147.ec2.internal" Jun 15 01:38:25.692704 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:25.692686 2551 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 15 01:38:25.693647 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:25.693621 2551 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-147.ec2.internal" Jun 15 01:38:25.699611 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:25.699599 2551 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 15 01:38:26.392789 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.392757 2551 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 01:38:26.422711 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.422684 2551 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 01:38:26.460318 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.460296 2551 apiserver.go:52] "Watching apiserver" Jun 15 01:38:26.466832 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.466808 2551 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 15 01:38:26.467218 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.467194 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-jm8jk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-147.ec2.internal","openshift-multus/multus-additional-cni-plugins-lpfqj","openshift-network-diagnostics/network-check-target-dqhvd","openshift-ovn-kubernetes/ovnkube-node-c2jms","kube-system/global-pull-secret-syncer-wlt8m","kube-system/kube-apiserver-proxy-ip-10-0-137-147.ec2.internal","openshift-image-registry/node-ca-w97rl","openshift-multus/multus-sj95p","openshift-multus/network-metrics-daemon-r567p","openshift-network-operator/iptables-alerter-4v279","kube-system/konnectivity-agent-6rwhz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rs79","openshift-cluster-node-tuning-operator/tuned-blhg2"] Jun 15 01:38:26.469748 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.469725 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4v279" Jun 15 01:38:26.472427 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.472092 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 15 01:38:26.472427 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.472231 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.472427 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.472296 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 15 01:38:26.472427 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.472344 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 15 01:38:26.472698 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.472547 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2ffzg\"" Jun 15 01:38:26.474080 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.474058 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 15 01:38:26.474382 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.474364 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-grvm4\"" Jun 15 01:38:26.474658 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.474643 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 15 01:38:26.474732 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.474691 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lpfqj" Jun 15 01:38:26.476374 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.476351 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 15 01:38:26.476481 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.476394 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jm8jk" Jun 15 01:38:26.476774 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.476604 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 15 01:38:26.476774 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.476605 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 15 01:38:26.476774 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.476695 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 15 01:38:26.476963 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.476848 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-t7cr5\"" Jun 15 01:38:26.476963 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.476863 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 15 01:38:26.477749 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.477730 2551 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 15 01:38:26.478707 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.478517 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 15 01:38:26.478707 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.478658 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 15 01:38:26.478822 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.478755 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-s2wmb\"" Jun 15 01:38:26.480209 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.480190 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.482087 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.482066 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 15 01:38:26.482307 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.482289 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 15 01:38:26.482404 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.482382 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 15 01:38:26.482505 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.482389 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7n9jc\"" Jun 15 01:38:26.482691 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.482675 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 15 01:38:26.482768 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.482727 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 15 01:38:26.482827 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.482680 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 15 01:38:26.484145 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.483504 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rs79" Jun 15 01:38:26.486684 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.485719 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 15 01:38:26.486684 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.486110 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 15 01:38:26.487368 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.487350 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 15 01:38:26.487514 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.487484 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fz84t\"" Jun 15 01:38:26.487992 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.487960 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6rwhz" Jun 15 01:38:26.488640 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.488610 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e7c476e-f3a4-446a-b8e5-f4028b6af346-system-cni-dir\") pod \"multus-additional-cni-plugins-lpfqj\" (UID: \"6e7c476e-f3a4-446a-b8e5-f4028b6af346\") " pod="openshift-multus/multus-additional-cni-plugins-lpfqj" Jun 15 01:38:26.488728 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.488675 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-var-lib-openvswitch\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.488728 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.488715 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-host-run-ovn-kubernetes\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.488841 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.488743 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-host-cni-bin\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.488841 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.488779 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9db6a608-3746-407c-8405-f97809114af8-lib-modules\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.488841 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.488805 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9db6a608-3746-407c-8405-f97809114af8-var-lib-kubelet\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.488841 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.488835 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6e7c476e-f3a4-446a-b8e5-f4028b6af346-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lpfqj\" (UID: \"6e7c476e-f3a4-446a-b8e5-f4028b6af346\") " pod="openshift-multus/multus-additional-cni-plugins-lpfqj" Jun 15 01:38:26.489056 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.488866 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0e7ee5cd-6981-4e21-a6bc-9fa66b8d8b37-iptables-alerter-script\") pod \"iptables-alerter-4v279\" (UID: \"0e7ee5cd-6981-4e21-a6bc-9fa66b8d8b37\") " pod="openshift-network-operator/iptables-alerter-4v279" Jun 15 01:38:26.489056 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.488896 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0e7ee5cd-6981-4e21-a6bc-9fa66b8d8b37-host-slash\") pod \"iptables-alerter-4v279\" (UID: \"0e7ee5cd-6981-4e21-a6bc-9fa66b8d8b37\") " pod="openshift-network-operator/iptables-alerter-4v279" Jun 15 01:38:26.489056 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.489038 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e7c476e-f3a4-446a-b8e5-f4028b6af346-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lpfqj\" (UID: \"6e7c476e-f3a4-446a-b8e5-f4028b6af346\") " pod="openshift-multus/multus-additional-cni-plugins-lpfqj" Jun 15 01:38:26.489209 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.489085 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8110134b-d73a-422f-88ca-b6eec684189d-tmp-dir\") pod \"node-resolver-jm8jk\" (UID: \"8110134b-d73a-422f-88ca-b6eec684189d\") " pod="openshift-dns/node-resolver-jm8jk" Jun 15 01:38:26.489209 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.489117 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-run-systemd\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.489311 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.489222 2551 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 15 01:38:26.489311 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.489298 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-run-ovn\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.489413 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.489339 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/63f8819b-4ac8-42d2-a662-78721cf2548f-ovn-node-metrics-cert\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.489413 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.489379 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/63f8819b-4ac8-42d2-a662-78721cf2548f-ovnkube-script-lib\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.489646 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.489428 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck4f4\" (UniqueName: \"kubernetes.io/projected/0e7ee5cd-6981-4e21-a6bc-9fa66b8d8b37-kube-api-access-ck4f4\") pod \"iptables-alerter-4v279\" (UID: \"0e7ee5cd-6981-4e21-a6bc-9fa66b8d8b37\") " pod="openshift-network-operator/iptables-alerter-4v279" Jun 15 01:38:26.489646 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.489463 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9db6a608-3746-407c-8405-f97809114af8-etc-sysconfig\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.489646 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.489492 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9db6a608-3746-407c-8405-f97809114af8-etc-sysctl-d\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.489646 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.489536 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9db6a608-3746-407c-8405-f97809114af8-etc-systemd\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.489646 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.489569 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9db6a608-3746-407c-8405-f97809114af8-tmp\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.489646 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.489604 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e7c476e-f3a4-446a-b8e5-f4028b6af346-cni-binary-copy\") pod \"multus-additional-cni-plugins-lpfqj\" (UID: \"6e7c476e-f3a4-446a-b8e5-f4028b6af346\") " pod="openshift-multus/multus-additional-cni-plugins-lpfqj" Jun 15 01:38:26.489946 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.489659 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-host-run-netns\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.489946 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.489695 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/63f8819b-4ac8-42d2-a662-78721cf2548f-ovnkube-config\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.489946 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.489747 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9db6a608-3746-407c-8405-f97809114af8-etc-modprobe-d\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.489946 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.489849 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 15 01:38:26.489946 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.489869 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9db6a608-3746-407c-8405-f97809114af8-etc-kubernetes\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.489946 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.489909 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9db6a608-3746-407c-8405-f97809114af8-etc-tuned\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.490248 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.489950 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e7c476e-f3a4-446a-b8e5-f4028b6af346-os-release\") pod \"multus-additional-cni-plugins-lpfqj\" (UID: \"6e7c476e-f3a4-446a-b8e5-f4028b6af346\") " pod="openshift-multus/multus-additional-cni-plugins-lpfqj" Jun 15 01:38:26.490248 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.490011 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-host-kubelet\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.490248 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.490086 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-host-slash\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.490248 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.490157 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6e7c476e-f3a4-446a-b8e5-f4028b6af346-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lpfqj\" (UID: \"6e7c476e-f3a4-446a-b8e5-f4028b6af346\") " pod="openshift-multus/multus-additional-cni-plugins-lpfqj" Jun 15 01:38:26.490248 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.490211 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpjln\" (UniqueName: \"kubernetes.io/projected/6e7c476e-f3a4-446a-b8e5-f4028b6af346-kube-api-access-xpjln\") pod \"multus-additional-cni-plugins-lpfqj\" (UID: \"6e7c476e-f3a4-446a-b8e5-f4028b6af346\") " pod="openshift-multus/multus-additional-cni-plugins-lpfqj" Jun 15 01:38:26.490248 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.490223 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 15 01:38:26.490248 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.490243 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dwl4\" (UniqueName: \"kubernetes.io/projected/8110134b-d73a-422f-88ca-b6eec684189d-kube-api-access-7dwl4\") pod \"node-resolver-jm8jk\" (UID: \"8110134b-d73a-422f-88ca-b6eec684189d\") " pod="openshift-dns/node-resolver-jm8jk" Jun 15 01:38:26.490582 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.490275 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/63f8819b-4ac8-42d2-a662-78721cf2548f-env-overrides\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.490582 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.490422 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9db6a608-3746-407c-8405-f97809114af8-run\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.490983 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.490895 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9db6a608-3746-407c-8405-f97809114af8-sys\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.490983 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.490944 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vwk6\" (UniqueName: \"kubernetes.io/projected/9db6a608-3746-407c-8405-f97809114af8-kube-api-access-2vwk6\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.490983 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.490973 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8110134b-d73a-422f-88ca-b6eec684189d-hosts-file\") pod \"node-resolver-jm8jk\" (UID: \"8110134b-d73a-422f-88ca-b6eec684189d\") " pod="openshift-dns/node-resolver-jm8jk" Jun 15 01:38:26.491179 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.491020 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-systemd-units\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.491179 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.491049 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-etc-openvswitch\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.491179 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.491076 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-run-openvswitch\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.491179 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.491114 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9db6a608-3746-407c-8405-f97809114af8-etc-sysctl-conf\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.491179 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.491143 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9db6a608-3746-407c-8405-f97809114af8-host\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.491449 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.491186 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e7c476e-f3a4-446a-b8e5-f4028b6af346-cnibin\") pod \"multus-additional-cni-plugins-lpfqj\" (UID: \"6e7c476e-f3a4-446a-b8e5-f4028b6af346\") " pod="openshift-multus/multus-additional-cni-plugins-lpfqj" Jun 15 01:38:26.491449 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.491221 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-node-log\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.491449 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.491242 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-log-socket\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.491449 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.491275 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-host-cni-netd\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.491449 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.491287 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w97rl" Jun 15 01:38:26.491449 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.491298 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.491449 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.491322 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrl7l\" (UniqueName: \"kubernetes.io/projected/63f8819b-4ac8-42d2-a662-78721cf2548f-kube-api-access-nrl7l\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.492491 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.492438 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-d2bkx\"" Jun 15 01:38:26.493190 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.493173 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 15 01:38:26.493315 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.493253 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 15 01:38:26.493376 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.493320 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zmrk6\"" Jun 15 01:38:26.493431 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.493259 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 15 01:38:26.493857 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.493840 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.495575 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.495529 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-s5qk6\"" Jun 15 01:38:26.495683 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.495578 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 15 01:38:26.496777 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.496573 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:38:26.496777 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:26.496725 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r567p" podUID="b3c35d53-b5a0-49e4-8964-61d18bbe5be1" Jun 15 01:38:26.498667 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.498649 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqhvd" Jun 15 01:38:26.498780 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:26.498756 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqhvd" podUID="a9ced722-0951-4661-809a-bffe50ecc3d4" Jun 15 01:38:26.500992 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.500971 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:38:26.501085 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:26.501047 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wlt8m" podUID="009c9c69-be75-43fc-96ba-3ce6a1082805" Jun 15 01:38:26.510867 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.510848 2551 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kwpw5" Jun 15 01:38:26.518238 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.518215 2551 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kwpw5" Jun 15 01:38:26.579104 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.579072 2551 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 15 01:38:26.591564 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.591538 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e7c476e-f3a4-446a-b8e5-f4028b6af346-cni-binary-copy\") pod \"multus-additional-cni-plugins-lpfqj\" (UID: \"6e7c476e-f3a4-446a-b8e5-f4028b6af346\") " pod="openshift-multus/multus-additional-cni-plugins-lpfqj" Jun 15 01:38:26.591693 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.591574 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-host-run-netns\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.591693 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.591603 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/63f8819b-4ac8-42d2-a662-78721cf2548f-ovnkube-config\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.591693 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.591643 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-host-var-lib-cni-bin\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.591693 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.591665 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-hostroot\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.591693 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.591689 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9db6a608-3746-407c-8405-f97809114af8-etc-modprobe-d\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.591863 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.591712 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9db6a608-3746-407c-8405-f97809114af8-etc-kubernetes\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.591863 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.591733 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-host-kubelet\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.591863 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.591755 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-host-slash\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.591863 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.591782 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/009c9c69-be75-43fc-96ba-3ce6a1082805-original-pull-secret\") pod \"global-pull-secret-syncer-wlt8m\" (UID: \"009c9c69-be75-43fc-96ba-3ce6a1082805\") " pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:38:26.591863 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.591823 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6e7c476e-f3a4-446a-b8e5-f4028b6af346-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lpfqj\" (UID: \"6e7c476e-f3a4-446a-b8e5-f4028b6af346\") " pod="openshift-multus/multus-additional-cni-plugins-lpfqj" Jun 15 01:38:26.591863 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.591857 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dwl4\" (UniqueName: \"kubernetes.io/projected/8110134b-d73a-422f-88ca-b6eec684189d-kube-api-access-7dwl4\") pod \"node-resolver-jm8jk\" (UID: \"8110134b-d73a-422f-88ca-b6eec684189d\") " pod="openshift-dns/node-resolver-jm8jk" Jun 15 01:38:26.592093 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.591883 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/63f8819b-4ac8-42d2-a662-78721cf2548f-env-overrides\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.592093 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.591906 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/10769daa-e827-4216-81c6-eeff8dedfb96-cni-binary-copy\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.592093 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.591935 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9db6a608-3746-407c-8405-f97809114af8-sys\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.592093 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.591958 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-run-openvswitch\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.592093 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.591986 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0e7ee5cd-6981-4e21-a6bc-9fa66b8d8b37-iptables-alerter-script\") pod \"iptables-alerter-4v279\" (UID: \"0e7ee5cd-6981-4e21-a6bc-9fa66b8d8b37\") " pod="openshift-network-operator/iptables-alerter-4v279" Jun 15 01:38:26.592093 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.591992 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-host-kubelet\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.592093 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.592008 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-os-release\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.592093 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.592026 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-host-run-netns\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.592093 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.592059 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9db6a608-3746-407c-8405-f97809114af8-etc-kubernetes\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.592093 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.592068 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-host-slash\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.592093 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.592090 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/42ad987b-989e-4e9f-b053-c2b273368cd1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4rs79\" (UID: \"42ad987b-989e-4e9f-b053-c2b273368cd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rs79" Jun 15 01:38:26.592542 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.592132 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-run-openvswitch\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.592542 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.592162 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9db6a608-3746-407c-8405-f97809114af8-host\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.592542 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.592187 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e7c476e-f3a4-446a-b8e5-f4028b6af346-cnibin\") pod \"multus-additional-cni-plugins-lpfqj\" (UID: \"6e7c476e-f3a4-446a-b8e5-f4028b6af346\") " pod="openshift-multus/multus-additional-cni-plugins-lpfqj" Jun 15 01:38:26.592542 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.592192 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9db6a608-3746-407c-8405-f97809114af8-etc-modprobe-d\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.592542 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.592197 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9db6a608-3746-407c-8405-f97809114af8-sys\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.592542 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.592202 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e7c476e-f3a4-446a-b8e5-f4028b6af346-cni-binary-copy\") pod \"multus-additional-cni-plugins-lpfqj\" (UID: \"6e7c476e-f3a4-446a-b8e5-f4028b6af346\") " pod="openshift-multus/multus-additional-cni-plugins-lpfqj" Jun 15 01:38:26.592542 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.592223 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.592542 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.592243 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e7c476e-f3a4-446a-b8e5-f4028b6af346-cnibin\") pod \"multus-additional-cni-plugins-lpfqj\" (UID: \"6e7c476e-f3a4-446a-b8e5-f4028b6af346\") " pod="openshift-multus/multus-additional-cni-plugins-lpfqj" Jun 15 01:38:26.592542 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.592289 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9db6a608-3746-407c-8405-f97809114af8-host\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.592542 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.592320 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.592542 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.592339 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-multus-conf-dir\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.592542 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.592449 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/42ad987b-989e-4e9f-b053-c2b273368cd1-registration-dir\") pod \"aws-ebs-csi-driver-node-4rs79\" (UID: \"42ad987b-989e-4e9f-b053-c2b273368cd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rs79" Jun 15 01:38:26.592542 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.592512 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/42ad987b-989e-4e9f-b053-c2b273368cd1-etc-selinux\") pod \"aws-ebs-csi-driver-node-4rs79\" (UID: \"42ad987b-989e-4e9f-b053-c2b273368cd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rs79" Jun 15 01:38:26.592542 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.592542 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/63f8819b-4ac8-42d2-a662-78721cf2548f-ovnkube-config\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.593192 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.592559 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-host-run-ovn-kubernetes\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.593192 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.592585 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-host-run-multus-certs\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.593192 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.592609 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jmg4\" (UniqueName: \"kubernetes.io/projected/81f80853-3308-4f3a-9cb4-83ce4fb00055-kube-api-access-5jmg4\") pod \"node-ca-w97rl\" (UID: \"81f80853-3308-4f3a-9cb4-83ce4fb00055\") " pod="openshift-image-registry/node-ca-w97rl" Jun 15 01:38:26.593192 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.592611 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6e7c476e-f3a4-446a-b8e5-f4028b6af346-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lpfqj\" (UID: \"6e7c476e-f3a4-446a-b8e5-f4028b6af346\") " pod="openshift-multus/multus-additional-cni-plugins-lpfqj" Jun 15 01:38:26.593192 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.592681 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-host-run-ovn-kubernetes\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.593192 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.592725 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6e7c476e-f3a4-446a-b8e5-f4028b6af346-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lpfqj\" (UID: \"6e7c476e-f3a4-446a-b8e5-f4028b6af346\") " pod="openshift-multus/multus-additional-cni-plugins-lpfqj" Jun 15 01:38:26.593192 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.592827 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0e7ee5cd-6981-4e21-a6bc-9fa66b8d8b37-host-slash\") pod \"iptables-alerter-4v279\" (UID: \"0e7ee5cd-6981-4e21-a6bc-9fa66b8d8b37\") " pod="openshift-network-operator/iptables-alerter-4v279" Jun 15 01:38:26.593192 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.592856 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/42ad987b-989e-4e9f-b053-c2b273368cd1-device-dir\") pod \"aws-ebs-csi-driver-node-4rs79\" (UID: \"42ad987b-989e-4e9f-b053-c2b273368cd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rs79" Jun 15 01:38:26.593192 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.592919 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0e7ee5cd-6981-4e21-a6bc-9fa66b8d8b37-host-slash\") pod \"iptables-alerter-4v279\" (UID: \"0e7ee5cd-6981-4e21-a6bc-9fa66b8d8b37\") " pod="openshift-network-operator/iptables-alerter-4v279" Jun 15 01:38:26.593192 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.592907 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/42ad987b-989e-4e9f-b053-c2b273368cd1-sys-fs\") pod \"aws-ebs-csi-driver-node-4rs79\" (UID: \"42ad987b-989e-4e9f-b053-c2b273368cd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rs79" Jun 15 01:38:26.593192 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.592963 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e7c476e-f3a4-446a-b8e5-f4028b6af346-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lpfqj\" (UID: \"6e7c476e-f3a4-446a-b8e5-f4028b6af346\") " pod="openshift-multus/multus-additional-cni-plugins-lpfqj" Jun 15 01:38:26.593192 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.592987 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8110134b-d73a-422f-88ca-b6eec684189d-tmp-dir\") pod \"node-resolver-jm8jk\" (UID: \"8110134b-d73a-422f-88ca-b6eec684189d\") " pod="openshift-dns/node-resolver-jm8jk" Jun 15 01:38:26.593192 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.592993 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0e7ee5cd-6981-4e21-a6bc-9fa66b8d8b37-iptables-alerter-script\") pod \"iptables-alerter-4v279\" (UID: \"0e7ee5cd-6981-4e21-a6bc-9fa66b8d8b37\") " pod="openshift-network-operator/iptables-alerter-4v279" Jun 15 01:38:26.593192 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.592524 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/63f8819b-4ac8-42d2-a662-78721cf2548f-env-overrides\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.593192 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593009 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-run-systemd\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.593192 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593032 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-run-ovn\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.593192 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593056 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/63f8819b-4ac8-42d2-a662-78721cf2548f-ovn-node-metrics-cert\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.593992 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593061 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-run-systemd\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.593992 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593079 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck4f4\" (UniqueName: \"kubernetes.io/projected/0e7ee5cd-6981-4e21-a6bc-9fa66b8d8b37-kube-api-access-ck4f4\") pod \"iptables-alerter-4v279\" (UID: \"0e7ee5cd-6981-4e21-a6bc-9fa66b8d8b37\") " pod="openshift-network-operator/iptables-alerter-4v279" Jun 15 01:38:26.593992 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593105 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-run-ovn\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.593992 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593128 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/009c9c69-be75-43fc-96ba-3ce6a1082805-dbus\") pod \"global-pull-secret-syncer-wlt8m\" (UID: \"009c9c69-be75-43fc-96ba-3ce6a1082805\") " pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:38:26.593992 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593151 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9db6a608-3746-407c-8405-f97809114af8-etc-sysctl-d\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.593992 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593175 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e7c476e-f3a4-446a-b8e5-f4028b6af346-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lpfqj\" (UID: \"6e7c476e-f3a4-446a-b8e5-f4028b6af346\") " pod="openshift-multus/multus-additional-cni-plugins-lpfqj" Jun 15 01:38:26.593992 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593176 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6e7c476e-f3a4-446a-b8e5-f4028b6af346-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lpfqj\" (UID: \"6e7c476e-f3a4-446a-b8e5-f4028b6af346\") " pod="openshift-multus/multus-additional-cni-plugins-lpfqj" Jun 15 01:38:26.593992 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593192 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9db6a608-3746-407c-8405-f97809114af8-tmp\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.593992 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593226 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-system-cni-dir\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.593992 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593276 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8110134b-d73a-422f-88ca-b6eec684189d-tmp-dir\") pod \"node-resolver-jm8jk\" (UID: \"8110134b-d73a-422f-88ca-b6eec684189d\") " pod="openshift-dns/node-resolver-jm8jk" Jun 15 01:38:26.593992 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593330 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9db6a608-3746-407c-8405-f97809114af8-etc-sysctl-d\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.593992 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593357 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9db6a608-3746-407c-8405-f97809114af8-etc-tuned\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.593992 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593389 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e7c476e-f3a4-446a-b8e5-f4028b6af346-os-release\") pod \"multus-additional-cni-plugins-lpfqj\" (UID: \"6e7c476e-f3a4-446a-b8e5-f4028b6af346\") " pod="openshift-multus/multus-additional-cni-plugins-lpfqj" Jun 15 01:38:26.593992 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593396 2551 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 15 01:38:26.593992 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593416 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-etc-kubernetes\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.593992 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593466 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/009c9c69-be75-43fc-96ba-3ce6a1082805-kubelet-config\") pod \"global-pull-secret-syncer-wlt8m\" (UID: \"009c9c69-be75-43fc-96ba-3ce6a1082805\") " pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:38:26.593992 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593476 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e7c476e-f3a4-446a-b8e5-f4028b6af346-os-release\") pod \"multus-additional-cni-plugins-lpfqj\" (UID: \"6e7c476e-f3a4-446a-b8e5-f4028b6af346\") " pod="openshift-multus/multus-additional-cni-plugins-lpfqj" Jun 15 01:38:26.593992 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593490 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/26d9c93d-7f11-4e53-91fe-b863d7bd96ce-agent-certs\") pod \"konnectivity-agent-6rwhz\" (UID: \"26d9c93d-7f11-4e53-91fe-b863d7bd96ce\") " pod="kube-system/konnectivity-agent-6rwhz" Jun 15 01:38:26.594755 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593527 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpjln\" (UniqueName: \"kubernetes.io/projected/6e7c476e-f3a4-446a-b8e5-f4028b6af346-kube-api-access-xpjln\") pod \"multus-additional-cni-plugins-lpfqj\" (UID: \"6e7c476e-f3a4-446a-b8e5-f4028b6af346\") " pod="openshift-multus/multus-additional-cni-plugins-lpfqj" Jun 15 01:38:26.594755 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593564 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-cnibin\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.594755 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593589 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-host-run-netns\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.594755 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593613 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/10769daa-e827-4216-81c6-eeff8dedfb96-multus-daemon-config\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.594755 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593650 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81f80853-3308-4f3a-9cb4-83ce4fb00055-host\") pod \"node-ca-w97rl\" (UID: \"81f80853-3308-4f3a-9cb4-83ce4fb00055\") " pod="openshift-image-registry/node-ca-w97rl" Jun 15 01:38:26.594755 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593675 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9db6a608-3746-407c-8405-f97809114af8-run\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.594755 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593738 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vwk6\" (UniqueName: \"kubernetes.io/projected/9db6a608-3746-407c-8405-f97809114af8-kube-api-access-2vwk6\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.594755 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593781 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8110134b-d73a-422f-88ca-b6eec684189d-hosts-file\") pod \"node-resolver-jm8jk\" (UID: \"8110134b-d73a-422f-88ca-b6eec684189d\") " pod="openshift-dns/node-resolver-jm8jk" Jun 15 01:38:26.594755 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593803 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9db6a608-3746-407c-8405-f97809114af8-run\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.594755 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593812 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-systemd-units\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.594755 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593841 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-etc-openvswitch\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.594755 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593864 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8110134b-d73a-422f-88ca-b6eec684189d-hosts-file\") pod \"node-resolver-jm8jk\" (UID: \"8110134b-d73a-422f-88ca-b6eec684189d\") " pod="openshift-dns/node-resolver-jm8jk" Jun 15 01:38:26.594755 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593867 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-node-log\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.594755 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593876 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-systemd-units\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.594755 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593910 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-etc-openvswitch\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.594755 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593912 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-node-log\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.594755 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593934 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-host-cni-netd\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.594755 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593958 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9db6a608-3746-407c-8405-f97809114af8-etc-sysctl-conf\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.595437 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593962 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-host-cni-netd\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.595437 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.593980 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-log-socket\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.595437 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.594003 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrl7l\" (UniqueName: \"kubernetes.io/projected/63f8819b-4ac8-42d2-a662-78721cf2548f-kube-api-access-nrl7l\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.595437 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.594029 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-multus-socket-dir-parent\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.595437 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.594040 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-log-socket\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.595437 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.594051 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-host-run-k8s-cni-cncf-io\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.595437 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.594058 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9db6a608-3746-407c-8405-f97809114af8-etc-sysctl-conf\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.595437 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.594071 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-host-var-lib-cni-multus\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.595437 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.594094 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdk9h\" (UniqueName: \"kubernetes.io/projected/b3c35d53-b5a0-49e4-8964-61d18bbe5be1-kube-api-access-fdk9h\") pod \"network-metrics-daemon-r567p\" (UID: \"b3c35d53-b5a0-49e4-8964-61d18bbe5be1\") " pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:38:26.595437 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.594121 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/81f80853-3308-4f3a-9cb4-83ce4fb00055-serviceca\") pod \"node-ca-w97rl\" (UID: \"81f80853-3308-4f3a-9cb4-83ce4fb00055\") " pod="openshift-image-registry/node-ca-w97rl" Jun 15 01:38:26.595437 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.594145 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e7c476e-f3a4-446a-b8e5-f4028b6af346-system-cni-dir\") pod \"multus-additional-cni-plugins-lpfqj\" (UID: \"6e7c476e-f3a4-446a-b8e5-f4028b6af346\") " pod="openshift-multus/multus-additional-cni-plugins-lpfqj" Jun 15 01:38:26.595437 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.594167 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-var-lib-openvswitch\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.595437 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.594190 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-host-cni-bin\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.595437 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.594190 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e7c476e-f3a4-446a-b8e5-f4028b6af346-system-cni-dir\") pod \"multus-additional-cni-plugins-lpfqj\" (UID: \"6e7c476e-f3a4-446a-b8e5-f4028b6af346\") " pod="openshift-multus/multus-additional-cni-plugins-lpfqj" Jun 15 01:38:26.595437 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.594209 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-var-lib-openvswitch\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.595437 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.594211 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9db6a608-3746-407c-8405-f97809114af8-lib-modules\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.595437 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.594242 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63f8819b-4ac8-42d2-a662-78721cf2548f-host-cni-bin\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.596218 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.594246 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9db6a608-3746-407c-8405-f97809114af8-var-lib-kubelet\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.596218 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.594268 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-multus-cni-dir\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.596218 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.594285 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3c35d53-b5a0-49e4-8964-61d18bbe5be1-metrics-certs\") pod \"network-metrics-daemon-r567p\" (UID: \"b3c35d53-b5a0-49e4-8964-61d18bbe5be1\") " pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:38:26.596218 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.594306 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9db6a608-3746-407c-8405-f97809114af8-lib-modules\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.596218 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.594308 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/26d9c93d-7f11-4e53-91fe-b863d7bd96ce-konnectivity-ca\") pod \"konnectivity-agent-6rwhz\" (UID: \"26d9c93d-7f11-4e53-91fe-b863d7bd96ce\") " pod="kube-system/konnectivity-agent-6rwhz" Jun 15 01:38:26.596218 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.594343 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/63f8819b-4ac8-42d2-a662-78721cf2548f-ovnkube-script-lib\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.596218 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.594358 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9db6a608-3746-407c-8405-f97809114af8-var-lib-kubelet\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.596218 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.594368 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-host-var-lib-kubelet\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.596218 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.594392 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt5ww\" (UniqueName: \"kubernetes.io/projected/10769daa-e827-4216-81c6-eeff8dedfb96-kube-api-access-wt5ww\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.596218 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.594420 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htgmq\" (UniqueName: \"kubernetes.io/projected/a9ced722-0951-4661-809a-bffe50ecc3d4-kube-api-access-htgmq\") pod \"network-check-target-dqhvd\" (UID: \"a9ced722-0951-4661-809a-bffe50ecc3d4\") " pod="openshift-network-diagnostics/network-check-target-dqhvd" Jun 15 01:38:26.596218 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.594442 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/42ad987b-989e-4e9f-b053-c2b273368cd1-socket-dir\") pod \"aws-ebs-csi-driver-node-4rs79\" (UID: \"42ad987b-989e-4e9f-b053-c2b273368cd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rs79" Jun 15 01:38:26.596218 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.594457 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sj8w\" (UniqueName: \"kubernetes.io/projected/42ad987b-989e-4e9f-b053-c2b273368cd1-kube-api-access-5sj8w\") pod \"aws-ebs-csi-driver-node-4rs79\" (UID: \"42ad987b-989e-4e9f-b053-c2b273368cd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rs79" Jun 15 01:38:26.596218 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.594493 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9db6a608-3746-407c-8405-f97809114af8-etc-sysconfig\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.596218 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.594545 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9db6a608-3746-407c-8405-f97809114af8-etc-systemd\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.596218 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.594581 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9db6a608-3746-407c-8405-f97809114af8-etc-systemd\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.596218 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.594589 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9db6a608-3746-407c-8405-f97809114af8-etc-sysconfig\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.596218 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.594940 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/63f8819b-4ac8-42d2-a662-78721cf2548f-ovnkube-script-lib\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.597011 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.596895 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9db6a608-3746-407c-8405-f97809114af8-etc-tuned\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.597011 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.596930 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9db6a608-3746-407c-8405-f97809114af8-tmp\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.597011 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.597001 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/63f8819b-4ac8-42d2-a662-78721cf2548f-ovn-node-metrics-cert\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.600472 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.600447 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dwl4\" (UniqueName: \"kubernetes.io/projected/8110134b-d73a-422f-88ca-b6eec684189d-kube-api-access-7dwl4\") pod \"node-resolver-jm8jk\" (UID: \"8110134b-d73a-422f-88ca-b6eec684189d\") " pod="openshift-dns/node-resolver-jm8jk" Jun 15 01:38:26.603522 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.603478 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck4f4\" (UniqueName: \"kubernetes.io/projected/0e7ee5cd-6981-4e21-a6bc-9fa66b8d8b37-kube-api-access-ck4f4\") pod \"iptables-alerter-4v279\" (UID: \"0e7ee5cd-6981-4e21-a6bc-9fa66b8d8b37\") " pod="openshift-network-operator/iptables-alerter-4v279" Jun 15 01:38:26.603607 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.603539 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vwk6\" (UniqueName: \"kubernetes.io/projected/9db6a608-3746-407c-8405-f97809114af8-kube-api-access-2vwk6\") pod \"tuned-blhg2\" (UID: \"9db6a608-3746-407c-8405-f97809114af8\") " pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.604224 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.604201 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpjln\" (UniqueName: \"kubernetes.io/projected/6e7c476e-f3a4-446a-b8e5-f4028b6af346-kube-api-access-xpjln\") pod \"multus-additional-cni-plugins-lpfqj\" (UID: \"6e7c476e-f3a4-446a-b8e5-f4028b6af346\") " pod="openshift-multus/multus-additional-cni-plugins-lpfqj" Jun 15 01:38:26.605751 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.605729 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrl7l\" (UniqueName: \"kubernetes.io/projected/63f8819b-4ac8-42d2-a662-78721cf2548f-kube-api-access-nrl7l\") pod \"ovnkube-node-c2jms\" (UID: \"63f8819b-4ac8-42d2-a662-78721cf2548f\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.695760 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.695685 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-system-cni-dir\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.695760 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.695724 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-etc-kubernetes\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.695760 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.695749 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/009c9c69-be75-43fc-96ba-3ce6a1082805-kubelet-config\") pod \"global-pull-secret-syncer-wlt8m\" (UID: \"009c9c69-be75-43fc-96ba-3ce6a1082805\") " pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:38:26.696042 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.695771 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/26d9c93d-7f11-4e53-91fe-b863d7bd96ce-agent-certs\") pod \"konnectivity-agent-6rwhz\" (UID: \"26d9c93d-7f11-4e53-91fe-b863d7bd96ce\") " pod="kube-system/konnectivity-agent-6rwhz" Jun 15 01:38:26.696042 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.695818 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-system-cni-dir\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.696042 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.695826 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-etc-kubernetes\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.696042 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.695850 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/009c9c69-be75-43fc-96ba-3ce6a1082805-kubelet-config\") pod \"global-pull-secret-syncer-wlt8m\" (UID: \"009c9c69-be75-43fc-96ba-3ce6a1082805\") " pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:38:26.696042 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.695881 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-cnibin\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.696042 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.695913 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-host-run-netns\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.696042 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.695939 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/10769daa-e827-4216-81c6-eeff8dedfb96-multus-daemon-config\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.696042 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.695960 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81f80853-3308-4f3a-9cb4-83ce4fb00055-host\") pod \"node-ca-w97rl\" (UID: \"81f80853-3308-4f3a-9cb4-83ce4fb00055\") " pod="openshift-image-registry/node-ca-w97rl" Jun 15 01:38:26.696042 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.695970 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-cnibin\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.696042 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696016 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-host-run-netns\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.696042 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696018 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81f80853-3308-4f3a-9cb4-83ce4fb00055-host\") pod \"node-ca-w97rl\" (UID: \"81f80853-3308-4f3a-9cb4-83ce4fb00055\") " pod="openshift-image-registry/node-ca-w97rl" Jun 15 01:38:26.696042 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696040 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-multus-socket-dir-parent\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.696648 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696068 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-host-run-k8s-cni-cncf-io\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.696648 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696093 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-host-var-lib-cni-multus\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.696648 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696118 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdk9h\" (UniqueName: \"kubernetes.io/projected/b3c35d53-b5a0-49e4-8964-61d18bbe5be1-kube-api-access-fdk9h\") pod \"network-metrics-daemon-r567p\" (UID: \"b3c35d53-b5a0-49e4-8964-61d18bbe5be1\") " pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:38:26.696648 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696143 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/81f80853-3308-4f3a-9cb4-83ce4fb00055-serviceca\") pod \"node-ca-w97rl\" (UID: \"81f80853-3308-4f3a-9cb4-83ce4fb00055\") " pod="openshift-image-registry/node-ca-w97rl" Jun 15 01:38:26.696648 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696143 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-multus-socket-dir-parent\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.696648 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696172 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-multus-cni-dir\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.696648 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696195 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3c35d53-b5a0-49e4-8964-61d18bbe5be1-metrics-certs\") pod \"network-metrics-daemon-r567p\" (UID: \"b3c35d53-b5a0-49e4-8964-61d18bbe5be1\") " pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:38:26.696648 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696197 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-host-var-lib-cni-multus\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.696648 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696219 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/26d9c93d-7f11-4e53-91fe-b863d7bd96ce-konnectivity-ca\") pod \"konnectivity-agent-6rwhz\" (UID: \"26d9c93d-7f11-4e53-91fe-b863d7bd96ce\") " pod="kube-system/konnectivity-agent-6rwhz" Jun 15 01:38:26.696648 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696235 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-host-run-k8s-cni-cncf-io\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.696648 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696245 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-host-var-lib-kubelet\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.696648 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696269 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt5ww\" (UniqueName: \"kubernetes.io/projected/10769daa-e827-4216-81c6-eeff8dedfb96-kube-api-access-wt5ww\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.696648 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696291 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-multus-cni-dir\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.696648 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696296 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htgmq\" (UniqueName: \"kubernetes.io/projected/a9ced722-0951-4661-809a-bffe50ecc3d4-kube-api-access-htgmq\") pod \"network-check-target-dqhvd\" (UID: \"a9ced722-0951-4661-809a-bffe50ecc3d4\") " pod="openshift-network-diagnostics/network-check-target-dqhvd" Jun 15 01:38:26.696648 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696323 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/42ad987b-989e-4e9f-b053-c2b273368cd1-socket-dir\") pod \"aws-ebs-csi-driver-node-4rs79\" (UID: \"42ad987b-989e-4e9f-b053-c2b273368cd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rs79" Jun 15 01:38:26.696648 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696346 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sj8w\" (UniqueName: \"kubernetes.io/projected/42ad987b-989e-4e9f-b053-c2b273368cd1-kube-api-access-5sj8w\") pod \"aws-ebs-csi-driver-node-4rs79\" (UID: \"42ad987b-989e-4e9f-b053-c2b273368cd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rs79" Jun 15 01:38:26.696648 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696375 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-host-var-lib-cni-bin\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.697443 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696402 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-hostroot\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.697443 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696429 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/009c9c69-be75-43fc-96ba-3ce6a1082805-original-pull-secret\") pod \"global-pull-secret-syncer-wlt8m\" (UID: \"009c9c69-be75-43fc-96ba-3ce6a1082805\") " pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:38:26.697443 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696457 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/10769daa-e827-4216-81c6-eeff8dedfb96-cni-binary-copy\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.697443 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696498 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-os-release\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.697443 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696526 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/42ad987b-989e-4e9f-b053-c2b273368cd1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4rs79\" (UID: \"42ad987b-989e-4e9f-b053-c2b273368cd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rs79" Jun 15 01:38:26.697443 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696538 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/10769daa-e827-4216-81c6-eeff8dedfb96-multus-daemon-config\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.697443 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696586 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-hostroot\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.697443 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696641 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-multus-conf-dir\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.697443 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696670 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/42ad987b-989e-4e9f-b053-c2b273368cd1-registration-dir\") pod \"aws-ebs-csi-driver-node-4rs79\" (UID: \"42ad987b-989e-4e9f-b053-c2b273368cd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rs79" Jun 15 01:38:26.697443 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696695 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/42ad987b-989e-4e9f-b053-c2b273368cd1-etc-selinux\") pod \"aws-ebs-csi-driver-node-4rs79\" (UID: \"42ad987b-989e-4e9f-b053-c2b273368cd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rs79" Jun 15 01:38:26.697443 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696706 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-host-var-lib-kubelet\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.697443 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696720 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-host-run-multus-certs\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.697443 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696748 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jmg4\" (UniqueName: \"kubernetes.io/projected/81f80853-3308-4f3a-9cb4-83ce4fb00055-kube-api-access-5jmg4\") pod \"node-ca-w97rl\" (UID: \"81f80853-3308-4f3a-9cb4-83ce4fb00055\") " pod="openshift-image-registry/node-ca-w97rl" Jun 15 01:38:26.697443 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696775 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/42ad987b-989e-4e9f-b053-c2b273368cd1-device-dir\") pod \"aws-ebs-csi-driver-node-4rs79\" (UID: \"42ad987b-989e-4e9f-b053-c2b273368cd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rs79" Jun 15 01:38:26.697443 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696793 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-os-release\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.697443 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696838 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/42ad987b-989e-4e9f-b053-c2b273368cd1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4rs79\" (UID: \"42ad987b-989e-4e9f-b053-c2b273368cd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rs79" Jun 15 01:38:26.697443 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696845 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/42ad987b-989e-4e9f-b053-c2b273368cd1-registration-dir\") pod \"aws-ebs-csi-driver-node-4rs79\" (UID: \"42ad987b-989e-4e9f-b053-c2b273368cd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rs79" Jun 15 01:38:26.697443 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:26.696800 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:26.698259 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696883 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/42ad987b-989e-4e9f-b053-c2b273368cd1-sys-fs\") pod \"aws-ebs-csi-driver-node-4rs79\" (UID: \"42ad987b-989e-4e9f-b053-c2b273368cd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rs79" Jun 15 01:38:26.698259 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696905 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-multus-conf-dir\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.698259 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:26.696910 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/009c9c69-be75-43fc-96ba-3ce6a1082805-original-pull-secret podName:009c9c69-be75-43fc-96ba-3ce6a1082805 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:27.19689435 +0000 UTC m=+3.055716995 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/009c9c69-be75-43fc-96ba-3ce6a1082805-original-pull-secret") pod "global-pull-secret-syncer-wlt8m" (UID: "009c9c69-be75-43fc-96ba-3ce6a1082805") : object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:26.698259 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696797 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/42ad987b-989e-4e9f-b053-c2b273368cd1-sys-fs\") pod \"aws-ebs-csi-driver-node-4rs79\" (UID: \"42ad987b-989e-4e9f-b053-c2b273368cd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rs79" Jun 15 01:38:26.698259 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696943 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/009c9c69-be75-43fc-96ba-3ce6a1082805-dbus\") pod \"global-pull-secret-syncer-wlt8m\" (UID: \"009c9c69-be75-43fc-96ba-3ce6a1082805\") " pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:38:26.698259 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696982 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/42ad987b-989e-4e9f-b053-c2b273368cd1-etc-selinux\") pod \"aws-ebs-csi-driver-node-4rs79\" (UID: \"42ad987b-989e-4e9f-b053-c2b273368cd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rs79" Jun 15 01:38:26.698259 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.697022 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-host-run-multus-certs\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.698259 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.697026 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/10769daa-e827-4216-81c6-eeff8dedfb96-cni-binary-copy\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.698259 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.697085 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/009c9c69-be75-43fc-96ba-3ce6a1082805-dbus\") pod \"global-pull-secret-syncer-wlt8m\" (UID: \"009c9c69-be75-43fc-96ba-3ce6a1082805\") " pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:38:26.698259 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:26.696853 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:26.698259 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:26.697149 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3c35d53-b5a0-49e4-8964-61d18bbe5be1-metrics-certs podName:b3c35d53-b5a0-49e4-8964-61d18bbe5be1 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:27.197132196 +0000 UTC m=+3.055954840 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3c35d53-b5a0-49e4-8964-61d18bbe5be1-metrics-certs") pod "network-metrics-daemon-r567p" (UID: "b3c35d53-b5a0-49e4-8964-61d18bbe5be1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:26.698259 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.696671 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/42ad987b-989e-4e9f-b053-c2b273368cd1-socket-dir\") pod \"aws-ebs-csi-driver-node-4rs79\" (UID: \"42ad987b-989e-4e9f-b053-c2b273368cd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rs79" Jun 15 01:38:26.698259 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.697311 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/42ad987b-989e-4e9f-b053-c2b273368cd1-device-dir\") pod \"aws-ebs-csi-driver-node-4rs79\" (UID: \"42ad987b-989e-4e9f-b053-c2b273368cd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rs79" Jun 15 01:38:26.698259 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.697335 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/26d9c93d-7f11-4e53-91fe-b863d7bd96ce-konnectivity-ca\") pod \"konnectivity-agent-6rwhz\" (UID: \"26d9c93d-7f11-4e53-91fe-b863d7bd96ce\") " pod="kube-system/konnectivity-agent-6rwhz" Jun 15 01:38:26.698259 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.697358 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10769daa-e827-4216-81c6-eeff8dedfb96-host-var-lib-cni-bin\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.698259 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.697564 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/81f80853-3308-4f3a-9cb4-83ce4fb00055-serviceca\") pod \"node-ca-w97rl\" (UID: \"81f80853-3308-4f3a-9cb4-83ce4fb00055\") " pod="openshift-image-registry/node-ca-w97rl" Jun 15 01:38:26.698908 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.698545 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/26d9c93d-7f11-4e53-91fe-b863d7bd96ce-agent-certs\") pod \"konnectivity-agent-6rwhz\" (UID: \"26d9c93d-7f11-4e53-91fe-b863d7bd96ce\") " pod="kube-system/konnectivity-agent-6rwhz" Jun 15 01:38:26.702555 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:26.702529 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 01:38:26.702555 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:26.702553 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 01:38:26.702727 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:26.702567 2551 projected.go:196] Error preparing data for projected volume kube-api-access-htgmq for pod openshift-network-diagnostics/network-check-target-dqhvd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:26.702727 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:26.702619 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9ced722-0951-4661-809a-bffe50ecc3d4-kube-api-access-htgmq podName:a9ced722-0951-4661-809a-bffe50ecc3d4 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:27.202602463 +0000 UTC m=+3.061425125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-htgmq" (UniqueName: "kubernetes.io/projected/a9ced722-0951-4661-809a-bffe50ecc3d4-kube-api-access-htgmq") pod "network-check-target-dqhvd" (UID: "a9ced722-0951-4661-809a-bffe50ecc3d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:26.703757 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.703735 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdk9h\" (UniqueName: \"kubernetes.io/projected/b3c35d53-b5a0-49e4-8964-61d18bbe5be1-kube-api-access-fdk9h\") pod \"network-metrics-daemon-r567p\" (UID: \"b3c35d53-b5a0-49e4-8964-61d18bbe5be1\") " pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:38:26.704693 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.704670 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sj8w\" (UniqueName: \"kubernetes.io/projected/42ad987b-989e-4e9f-b053-c2b273368cd1-kube-api-access-5sj8w\") pod \"aws-ebs-csi-driver-node-4rs79\" (UID: \"42ad987b-989e-4e9f-b053-c2b273368cd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rs79" Jun 15 01:38:26.705866 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.705849 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt5ww\" (UniqueName: \"kubernetes.io/projected/10769daa-e827-4216-81c6-eeff8dedfb96-kube-api-access-wt5ww\") pod \"multus-sj95p\" (UID: \"10769daa-e827-4216-81c6-eeff8dedfb96\") " pod="openshift-multus/multus-sj95p" Jun 15 01:38:26.705965 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.705890 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jmg4\" (UniqueName: \"kubernetes.io/projected/81f80853-3308-4f3a-9cb4-83ce4fb00055-kube-api-access-5jmg4\") pod \"node-ca-w97rl\" (UID: \"81f80853-3308-4f3a-9cb4-83ce4fb00055\") " pod="openshift-image-registry/node-ca-w97rl" Jun 15 01:38:26.785038 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.785002 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4v279" Jun 15 01:38:26.794017 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.793993 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-blhg2" Jun 15 01:38:26.799687 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.799667 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lpfqj" Jun 15 01:38:26.808335 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.808317 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jm8jk" Jun 15 01:38:26.815093 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.815075 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:26.822662 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.822641 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rs79" Jun 15 01:38:26.830219 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.830196 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6rwhz" Jun 15 01:38:26.837609 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.837589 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w97rl" Jun 15 01:38:26.844196 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:26.844170 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sj95p" Jun 15 01:38:27.199321 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:27.199287 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3c35d53-b5a0-49e4-8964-61d18bbe5be1-metrics-certs\") pod \"network-metrics-daemon-r567p\" (UID: \"b3c35d53-b5a0-49e4-8964-61d18bbe5be1\") " pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:38:27.199490 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:27.199349 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/009c9c69-be75-43fc-96ba-3ce6a1082805-original-pull-secret\") pod \"global-pull-secret-syncer-wlt8m\" (UID: \"009c9c69-be75-43fc-96ba-3ce6a1082805\") " pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:38:27.199490 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:27.199457 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:27.199586 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:27.199530 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/009c9c69-be75-43fc-96ba-3ce6a1082805-original-pull-secret podName:009c9c69-be75-43fc-96ba-3ce6a1082805 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:28.199510976 +0000 UTC m=+4.058333622 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/009c9c69-be75-43fc-96ba-3ce6a1082805-original-pull-secret") pod "global-pull-secret-syncer-wlt8m" (UID: "009c9c69-be75-43fc-96ba-3ce6a1082805") : object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:27.199586 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:27.199458 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:27.199681 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:27.199592 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3c35d53-b5a0-49e4-8964-61d18bbe5be1-metrics-certs podName:b3c35d53-b5a0-49e4-8964-61d18bbe5be1 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:28.199579536 +0000 UTC m=+4.058402185 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3c35d53-b5a0-49e4-8964-61d18bbe5be1-metrics-certs") pod "network-metrics-daemon-r567p" (UID: "b3c35d53-b5a0-49e4-8964-61d18bbe5be1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:27.300396 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:27.300359 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htgmq\" (UniqueName: \"kubernetes.io/projected/a9ced722-0951-4661-809a-bffe50ecc3d4-kube-api-access-htgmq\") pod \"network-check-target-dqhvd\" (UID: \"a9ced722-0951-4661-809a-bffe50ecc3d4\") " pod="openshift-network-diagnostics/network-check-target-dqhvd" Jun 15 01:38:27.300572 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:27.300552 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 01:38:27.300621 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:27.300577 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 01:38:27.300621 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:27.300588 2551 projected.go:196] Error preparing data for projected volume kube-api-access-htgmq for pod openshift-network-diagnostics/network-check-target-dqhvd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:27.300714 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:27.300652 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9ced722-0951-4661-809a-bffe50ecc3d4-kube-api-access-htgmq podName:a9ced722-0951-4661-809a-bffe50ecc3d4 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:28.300637455 +0000 UTC m=+4.159460114 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-htgmq" (UniqueName: "kubernetes.io/projected/a9ced722-0951-4661-809a-bffe50ecc3d4-kube-api-access-htgmq") pod "network-check-target-dqhvd" (UID: "a9ced722-0951-4661-809a-bffe50ecc3d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:27.416497 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:27.416472 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81f80853_3308_4f3a_9cb4_83ce4fb00055.slice/crio-f2782d7dc92fac8867ff80b912218f92de8dd1c880c90bf94b55027e4c3c27a3 WatchSource:0}: Error finding container f2782d7dc92fac8867ff80b912218f92de8dd1c880c90bf94b55027e4c3c27a3: Status 404 returned error can't find the container with id f2782d7dc92fac8867ff80b912218f92de8dd1c880c90bf94b55027e4c3c27a3 Jun 15 01:38:27.417435 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:27.417412 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9db6a608_3746_407c_8405_f97809114af8.slice/crio-9a44f8c8e90a623db3b93a5bba45326cab418cdb556bebbd1f6df436bfdd1f51 WatchSource:0}: Error finding container 9a44f8c8e90a623db3b93a5bba45326cab418cdb556bebbd1f6df436bfdd1f51: Status 404 returned error can't find the container with id 9a44f8c8e90a623db3b93a5bba45326cab418cdb556bebbd1f6df436bfdd1f51 Jun 15 01:38:27.418819 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:27.418768 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8110134b_d73a_422f_88ca_b6eec684189d.slice/crio-affe099881565a052dea721450ddc6032dfb1b341eaa0e58efc22105120fc82e WatchSource:0}: Error finding container affe099881565a052dea721450ddc6032dfb1b341eaa0e58efc22105120fc82e: Status 404 returned error can't find the container with id affe099881565a052dea721450ddc6032dfb1b341eaa0e58efc22105120fc82e Jun 15 01:38:27.420132 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:27.420109 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63f8819b_4ac8_42d2_a662_78721cf2548f.slice/crio-7f3b8e00aaa46cb117f97362a54e2e59f5bcfb7919d5d396ebda7a87a91b9593 WatchSource:0}: Error finding container 7f3b8e00aaa46cb117f97362a54e2e59f5bcfb7919d5d396ebda7a87a91b9593: Status 404 returned error can't find the container with id 7f3b8e00aaa46cb117f97362a54e2e59f5bcfb7919d5d396ebda7a87a91b9593 Jun 15 01:38:27.443253 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:27.443234 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26d9c93d_7f11_4e53_91fe_b863d7bd96ce.slice/crio-efc3ea1977fb954f946fbb4e66b85f73cc321e10e0d70afc05cd8dc59f687f17 WatchSource:0}: Error finding container efc3ea1977fb954f946fbb4e66b85f73cc321e10e0d70afc05cd8dc59f687f17: Status 404 returned error can't find the container with id efc3ea1977fb954f946fbb4e66b85f73cc321e10e0d70afc05cd8dc59f687f17 Jun 15 01:38:27.443772 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:27.443754 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42ad987b_989e_4e9f_b053_c2b273368cd1.slice/crio-62c9e19faa9de6c25db4d0955d57e140c380b8d23de0f157753a10d3fa2a7a6f WatchSource:0}: Error finding container 62c9e19faa9de6c25db4d0955d57e140c380b8d23de0f157753a10d3fa2a7a6f: Status 404 returned error can't find the container with id 62c9e19faa9de6c25db4d0955d57e140c380b8d23de0f157753a10d3fa2a7a6f Jun 15 01:38:27.444909 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:27.444889 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10769daa_e827_4216_81c6_eeff8dedfb96.slice/crio-a481d2d10b83fe6a27aee133e7a2833d255fbaed7d2dcccdfcd0b8c83cad29aa WatchSource:0}: Error finding container a481d2d10b83fe6a27aee133e7a2833d255fbaed7d2dcccdfcd0b8c83cad29aa: Status 404 returned error can't find the container with id a481d2d10b83fe6a27aee133e7a2833d255fbaed7d2dcccdfcd0b8c83cad29aa Jun 15 01:38:27.446058 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:27.446015 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e7ee5cd_6981_4e21_a6bc_9fa66b8d8b37.slice/crio-3bf9386d9470e7a12a1efe8aece5b3ea031258db0c930a86505b050e206c2a78 WatchSource:0}: Error finding container 3bf9386d9470e7a12a1efe8aece5b3ea031258db0c930a86505b050e206c2a78: Status 404 returned error can't find the container with id 3bf9386d9470e7a12a1efe8aece5b3ea031258db0c930a86505b050e206c2a78 Jun 15 01:38:27.446850 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:38:27.446740 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e7c476e_f3a4_446a_b8e5_f4028b6af346.slice/crio-7df647f4d2ac15ff0d4dd0676abd9aafa0678ea671963efa81371060ebeecf0b WatchSource:0}: Error finding container 7df647f4d2ac15ff0d4dd0676abd9aafa0678ea671963efa81371060ebeecf0b: Status 404 returned error can't find the container with id 7df647f4d2ac15ff0d4dd0676abd9aafa0678ea671963efa81371060ebeecf0b Jun 15 01:38:27.521085 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:27.520919 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 01:33:26 +0000 UTC" deadline="2028-03-09 15:09:38.565338718 +0000 UTC" Jun 15 01:38:27.521184 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:27.521087 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15205h31m11.044255606s" Jun 15 01:38:27.550491 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:27.550464 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sj95p" event={"ID":"10769daa-e827-4216-81c6-eeff8dedfb96","Type":"ContainerStarted","Data":"a481d2d10b83fe6a27aee133e7a2833d255fbaed7d2dcccdfcd0b8c83cad29aa"} Jun 15 01:38:27.551508 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:27.551481 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rs79" event={"ID":"42ad987b-989e-4e9f-b053-c2b273368cd1","Type":"ContainerStarted","Data":"62c9e19faa9de6c25db4d0955d57e140c380b8d23de0f157753a10d3fa2a7a6f"} Jun 15 01:38:27.552516 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:27.552492 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6rwhz" event={"ID":"26d9c93d-7f11-4e53-91fe-b863d7bd96ce","Type":"ContainerStarted","Data":"efc3ea1977fb954f946fbb4e66b85f73cc321e10e0d70afc05cd8dc59f687f17"} Jun 15 01:38:27.555417 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:27.555395 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jm8jk" event={"ID":"8110134b-d73a-422f-88ca-b6eec684189d","Type":"ContainerStarted","Data":"affe099881565a052dea721450ddc6032dfb1b341eaa0e58efc22105120fc82e"} Jun 15 01:38:27.558954 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:27.558931 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w97rl" event={"ID":"81f80853-3308-4f3a-9cb4-83ce4fb00055","Type":"ContainerStarted","Data":"f2782d7dc92fac8867ff80b912218f92de8dd1c880c90bf94b55027e4c3c27a3"} Jun 15 01:38:27.563827 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:27.563806 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-147.ec2.internal" event={"ID":"4a0fa8a0ec9211c9d89de751bfc47d7e","Type":"ContainerStarted","Data":"a35654c97977f4621e90092c1ae01d80e059e2d0b4c93036df1a9e9df0d1ef9b"} Jun 15 01:38:27.565975 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:27.565954 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpfqj" event={"ID":"6e7c476e-f3a4-446a-b8e5-f4028b6af346","Type":"ContainerStarted","Data":"7df647f4d2ac15ff0d4dd0676abd9aafa0678ea671963efa81371060ebeecf0b"} Jun 15 01:38:27.570063 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:27.570043 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4v279" event={"ID":"0e7ee5cd-6981-4e21-a6bc-9fa66b8d8b37","Type":"ContainerStarted","Data":"3bf9386d9470e7a12a1efe8aece5b3ea031258db0c930a86505b050e206c2a78"} Jun 15 01:38:27.571293 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:27.571272 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" event={"ID":"63f8819b-4ac8-42d2-a662-78721cf2548f","Type":"ContainerStarted","Data":"7f3b8e00aaa46cb117f97362a54e2e59f5bcfb7919d5d396ebda7a87a91b9593"} Jun 15 01:38:27.573906 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:27.573884 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-blhg2" event={"ID":"9db6a608-3746-407c-8405-f97809114af8","Type":"ContainerStarted","Data":"9a44f8c8e90a623db3b93a5bba45326cab418cdb556bebbd1f6df436bfdd1f51"} Jun 15 01:38:27.576022 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:27.575982 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-147.ec2.internal" podStartSLOduration=2.575966044 podStartE2EDuration="2.575966044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:38:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:38:27.575822382 +0000 UTC m=+3.434645048" watchObservedRunningTime="2026-06-15 01:38:27.575966044 +0000 UTC m=+3.434788713" Jun 15 01:38:28.206747 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:28.205950 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3c35d53-b5a0-49e4-8964-61d18bbe5be1-metrics-certs\") pod \"network-metrics-daemon-r567p\" (UID: \"b3c35d53-b5a0-49e4-8964-61d18bbe5be1\") " pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:38:28.206747 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:28.206016 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/009c9c69-be75-43fc-96ba-3ce6a1082805-original-pull-secret\") pod \"global-pull-secret-syncer-wlt8m\" (UID: \"009c9c69-be75-43fc-96ba-3ce6a1082805\") " pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:38:28.206747 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:28.206186 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:28.206747 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:28.206249 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/009c9c69-be75-43fc-96ba-3ce6a1082805-original-pull-secret podName:009c9c69-be75-43fc-96ba-3ce6a1082805 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:30.206230128 +0000 UTC m=+6.065052780 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/009c9c69-be75-43fc-96ba-3ce6a1082805-original-pull-secret") pod "global-pull-secret-syncer-wlt8m" (UID: "009c9c69-be75-43fc-96ba-3ce6a1082805") : object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:28.206747 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:28.206649 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:28.206747 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:28.206696 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3c35d53-b5a0-49e4-8964-61d18bbe5be1-metrics-certs podName:b3c35d53-b5a0-49e4-8964-61d18bbe5be1 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:30.206682404 +0000 UTC m=+6.065505054 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3c35d53-b5a0-49e4-8964-61d18bbe5be1-metrics-certs") pod "network-metrics-daemon-r567p" (UID: "b3c35d53-b5a0-49e4-8964-61d18bbe5be1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:28.222048 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:28.221767 2551 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 01:38:28.307139 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:28.306468 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htgmq\" (UniqueName: \"kubernetes.io/projected/a9ced722-0951-4661-809a-bffe50ecc3d4-kube-api-access-htgmq\") pod \"network-check-target-dqhvd\" (UID: \"a9ced722-0951-4661-809a-bffe50ecc3d4\") " pod="openshift-network-diagnostics/network-check-target-dqhvd" Jun 15 01:38:28.307139 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:28.306723 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 01:38:28.307139 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:28.306747 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 01:38:28.307139 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:28.306759 2551 projected.go:196] Error preparing data for projected volume kube-api-access-htgmq for pod openshift-network-diagnostics/network-check-target-dqhvd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:28.307139 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:28.306813 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9ced722-0951-4661-809a-bffe50ecc3d4-kube-api-access-htgmq podName:a9ced722-0951-4661-809a-bffe50ecc3d4 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:30.306795106 +0000 UTC m=+6.165617772 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-htgmq" (UniqueName: "kubernetes.io/projected/a9ced722-0951-4661-809a-bffe50ecc3d4-kube-api-access-htgmq") pod "network-check-target-dqhvd" (UID: "a9ced722-0951-4661-809a-bffe50ecc3d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:28.522269 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:28.522176 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 01:33:26 +0000 UTC" deadline="2027-12-30 17:21:17.348575556 +0000 UTC" Jun 15 01:38:28.522269 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:28.522219 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13527h42m48.826361774s" Jun 15 01:38:28.544128 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:28.543222 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:38:28.544128 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:28.543360 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r567p" podUID="b3c35d53-b5a0-49e4-8964-61d18bbe5be1" Jun 15 01:38:28.544128 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:28.543757 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqhvd" Jun 15 01:38:28.544128 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:28.543850 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqhvd" podUID="a9ced722-0951-4661-809a-bffe50ecc3d4" Jun 15 01:38:28.544128 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:28.543910 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:38:28.544128 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:28.544065 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wlt8m" podUID="009c9c69-be75-43fc-96ba-3ce6a1082805" Jun 15 01:38:28.588464 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:28.587343 2551 generic.go:356] "Generic (PLEG): container finished" podID="ee0c27a8e8d9329ff25e55ac588e856f" containerID="7fbaefb7e1d9ecf4a35fe2ead0f766c2b462978c3e41029fee8389d532ab8000" exitCode=0 Jun 15 01:38:28.588464 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:28.588244 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-147.ec2.internal" event={"ID":"ee0c27a8e8d9329ff25e55ac588e856f","Type":"ContainerDied","Data":"7fbaefb7e1d9ecf4a35fe2ead0f766c2b462978c3e41029fee8389d532ab8000"} Jun 15 01:38:29.617652 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:29.617513 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-147.ec2.internal" event={"ID":"ee0c27a8e8d9329ff25e55ac588e856f","Type":"ContainerStarted","Data":"dcce686ce7bcc0cef907563ab86c27e412b43bb66bb969c785d32a1d6dfb687a"} Jun 15 01:38:30.225878 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:30.225837 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3c35d53-b5a0-49e4-8964-61d18bbe5be1-metrics-certs\") pod \"network-metrics-daemon-r567p\" (UID: \"b3c35d53-b5a0-49e4-8964-61d18bbe5be1\") " pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:38:30.226074 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:30.225916 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/009c9c69-be75-43fc-96ba-3ce6a1082805-original-pull-secret\") pod \"global-pull-secret-syncer-wlt8m\" (UID: \"009c9c69-be75-43fc-96ba-3ce6a1082805\") " pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:38:30.226074 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:30.226068 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:30.226199 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:30.226132 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/009c9c69-be75-43fc-96ba-3ce6a1082805-original-pull-secret podName:009c9c69-be75-43fc-96ba-3ce6a1082805 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:34.22611424 +0000 UTC m=+10.084936899 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/009c9c69-be75-43fc-96ba-3ce6a1082805-original-pull-secret") pod "global-pull-secret-syncer-wlt8m" (UID: "009c9c69-be75-43fc-96ba-3ce6a1082805") : object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:30.226561 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:30.226541 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:30.226667 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:30.226598 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3c35d53-b5a0-49e4-8964-61d18bbe5be1-metrics-certs podName:b3c35d53-b5a0-49e4-8964-61d18bbe5be1 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:34.226581058 +0000 UTC m=+10.085403730 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3c35d53-b5a0-49e4-8964-61d18bbe5be1-metrics-certs") pod "network-metrics-daemon-r567p" (UID: "b3c35d53-b5a0-49e4-8964-61d18bbe5be1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:30.326484 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:30.326439 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htgmq\" (UniqueName: \"kubernetes.io/projected/a9ced722-0951-4661-809a-bffe50ecc3d4-kube-api-access-htgmq\") pod \"network-check-target-dqhvd\" (UID: \"a9ced722-0951-4661-809a-bffe50ecc3d4\") " pod="openshift-network-diagnostics/network-check-target-dqhvd" Jun 15 01:38:30.326728 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:30.326635 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 01:38:30.326728 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:30.326681 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 01:38:30.326728 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:30.326694 2551 projected.go:196] Error preparing data for projected volume kube-api-access-htgmq for pod openshift-network-diagnostics/network-check-target-dqhvd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:30.326912 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:30.326795 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9ced722-0951-4661-809a-bffe50ecc3d4-kube-api-access-htgmq podName:a9ced722-0951-4661-809a-bffe50ecc3d4 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:34.326775931 +0000 UTC m=+10.185598577 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-htgmq" (UniqueName: "kubernetes.io/projected/a9ced722-0951-4661-809a-bffe50ecc3d4-kube-api-access-htgmq") pod "network-check-target-dqhvd" (UID: "a9ced722-0951-4661-809a-bffe50ecc3d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:30.543744 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:30.542847 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:38:30.543744 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:30.542983 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r567p" podUID="b3c35d53-b5a0-49e4-8964-61d18bbe5be1" Jun 15 01:38:30.543744 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:30.543353 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqhvd" Jun 15 01:38:30.543744 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:30.543438 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqhvd" podUID="a9ced722-0951-4661-809a-bffe50ecc3d4" Jun 15 01:38:30.543744 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:30.543499 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:38:30.543744 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:30.543563 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wlt8m" podUID="009c9c69-be75-43fc-96ba-3ce6a1082805" Jun 15 01:38:32.541759 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:32.541286 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqhvd" Jun 15 01:38:32.541759 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:32.541286 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:38:32.541759 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:32.541414 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqhvd" podUID="a9ced722-0951-4661-809a-bffe50ecc3d4" Jun 15 01:38:32.541759 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:32.541444 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:38:32.541759 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:32.541549 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r567p" podUID="b3c35d53-b5a0-49e4-8964-61d18bbe5be1" Jun 15 01:38:32.541759 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:32.541641 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wlt8m" podUID="009c9c69-be75-43fc-96ba-3ce6a1082805" Jun 15 01:38:34.257735 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:34.257697 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3c35d53-b5a0-49e4-8964-61d18bbe5be1-metrics-certs\") pod \"network-metrics-daemon-r567p\" (UID: \"b3c35d53-b5a0-49e4-8964-61d18bbe5be1\") " pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:38:34.258264 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:34.257867 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:34.258264 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:34.257938 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3c35d53-b5a0-49e4-8964-61d18bbe5be1-metrics-certs podName:b3c35d53-b5a0-49e4-8964-61d18bbe5be1 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:42.257917368 +0000 UTC m=+18.116740022 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3c35d53-b5a0-49e4-8964-61d18bbe5be1-metrics-certs") pod "network-metrics-daemon-r567p" (UID: "b3c35d53-b5a0-49e4-8964-61d18bbe5be1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:34.258376 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:34.258293 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/009c9c69-be75-43fc-96ba-3ce6a1082805-original-pull-secret\") pod \"global-pull-secret-syncer-wlt8m\" (UID: \"009c9c69-be75-43fc-96ba-3ce6a1082805\") " pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:38:34.258424 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:34.258409 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:34.258460 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:34.258450 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/009c9c69-be75-43fc-96ba-3ce6a1082805-original-pull-secret podName:009c9c69-be75-43fc-96ba-3ce6a1082805 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:42.25843601 +0000 UTC m=+18.117258657 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/009c9c69-be75-43fc-96ba-3ce6a1082805-original-pull-secret") pod "global-pull-secret-syncer-wlt8m" (UID: "009c9c69-be75-43fc-96ba-3ce6a1082805") : object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:34.359065 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:34.359032 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htgmq\" (UniqueName: \"kubernetes.io/projected/a9ced722-0951-4661-809a-bffe50ecc3d4-kube-api-access-htgmq\") pod \"network-check-target-dqhvd\" (UID: \"a9ced722-0951-4661-809a-bffe50ecc3d4\") " pod="openshift-network-diagnostics/network-check-target-dqhvd" Jun 15 01:38:34.359253 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:34.359232 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 01:38:34.359324 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:34.359261 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 01:38:34.359324 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:34.359274 2551 projected.go:196] Error preparing data for projected volume kube-api-access-htgmq for pod openshift-network-diagnostics/network-check-target-dqhvd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:34.359419 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:34.359335 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9ced722-0951-4661-809a-bffe50ecc3d4-kube-api-access-htgmq podName:a9ced722-0951-4661-809a-bffe50ecc3d4 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:42.359317752 +0000 UTC m=+18.218140404 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-htgmq" (UniqueName: "kubernetes.io/projected/a9ced722-0951-4661-809a-bffe50ecc3d4-kube-api-access-htgmq") pod "network-check-target-dqhvd" (UID: "a9ced722-0951-4661-809a-bffe50ecc3d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:34.541410 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:34.541338 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:38:34.541695 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:34.541420 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqhvd" Jun 15 01:38:34.541695 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:34.541678 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r567p" podUID="b3c35d53-b5a0-49e4-8964-61d18bbe5be1" Jun 15 01:38:34.541873 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:34.541479 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:38:34.541873 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:34.541756 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqhvd" podUID="a9ced722-0951-4661-809a-bffe50ecc3d4" Jun 15 01:38:34.541873 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:34.541858 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wlt8m" podUID="009c9c69-be75-43fc-96ba-3ce6a1082805" Jun 15 01:38:36.540700 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:36.540640 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:38:36.540700 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:36.540667 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:38:36.541277 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:36.540712 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqhvd" Jun 15 01:38:36.541277 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:36.540818 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqhvd" podUID="a9ced722-0951-4661-809a-bffe50ecc3d4" Jun 15 01:38:36.541277 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:36.541236 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wlt8m" podUID="009c9c69-be75-43fc-96ba-3ce6a1082805" Jun 15 01:38:36.541426 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:36.541336 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r567p" podUID="b3c35d53-b5a0-49e4-8964-61d18bbe5be1" Jun 15 01:38:38.540594 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:38.540558 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqhvd" Jun 15 01:38:38.540594 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:38.540578 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:38:38.540594 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:38.540558 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:38:38.541162 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:38.540717 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wlt8m" podUID="009c9c69-be75-43fc-96ba-3ce6a1082805" Jun 15 01:38:38.541162 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:38.540804 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r567p" podUID="b3c35d53-b5a0-49e4-8964-61d18bbe5be1" Jun 15 01:38:38.541162 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:38.540889 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqhvd" podUID="a9ced722-0951-4661-809a-bffe50ecc3d4" Jun 15 01:38:40.541343 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:40.541315 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:38:40.541794 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:40.541318 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:38:40.541794 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:40.541450 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r567p" podUID="b3c35d53-b5a0-49e4-8964-61d18bbe5be1" Jun 15 01:38:40.541794 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:40.541512 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wlt8m" podUID="009c9c69-be75-43fc-96ba-3ce6a1082805" Jun 15 01:38:40.541794 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:40.541318 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqhvd" Jun 15 01:38:40.541794 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:40.541585 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqhvd" podUID="a9ced722-0951-4661-809a-bffe50ecc3d4" Jun 15 01:38:42.324290 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:42.324255 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/009c9c69-be75-43fc-96ba-3ce6a1082805-original-pull-secret\") pod \"global-pull-secret-syncer-wlt8m\" (UID: \"009c9c69-be75-43fc-96ba-3ce6a1082805\") " pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:38:42.324736 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:42.324330 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3c35d53-b5a0-49e4-8964-61d18bbe5be1-metrics-certs\") pod \"network-metrics-daemon-r567p\" (UID: \"b3c35d53-b5a0-49e4-8964-61d18bbe5be1\") " pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:38:42.324736 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:42.324428 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:42.324736 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:42.324483 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3c35d53-b5a0-49e4-8964-61d18bbe5be1-metrics-certs podName:b3c35d53-b5a0-49e4-8964-61d18bbe5be1 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:58.32446812 +0000 UTC m=+34.183290768 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3c35d53-b5a0-49e4-8964-61d18bbe5be1-metrics-certs") pod "network-metrics-daemon-r567p" (UID: "b3c35d53-b5a0-49e4-8964-61d18bbe5be1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:42.324736 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:42.324428 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:42.324736 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:42.324546 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/009c9c69-be75-43fc-96ba-3ce6a1082805-original-pull-secret podName:009c9c69-be75-43fc-96ba-3ce6a1082805 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:58.324533838 +0000 UTC m=+34.183356496 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/009c9c69-be75-43fc-96ba-3ce6a1082805-original-pull-secret") pod "global-pull-secret-syncer-wlt8m" (UID: "009c9c69-be75-43fc-96ba-3ce6a1082805") : object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:42.425090 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:42.425052 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htgmq\" (UniqueName: \"kubernetes.io/projected/a9ced722-0951-4661-809a-bffe50ecc3d4-kube-api-access-htgmq\") pod \"network-check-target-dqhvd\" (UID: \"a9ced722-0951-4661-809a-bffe50ecc3d4\") " pod="openshift-network-diagnostics/network-check-target-dqhvd" Jun 15 01:38:42.425240 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:42.425227 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 01:38:42.425309 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:42.425254 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 01:38:42.425309 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:42.425267 2551 projected.go:196] Error preparing data for projected volume kube-api-access-htgmq for pod openshift-network-diagnostics/network-check-target-dqhvd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:42.425401 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:42.425332 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9ced722-0951-4661-809a-bffe50ecc3d4-kube-api-access-htgmq podName:a9ced722-0951-4661-809a-bffe50ecc3d4 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:58.425312359 +0000 UTC m=+34.284135024 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-htgmq" (UniqueName: "kubernetes.io/projected/a9ced722-0951-4661-809a-bffe50ecc3d4-kube-api-access-htgmq") pod "network-check-target-dqhvd" (UID: "a9ced722-0951-4661-809a-bffe50ecc3d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:42.541127 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:42.541090 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:38:42.541283 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:42.541090 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqhvd" Jun 15 01:38:42.541283 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:42.541220 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r567p" podUID="b3c35d53-b5a0-49e4-8964-61d18bbe5be1" Jun 15 01:38:42.541283 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:42.541090 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:38:42.541495 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:42.541281 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqhvd" podUID="a9ced722-0951-4661-809a-bffe50ecc3d4" Jun 15 01:38:42.541495 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:42.541338 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wlt8m" podUID="009c9c69-be75-43fc-96ba-3ce6a1082805" Jun 15 01:38:44.541385 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:44.541353 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:38:44.541823 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:44.541451 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r567p" podUID="b3c35d53-b5a0-49e4-8964-61d18bbe5be1" Jun 15 01:38:44.541823 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:44.541536 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqhvd" Jun 15 01:38:44.541823 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:44.541666 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqhvd" podUID="a9ced722-0951-4661-809a-bffe50ecc3d4" Jun 15 01:38:44.541823 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:44.541730 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:38:44.542000 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:44.541828 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wlt8m" podUID="009c9c69-be75-43fc-96ba-3ce6a1082805" Jun 15 01:38:46.541568 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:46.541406 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqhvd" Jun 15 01:38:46.542115 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:46.541406 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:38:46.542115 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:46.541679 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqhvd" podUID="a9ced722-0951-4661-809a-bffe50ecc3d4" Jun 15 01:38:46.542115 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:46.541453 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:38:46.542115 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:46.541756 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r567p" podUID="b3c35d53-b5a0-49e4-8964-61d18bbe5be1" Jun 15 01:38:46.542115 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:46.541808 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wlt8m" podUID="009c9c69-be75-43fc-96ba-3ce6a1082805" Jun 15 01:38:46.653723 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:46.653589 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6rwhz" event={"ID":"26d9c93d-7f11-4e53-91fe-b863d7bd96ce","Type":"ContainerStarted","Data":"d778bfd7b7e04b99d1f8bf4fe590a37559b57ea5358b17f9a803fd129bf1b837"} Jun 15 01:38:46.655724 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:46.655700 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jm8jk" event={"ID":"8110134b-d73a-422f-88ca-b6eec684189d","Type":"ContainerStarted","Data":"cdec95cd836cc39c0da5d1b37140e805b4838347a9888d7f3de78b84c3d08d8f"} Jun 15 01:38:46.659961 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:46.659926 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w97rl" event={"ID":"81f80853-3308-4f3a-9cb4-83ce4fb00055","Type":"ContainerStarted","Data":"98aa59dd28b27c77ba4c7115907327c5f890c77a35c4cc146ed97729915a37fc"} Jun 15 01:38:46.661464 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:46.661445 2551 generic.go:356] "Generic (PLEG): container finished" podID="6e7c476e-f3a4-446a-b8e5-f4028b6af346" containerID="1ff6dffb674396363115999108fea12298a163ff959d4084d31b3df97b2ffd7f" exitCode=0 Jun 15 01:38:46.661551 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:46.661507 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpfqj" event={"ID":"6e7c476e-f3a4-446a-b8e5-f4028b6af346","Type":"ContainerDied","Data":"1ff6dffb674396363115999108fea12298a163ff959d4084d31b3df97b2ffd7f"} Jun 15 01:38:46.663416 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:46.663398 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c2jms_63f8819b-4ac8-42d2-a662-78721cf2548f/ovn-acl-logging/0.log" Jun 15 01:38:46.663783 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:46.663766 2551 generic.go:356] "Generic (PLEG): container finished" podID="63f8819b-4ac8-42d2-a662-78721cf2548f" containerID="ca899f26c8079dddd2a9e39ec777da2e18841737c8ae03452b5320c832d94dae" exitCode=1 Jun 15 01:38:46.663883 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:46.663792 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" event={"ID":"63f8819b-4ac8-42d2-a662-78721cf2548f","Type":"ContainerStarted","Data":"c6f82c8784335c82a9340a4501716e2bba80aa9e7077758f49d90e367ec64a8a"} Jun 15 01:38:46.663883 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:46.663863 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" event={"ID":"63f8819b-4ac8-42d2-a662-78721cf2548f","Type":"ContainerDied","Data":"ca899f26c8079dddd2a9e39ec777da2e18841737c8ae03452b5320c832d94dae"} Jun 15 01:38:46.663998 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:46.663909 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" event={"ID":"63f8819b-4ac8-42d2-a662-78721cf2548f","Type":"ContainerStarted","Data":"80cce229a5cd5ef03d4d435436638800776930ae5dbbd439f650077c433385e0"} Jun 15 01:38:46.665392 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:46.665372 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-blhg2" event={"ID":"9db6a608-3746-407c-8405-f97809114af8","Type":"ContainerStarted","Data":"bcba615c9c1d933ea62b2e9fd48693adf79b8bae7a17ee3e7d1347d95c738bbb"} Jun 15 01:38:46.666098 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:46.666066 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6rwhz" podStartSLOduration=12.563664379 podStartE2EDuration="22.666052093s" totalImagesPullingTime="10.102387714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:38:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:38:46.665809829 +0000 UTC m=+22.524632496" watchObservedRunningTime="2026-06-15 01:38:46.666052093 +0000 UTC m=+22.524874760" Jun 15 01:38:46.666367 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:46.666336 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-147.ec2.internal" podStartSLOduration=21.666323341000002 podStartE2EDuration="21.666323341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:38:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:38:29.634478488 +0000 UTC m=+5.493301156" watchObservedRunningTime="2026-06-15 01:38:46.666323341 +0000 UTC m=+22.525146010" Jun 15 01:38:46.667246 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:46.667225 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sj95p" event={"ID":"10769daa-e827-4216-81c6-eeff8dedfb96","Type":"ContainerStarted","Data":"0744aa45dffe88aa88bc783f244013926787c43acd6f88838ba16b968ab033df"} Jun 15 01:38:46.668617 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:46.668600 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rs79" event={"ID":"42ad987b-989e-4e9f-b053-c2b273368cd1","Type":"ContainerStarted","Data":"4aba7752678ba52ac3a4644c92319abf9641d2b9e9a85451ae9ebd123c211235"} Jun 15 01:38:46.695775 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:46.695744 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jm8jk" podStartSLOduration=4.030232443 podStartE2EDuration="22.695732757s" totalImagesPullingTime="18.665500314s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:38:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:38:46.695666823 +0000 UTC m=+22.554489491" watchObservedRunningTime="2026-06-15 01:38:46.695732757 +0000 UTC m=+22.554555423" Jun 15 01:38:46.706907 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:46.706879 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-w97rl" podStartSLOduration=4.04117052 podStartE2EDuration="22.706867953s" totalImagesPullingTime="18.665697433s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:38:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:38:46.706541968 +0000 UTC m=+22.565364637" watchObservedRunningTime="2026-06-15 01:38:46.706867953 +0000 UTC m=+22.565690620" Jun 15 01:38:46.719569 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:46.719534 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-blhg2" podStartSLOduration=4.003348424 podStartE2EDuration="22.71952352s" totalImagesPullingTime="18.716175096s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:38:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:38:46.719356006 +0000 UTC m=+22.578178673" watchObservedRunningTime="2026-06-15 01:38:46.71952352 +0000 UTC m=+22.578346187" Jun 15 01:38:46.740838 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:46.740805 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sj95p" podStartSLOduration=4.041555509 podStartE2EDuration="22.74079206s" totalImagesPullingTime="18.699236551s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:38:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:38:46.740348445 +0000 UTC m=+22.599171104" watchObservedRunningTime="2026-06-15 01:38:46.74079206 +0000 UTC m=+22.599614727" Jun 15 01:38:47.672667 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:47.672588 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4v279" event={"ID":"0e7ee5cd-6981-4e21-a6bc-9fa66b8d8b37","Type":"ContainerStarted","Data":"a358264b7db27e8ace3b07a376a9b7e1debf92465035c7dfadde0c7c0dea20c9"} Jun 15 01:38:47.676973 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:47.676951 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c2jms_63f8819b-4ac8-42d2-a662-78721cf2548f/ovn-acl-logging/0.log" Jun 15 01:38:47.678154 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:47.678126 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" event={"ID":"63f8819b-4ac8-42d2-a662-78721cf2548f","Type":"ContainerStarted","Data":"fe8b544a2bccfd58a99f08550976f5c5cbe32e4cd39ea007dcdeb5c7417ca41f"} Jun 15 01:38:47.678263 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:47.678205 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" event={"ID":"63f8819b-4ac8-42d2-a662-78721cf2548f","Type":"ContainerStarted","Data":"e2fb319ff118b432d9848688249015d830434179ca09a85a363f1582be15e1e3"} Jun 15 01:38:47.678263 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:47.678258 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" event={"ID":"63f8819b-4ac8-42d2-a662-78721cf2548f","Type":"ContainerStarted","Data":"46d5b304d784696112aca6f833ad58d81d4ff3a92bf00f53739929bfef6e6867"} Jun 15 01:38:47.687147 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:47.687101 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4v279" podStartSLOduration=5.004653621 podStartE2EDuration="23.687084344s" totalImagesPullingTime="18.682430723s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:38:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:38:47.686925497 +0000 UTC m=+23.545748166" watchObservedRunningTime="2026-06-15 01:38:47.687084344 +0000 UTC m=+23.545907012" Jun 15 01:38:47.772926 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:47.772900 2551 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 15 01:38:48.540954 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:48.540920 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:38:48.540954 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:48.540920 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqhvd" Jun 15 01:38:48.541168 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:48.540934 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:38:48.541168 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:48.541055 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r567p" podUID="b3c35d53-b5a0-49e4-8964-61d18bbe5be1" Jun 15 01:38:48.541255 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:48.541158 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wlt8m" podUID="009c9c69-be75-43fc-96ba-3ce6a1082805" Jun 15 01:38:48.541255 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:48.541243 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqhvd" podUID="a9ced722-0951-4661-809a-bffe50ecc3d4" Jun 15 01:38:48.547004 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:48.546896 2551 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-15T01:38:47.772920498Z","UUID":"4f5b8ade-d60b-4fe7-b55c-5302826d4186","Handler":null,"Name":"","Endpoint":""} Jun 15 01:38:48.549169 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:48.549141 2551 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 15 01:38:48.549169 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:48.549184 2551 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 15 01:38:48.681901 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:48.681865 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rs79" event={"ID":"42ad987b-989e-4e9f-b053-c2b273368cd1","Type":"ContainerStarted","Data":"704158db1a008f7d4fedfde13d54af98bfd1917e40adc9c4f3e33baf88f5d64b"} Jun 15 01:38:49.686620 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:49.686452 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c2jms_63f8819b-4ac8-42d2-a662-78721cf2548f/ovn-acl-logging/0.log" Jun 15 01:38:49.686998 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:49.686956 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" event={"ID":"63f8819b-4ac8-42d2-a662-78721cf2548f","Type":"ContainerStarted","Data":"cd64ec29f0d6264170450ccc9d91b51af78f4697c0f4c53dd32b7af01f6e16a7"} Jun 15 01:38:49.688797 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:49.688778 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rs79" event={"ID":"42ad987b-989e-4e9f-b053-c2b273368cd1","Type":"ContainerStarted","Data":"a52e9bc98e23043d378e359e359bae251cd118026472a37bf0b3ff9bee31cc13"} Jun 15 01:38:49.705241 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:49.705202 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4rs79" podStartSLOduration=4.6025683520000005 podStartE2EDuration="25.705190809s" totalImagesPullingTime="21.102622457s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:38:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:38:49.704962288 +0000 UTC m=+25.563784956" watchObservedRunningTime="2026-06-15 01:38:49.705190809 +0000 UTC m=+25.564013494" Jun 15 01:38:49.820182 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:49.820159 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6rwhz" Jun 15 01:38:49.820764 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:49.820747 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6rwhz" Jun 15 01:38:50.541520 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:50.541490 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:38:50.541520 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:50.541510 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:38:50.541827 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:50.541496 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqhvd" Jun 15 01:38:50.541827 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:50.541600 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r567p" podUID="b3c35d53-b5a0-49e4-8964-61d18bbe5be1" Jun 15 01:38:50.541827 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:50.541723 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqhvd" podUID="a9ced722-0951-4661-809a-bffe50ecc3d4" Jun 15 01:38:50.541827 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:50.541817 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wlt8m" podUID="009c9c69-be75-43fc-96ba-3ce6a1082805" Jun 15 01:38:50.690825 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:50.690783 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6rwhz" Jun 15 01:38:50.691318 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:50.691180 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6rwhz" Jun 15 01:38:52.541100 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:52.540870 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqhvd" Jun 15 01:38:52.541651 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:52.540871 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:38:52.541651 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:52.541115 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqhvd" podUID="a9ced722-0951-4661-809a-bffe50ecc3d4" Jun 15 01:38:52.541651 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:52.541221 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r567p" podUID="b3c35d53-b5a0-49e4-8964-61d18bbe5be1" Jun 15 01:38:52.541651 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:52.540937 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:38:52.541651 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:52.541317 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wlt8m" podUID="009c9c69-be75-43fc-96ba-3ce6a1082805" Jun 15 01:38:52.697056 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:52.697010 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpfqj" event={"ID":"6e7c476e-f3a4-446a-b8e5-f4028b6af346","Type":"ContainerStarted","Data":"25f3dbcce60412c891d95a092dc20d62c5183871f5bbed88991d2a6d6620ec9f"} Jun 15 01:38:52.700464 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:52.700442 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c2jms_63f8819b-4ac8-42d2-a662-78721cf2548f/ovn-acl-logging/0.log" Jun 15 01:38:52.700837 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:52.700802 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" event={"ID":"63f8819b-4ac8-42d2-a662-78721cf2548f","Type":"ContainerStarted","Data":"a2d83c2681ecb1af31292427c1d41d12356b5746196dc228738cadcd8eb9c910"} Jun 15 01:38:52.701139 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:52.701118 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:52.701248 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:52.701192 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:52.701248 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:52.701243 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:52.701335 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:52.701259 2551 scope.go:117] "RemoveContainer" containerID="ca899f26c8079dddd2a9e39ec777da2e18841737c8ae03452b5320c832d94dae" Jun 15 01:38:52.717022 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:52.716998 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:52.717172 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:52.717158 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:38:53.705906 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:53.705868 2551 generic.go:356] "Generic (PLEG): container finished" podID="6e7c476e-f3a4-446a-b8e5-f4028b6af346" containerID="25f3dbcce60412c891d95a092dc20d62c5183871f5bbed88991d2a6d6620ec9f" exitCode=0 Jun 15 01:38:53.706334 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:53.705961 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpfqj" event={"ID":"6e7c476e-f3a4-446a-b8e5-f4028b6af346","Type":"ContainerDied","Data":"25f3dbcce60412c891d95a092dc20d62c5183871f5bbed88991d2a6d6620ec9f"} Jun 15 01:38:53.711322 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:53.711305 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c2jms_63f8819b-4ac8-42d2-a662-78721cf2548f/ovn-acl-logging/0.log" Jun 15 01:38:53.711695 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:53.711662 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" event={"ID":"63f8819b-4ac8-42d2-a662-78721cf2548f","Type":"ContainerStarted","Data":"5ba224e1885871f518468f18d8aab8fde56eed7ad90e32f2268e86cb1c1f03b7"} Jun 15 01:38:53.747718 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:53.747671 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" podStartSLOduration=11.000312588 podStartE2EDuration="29.747656697s" totalImagesPullingTime="18.747344109s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:38:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:38:53.746785248 +0000 UTC m=+29.605607915" watchObservedRunningTime="2026-06-15 01:38:53.747656697 +0000 UTC m=+29.606479363" Jun 15 01:38:54.274369 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:54.274334 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wlt8m"] Jun 15 01:38:54.274554 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:54.274445 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:38:54.274554 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:54.274532 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wlt8m" podUID="009c9c69-be75-43fc-96ba-3ce6a1082805" Jun 15 01:38:54.277652 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:54.277597 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dqhvd"] Jun 15 01:38:54.277813 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:54.277714 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqhvd" Jun 15 01:38:54.277813 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:54.277802 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqhvd" podUID="a9ced722-0951-4661-809a-bffe50ecc3d4" Jun 15 01:38:54.278273 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:54.278247 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r567p"] Jun 15 01:38:54.278399 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:54.278360 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:38:54.278479 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:54.278463 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r567p" podUID="b3c35d53-b5a0-49e4-8964-61d18bbe5be1" Jun 15 01:38:55.541365 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:55.541284 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqhvd" Jun 15 01:38:55.541722 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:55.541380 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqhvd" podUID="a9ced722-0951-4661-809a-bffe50ecc3d4" Jun 15 01:38:55.541722 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:55.541434 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:38:55.541722 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:55.541533 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r567p" podUID="b3c35d53-b5a0-49e4-8964-61d18bbe5be1" Jun 15 01:38:55.718389 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:55.718360 2551 generic.go:356] "Generic (PLEG): container finished" podID="6e7c476e-f3a4-446a-b8e5-f4028b6af346" containerID="7789662fd4af564abab76b1abc8f12176e2743b7a8e846b1a0eeeaf8d1dc9b98" exitCode=0 Jun 15 01:38:55.718540 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:55.718410 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpfqj" event={"ID":"6e7c476e-f3a4-446a-b8e5-f4028b6af346","Type":"ContainerDied","Data":"7789662fd4af564abab76b1abc8f12176e2743b7a8e846b1a0eeeaf8d1dc9b98"} Jun 15 01:38:56.541343 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:56.541314 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:38:56.541470 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:56.541421 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wlt8m" podUID="009c9c69-be75-43fc-96ba-3ce6a1082805" Jun 15 01:38:57.540579 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:57.540552 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:38:57.540744 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:57.540552 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqhvd" Jun 15 01:38:57.540744 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:57.540664 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r567p" podUID="b3c35d53-b5a0-49e4-8964-61d18bbe5be1" Jun 15 01:38:57.540744 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:57.540717 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqhvd" podUID="a9ced722-0951-4661-809a-bffe50ecc3d4" Jun 15 01:38:57.725380 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:57.725349 2551 generic.go:356] "Generic (PLEG): container finished" podID="6e7c476e-f3a4-446a-b8e5-f4028b6af346" containerID="5b2026de8d0b6bfec5fb48f96041ee0d00725ca1780bebb42095b2cc7b5d4b55" exitCode=0 Jun 15 01:38:57.725838 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:57.725405 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpfqj" event={"ID":"6e7c476e-f3a4-446a-b8e5-f4028b6af346","Type":"ContainerDied","Data":"5b2026de8d0b6bfec5fb48f96041ee0d00725ca1780bebb42095b2cc7b5d4b55"} Jun 15 01:38:58.345370 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:58.345337 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/009c9c69-be75-43fc-96ba-3ce6a1082805-original-pull-secret\") pod \"global-pull-secret-syncer-wlt8m\" (UID: \"009c9c69-be75-43fc-96ba-3ce6a1082805\") " pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:38:58.345554 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:58.345396 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3c35d53-b5a0-49e4-8964-61d18bbe5be1-metrics-certs\") pod \"network-metrics-daemon-r567p\" (UID: \"b3c35d53-b5a0-49e4-8964-61d18bbe5be1\") " pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:38:58.345554 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:58.345488 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:58.345554 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:58.345539 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3c35d53-b5a0-49e4-8964-61d18bbe5be1-metrics-certs podName:b3c35d53-b5a0-49e4-8964-61d18bbe5be1 nodeName:}" failed. No retries permitted until 2026-06-15 01:39:30.345525559 +0000 UTC m=+66.204348203 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3c35d53-b5a0-49e4-8964-61d18bbe5be1-metrics-certs") pod "network-metrics-daemon-r567p" (UID: "b3c35d53-b5a0-49e4-8964-61d18bbe5be1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:58.345741 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:58.345488 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:58.345741 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:58.345611 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/009c9c69-be75-43fc-96ba-3ce6a1082805-original-pull-secret podName:009c9c69-be75-43fc-96ba-3ce6a1082805 nodeName:}" failed. No retries permitted until 2026-06-15 01:39:30.345599655 +0000 UTC m=+66.204422304 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/009c9c69-be75-43fc-96ba-3ce6a1082805-original-pull-secret") pod "global-pull-secret-syncer-wlt8m" (UID: "009c9c69-be75-43fc-96ba-3ce6a1082805") : object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:58.446399 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:58.446368 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htgmq\" (UniqueName: \"kubernetes.io/projected/a9ced722-0951-4661-809a-bffe50ecc3d4-kube-api-access-htgmq\") pod \"network-check-target-dqhvd\" (UID: \"a9ced722-0951-4661-809a-bffe50ecc3d4\") " pod="openshift-network-diagnostics/network-check-target-dqhvd" Jun 15 01:38:58.446579 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:58.446558 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 01:38:58.446647 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:58.446586 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 01:38:58.446647 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:58.446600 2551 projected.go:196] Error preparing data for projected volume kube-api-access-htgmq for pod openshift-network-diagnostics/network-check-target-dqhvd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:58.446748 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:58.446678 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9ced722-0951-4661-809a-bffe50ecc3d4-kube-api-access-htgmq podName:a9ced722-0951-4661-809a-bffe50ecc3d4 nodeName:}" failed. No retries permitted until 2026-06-15 01:39:30.446657144 +0000 UTC m=+66.305479808 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-htgmq" (UniqueName: "kubernetes.io/projected/a9ced722-0951-4661-809a-bffe50ecc3d4-kube-api-access-htgmq") pod "network-check-target-dqhvd" (UID: "a9ced722-0951-4661-809a-bffe50ecc3d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:58.541191 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:58.541160 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:38:58.541374 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:58.541259 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wlt8m" podUID="009c9c69-be75-43fc-96ba-3ce6a1082805" Jun 15 01:38:59.540534 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:59.540498 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqhvd" Jun 15 01:38:59.541171 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:38:59.540540 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:38:59.541171 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:59.540645 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqhvd" podUID="a9ced722-0951-4661-809a-bffe50ecc3d4" Jun 15 01:38:59.541171 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:38:59.540733 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r567p" podUID="b3c35d53-b5a0-49e4-8964-61d18bbe5be1" Jun 15 01:39:00.011331 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.011303 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-147.ec2.internal" event="NodeReady" Jun 15 01:39:00.011521 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.011427 2551 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 15 01:39:00.046304 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.046273 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-bfd57b8b7-zh79v"] Jun 15 01:39:00.066861 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.066837 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qqxsf"] Jun 15 01:39:00.067021 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.066973 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:39:00.068943 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.068923 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 15 01:39:00.069074 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.069025 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vq2mt\"" Jun 15 01:39:00.069874 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.069344 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 15 01:39:00.069874 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.069512 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 15 01:39:00.076680 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.076517 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 15 01:39:00.082863 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.082842 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qqxsf" Jun 15 01:39:00.082994 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.082841 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bfd57b8b7-zh79v"] Jun 15 01:39:00.083151 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.083100 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-27cht"] Jun 15 01:39:00.085031 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.085008 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 15 01:39:00.085141 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.085029 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 15 01:39:00.085141 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.085015 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-55pqm\"" Jun 15 01:39:00.100909 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.100893 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qqxsf"] Jun 15 01:39:00.100987 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.100923 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-27cht"] Jun 15 01:39:00.101024 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.100998 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-27cht" Jun 15 01:39:00.103521 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.103503 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 15 01:39:00.103741 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.103723 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8gwn9\"" Jun 15 01:39:00.104247 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.104232 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 15 01:39:00.104320 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.104245 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 15 01:39:00.157779 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.157755 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/317fa362-6021-4fc1-8d2c-f18e70ecb41d-image-registry-private-configuration\") pod \"image-registry-bfd57b8b7-zh79v\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:39:00.157951 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.157788 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78jbd\" (UniqueName: \"kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-kube-api-access-78jbd\") pod \"image-registry-bfd57b8b7-zh79v\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:39:00.157951 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.157812 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/317fa362-6021-4fc1-8d2c-f18e70ecb41d-ca-trust-extracted\") pod \"image-registry-bfd57b8b7-zh79v\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:39:00.157951 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.157827 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-bound-sa-token\") pod \"image-registry-bfd57b8b7-zh79v\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:39:00.157951 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.157907 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/317fa362-6021-4fc1-8d2c-f18e70ecb41d-trusted-ca\") pod \"image-registry-bfd57b8b7-zh79v\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:39:00.157951 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.157934 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/317fa362-6021-4fc1-8d2c-f18e70ecb41d-installation-pull-secrets\") pod \"image-registry-bfd57b8b7-zh79v\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:39:00.157951 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.157954 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-certificates\") pod \"image-registry-bfd57b8b7-zh79v\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:39:00.158162 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.157974 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-tls\") pod \"image-registry-bfd57b8b7-zh79v\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:39:00.234774 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.234745 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:00.258709 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.258685 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/317fa362-6021-4fc1-8d2c-f18e70ecb41d-trusted-ca\") pod \"image-registry-bfd57b8b7-zh79v\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:39:00.258819 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.258714 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/317fa362-6021-4fc1-8d2c-f18e70ecb41d-installation-pull-secrets\") pod \"image-registry-bfd57b8b7-zh79v\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:39:00.258819 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.258736 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-certificates\") pod \"image-registry-bfd57b8b7-zh79v\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:39:00.258819 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.258767 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-tls\") pod \"image-registry-bfd57b8b7-zh79v\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:39:00.258925 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.258815 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0c44f922-cd2d-42e8-99c5-445dae30b40b-config-volume\") pod \"dns-default-qqxsf\" (UID: \"0c44f922-cd2d-42e8-99c5-445dae30b40b\") " pod="openshift-dns/dns-default-qqxsf" Jun 15 01:39:00.258925 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.258847 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c44f922-cd2d-42e8-99c5-445dae30b40b-tmp-dir\") pod \"dns-default-qqxsf\" (UID: \"0c44f922-cd2d-42e8-99c5-445dae30b40b\") " pod="openshift-dns/dns-default-qqxsf" Jun 15 01:39:00.258925 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.258874 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f463e3d-ebaf-481f-9eed-c2c150aca07b-cert\") pod \"ingress-canary-27cht\" (UID: \"2f463e3d-ebaf-481f-9eed-c2c150aca07b\") " pod="openshift-ingress-canary/ingress-canary-27cht" Jun 15 01:39:00.258925 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.258899 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/317fa362-6021-4fc1-8d2c-f18e70ecb41d-image-registry-private-configuration\") pod \"image-registry-bfd57b8b7-zh79v\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:39:00.259090 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:00.258976 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 01:39:00.259090 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:00.259005 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bfd57b8b7-zh79v: secret "image-registry-tls" not found Jun 15 01:39:00.259090 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:00.259055 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-tls podName:317fa362-6021-4fc1-8d2c-f18e70ecb41d nodeName:}" failed. No retries permitted until 2026-06-15 01:39:00.759039675 +0000 UTC m=+36.617862319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-tls") pod "image-registry-bfd57b8b7-zh79v" (UID: "317fa362-6021-4fc1-8d2c-f18e70ecb41d") : secret "image-registry-tls" not found Jun 15 01:39:00.259090 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.259075 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c44f922-cd2d-42e8-99c5-445dae30b40b-metrics-tls\") pod \"dns-default-qqxsf\" (UID: \"0c44f922-cd2d-42e8-99c5-445dae30b40b\") " pod="openshift-dns/dns-default-qqxsf" Jun 15 01:39:00.259269 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.259119 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78jbd\" (UniqueName: \"kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-kube-api-access-78jbd\") pod \"image-registry-bfd57b8b7-zh79v\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:39:00.259269 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.259157 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/317fa362-6021-4fc1-8d2c-f18e70ecb41d-ca-trust-extracted\") pod \"image-registry-bfd57b8b7-zh79v\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:39:00.259269 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.259177 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-bound-sa-token\") pod \"image-registry-bfd57b8b7-zh79v\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:39:00.259269 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.259219 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5hvb\" (UniqueName: \"kubernetes.io/projected/2f463e3d-ebaf-481f-9eed-c2c150aca07b-kube-api-access-k5hvb\") pod \"ingress-canary-27cht\" (UID: \"2f463e3d-ebaf-481f-9eed-c2c150aca07b\") " pod="openshift-ingress-canary/ingress-canary-27cht" Jun 15 01:39:00.259269 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.259242 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2sk6\" (UniqueName: \"kubernetes.io/projected/0c44f922-cd2d-42e8-99c5-445dae30b40b-kube-api-access-k2sk6\") pod \"dns-default-qqxsf\" (UID: \"0c44f922-cd2d-42e8-99c5-445dae30b40b\") " pod="openshift-dns/dns-default-qqxsf" Jun 15 01:39:00.259501 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.259324 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-certificates\") pod \"image-registry-bfd57b8b7-zh79v\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:39:00.259653 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.259615 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/317fa362-6021-4fc1-8d2c-f18e70ecb41d-ca-trust-extracted\") pod \"image-registry-bfd57b8b7-zh79v\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:39:00.259829 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.259795 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/317fa362-6021-4fc1-8d2c-f18e70ecb41d-trusted-ca\") pod \"image-registry-bfd57b8b7-zh79v\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:39:00.262968 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.262924 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/317fa362-6021-4fc1-8d2c-f18e70ecb41d-image-registry-private-configuration\") pod \"image-registry-bfd57b8b7-zh79v\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:39:00.262968 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.262929 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/317fa362-6021-4fc1-8d2c-f18e70ecb41d-installation-pull-secrets\") pod \"image-registry-bfd57b8b7-zh79v\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:39:00.267979 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.267955 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-bound-sa-token\") pod \"image-registry-bfd57b8b7-zh79v\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:39:00.268104 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.268087 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78jbd\" (UniqueName: \"kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-kube-api-access-78jbd\") pod \"image-registry-bfd57b8b7-zh79v\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:39:00.314754 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.314723 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:00.359815 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.359791 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0c44f922-cd2d-42e8-99c5-445dae30b40b-config-volume\") pod \"dns-default-qqxsf\" (UID: \"0c44f922-cd2d-42e8-99c5-445dae30b40b\") " pod="openshift-dns/dns-default-qqxsf" Jun 15 01:39:00.359965 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.359828 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c44f922-cd2d-42e8-99c5-445dae30b40b-tmp-dir\") pod \"dns-default-qqxsf\" (UID: \"0c44f922-cd2d-42e8-99c5-445dae30b40b\") " pod="openshift-dns/dns-default-qqxsf" Jun 15 01:39:00.359965 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.359853 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f463e3d-ebaf-481f-9eed-c2c150aca07b-cert\") pod \"ingress-canary-27cht\" (UID: \"2f463e3d-ebaf-481f-9eed-c2c150aca07b\") " pod="openshift-ingress-canary/ingress-canary-27cht" Jun 15 01:39:00.359965 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.359875 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c44f922-cd2d-42e8-99c5-445dae30b40b-metrics-tls\") pod \"dns-default-qqxsf\" (UID: \"0c44f922-cd2d-42e8-99c5-445dae30b40b\") " pod="openshift-dns/dns-default-qqxsf" Jun 15 01:39:00.359965 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.359931 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5hvb\" (UniqueName: \"kubernetes.io/projected/2f463e3d-ebaf-481f-9eed-c2c150aca07b-kube-api-access-k5hvb\") pod \"ingress-canary-27cht\" (UID: \"2f463e3d-ebaf-481f-9eed-c2c150aca07b\") " pod="openshift-ingress-canary/ingress-canary-27cht" Jun 15 01:39:00.359965 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.359957 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2sk6\" (UniqueName: \"kubernetes.io/projected/0c44f922-cd2d-42e8-99c5-445dae30b40b-kube-api-access-k2sk6\") pod \"dns-default-qqxsf\" (UID: \"0c44f922-cd2d-42e8-99c5-445dae30b40b\") " pod="openshift-dns/dns-default-qqxsf" Jun 15 01:39:00.360209 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:00.360084 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 01:39:00.360209 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:00.360152 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c44f922-cd2d-42e8-99c5-445dae30b40b-metrics-tls podName:0c44f922-cd2d-42e8-99c5-445dae30b40b nodeName:}" failed. No retries permitted until 2026-06-15 01:39:00.860130603 +0000 UTC m=+36.718953249 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c44f922-cd2d-42e8-99c5-445dae30b40b-metrics-tls") pod "dns-default-qqxsf" (UID: "0c44f922-cd2d-42e8-99c5-445dae30b40b") : secret "dns-default-metrics-tls" not found Jun 15 01:39:00.360209 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.360181 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c44f922-cd2d-42e8-99c5-445dae30b40b-tmp-dir\") pod \"dns-default-qqxsf\" (UID: \"0c44f922-cd2d-42e8-99c5-445dae30b40b\") " pod="openshift-dns/dns-default-qqxsf" Jun 15 01:39:00.360408 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.360384 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0c44f922-cd2d-42e8-99c5-445dae30b40b-config-volume\") pod \"dns-default-qqxsf\" (UID: \"0c44f922-cd2d-42e8-99c5-445dae30b40b\") " pod="openshift-dns/dns-default-qqxsf" Jun 15 01:39:00.362136 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.362116 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f463e3d-ebaf-481f-9eed-c2c150aca07b-cert\") pod \"ingress-canary-27cht\" (UID: \"2f463e3d-ebaf-481f-9eed-c2c150aca07b\") " pod="openshift-ingress-canary/ingress-canary-27cht" Jun 15 01:39:00.367848 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.367830 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2sk6\" (UniqueName: \"kubernetes.io/projected/0c44f922-cd2d-42e8-99c5-445dae30b40b-kube-api-access-k2sk6\") pod \"dns-default-qqxsf\" (UID: \"0c44f922-cd2d-42e8-99c5-445dae30b40b\") " pod="openshift-dns/dns-default-qqxsf" Jun 15 01:39:00.368034 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.368015 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5hvb\" (UniqueName: \"kubernetes.io/projected/2f463e3d-ebaf-481f-9eed-c2c150aca07b-kube-api-access-k5hvb\") pod \"ingress-canary-27cht\" (UID: \"2f463e3d-ebaf-481f-9eed-c2c150aca07b\") " pod="openshift-ingress-canary/ingress-canary-27cht" Jun 15 01:39:00.410062 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.410041 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-27cht" Jun 15 01:39:00.541447 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.540949 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:39:00.543433 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.543410 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 15 01:39:00.627226 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.627090 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-27cht"] Jun 15 01:39:00.629988 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:39:00.629961 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f463e3d_ebaf_481f_9eed_c2c150aca07b.slice/crio-0dbd26039351d7e43f6e101a42491aba356c1c5663ece09b055c995c11c1e9fa WatchSource:0}: Error finding container 0dbd26039351d7e43f6e101a42491aba356c1c5663ece09b055c995c11c1e9fa: Status 404 returned error can't find the container with id 0dbd26039351d7e43f6e101a42491aba356c1c5663ece09b055c995c11c1e9fa Jun 15 01:39:00.732752 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.732723 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-27cht" event={"ID":"2f463e3d-ebaf-481f-9eed-c2c150aca07b","Type":"ContainerStarted","Data":"0dbd26039351d7e43f6e101a42491aba356c1c5663ece09b055c995c11c1e9fa"} Jun 15 01:39:00.764079 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.764058 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-tls\") pod \"image-registry-bfd57b8b7-zh79v\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:39:00.764174 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:00.764157 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 01:39:00.764174 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:00.764168 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bfd57b8b7-zh79v: secret "image-registry-tls" not found Jun 15 01:39:00.764257 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:00.764215 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-tls podName:317fa362-6021-4fc1-8d2c-f18e70ecb41d nodeName:}" failed. No retries permitted until 2026-06-15 01:39:01.764200237 +0000 UTC m=+37.623022899 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-tls") pod "image-registry-bfd57b8b7-zh79v" (UID: "317fa362-6021-4fc1-8d2c-f18e70ecb41d") : secret "image-registry-tls" not found Jun 15 01:39:00.821676 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.821608 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:00.865108 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.865084 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c44f922-cd2d-42e8-99c5-445dae30b40b-metrics-tls\") pod \"dns-default-qqxsf\" (UID: \"0c44f922-cd2d-42e8-99c5-445dae30b40b\") " pod="openshift-dns/dns-default-qqxsf" Jun 15 01:39:00.865243 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:00.865226 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 01:39:00.865290 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:00.865281 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c44f922-cd2d-42e8-99c5-445dae30b40b-metrics-tls podName:0c44f922-cd2d-42e8-99c5-445dae30b40b nodeName:}" failed. No retries permitted until 2026-06-15 01:39:01.865268494 +0000 UTC m=+37.724091144 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c44f922-cd2d-42e8-99c5-445dae30b40b-metrics-tls") pod "dns-default-qqxsf" (UID: "0c44f922-cd2d-42e8-99c5-445dae30b40b") : secret "dns-default-metrics-tls" not found Jun 15 01:39:00.876552 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:00.876510 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:01.540478 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:01.540444 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqhvd" Jun 15 01:39:01.540700 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:01.540659 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:39:01.542939 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:01.542916 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 15 01:39:01.543826 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:01.543562 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 15 01:39:01.543826 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:01.543619 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 15 01:39:01.543826 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:01.543650 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-46p56\"" Jun 15 01:39:01.543826 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:01.543665 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hkjfs\"" Jun 15 01:39:01.772718 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:01.772679 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-tls\") pod \"image-registry-bfd57b8b7-zh79v\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:39:01.772893 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:01.772832 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 01:39:01.772893 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:01.772849 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bfd57b8b7-zh79v: secret "image-registry-tls" not found Jun 15 01:39:01.772994 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:01.772907 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-tls podName:317fa362-6021-4fc1-8d2c-f18e70ecb41d nodeName:}" failed. No retries permitted until 2026-06-15 01:39:03.772890238 +0000 UTC m=+39.631712908 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-tls") pod "image-registry-bfd57b8b7-zh79v" (UID: "317fa362-6021-4fc1-8d2c-f18e70ecb41d") : secret "image-registry-tls" not found Jun 15 01:39:01.873794 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:01.873761 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c44f922-cd2d-42e8-99c5-445dae30b40b-metrics-tls\") pod \"dns-default-qqxsf\" (UID: \"0c44f922-cd2d-42e8-99c5-445dae30b40b\") " pod="openshift-dns/dns-default-qqxsf" Jun 15 01:39:01.873943 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:01.873919 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 01:39:01.873991 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:01.873980 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c44f922-cd2d-42e8-99c5-445dae30b40b-metrics-tls podName:0c44f922-cd2d-42e8-99c5-445dae30b40b nodeName:}" failed. No retries permitted until 2026-06-15 01:39:03.873964403 +0000 UTC m=+39.732787062 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c44f922-cd2d-42e8-99c5-445dae30b40b-metrics-tls") pod "dns-default-qqxsf" (UID: "0c44f922-cd2d-42e8-99c5-445dae30b40b") : secret "dns-default-metrics-tls" not found Jun 15 01:39:02.741409 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:02.741369 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-27cht" event={"ID":"2f463e3d-ebaf-481f-9eed-c2c150aca07b","Type":"ContainerStarted","Data":"91b9b38d9c54873c3239e25ffe9f28f554259550d67f30027d27bbc0139eeddc"} Jun 15 01:39:02.755781 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:02.755703 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-27cht" podStartSLOduration=0.885967064 podStartE2EDuration="2.755687257s" totalImagesPullingTime="1.869720193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:39:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:39:02.755242493 +0000 UTC m=+38.614065160" watchObservedRunningTime="2026-06-15 01:39:02.755687257 +0000 UTC m=+38.614509923" Jun 15 01:39:03.701016 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:03.700984 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:03.790954 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:03.790916 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-tls\") pod \"image-registry-bfd57b8b7-zh79v\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:39:03.791339 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:03.791052 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 01:39:03.791339 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:03.791064 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bfd57b8b7-zh79v: secret "image-registry-tls" not found Jun 15 01:39:03.791339 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:03.791114 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-tls podName:317fa362-6021-4fc1-8d2c-f18e70ecb41d nodeName:}" failed. No retries permitted until 2026-06-15 01:39:07.791096924 +0000 UTC m=+43.649919586 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-tls") pod "image-registry-bfd57b8b7-zh79v" (UID: "317fa362-6021-4fc1-8d2c-f18e70ecb41d") : secret "image-registry-tls" not found Jun 15 01:39:03.891352 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:03.891292 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c44f922-cd2d-42e8-99c5-445dae30b40b-metrics-tls\") pod \"dns-default-qqxsf\" (UID: \"0c44f922-cd2d-42e8-99c5-445dae30b40b\") " pod="openshift-dns/dns-default-qqxsf" Jun 15 01:39:03.891536 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:03.891413 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 01:39:03.891536 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:03.891481 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c44f922-cd2d-42e8-99c5-445dae30b40b-metrics-tls podName:0c44f922-cd2d-42e8-99c5-445dae30b40b nodeName:}" failed. No retries permitted until 2026-06-15 01:39:07.891460514 +0000 UTC m=+43.750283161 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c44f922-cd2d-42e8-99c5-445dae30b40b-metrics-tls") pod "dns-default-qqxsf" (UID: "0c44f922-cd2d-42e8-99c5-445dae30b40b") : secret "dns-default-metrics-tls" not found Jun 15 01:39:04.365792 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:04.365737 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:04.467060 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:04.467020 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:05.225602 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:05.225562 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:06.311206 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:06.311171 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:06.414990 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:06.414962 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:06.754030 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:06.753996 2551 generic.go:356] "Generic (PLEG): container finished" podID="6e7c476e-f3a4-446a-b8e5-f4028b6af346" containerID="7840f1affc66307522a72e789ddf3cb7d8c08aa7988aa5eb4e64ada7c81e11a0" exitCode=0 Jun 15 01:39:06.754293 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:06.754066 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpfqj" event={"ID":"6e7c476e-f3a4-446a-b8e5-f4028b6af346","Type":"ContainerDied","Data":"7840f1affc66307522a72e789ddf3cb7d8c08aa7988aa5eb4e64ada7c81e11a0"} Jun 15 01:39:06.794788 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:06.794760 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:06.857781 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:06.857754 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:06.908641 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:06.908600 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:07.758894 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:07.758860 2551 generic.go:356] "Generic (PLEG): container finished" podID="6e7c476e-f3a4-446a-b8e5-f4028b6af346" containerID="f49b001c580b0381209c0fb4af9a0a909ede89712ee4ae71b6c0042989e4176e" exitCode=0 Jun 15 01:39:07.759306 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:07.758912 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpfqj" event={"ID":"6e7c476e-f3a4-446a-b8e5-f4028b6af346","Type":"ContainerDied","Data":"f49b001c580b0381209c0fb4af9a0a909ede89712ee4ae71b6c0042989e4176e"} Jun 15 01:39:07.784796 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:07.784763 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:07.817939 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:07.817915 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-tls\") pod \"image-registry-bfd57b8b7-zh79v\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:39:07.818043 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:07.818027 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 01:39:07.818043 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:07.818038 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bfd57b8b7-zh79v: secret "image-registry-tls" not found Jun 15 01:39:07.818115 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:07.818085 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-tls podName:317fa362-6021-4fc1-8d2c-f18e70ecb41d nodeName:}" failed. No retries permitted until 2026-06-15 01:39:15.818072426 +0000 UTC m=+51.676895075 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-tls") pod "image-registry-bfd57b8b7-zh79v" (UID: "317fa362-6021-4fc1-8d2c-f18e70ecb41d") : secret "image-registry-tls" not found Jun 15 01:39:07.833485 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:07.833458 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:07.918873 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:07.918835 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c44f922-cd2d-42e8-99c5-445dae30b40b-metrics-tls\") pod \"dns-default-qqxsf\" (UID: \"0c44f922-cd2d-42e8-99c5-445dae30b40b\") " pod="openshift-dns/dns-default-qqxsf" Jun 15 01:39:07.919021 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:07.918984 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 01:39:07.919076 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:07.919051 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c44f922-cd2d-42e8-99c5-445dae30b40b-metrics-tls podName:0c44f922-cd2d-42e8-99c5-445dae30b40b nodeName:}" failed. No retries permitted until 2026-06-15 01:39:15.919030386 +0000 UTC m=+51.777853051 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c44f922-cd2d-42e8-99c5-445dae30b40b-metrics-tls") pod "dns-default-qqxsf" (UID: "0c44f922-cd2d-42e8-99c5-445dae30b40b") : secret "dns-default-metrics-tls" not found Jun 15 01:39:08.764385 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:08.764346 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpfqj" event={"ID":"6e7c476e-f3a4-446a-b8e5-f4028b6af346","Type":"ContainerStarted","Data":"d8251520b99ed9b823125dc8ed76d4d1c81aeeee92354fdde83344793bee3705"} Jun 15 01:39:08.783254 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:08.783211 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lpfqj" podStartSLOduration=9.661521557 podStartE2EDuration="44.783196206s" totalImagesPullingTime="35.121674649s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:38:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:39:08.781916682 +0000 UTC m=+44.640739363" watchObservedRunningTime="2026-06-15 01:39:08.783196206 +0000 UTC m=+44.642018873" Jun 15 01:39:08.902873 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:08.902836 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:09.002500 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:09.002471 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:10.729571 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:10.729538 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:15.876265 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:15.876223 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-tls\") pod \"image-registry-bfd57b8b7-zh79v\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:39:15.876750 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:15.876348 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 01:39:15.876750 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:15.876360 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bfd57b8b7-zh79v: secret "image-registry-tls" not found Jun 15 01:39:15.876750 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:15.876408 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-tls podName:317fa362-6021-4fc1-8d2c-f18e70ecb41d nodeName:}" failed. No retries permitted until 2026-06-15 01:39:31.876394687 +0000 UTC m=+67.735217332 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-tls") pod "image-registry-bfd57b8b7-zh79v" (UID: "317fa362-6021-4fc1-8d2c-f18e70ecb41d") : secret "image-registry-tls" not found Jun 15 01:39:15.976982 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:15.976944 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c44f922-cd2d-42e8-99c5-445dae30b40b-metrics-tls\") pod \"dns-default-qqxsf\" (UID: \"0c44f922-cd2d-42e8-99c5-445dae30b40b\") " pod="openshift-dns/dns-default-qqxsf" Jun 15 01:39:15.977127 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:15.977098 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 01:39:15.977183 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:15.977173 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c44f922-cd2d-42e8-99c5-445dae30b40b-metrics-tls podName:0c44f922-cd2d-42e8-99c5-445dae30b40b nodeName:}" failed. No retries permitted until 2026-06-15 01:39:31.97715756 +0000 UTC m=+67.835980205 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c44f922-cd2d-42e8-99c5-445dae30b40b-metrics-tls") pod "dns-default-qqxsf" (UID: "0c44f922-cd2d-42e8-99c5-445dae30b40b") : secret "dns-default-metrics-tls" not found Jun 15 01:39:17.555345 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:17.555293 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:17.656930 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:17.656899 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:19.107164 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:19.107135 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:19.207722 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:19.207689 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:20.384208 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:20.384170 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:20.441548 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:20.441502 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:21.247844 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:21.247801 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:22.877710 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:22.877675 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:22.933941 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:22.933908 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:22.992003 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:22.991970 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:23.039687 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:23.039659 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:24.724138 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:24.724112 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c2jms" Jun 15 01:39:24.870491 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:24.870456 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:24.920269 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:24.920242 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:30.382121 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:30.382074 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3c35d53-b5a0-49e4-8964-61d18bbe5be1-metrics-certs\") pod \"network-metrics-daemon-r567p\" (UID: \"b3c35d53-b5a0-49e4-8964-61d18bbe5be1\") " pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:39:30.382501 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:30.382139 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/009c9c69-be75-43fc-96ba-3ce6a1082805-original-pull-secret\") pod \"global-pull-secret-syncer-wlt8m\" (UID: \"009c9c69-be75-43fc-96ba-3ce6a1082805\") " pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:39:30.384211 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:30.384192 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 15 01:39:30.384383 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:30.384366 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 15 01:39:30.392905 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:30.392882 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 15 01:39:30.392971 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:30.392961 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3c35d53-b5a0-49e4-8964-61d18bbe5be1-metrics-certs podName:b3c35d53-b5a0-49e4-8964-61d18bbe5be1 nodeName:}" failed. No retries permitted until 2026-06-15 01:40:34.39293801 +0000 UTC m=+130.251760668 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3c35d53-b5a0-49e4-8964-61d18bbe5be1-metrics-certs") pod "network-metrics-daemon-r567p" (UID: "b3c35d53-b5a0-49e4-8964-61d18bbe5be1") : secret "metrics-daemon-secret" not found Jun 15 01:39:30.396044 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:30.396029 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/009c9c69-be75-43fc-96ba-3ce6a1082805-original-pull-secret\") pod \"global-pull-secret-syncer-wlt8m\" (UID: \"009c9c69-be75-43fc-96ba-3ce6a1082805\") " pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:39:30.483240 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:30.483197 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htgmq\" (UniqueName: \"kubernetes.io/projected/a9ced722-0951-4661-809a-bffe50ecc3d4-kube-api-access-htgmq\") pod \"network-check-target-dqhvd\" (UID: \"a9ced722-0951-4661-809a-bffe50ecc3d4\") " pod="openshift-network-diagnostics/network-check-target-dqhvd" Jun 15 01:39:30.485648 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:30.485615 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 15 01:39:30.495927 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:30.495911 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 15 01:39:30.506840 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:30.506815 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htgmq\" (UniqueName: \"kubernetes.io/projected/a9ced722-0951-4661-809a-bffe50ecc3d4-kube-api-access-htgmq\") pod \"network-check-target-dqhvd\" (UID: \"a9ced722-0951-4661-809a-bffe50ecc3d4\") " pod="openshift-network-diagnostics/network-check-target-dqhvd" Jun 15 01:39:30.552493 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:30.552469 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wlt8m" Jun 15 01:39:30.655131 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:30.655066 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hkjfs\"" Jun 15 01:39:30.663841 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:30.663817 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqhvd" Jun 15 01:39:30.668313 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:30.668291 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wlt8m"] Jun 15 01:39:30.671932 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:39:30.671903 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod009c9c69_be75_43fc_96ba_3ce6a1082805.slice/crio-2d0d14d36223e077a0ea91fd750afbe2c6a339f7ff93b16c072aa537ff3801f8 WatchSource:0}: Error finding container 2d0d14d36223e077a0ea91fd750afbe2c6a339f7ff93b16c072aa537ff3801f8: Status 404 returned error can't find the container with id 2d0d14d36223e077a0ea91fd750afbe2c6a339f7ff93b16c072aa537ff3801f8 Jun 15 01:39:30.796673 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:30.796646 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dqhvd"] Jun 15 01:39:30.799671 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:39:30.799646 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9ced722_0951_4661_809a_bffe50ecc3d4.slice/crio-1b429f7628df9831e3d4c0a148f33d74040b402a8928e4601b282cfec69331cb WatchSource:0}: Error finding container 1b429f7628df9831e3d4c0a148f33d74040b402a8928e4601b282cfec69331cb: Status 404 returned error can't find the container with id 1b429f7628df9831e3d4c0a148f33d74040b402a8928e4601b282cfec69331cb Jun 15 01:39:30.815309 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:30.815281 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dqhvd" event={"ID":"a9ced722-0951-4661-809a-bffe50ecc3d4","Type":"ContainerStarted","Data":"1b429f7628df9831e3d4c0a148f33d74040b402a8928e4601b282cfec69331cb"} Jun 15 01:39:30.818409 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:30.818387 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wlt8m" event={"ID":"009c9c69-be75-43fc-96ba-3ce6a1082805","Type":"ContainerStarted","Data":"2d0d14d36223e077a0ea91fd750afbe2c6a339f7ff93b16c072aa537ff3801f8"} Jun 15 01:39:31.894141 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:31.894098 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-tls\") pod \"image-registry-bfd57b8b7-zh79v\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:39:31.894611 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:31.894259 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 01:39:31.894611 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:31.894276 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bfd57b8b7-zh79v: secret "image-registry-tls" not found Jun 15 01:39:31.894611 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:31.894336 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-tls podName:317fa362-6021-4fc1-8d2c-f18e70ecb41d nodeName:}" failed. No retries permitted until 2026-06-15 01:40:03.89431602 +0000 UTC m=+99.753138666 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-tls") pod "image-registry-bfd57b8b7-zh79v" (UID: "317fa362-6021-4fc1-8d2c-f18e70ecb41d") : secret "image-registry-tls" not found Jun 15 01:39:31.995444 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:31.995406 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c44f922-cd2d-42e8-99c5-445dae30b40b-metrics-tls\") pod \"dns-default-qqxsf\" (UID: \"0c44f922-cd2d-42e8-99c5-445dae30b40b\") " pod="openshift-dns/dns-default-qqxsf" Jun 15 01:39:31.995640 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:31.995596 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 01:39:31.995753 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:39:31.995694 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c44f922-cd2d-42e8-99c5-445dae30b40b-metrics-tls podName:0c44f922-cd2d-42e8-99c5-445dae30b40b nodeName:}" failed. No retries permitted until 2026-06-15 01:40:03.995673124 +0000 UTC m=+99.854495783 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c44f922-cd2d-42e8-99c5-445dae30b40b-metrics-tls") pod "dns-default-qqxsf" (UID: "0c44f922-cd2d-42e8-99c5-445dae30b40b") : secret "dns-default-metrics-tls" not found Jun 15 01:39:33.827225 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:33.827184 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dqhvd" event={"ID":"a9ced722-0951-4661-809a-bffe50ecc3d4","Type":"ContainerStarted","Data":"438844bca5edc19104de0e774027900aa830dbada28d208d878d13c87dc03bf7"} Jun 15 01:39:33.827576 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:33.827330 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dqhvd" Jun 15 01:39:33.840381 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:33.840326 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dqhvd" podStartSLOduration=65.933412006 podStartE2EDuration="1m8.840310642s" totalImagesPullingTime="2.906898636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:38:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:39:33.839986985 +0000 UTC m=+69.698809651" watchObservedRunningTime="2026-06-15 01:39:33.840310642 +0000 UTC m=+69.699133310" Jun 15 01:39:35.833549 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:35.833481 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wlt8m" event={"ID":"009c9c69-be75-43fc-96ba-3ce6a1082805","Type":"ContainerStarted","Data":"f6530206bf262d026c701f402e681fd3234c83333ecd123768b531ea21a1a18b"} Jun 15 01:39:35.847393 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:35.847351 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wlt8m" podStartSLOduration=66.078880516 podStartE2EDuration="1m10.847317153s" totalImagesPullingTime="4.768436637s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:38:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:39:35.846840422 +0000 UTC m=+71.705663100" watchObservedRunningTime="2026-06-15 01:39:35.847317153 +0000 UTC m=+71.706139847" Jun 15 01:39:40.845185 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:40.845147 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-788754d7bc-b4fzh"] Jun 15 01:39:40.847296 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:40.847275 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788754d7bc-b4fzh" Jun 15 01:39:40.849234 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:40.849214 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 15 01:39:40.849859 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:40.849839 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 15 01:39:40.849967 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:40.849875 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 15 01:39:40.849967 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:40.849848 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 15 01:39:40.859113 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:40.859093 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-788754d7bc-b4fzh"] Jun 15 01:39:40.958079 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:40.958044 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42757b3c-7f77-48c5-bda5-2994b430bced-tmp\") pod \"klusterlet-addon-workmgr-788754d7bc-b4fzh\" (UID: \"42757b3c-7f77-48c5-bda5-2994b430bced\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788754d7bc-b4fzh" Jun 15 01:39:40.958289 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:40.958104 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/42757b3c-7f77-48c5-bda5-2994b430bced-klusterlet-config\") pod \"klusterlet-addon-workmgr-788754d7bc-b4fzh\" (UID: \"42757b3c-7f77-48c5-bda5-2994b430bced\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788754d7bc-b4fzh" Jun 15 01:39:40.958289 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:40.958175 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qlm2\" (UniqueName: \"kubernetes.io/projected/42757b3c-7f77-48c5-bda5-2994b430bced-kube-api-access-7qlm2\") pod \"klusterlet-addon-workmgr-788754d7bc-b4fzh\" (UID: \"42757b3c-7f77-48c5-bda5-2994b430bced\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788754d7bc-b4fzh" Jun 15 01:39:41.059509 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:41.059466 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qlm2\" (UniqueName: \"kubernetes.io/projected/42757b3c-7f77-48c5-bda5-2994b430bced-kube-api-access-7qlm2\") pod \"klusterlet-addon-workmgr-788754d7bc-b4fzh\" (UID: \"42757b3c-7f77-48c5-bda5-2994b430bced\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788754d7bc-b4fzh" Jun 15 01:39:41.059656 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:41.059542 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42757b3c-7f77-48c5-bda5-2994b430bced-tmp\") pod \"klusterlet-addon-workmgr-788754d7bc-b4fzh\" (UID: \"42757b3c-7f77-48c5-bda5-2994b430bced\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788754d7bc-b4fzh" Jun 15 01:39:41.059656 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:41.059583 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/42757b3c-7f77-48c5-bda5-2994b430bced-klusterlet-config\") pod \"klusterlet-addon-workmgr-788754d7bc-b4fzh\" (UID: \"42757b3c-7f77-48c5-bda5-2994b430bced\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788754d7bc-b4fzh" Jun 15 01:39:41.059975 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:41.059955 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42757b3c-7f77-48c5-bda5-2994b430bced-tmp\") pod \"klusterlet-addon-workmgr-788754d7bc-b4fzh\" (UID: \"42757b3c-7f77-48c5-bda5-2994b430bced\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788754d7bc-b4fzh" Jun 15 01:39:41.061991 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:41.061973 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/42757b3c-7f77-48c5-bda5-2994b430bced-klusterlet-config\") pod \"klusterlet-addon-workmgr-788754d7bc-b4fzh\" (UID: \"42757b3c-7f77-48c5-bda5-2994b430bced\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788754d7bc-b4fzh" Jun 15 01:39:41.066828 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:41.066805 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qlm2\" (UniqueName: \"kubernetes.io/projected/42757b3c-7f77-48c5-bda5-2994b430bced-kube-api-access-7qlm2\") pod \"klusterlet-addon-workmgr-788754d7bc-b4fzh\" (UID: \"42757b3c-7f77-48c5-bda5-2994b430bced\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788754d7bc-b4fzh" Jun 15 01:39:41.155791 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:41.155756 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788754d7bc-b4fzh" Jun 15 01:39:41.225433 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:41.225406 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:41.271231 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:41.271203 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-788754d7bc-b4fzh"] Jun 15 01:39:41.274185 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:39:41.274160 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42757b3c_7f77_48c5_bda5_2994b430bced.slice/crio-4433217035fa9a4e3b213942fec180c5e559b4e3e794fec51b5bba6441336d4a WatchSource:0}: Error finding container 4433217035fa9a4e3b213942fec180c5e559b4e3e794fec51b5bba6441336d4a: Status 404 returned error can't find the container with id 4433217035fa9a4e3b213942fec180c5e559b4e3e794fec51b5bba6441336d4a Jun 15 01:39:41.847577 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:41.847544 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788754d7bc-b4fzh" event={"ID":"42757b3c-7f77-48c5-bda5-2994b430bced","Type":"ContainerStarted","Data":"4433217035fa9a4e3b213942fec180c5e559b4e3e794fec51b5bba6441336d4a"} Jun 15 01:39:42.374781 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:42.374740 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:42.424650 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:42.424547 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:43.812270 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:43.812236 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:43.864390 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:43.864352 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:39:45.859713 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:45.859678 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788754d7bc-b4fzh" event={"ID":"42757b3c-7f77-48c5-bda5-2994b430bced","Type":"ContainerStarted","Data":"ec4fbd8365c6787d673632a288180cf36e11a856271c1545f0f337ab3a403c22"} Jun 15 01:39:45.860154 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:45.859955 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788754d7bc-b4fzh" Jun 15 01:39:45.861594 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:45.861574 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788754d7bc-b4fzh" Jun 15 01:39:45.875074 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:39:45.874948 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788754d7bc-b4fzh" podStartSLOduration=2.022018823 podStartE2EDuration="5.874929729s" totalImagesPullingTime="3.852910906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:39:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:39:45.87412022 +0000 UTC m=+81.732942901" watchObservedRunningTime="2026-06-15 01:39:45.874929729 +0000 UTC m=+81.733752398" Jun 15 01:40:03.926566 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:40:03.926527 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-tls\") pod \"image-registry-bfd57b8b7-zh79v\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:40:03.926947 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:40:03.926692 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 01:40:03.926947 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:40:03.926710 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bfd57b8b7-zh79v: secret "image-registry-tls" not found Jun 15 01:40:03.926947 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:40:03.926773 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-tls podName:317fa362-6021-4fc1-8d2c-f18e70ecb41d nodeName:}" failed. No retries permitted until 2026-06-15 01:41:07.926758525 +0000 UTC m=+163.785581169 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-tls") pod "image-registry-bfd57b8b7-zh79v" (UID: "317fa362-6021-4fc1-8d2c-f18e70ecb41d") : secret "image-registry-tls" not found Jun 15 01:40:04.027289 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:40:04.027251 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c44f922-cd2d-42e8-99c5-445dae30b40b-metrics-tls\") pod \"dns-default-qqxsf\" (UID: \"0c44f922-cd2d-42e8-99c5-445dae30b40b\") " pod="openshift-dns/dns-default-qqxsf" Jun 15 01:40:04.027421 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:40:04.027367 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 01:40:04.027458 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:40:04.027436 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c44f922-cd2d-42e8-99c5-445dae30b40b-metrics-tls podName:0c44f922-cd2d-42e8-99c5-445dae30b40b nodeName:}" failed. No retries permitted until 2026-06-15 01:41:08.027422411 +0000 UTC m=+163.886245056 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c44f922-cd2d-42e8-99c5-445dae30b40b-metrics-tls") pod "dns-default-qqxsf" (UID: "0c44f922-cd2d-42e8-99c5-445dae30b40b") : secret "dns-default-metrics-tls" not found Jun 15 01:40:04.831681 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:40:04.831646 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dqhvd" Jun 15 01:40:34.433435 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:40:34.433395 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3c35d53-b5a0-49e4-8964-61d18bbe5be1-metrics-certs\") pod \"network-metrics-daemon-r567p\" (UID: \"b3c35d53-b5a0-49e4-8964-61d18bbe5be1\") " pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:40:34.433915 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:40:34.433504 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 15 01:40:34.433915 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:40:34.433557 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3c35d53-b5a0-49e4-8964-61d18bbe5be1-metrics-certs podName:b3c35d53-b5a0-49e4-8964-61d18bbe5be1 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:36.433543642 +0000 UTC m=+252.292366288 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3c35d53-b5a0-49e4-8964-61d18bbe5be1-metrics-certs") pod "network-metrics-daemon-r567p" (UID: "b3c35d53-b5a0-49e4-8964-61d18bbe5be1") : secret "metrics-daemon-secret" not found Jun 15 01:41:03.079295 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:41:03.079239 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" podUID="317fa362-6021-4fc1-8d2c-f18e70ecb41d" Jun 15 01:41:03.092445 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:41:03.092412 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qqxsf" podUID="0c44f922-cd2d-42e8-99c5-445dae30b40b" Jun 15 01:41:04.036664 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:41:04.036618 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qqxsf" Jun 15 01:41:04.036824 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:41:04.036618 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:41:04.558694 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:41:04.558656 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-r567p" podUID="b3c35d53-b5a0-49e4-8964-61d18bbe5be1" Jun 15 01:41:07.968770 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:41:07.968684 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-tls\") pod \"image-registry-bfd57b8b7-zh79v\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:41:07.969181 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:41:07.968806 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 01:41:07.969181 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:41:07.968819 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bfd57b8b7-zh79v: secret "image-registry-tls" not found Jun 15 01:41:07.969181 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:41:07.968880 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-tls podName:317fa362-6021-4fc1-8d2c-f18e70ecb41d nodeName:}" failed. No retries permitted until 2026-06-15 01:43:09.968865372 +0000 UTC m=+285.827688018 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-tls") pod "image-registry-bfd57b8b7-zh79v" (UID: "317fa362-6021-4fc1-8d2c-f18e70ecb41d") : secret "image-registry-tls" not found Jun 15 01:41:08.069969 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:41:08.069938 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c44f922-cd2d-42e8-99c5-445dae30b40b-metrics-tls\") pod \"dns-default-qqxsf\" (UID: \"0c44f922-cd2d-42e8-99c5-445dae30b40b\") " pod="openshift-dns/dns-default-qqxsf" Jun 15 01:41:08.070125 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:41:08.070045 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 01:41:08.070125 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:41:08.070102 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c44f922-cd2d-42e8-99c5-445dae30b40b-metrics-tls podName:0c44f922-cd2d-42e8-99c5-445dae30b40b nodeName:}" failed. No retries permitted until 2026-06-15 01:43:10.070087615 +0000 UTC m=+285.928910260 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c44f922-cd2d-42e8-99c5-445dae30b40b-metrics-tls") pod "dns-default-qqxsf" (UID: "0c44f922-cd2d-42e8-99c5-445dae30b40b") : secret "dns-default-metrics-tls" not found Jun 15 01:41:16.540643 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:41:16.540586 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:41:38.716385 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:41:38.716354 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:41:45.860369 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:41:45.860325 2551 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788754d7bc-b4fzh" podUID="42757b3c-7f77-48c5-bda5-2994b430bced" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/readyz\": dial tcp 10.132.0.9:8000: connect: connection refused" Jun 15 01:41:46.133869 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:41:46.133787 2551 generic.go:356] "Generic (PLEG): container finished" podID="42757b3c-7f77-48c5-bda5-2994b430bced" containerID="ec4fbd8365c6787d673632a288180cf36e11a856271c1545f0f337ab3a403c22" exitCode=1 Jun 15 01:41:46.133869 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:41:46.133842 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788754d7bc-b4fzh" event={"ID":"42757b3c-7f77-48c5-bda5-2994b430bced","Type":"ContainerDied","Data":"ec4fbd8365c6787d673632a288180cf36e11a856271c1545f0f337ab3a403c22"} Jun 15 01:41:46.134143 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:41:46.134130 2551 scope.go:117] "RemoveContainer" containerID="ec4fbd8365c6787d673632a288180cf36e11a856271c1545f0f337ab3a403c22" Jun 15 01:41:47.138508 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:41:47.138474 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788754d7bc-b4fzh" event={"ID":"42757b3c-7f77-48c5-bda5-2994b430bced","Type":"ContainerStarted","Data":"00757e643542a7e281a0a5afdc61c48c42b94ce905191b5bc8b737766a8b6e4a"} Jun 15 01:41:47.138909 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:41:47.138711 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788754d7bc-b4fzh" Jun 15 01:41:47.139305 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:41:47.139289 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788754d7bc-b4fzh" Jun 15 01:42:00.656480 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.656445 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lgp8k"] Jun 15 01:42:00.659190 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.659175 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-4rz9m"] Jun 15 01:42:00.659310 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.659292 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lgp8k" Jun 15 01:42:00.661155 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.661122 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 15 01:42:00.661303 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.661247 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 15 01:42:00.661303 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.661254 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 15 01:42:00.661419 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.661368 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-fj2f6\"" Jun 15 01:42:00.661590 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.661573 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 15 01:42:00.661805 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.661790 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-4rz9m" Jun 15 01:42:00.663719 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.663701 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 15 01:42:00.663868 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.663742 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 15 01:42:00.664447 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.664431 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 15 01:42:00.664606 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.664465 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jsngk\"" Jun 15 01:42:00.664606 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.664491 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 15 01:42:00.672446 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.672423 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lgp8k"] Jun 15 01:42:00.674897 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.674874 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-4rz9m"] Jun 15 01:42:00.753134 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.753106 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-9lwgr"] Jun 15 01:42:00.756076 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.756056 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-9lwgr" Jun 15 01:42:00.758200 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.758179 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 15 01:42:00.758289 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.758179 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 15 01:42:00.758617 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.758598 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 15 01:42:00.758736 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.758719 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 15 01:42:00.758849 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.758836 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4jmb7\"" Jun 15 01:42:00.764056 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.764037 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 15 01:42:00.768318 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.768297 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-9lwgr"] Jun 15 01:42:00.844704 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.844672 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gk8p\" (UniqueName: \"kubernetes.io/projected/a87d8d2f-e694-40c2-8f7e-9bb66c8db7d6-kube-api-access-4gk8p\") pod \"kube-storage-version-migrator-operator-7c578b78fc-lgp8k\" (UID: \"a87d8d2f-e694-40c2-8f7e-9bb66c8db7d6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lgp8k" Jun 15 01:42:00.844704 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.844702 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f5cec08-fb70-4116-83fb-a9a5f04b93da-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-4rz9m\" (UID: \"8f5cec08-fb70-4116-83fb-a9a5f04b93da\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-4rz9m" Jun 15 01:42:00.844887 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.844723 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swkrn\" (UniqueName: \"kubernetes.io/projected/8f5cec08-fb70-4116-83fb-a9a5f04b93da-kube-api-access-swkrn\") pod \"cluster-monitoring-operator-f9d7df769-4rz9m\" (UID: \"8f5cec08-fb70-4116-83fb-a9a5f04b93da\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-4rz9m" Jun 15 01:42:00.844887 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.844746 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a87d8d2f-e694-40c2-8f7e-9bb66c8db7d6-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-lgp8k\" (UID: \"a87d8d2f-e694-40c2-8f7e-9bb66c8db7d6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lgp8k" Jun 15 01:42:00.844887 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.844814 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8f5cec08-fb70-4116-83fb-a9a5f04b93da-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-4rz9m\" (UID: \"8f5cec08-fb70-4116-83fb-a9a5f04b93da\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-4rz9m" Jun 15 01:42:00.844999 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.844894 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a87d8d2f-e694-40c2-8f7e-9bb66c8db7d6-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-lgp8k\" (UID: \"a87d8d2f-e694-40c2-8f7e-9bb66c8db7d6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lgp8k" Jun 15 01:42:00.894586 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.894555 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:00.941564 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.941492 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:00.945534 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.945516 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a87d8d2f-e694-40c2-8f7e-9bb66c8db7d6-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-lgp8k\" (UID: \"a87d8d2f-e694-40c2-8f7e-9bb66c8db7d6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lgp8k" Jun 15 01:42:00.945593 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.945554 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6094a811-09ad-44ff-93b1-dc8fb2b7e706-tmp\") pod \"insights-operator-5bbd86d6bd-9lwgr\" (UID: \"6094a811-09ad-44ff-93b1-dc8fb2b7e706\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9lwgr" Jun 15 01:42:00.945593 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.945579 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swkrn\" (UniqueName: \"kubernetes.io/projected/8f5cec08-fb70-4116-83fb-a9a5f04b93da-kube-api-access-swkrn\") pod \"cluster-monitoring-operator-f9d7df769-4rz9m\" (UID: \"8f5cec08-fb70-4116-83fb-a9a5f04b93da\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-4rz9m" Jun 15 01:42:00.945679 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.945605 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a87d8d2f-e694-40c2-8f7e-9bb66c8db7d6-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-lgp8k\" (UID: \"a87d8d2f-e694-40c2-8f7e-9bb66c8db7d6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lgp8k" Jun 15 01:42:00.945679 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.945648 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9wwn\" (UniqueName: \"kubernetes.io/projected/6094a811-09ad-44ff-93b1-dc8fb2b7e706-kube-api-access-l9wwn\") pod \"insights-operator-5bbd86d6bd-9lwgr\" (UID: \"6094a811-09ad-44ff-93b1-dc8fb2b7e706\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9lwgr" Jun 15 01:42:00.945761 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.945682 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8f5cec08-fb70-4116-83fb-a9a5f04b93da-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-4rz9m\" (UID: \"8f5cec08-fb70-4116-83fb-a9a5f04b93da\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-4rz9m" Jun 15 01:42:00.945806 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.945789 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6094a811-09ad-44ff-93b1-dc8fb2b7e706-snapshots\") pod \"insights-operator-5bbd86d6bd-9lwgr\" (UID: \"6094a811-09ad-44ff-93b1-dc8fb2b7e706\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9lwgr" Jun 15 01:42:00.945853 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.945839 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6094a811-09ad-44ff-93b1-dc8fb2b7e706-serving-cert\") pod \"insights-operator-5bbd86d6bd-9lwgr\" (UID: \"6094a811-09ad-44ff-93b1-dc8fb2b7e706\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9lwgr" Jun 15 01:42:00.945940 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.945920 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6094a811-09ad-44ff-93b1-dc8fb2b7e706-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-9lwgr\" (UID: \"6094a811-09ad-44ff-93b1-dc8fb2b7e706\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9lwgr" Jun 15 01:42:00.945987 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.945965 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gk8p\" (UniqueName: \"kubernetes.io/projected/a87d8d2f-e694-40c2-8f7e-9bb66c8db7d6-kube-api-access-4gk8p\") pod \"kube-storage-version-migrator-operator-7c578b78fc-lgp8k\" (UID: \"a87d8d2f-e694-40c2-8f7e-9bb66c8db7d6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lgp8k" Jun 15 01:42:00.946043 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.945995 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f5cec08-fb70-4116-83fb-a9a5f04b93da-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-4rz9m\" (UID: \"8f5cec08-fb70-4116-83fb-a9a5f04b93da\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-4rz9m" Jun 15 01:42:00.946043 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.946024 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6094a811-09ad-44ff-93b1-dc8fb2b7e706-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-9lwgr\" (UID: \"6094a811-09ad-44ff-93b1-dc8fb2b7e706\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9lwgr" Jun 15 01:42:00.946137 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:00.946110 2551 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 15 01:42:00.946200 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:00.946179 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f5cec08-fb70-4116-83fb-a9a5f04b93da-cluster-monitoring-operator-tls podName:8f5cec08-fb70-4116-83fb-a9a5f04b93da nodeName:}" failed. No retries permitted until 2026-06-15 01:42:01.446159547 +0000 UTC m=+217.304982194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8f5cec08-fb70-4116-83fb-a9a5f04b93da-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-4rz9m" (UID: "8f5cec08-fb70-4116-83fb-a9a5f04b93da") : secret "cluster-monitoring-operator-tls" not found Jun 15 01:42:00.946307 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.946287 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a87d8d2f-e694-40c2-8f7e-9bb66c8db7d6-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-lgp8k\" (UID: \"a87d8d2f-e694-40c2-8f7e-9bb66c8db7d6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lgp8k" Jun 15 01:42:00.946350 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.946326 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8f5cec08-fb70-4116-83fb-a9a5f04b93da-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-4rz9m\" (UID: \"8f5cec08-fb70-4116-83fb-a9a5f04b93da\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-4rz9m" Jun 15 01:42:00.947898 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.947882 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a87d8d2f-e694-40c2-8f7e-9bb66c8db7d6-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-lgp8k\" (UID: \"a87d8d2f-e694-40c2-8f7e-9bb66c8db7d6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lgp8k" Jun 15 01:42:00.953806 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.953781 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gk8p\" (UniqueName: \"kubernetes.io/projected/a87d8d2f-e694-40c2-8f7e-9bb66c8db7d6-kube-api-access-4gk8p\") pod \"kube-storage-version-migrator-operator-7c578b78fc-lgp8k\" (UID: \"a87d8d2f-e694-40c2-8f7e-9bb66c8db7d6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lgp8k" Jun 15 01:42:00.954666 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.954615 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swkrn\" (UniqueName: \"kubernetes.io/projected/8f5cec08-fb70-4116-83fb-a9a5f04b93da-kube-api-access-swkrn\") pod \"cluster-monitoring-operator-f9d7df769-4rz9m\" (UID: \"8f5cec08-fb70-4116-83fb-a9a5f04b93da\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-4rz9m" Jun 15 01:42:00.969407 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:00.969392 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lgp8k" Jun 15 01:42:01.047144 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:01.047110 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6094a811-09ad-44ff-93b1-dc8fb2b7e706-tmp\") pod \"insights-operator-5bbd86d6bd-9lwgr\" (UID: \"6094a811-09ad-44ff-93b1-dc8fb2b7e706\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9lwgr" Jun 15 01:42:01.047249 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:01.047170 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9wwn\" (UniqueName: \"kubernetes.io/projected/6094a811-09ad-44ff-93b1-dc8fb2b7e706-kube-api-access-l9wwn\") pod \"insights-operator-5bbd86d6bd-9lwgr\" (UID: \"6094a811-09ad-44ff-93b1-dc8fb2b7e706\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9lwgr" Jun 15 01:42:01.047249 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:01.047209 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6094a811-09ad-44ff-93b1-dc8fb2b7e706-snapshots\") pod \"insights-operator-5bbd86d6bd-9lwgr\" (UID: \"6094a811-09ad-44ff-93b1-dc8fb2b7e706\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9lwgr" Jun 15 01:42:01.047337 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:01.047292 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6094a811-09ad-44ff-93b1-dc8fb2b7e706-serving-cert\") pod \"insights-operator-5bbd86d6bd-9lwgr\" (UID: \"6094a811-09ad-44ff-93b1-dc8fb2b7e706\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9lwgr" Jun 15 01:42:01.047381 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:01.047343 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6094a811-09ad-44ff-93b1-dc8fb2b7e706-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-9lwgr\" (UID: \"6094a811-09ad-44ff-93b1-dc8fb2b7e706\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9lwgr" Jun 15 01:42:01.047427 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:01.047385 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6094a811-09ad-44ff-93b1-dc8fb2b7e706-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-9lwgr\" (UID: \"6094a811-09ad-44ff-93b1-dc8fb2b7e706\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9lwgr" Jun 15 01:42:01.047794 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:01.047512 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6094a811-09ad-44ff-93b1-dc8fb2b7e706-tmp\") pod \"insights-operator-5bbd86d6bd-9lwgr\" (UID: \"6094a811-09ad-44ff-93b1-dc8fb2b7e706\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9lwgr" Jun 15 01:42:01.047945 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:01.047911 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6094a811-09ad-44ff-93b1-dc8fb2b7e706-snapshots\") pod \"insights-operator-5bbd86d6bd-9lwgr\" (UID: \"6094a811-09ad-44ff-93b1-dc8fb2b7e706\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9lwgr" Jun 15 01:42:01.048043 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:01.048024 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6094a811-09ad-44ff-93b1-dc8fb2b7e706-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-9lwgr\" (UID: \"6094a811-09ad-44ff-93b1-dc8fb2b7e706\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9lwgr" Jun 15 01:42:01.048614 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:01.048538 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6094a811-09ad-44ff-93b1-dc8fb2b7e706-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-9lwgr\" (UID: \"6094a811-09ad-44ff-93b1-dc8fb2b7e706\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9lwgr" Jun 15 01:42:01.049789 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:01.049767 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6094a811-09ad-44ff-93b1-dc8fb2b7e706-serving-cert\") pod \"insights-operator-5bbd86d6bd-9lwgr\" (UID: \"6094a811-09ad-44ff-93b1-dc8fb2b7e706\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9lwgr" Jun 15 01:42:01.054923 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:01.054903 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9wwn\" (UniqueName: \"kubernetes.io/projected/6094a811-09ad-44ff-93b1-dc8fb2b7e706-kube-api-access-l9wwn\") pod \"insights-operator-5bbd86d6bd-9lwgr\" (UID: \"6094a811-09ad-44ff-93b1-dc8fb2b7e706\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9lwgr" Jun 15 01:42:01.064755 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:01.064734 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-9lwgr" Jun 15 01:42:01.087775 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:01.087750 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lgp8k"] Jun 15 01:42:01.090336 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:42:01.090312 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda87d8d2f_e694_40c2_8f7e_9bb66c8db7d6.slice/crio-5fdb3ee61696e33103c470fa6a5ae09c5d607636375d3d552b039c4fd6171b67 WatchSource:0}: Error finding container 5fdb3ee61696e33103c470fa6a5ae09c5d607636375d3d552b039c4fd6171b67: Status 404 returned error can't find the container with id 5fdb3ee61696e33103c470fa6a5ae09c5d607636375d3d552b039c4fd6171b67 Jun 15 01:42:01.179579 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:01.179542 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lgp8k" event={"ID":"a87d8d2f-e694-40c2-8f7e-9bb66c8db7d6","Type":"ContainerStarted","Data":"5fdb3ee61696e33103c470fa6a5ae09c5d607636375d3d552b039c4fd6171b67"} Jun 15 01:42:01.185758 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:01.183253 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-9lwgr"] Jun 15 01:42:01.189167 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:42:01.189143 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6094a811_09ad_44ff_93b1_dc8fb2b7e706.slice/crio-c65242786e85fc2d5d8e633e2530ea98790483e9d1eeee297e6570f8e8019a0c WatchSource:0}: Error finding container c65242786e85fc2d5d8e633e2530ea98790483e9d1eeee297e6570f8e8019a0c: Status 404 returned error can't find the container with id c65242786e85fc2d5d8e633e2530ea98790483e9d1eeee297e6570f8e8019a0c Jun 15 01:42:01.451200 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:01.451137 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f5cec08-fb70-4116-83fb-a9a5f04b93da-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-4rz9m\" (UID: \"8f5cec08-fb70-4116-83fb-a9a5f04b93da\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-4rz9m" Jun 15 01:42:01.451297 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:01.451246 2551 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 15 01:42:01.451297 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:01.451293 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f5cec08-fb70-4116-83fb-a9a5f04b93da-cluster-monitoring-operator-tls podName:8f5cec08-fb70-4116-83fb-a9a5f04b93da nodeName:}" failed. No retries permitted until 2026-06-15 01:42:02.451280467 +0000 UTC m=+218.310103112 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8f5cec08-fb70-4116-83fb-a9a5f04b93da-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-4rz9m" (UID: "8f5cec08-fb70-4116-83fb-a9a5f04b93da") : secret "cluster-monitoring-operator-tls" not found Jun 15 01:42:02.184941 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:02.184828 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-9lwgr" event={"ID":"6094a811-09ad-44ff-93b1-dc8fb2b7e706","Type":"ContainerStarted","Data":"c65242786e85fc2d5d8e633e2530ea98790483e9d1eeee297e6570f8e8019a0c"} Jun 15 01:42:02.459126 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:02.459024 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f5cec08-fb70-4116-83fb-a9a5f04b93da-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-4rz9m\" (UID: \"8f5cec08-fb70-4116-83fb-a9a5f04b93da\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-4rz9m" Jun 15 01:42:02.459293 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:02.459184 2551 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 15 01:42:02.459293 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:02.459267 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f5cec08-fb70-4116-83fb-a9a5f04b93da-cluster-monitoring-operator-tls podName:8f5cec08-fb70-4116-83fb-a9a5f04b93da nodeName:}" failed. No retries permitted until 2026-06-15 01:42:04.459245187 +0000 UTC m=+220.318067834 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8f5cec08-fb70-4116-83fb-a9a5f04b93da-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-4rz9m" (UID: "8f5cec08-fb70-4116-83fb-a9a5f04b93da") : secret "cluster-monitoring-operator-tls" not found Jun 15 01:42:02.719597 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:02.719515 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:04.191880 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:04.191843 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lgp8k" event={"ID":"a87d8d2f-e694-40c2-8f7e-9bb66c8db7d6","Type":"ContainerStarted","Data":"6874f30e45ee1228cd450cf652f0f312c045f4e9d2223939209aa6f9f0883147"} Jun 15 01:42:04.193406 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:04.193384 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-9lwgr" event={"ID":"6094a811-09ad-44ff-93b1-dc8fb2b7e706","Type":"ContainerStarted","Data":"2f754655db124861d4629e18d395b6c487e853848389f8e6bbfecd1c7142c05e"} Jun 15 01:42:04.208578 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:04.208521 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lgp8k" podStartSLOduration=1.7711636039999998 podStartE2EDuration="4.208503347s" totalImagesPullingTime="2.437339743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:04.208033124 +0000 UTC m=+220.066855792" watchObservedRunningTime="2026-06-15 01:42:04.208503347 +0000 UTC m=+220.067326015" Jun 15 01:42:04.221612 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:04.221566 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-9lwgr" podStartSLOduration=1.88168497 podStartE2EDuration="4.221551592s" totalImagesPullingTime="2.339866622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:04.220529394 +0000 UTC m=+220.079352090" watchObservedRunningTime="2026-06-15 01:42:04.221551592 +0000 UTC m=+220.080374258" Jun 15 01:42:04.470689 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:04.470582 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f5cec08-fb70-4116-83fb-a9a5f04b93da-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-4rz9m\" (UID: \"8f5cec08-fb70-4116-83fb-a9a5f04b93da\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-4rz9m" Jun 15 01:42:04.470838 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:04.470726 2551 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 15 01:42:04.470838 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:04.470784 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f5cec08-fb70-4116-83fb-a9a5f04b93da-cluster-monitoring-operator-tls podName:8f5cec08-fb70-4116-83fb-a9a5f04b93da nodeName:}" failed. No retries permitted until 2026-06-15 01:42:08.470768354 +0000 UTC m=+224.329591009 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8f5cec08-fb70-4116-83fb-a9a5f04b93da-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-4rz9m" (UID: "8f5cec08-fb70-4116-83fb-a9a5f04b93da") : secret "cluster-monitoring-operator-tls" not found Jun 15 01:42:04.509327 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:04.509298 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:04.554894 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:04.554841 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:04.953311 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:04.953259 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:05.011840 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.011805 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-cv8mp"] Jun 15 01:42:05.014912 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.014896 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-cv8mp" Jun 15 01:42:05.017025 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.017003 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 15 01:42:05.017201 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.017185 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-57dvq\"" Jun 15 01:42:05.017814 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.017794 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 15 01:42:05.023930 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.023897 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-cv8mp"] Jun 15 01:42:05.034233 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.034212 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:05.075537 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.075504 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tdq2\" (UniqueName: \"kubernetes.io/projected/822aba9d-e387-4e4b-b1fa-a3f4d66261ab-kube-api-access-6tdq2\") pod \"migrator-d4bcd4867-cv8mp\" (UID: \"822aba9d-e387-4e4b-b1fa-a3f4d66261ab\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-cv8mp" Jun 15 01:42:05.085013 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.084986 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:05.140077 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.140052 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:05.176373 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.176345 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tdq2\" (UniqueName: \"kubernetes.io/projected/822aba9d-e387-4e4b-b1fa-a3f4d66261ab-kube-api-access-6tdq2\") pod \"migrator-d4bcd4867-cv8mp\" (UID: \"822aba9d-e387-4e4b-b1fa-a3f4d66261ab\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-cv8mp" Jun 15 01:42:05.192523 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.192494 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tdq2\" (UniqueName: \"kubernetes.io/projected/822aba9d-e387-4e4b-b1fa-a3f4d66261ab-kube-api-access-6tdq2\") pod \"migrator-d4bcd4867-cv8mp\" (UID: \"822aba9d-e387-4e4b-b1fa-a3f4d66261ab\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-cv8mp" Jun 15 01:42:05.216278 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.216197 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l76dr"] Jun 15 01:42:05.219858 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.219836 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l76dr" Jun 15 01:42:05.221959 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.221937 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 15 01:42:05.222116 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.222067 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m4nht\"" Jun 15 01:42:05.222244 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.222216 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 15 01:42:05.230346 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.230254 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l76dr"] Jun 15 01:42:05.235418 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.235396 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:05.279178 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.279142 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-data-volume\") pod \"insights-runtime-extractor-l76dr\" (UID: \"1afa52ec-3fc6-4780-8da4-588b1ff7e8c8\") " pod="openshift-insights/insights-runtime-extractor-l76dr" Jun 15 01:42:05.279347 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.279214 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l76dr\" (UID: \"1afa52ec-3fc6-4780-8da4-588b1ff7e8c8\") " pod="openshift-insights/insights-runtime-extractor-l76dr" Jun 15 01:42:05.279347 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.279299 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l76dr\" (UID: \"1afa52ec-3fc6-4780-8da4-588b1ff7e8c8\") " pod="openshift-insights/insights-runtime-extractor-l76dr" Jun 15 01:42:05.279483 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.279353 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-crio-socket\") pod \"insights-runtime-extractor-l76dr\" (UID: \"1afa52ec-3fc6-4780-8da4-588b1ff7e8c8\") " pod="openshift-insights/insights-runtime-extractor-l76dr" Jun 15 01:42:05.279483 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.279381 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp4cx\" (UniqueName: \"kubernetes.io/projected/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-kube-api-access-zp4cx\") pod \"insights-runtime-extractor-l76dr\" (UID: \"1afa52ec-3fc6-4780-8da4-588b1ff7e8c8\") " pod="openshift-insights/insights-runtime-extractor-l76dr" Jun 15 01:42:05.290079 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.290054 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:05.324862 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.324830 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-cv8mp" Jun 15 01:42:05.380671 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.380618 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-data-volume\") pod \"insights-runtime-extractor-l76dr\" (UID: \"1afa52ec-3fc6-4780-8da4-588b1ff7e8c8\") " pod="openshift-insights/insights-runtime-extractor-l76dr" Jun 15 01:42:05.380796 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.380703 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l76dr\" (UID: \"1afa52ec-3fc6-4780-8da4-588b1ff7e8c8\") " pod="openshift-insights/insights-runtime-extractor-l76dr" Jun 15 01:42:05.380796 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.380750 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l76dr\" (UID: \"1afa52ec-3fc6-4780-8da4-588b1ff7e8c8\") " pod="openshift-insights/insights-runtime-extractor-l76dr" Jun 15 01:42:05.380881 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.380801 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-crio-socket\") pod \"insights-runtime-extractor-l76dr\" (UID: \"1afa52ec-3fc6-4780-8da4-588b1ff7e8c8\") " pod="openshift-insights/insights-runtime-extractor-l76dr" Jun 15 01:42:05.380881 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.380830 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp4cx\" (UniqueName: \"kubernetes.io/projected/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-kube-api-access-zp4cx\") pod \"insights-runtime-extractor-l76dr\" (UID: \"1afa52ec-3fc6-4780-8da4-588b1ff7e8c8\") " pod="openshift-insights/insights-runtime-extractor-l76dr" Jun 15 01:42:05.381408 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:05.381354 2551 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 01:42:05.381408 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:05.381374 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 01:42:05.381557 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:05.381453 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-kube-rbac-proxy-cm podName:1afa52ec-3fc6-4780-8da4-588b1ff7e8c8 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:05.881431342 +0000 UTC m=+221.740254007 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l76dr" (UID: "1afa52ec-3fc6-4780-8da4-588b1ff7e8c8") : configmap "kube-rbac-proxy" not found Jun 15 01:42:05.381557 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:05.381474 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-insights-runtime-extractor-tls podName:1afa52ec-3fc6-4780-8da4-588b1ff7e8c8 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:05.881464618 +0000 UTC m=+221.740287266 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l76dr" (UID: "1afa52ec-3fc6-4780-8da4-588b1ff7e8c8") : secret "insights-runtime-extractor-tls" not found Jun 15 01:42:05.381557 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.381493 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-crio-socket\") pod \"insights-runtime-extractor-l76dr\" (UID: \"1afa52ec-3fc6-4780-8da4-588b1ff7e8c8\") " pod="openshift-insights/insights-runtime-extractor-l76dr" Jun 15 01:42:05.381840 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.381568 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-data-volume\") pod \"insights-runtime-extractor-l76dr\" (UID: \"1afa52ec-3fc6-4780-8da4-588b1ff7e8c8\") " pod="openshift-insights/insights-runtime-extractor-l76dr" Jun 15 01:42:05.389717 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.389688 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp4cx\" (UniqueName: \"kubernetes.io/projected/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-kube-api-access-zp4cx\") pod \"insights-runtime-extractor-l76dr\" (UID: \"1afa52ec-3fc6-4780-8da4-588b1ff7e8c8\") " pod="openshift-insights/insights-runtime-extractor-l76dr" Jun 15 01:42:05.445795 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.445765 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-cv8mp"] Jun 15 01:42:05.448927 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:42:05.448900 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod822aba9d_e387_4e4b_b1fa_a3f4d66261ab.slice/crio-36ffab2cf3d1483e7ad88cc677730ee0287a03e691add49fc96d0348396a25fc WatchSource:0}: Error finding container 36ffab2cf3d1483e7ad88cc677730ee0287a03e691add49fc96d0348396a25fc: Status 404 returned error can't find the container with id 36ffab2cf3d1483e7ad88cc677730ee0287a03e691add49fc96d0348396a25fc Jun 15 01:42:05.885833 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.885793 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l76dr\" (UID: \"1afa52ec-3fc6-4780-8da4-588b1ff7e8c8\") " pod="openshift-insights/insights-runtime-extractor-l76dr" Jun 15 01:42:05.885833 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:05.885841 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l76dr\" (UID: \"1afa52ec-3fc6-4780-8da4-588b1ff7e8c8\") " pod="openshift-insights/insights-runtime-extractor-l76dr" Jun 15 01:42:05.886064 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:05.885913 2551 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 01:42:05.886064 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:05.885947 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 01:42:05.886064 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:05.885979 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-kube-rbac-proxy-cm podName:1afa52ec-3fc6-4780-8da4-588b1ff7e8c8 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:06.885961587 +0000 UTC m=+222.744784233 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l76dr" (UID: "1afa52ec-3fc6-4780-8da4-588b1ff7e8c8") : configmap "kube-rbac-proxy" not found Jun 15 01:42:05.886064 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:05.885994 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-insights-runtime-extractor-tls podName:1afa52ec-3fc6-4780-8da4-588b1ff7e8c8 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:06.885987595 +0000 UTC m=+222.744810240 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l76dr" (UID: "1afa52ec-3fc6-4780-8da4-588b1ff7e8c8") : secret "insights-runtime-extractor-tls" not found Jun 15 01:42:06.202297 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:06.202213 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-cv8mp" event={"ID":"822aba9d-e387-4e4b-b1fa-a3f4d66261ab","Type":"ContainerStarted","Data":"36ffab2cf3d1483e7ad88cc677730ee0287a03e691add49fc96d0348396a25fc"} Jun 15 01:42:06.850995 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:06.850967 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:06.893746 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:06.893716 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l76dr\" (UID: \"1afa52ec-3fc6-4780-8da4-588b1ff7e8c8\") " pod="openshift-insights/insights-runtime-extractor-l76dr" Jun 15 01:42:06.893906 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:06.893766 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l76dr\" (UID: \"1afa52ec-3fc6-4780-8da4-588b1ff7e8c8\") " pod="openshift-insights/insights-runtime-extractor-l76dr" Jun 15 01:42:06.893906 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:06.893833 2551 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 01:42:06.893906 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:06.893897 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-kube-rbac-proxy-cm podName:1afa52ec-3fc6-4780-8da4-588b1ff7e8c8 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:08.893879126 +0000 UTC m=+224.752701771 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l76dr" (UID: "1afa52ec-3fc6-4780-8da4-588b1ff7e8c8") : configmap "kube-rbac-proxy" not found Jun 15 01:42:06.894023 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:06.893927 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 01:42:06.894023 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:06.893975 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-insights-runtime-extractor-tls podName:1afa52ec-3fc6-4780-8da4-588b1ff7e8c8 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:08.893962754 +0000 UTC m=+224.752785399 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l76dr" (UID: "1afa52ec-3fc6-4780-8da4-588b1ff7e8c8") : secret "insights-runtime-extractor-tls" not found Jun 15 01:42:06.905370 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:06.905346 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:07.206976 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:07.206903 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-cv8mp" event={"ID":"822aba9d-e387-4e4b-b1fa-a3f4d66261ab","Type":"ContainerStarted","Data":"9e00da88baf79b118b3a68dc74db155d6fcee8c3c7ea630d0fd11aabd184d7a3"} Jun 15 01:42:07.206976 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:07.206953 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-cv8mp" event={"ID":"822aba9d-e387-4e4b-b1fa-a3f4d66261ab","Type":"ContainerStarted","Data":"9e08bf6f4e32e943ed547e1c8003f866e44011b2742d3d0b94b4f80c3055d32b"} Jun 15 01:42:07.220728 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:07.220684 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-cv8mp" podStartSLOduration=2.186259883 podStartE2EDuration="3.22066917s" totalImagesPullingTime="1.034409287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:42:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:07.220273818 +0000 UTC m=+223.079096487" watchObservedRunningTime="2026-06-15 01:42:07.22066917 +0000 UTC m=+223.079491838" Jun 15 01:42:07.296394 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:07.296342 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:07.397419 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:07.397369 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:07.694045 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:07.693995 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:07.909786 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:07.909757 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jm8jk_8110134b-d73a-422f-88ca-b6eec684189d/dns-node-resolver/0.log" Jun 15 01:42:08.505399 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:08.505366 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f5cec08-fb70-4116-83fb-a9a5f04b93da-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-4rz9m\" (UID: \"8f5cec08-fb70-4116-83fb-a9a5f04b93da\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-4rz9m" Jun 15 01:42:08.505783 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:08.505483 2551 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 15 01:42:08.505783 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:08.505534 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f5cec08-fb70-4116-83fb-a9a5f04b93da-cluster-monitoring-operator-tls podName:8f5cec08-fb70-4116-83fb-a9a5f04b93da nodeName:}" failed. No retries permitted until 2026-06-15 01:42:16.505521407 +0000 UTC m=+232.364344052 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8f5cec08-fb70-4116-83fb-a9a5f04b93da-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-4rz9m" (UID: "8f5cec08-fb70-4116-83fb-a9a5f04b93da") : secret "cluster-monitoring-operator-tls" not found Jun 15 01:42:08.908216 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:08.908183 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l76dr\" (UID: \"1afa52ec-3fc6-4780-8da4-588b1ff7e8c8\") " pod="openshift-insights/insights-runtime-extractor-l76dr" Jun 15 01:42:08.908398 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:08.908225 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l76dr\" (UID: \"1afa52ec-3fc6-4780-8da4-588b1ff7e8c8\") " pod="openshift-insights/insights-runtime-extractor-l76dr" Jun 15 01:42:08.908398 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:08.908304 2551 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 01:42:08.908398 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:08.908320 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 01:42:08.908398 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:08.908364 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-insights-runtime-extractor-tls podName:1afa52ec-3fc6-4780-8da4-588b1ff7e8c8 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:12.908350941 +0000 UTC m=+228.767173586 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l76dr" (UID: "1afa52ec-3fc6-4780-8da4-588b1ff7e8c8") : secret "insights-runtime-extractor-tls" not found Jun 15 01:42:08.908398 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:08.908377 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-kube-rbac-proxy-cm podName:1afa52ec-3fc6-4780-8da4-588b1ff7e8c8 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:12.908370995 +0000 UTC m=+228.767193640 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l76dr" (UID: "1afa52ec-3fc6-4780-8da4-588b1ff7e8c8") : configmap "kube-rbac-proxy" not found Jun 15 01:42:09.108923 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:09.108894 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w97rl_81f80853-3308-4f3a-9cb4-83ce4fb00055/node-ca/0.log" Jun 15 01:42:09.380237 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:09.380201 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:09.517640 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:09.517585 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:09.619803 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:09.619771 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:09.710298 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:09.710221 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-27cht_2f463e3d-ebaf-481f-9eed-c2c150aca07b/serve-healthcheck-canary/0.log" Jun 15 01:42:09.719599 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:09.719574 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:09.782359 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:09.782331 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:09.894271 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:09.894231 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:10.053885 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:10.053793 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:10.105019 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:10.104977 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:10.310241 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:10.310139 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-cv8mp_822aba9d-e387-4e4b-b1fa-a3f4d66261ab/migrator/0.log" Jun 15 01:42:10.513868 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:10.513844 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-cv8mp_822aba9d-e387-4e4b-b1fa-a3f4d66261ab/graceful-termination/0.log" Jun 15 01:42:10.710462 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:10.710410 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-lgp8k_a87d8d2f-e694-40c2-8f7e-9bb66c8db7d6/kube-storage-version-migrator-operator/0.log" Jun 15 01:42:10.880483 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:10.880451 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:11.275811 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:11.275768 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:11.674449 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:11.674399 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:12.078186 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:12.078082 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:12.276394 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:12.276363 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:12.875328 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:12.875276 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:12.944289 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:12.944262 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l76dr\" (UID: \"1afa52ec-3fc6-4780-8da4-588b1ff7e8c8\") " pod="openshift-insights/insights-runtime-extractor-l76dr" Jun 15 01:42:12.944406 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:12.944300 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l76dr\" (UID: \"1afa52ec-3fc6-4780-8da4-588b1ff7e8c8\") " pod="openshift-insights/insights-runtime-extractor-l76dr" Jun 15 01:42:12.944406 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:12.944376 2551 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 01:42:12.944498 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:12.944416 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 01:42:12.944498 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:12.944436 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-kube-rbac-proxy-cm podName:1afa52ec-3fc6-4780-8da4-588b1ff7e8c8 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:20.944420102 +0000 UTC m=+236.803242747 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l76dr" (UID: "1afa52ec-3fc6-4780-8da4-588b1ff7e8c8") : configmap "kube-rbac-proxy" not found Jun 15 01:42:12.944498 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:12.944463 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-insights-runtime-extractor-tls podName:1afa52ec-3fc6-4780-8da4-588b1ff7e8c8 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:20.944452182 +0000 UTC m=+236.803274827 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l76dr" (UID: "1afa52ec-3fc6-4780-8da4-588b1ff7e8c8") : secret "insights-runtime-extractor-tls" not found Jun 15 01:42:13.178819 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:13.178722 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:13.279741 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:13.279712 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:13.330770 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:13.330717 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:13.683290 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:13.683250 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:13.877874 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:13.877842 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:14.318654 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:14.318588 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:14.480002 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:14.479971 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:15.081103 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:15.081056 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:15.282451 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:15.282422 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:15.478523 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:15.478485 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:15.675141 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:15.675107 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:15.899796 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:15.899756 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:16.573033 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:16.573004 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f5cec08-fb70-4116-83fb-a9a5f04b93da-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-4rz9m\" (UID: \"8f5cec08-fb70-4116-83fb-a9a5f04b93da\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-4rz9m" Jun 15 01:42:16.575240 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:16.575216 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f5cec08-fb70-4116-83fb-a9a5f04b93da-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-4rz9m\" (UID: \"8f5cec08-fb70-4116-83fb-a9a5f04b93da\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-4rz9m" Jun 15 01:42:16.679802 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:16.679769 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:16.875028 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:16.875002 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-4rz9m" Jun 15 01:42:16.886699 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:16.886669 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:16.995884 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:16.995773 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-4rz9m"] Jun 15 01:42:16.998196 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:42:16.998174 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f5cec08_fb70_4116_83fb_a9a5f04b93da.slice/crio-085683ffb1a4a8a502cda8daca5a9f745f05ea58da68f106f2b4c416b1ff5817 WatchSource:0}: Error finding container 085683ffb1a4a8a502cda8daca5a9f745f05ea58da68f106f2b4c416b1ff5817: Status 404 returned error can't find the container with id 085683ffb1a4a8a502cda8daca5a9f745f05ea58da68f106f2b4c416b1ff5817 Jun 15 01:42:17.090193 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:17.090159 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:17.239089 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:17.239000 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-4rz9m" event={"ID":"8f5cec08-fb70-4116-83fb-a9a5f04b93da","Type":"ContainerStarted","Data":"085683ffb1a4a8a502cda8daca5a9f745f05ea58da68f106f2b4c416b1ff5817"} Jun 15 01:42:17.477345 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:17.477312 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:17.993940 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:17.993899 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:18.094888 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:18.094856 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:18.683561 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:18.683513 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:18.880732 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:18.880701 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:18.983844 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:18.983813 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:19.081814 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:19.081788 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:19.246855 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:19.246769 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-4rz9m" event={"ID":"8f5cec08-fb70-4116-83fb-a9a5f04b93da","Type":"ContainerStarted","Data":"1fd39fc940a6a7b0e404127db709917af6b2c2f9a4197abb5eeca63f74924640"} Jun 15 01:42:19.262790 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:19.262744 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-4rz9m" podStartSLOduration=17.680433003 podStartE2EDuration="19.26273224s" totalImagesPullingTime="1.582299237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:19.262101749 +0000 UTC m=+235.120924418" watchObservedRunningTime="2026-06-15 01:42:19.26273224 +0000 UTC m=+235.121554906" Jun 15 01:42:19.283432 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:19.283409 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:19.486615 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:19.486581 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:19.677582 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:19.677535 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:20.276966 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:20.276931 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:20.477258 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:20.477228 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:21.009938 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:21.009902 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l76dr\" (UID: \"1afa52ec-3fc6-4780-8da4-588b1ff7e8c8\") " pod="openshift-insights/insights-runtime-extractor-l76dr" Jun 15 01:42:21.010128 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:21.009944 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l76dr\" (UID: \"1afa52ec-3fc6-4780-8da4-588b1ff7e8c8\") " pod="openshift-insights/insights-runtime-extractor-l76dr" Jun 15 01:42:21.010419 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:21.010399 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l76dr\" (UID: \"1afa52ec-3fc6-4780-8da4-588b1ff7e8c8\") " pod="openshift-insights/insights-runtime-extractor-l76dr" Jun 15 01:42:21.012187 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:21.012163 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1afa52ec-3fc6-4780-8da4-588b1ff7e8c8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l76dr\" (UID: \"1afa52ec-3fc6-4780-8da4-588b1ff7e8c8\") " pod="openshift-insights/insights-runtime-extractor-l76dr" Jun 15 01:42:21.133268 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:21.133229 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l76dr" Jun 15 01:42:21.256875 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:21.256850 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l76dr"] Jun 15 01:42:21.259464 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:42:21.259440 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1afa52ec_3fc6_4780_8da4_588b1ff7e8c8.slice/crio-af547b68c3dfbdc5fd10a51ec4695893cacab5d42b718bb44f2618054f5f6fc1 WatchSource:0}: Error finding container af547b68c3dfbdc5fd10a51ec4695893cacab5d42b718bb44f2618054f5f6fc1: Status 404 returned error can't find the container with id af547b68c3dfbdc5fd10a51ec4695893cacab5d42b718bb44f2618054f5f6fc1 Jun 15 01:42:22.259778 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:22.259741 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l76dr" event={"ID":"1afa52ec-3fc6-4780-8da4-588b1ff7e8c8","Type":"ContainerStarted","Data":"af547b68c3dfbdc5fd10a51ec4695893cacab5d42b718bb44f2618054f5f6fc1"} Jun 15 01:42:25.271440 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:25.271413 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l76dr" event={"ID":"1afa52ec-3fc6-4780-8da4-588b1ff7e8c8","Type":"ContainerStarted","Data":"5b225481331abf8eacba93ecd230acd05fe77b7d1783f25933b81a57edae768a"} Jun 15 01:42:25.592255 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:25.592133 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:25.692314 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:25.692267 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:25.744492 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:25.744454 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:25.887239 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:25.887201 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:26.265021 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:26.264946 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:26.276459 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:26.276433 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l76dr" event={"ID":"1afa52ec-3fc6-4780-8da4-588b1ff7e8c8","Type":"ContainerStarted","Data":"68ce6238927bc92def2080189fbfec547a65395505462753e48f035bcf159e8f"} Jun 15 01:42:26.365608 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:26.365545 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:26.573619 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:26.573537 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rwqj5"] Jun 15 01:42:26.578412 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:26.578386 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rwqj5" Jun 15 01:42:26.581024 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:26.581006 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 15 01:42:26.581145 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:26.581007 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-5m2bd\"" Jun 15 01:42:26.586425 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:26.586406 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-n4svk"] Jun 15 01:42:26.589568 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:26.589547 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rwqj5"] Jun 15 01:42:26.589697 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:26.589664 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-n4svk" Jun 15 01:42:26.591886 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:26.591738 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 15 01:42:26.591886 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:26.591781 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 15 01:42:26.591886 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:26.591885 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-q6vpp\"" Jun 15 01:42:26.604289 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:26.604261 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-n4svk"] Jun 15 01:42:26.652386 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:26.652348 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e62599e1-4578-4a70-80fd-03caef034b8e-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-rwqj5\" (UID: \"e62599e1-4578-4a70-80fd-03caef034b8e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rwqj5" Jun 15 01:42:26.652591 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:26.652397 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plh77\" (UniqueName: \"kubernetes.io/projected/e2a38d97-bb5c-499b-a908-91fa1d68f4d7-kube-api-access-plh77\") pod \"downloads-694c955b9-n4svk\" (UID: \"e2a38d97-bb5c-499b-a908-91fa1d68f4d7\") " pod="openshift-console/downloads-694c955b9-n4svk" Jun 15 01:42:26.731930 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:26.731877 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:26.753335 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:26.753297 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e62599e1-4578-4a70-80fd-03caef034b8e-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-rwqj5\" (UID: \"e62599e1-4578-4a70-80fd-03caef034b8e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rwqj5" Jun 15 01:42:26.753525 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:26.753341 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plh77\" (UniqueName: \"kubernetes.io/projected/e2a38d97-bb5c-499b-a908-91fa1d68f4d7-kube-api-access-plh77\") pod \"downloads-694c955b9-n4svk\" (UID: \"e2a38d97-bb5c-499b-a908-91fa1d68f4d7\") " pod="openshift-console/downloads-694c955b9-n4svk" Jun 15 01:42:26.756045 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:26.756020 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e62599e1-4578-4a70-80fd-03caef034b8e-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-rwqj5\" (UID: \"e62599e1-4578-4a70-80fd-03caef034b8e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rwqj5" Jun 15 01:42:26.765885 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:26.765860 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plh77\" (UniqueName: \"kubernetes.io/projected/e2a38d97-bb5c-499b-a908-91fa1d68f4d7-kube-api-access-plh77\") pod \"downloads-694c955b9-n4svk\" (UID: \"e2a38d97-bb5c-499b-a908-91fa1d68f4d7\") " pod="openshift-console/downloads-694c955b9-n4svk" Jun 15 01:42:26.830493 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:26.830423 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:26.889413 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:26.889386 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rwqj5" Jun 15 01:42:26.899967 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:26.899899 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-n4svk" Jun 15 01:42:26.929664 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:26.929620 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:27.035345 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:27.035313 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rwqj5"] Jun 15 01:42:27.038414 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:42:27.038384 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode62599e1_4578_4a70_80fd_03caef034b8e.slice/crio-281fd67b7d01687f501aa5a7a301a13ff6b80ecfe047a3715f8677832ea4c619 WatchSource:0}: Error finding container 281fd67b7d01687f501aa5a7a301a13ff6b80ecfe047a3715f8677832ea4c619: Status 404 returned error can't find the container with id 281fd67b7d01687f501aa5a7a301a13ff6b80ecfe047a3715f8677832ea4c619 Jun 15 01:42:27.051676 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:27.051653 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-n4svk"] Jun 15 01:42:27.056712 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:42:27.056689 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2a38d97_bb5c_499b_a908_91fa1d68f4d7.slice/crio-3f06149a832f6a826cf226b05cc91600a532d5b25421a3d09c25b6a9ed4e4e00 WatchSource:0}: Error finding container 3f06149a832f6a826cf226b05cc91600a532d5b25421a3d09c25b6a9ed4e4e00: Status 404 returned error can't find the container with id 3f06149a832f6a826cf226b05cc91600a532d5b25421a3d09c25b6a9ed4e4e00 Jun 15 01:42:27.074731 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:27.074707 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:27.137844 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:27.137818 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:27.279468 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:27.279436 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:27.281447 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:27.281417 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rwqj5" event={"ID":"e62599e1-4578-4a70-80fd-03caef034b8e","Type":"ContainerStarted","Data":"281fd67b7d01687f501aa5a7a301a13ff6b80ecfe047a3715f8677832ea4c619"} Jun 15 01:42:27.283347 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:27.283320 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l76dr" event={"ID":"1afa52ec-3fc6-4780-8da4-588b1ff7e8c8","Type":"ContainerStarted","Data":"4e30c68bd119fd727e450ec65e4da53ee6dad0e8e28b9f001aee7c5813603c04"} Jun 15 01:42:27.284372 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:27.284353 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-n4svk" event={"ID":"e2a38d97-bb5c-499b-a908-91fa1d68f4d7","Type":"ContainerStarted","Data":"3f06149a832f6a826cf226b05cc91600a532d5b25421a3d09c25b6a9ed4e4e00"} Jun 15 01:42:27.302015 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:27.301967 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l76dr" podStartSLOduration=16.769933761 podStartE2EDuration="22.30195131s" totalImagesPullingTime="5.532017549s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:42:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:27.300803573 +0000 UTC m=+243.159626231" watchObservedRunningTime="2026-06-15 01:42:27.30195131 +0000 UTC m=+243.160773977" Jun 15 01:42:27.471983 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:27.471901 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:27.627790 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:27.627756 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:28.289835 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:28.289792 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rwqj5" event={"ID":"e62599e1-4578-4a70-80fd-03caef034b8e","Type":"ContainerStarted","Data":"c75d415aa1747d0d873cf9323aebec89421195f57b709333418a61cf1a4aa295"} Jun 15 01:42:28.290263 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:28.289952 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rwqj5" Jun 15 01:42:28.291561 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:28.291530 2551 patch_prober.go:28] interesting pod/prometheus-operator-admission-webhook-5cf667749c-rwqj5 container/prometheus-operator-admission-webhook namespace/openshift-monitoring: Readiness probe status=failure output="Get \"https://10.132.0.15:8443/healthz\": dial tcp 10.132.0.15:8443: connect: connection refused" start-of-body= Jun 15 01:42:28.291702 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:28.291585 2551 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rwqj5" podUID="e62599e1-4578-4a70-80fd-03caef034b8e" containerName="prometheus-operator-admission-webhook" probeResult="failure" output="Get \"https://10.132.0.15:8443/healthz\": dial tcp 10.132.0.15:8443: connect: connection refused" Jun 15 01:42:28.304005 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:28.303954 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rwqj5" podStartSLOduration=1.141837532 podStartE2EDuration="2.303937527s" totalImagesPullingTime="1.162099995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:42:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:28.303519059 +0000 UTC m=+244.162341752" watchObservedRunningTime="2026-06-15 01:42:28.303937527 +0000 UTC m=+244.162760171" Jun 15 01:42:28.490305 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:28.490209 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:28.543029 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:28.542985 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:29.298005 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:29.297974 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rwqj5" Jun 15 01:42:30.065448 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:30.065393 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:30.102909 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:30.102875 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-swvv6"] Jun 15 01:42:30.106433 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:30.106413 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-swvv6" Jun 15 01:42:30.108485 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:30.108463 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-hp2ms\"" Jun 15 01:42:30.108485 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:30.108475 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 15 01:42:30.108669 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:30.108475 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 15 01:42:30.109128 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:30.109111 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 15 01:42:30.112687 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:30.112641 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-swvv6"] Jun 15 01:42:30.128383 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:30.128354 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:30.183617 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:30.183578 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/649b3814-bffa-4f87-9f11-3b647582aa21-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-swvv6\" (UID: \"649b3814-bffa-4f87-9f11-3b647582aa21\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-swvv6" Jun 15 01:42:30.183857 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:30.183712 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/649b3814-bffa-4f87-9f11-3b647582aa21-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-swvv6\" (UID: \"649b3814-bffa-4f87-9f11-3b647582aa21\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-swvv6" Jun 15 01:42:30.183857 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:30.183767 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/649b3814-bffa-4f87-9f11-3b647582aa21-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-swvv6\" (UID: \"649b3814-bffa-4f87-9f11-3b647582aa21\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-swvv6" Jun 15 01:42:30.183857 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:30.183794 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgk5s\" (UniqueName: \"kubernetes.io/projected/649b3814-bffa-4f87-9f11-3b647582aa21-kube-api-access-kgk5s\") pod \"prometheus-operator-864fcfc6f9-swvv6\" (UID: \"649b3814-bffa-4f87-9f11-3b647582aa21\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-swvv6" Jun 15 01:42:30.235489 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:30.235447 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:30.284674 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:30.284644 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/649b3814-bffa-4f87-9f11-3b647582aa21-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-swvv6\" (UID: \"649b3814-bffa-4f87-9f11-3b647582aa21\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-swvv6" Jun 15 01:42:30.284855 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:30.284682 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/649b3814-bffa-4f87-9f11-3b647582aa21-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-swvv6\" (UID: \"649b3814-bffa-4f87-9f11-3b647582aa21\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-swvv6" Jun 15 01:42:30.284855 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:30.284713 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgk5s\" (UniqueName: \"kubernetes.io/projected/649b3814-bffa-4f87-9f11-3b647582aa21-kube-api-access-kgk5s\") pod \"prometheus-operator-864fcfc6f9-swvv6\" (UID: \"649b3814-bffa-4f87-9f11-3b647582aa21\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-swvv6" Jun 15 01:42:30.284855 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:30.284755 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/649b3814-bffa-4f87-9f11-3b647582aa21-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-swvv6\" (UID: \"649b3814-bffa-4f87-9f11-3b647582aa21\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-swvv6" Jun 15 01:42:30.285491 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:30.285462 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/649b3814-bffa-4f87-9f11-3b647582aa21-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-swvv6\" (UID: \"649b3814-bffa-4f87-9f11-3b647582aa21\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-swvv6" Jun 15 01:42:30.287711 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:30.287688 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/649b3814-bffa-4f87-9f11-3b647582aa21-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-swvv6\" (UID: \"649b3814-bffa-4f87-9f11-3b647582aa21\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-swvv6" Jun 15 01:42:30.287808 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:30.287758 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/649b3814-bffa-4f87-9f11-3b647582aa21-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-swvv6\" (UID: \"649b3814-bffa-4f87-9f11-3b647582aa21\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-swvv6" Jun 15 01:42:30.291944 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:30.291914 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgk5s\" (UniqueName: \"kubernetes.io/projected/649b3814-bffa-4f87-9f11-3b647582aa21-kube-api-access-kgk5s\") pod \"prometheus-operator-864fcfc6f9-swvv6\" (UID: \"649b3814-bffa-4f87-9f11-3b647582aa21\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-swvv6" Jun 15 01:42:30.417998 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:30.417963 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-swvv6" Jun 15 01:42:30.562142 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:30.562086 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-swvv6"] Jun 15 01:42:30.565518 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:42:30.565482 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod649b3814_bffa_4f87_9f11_3b647582aa21.slice/crio-ccff0e9404541f17aa14aa645dffbad87f1aa8a556e1cf24636afcf64f4990d0 WatchSource:0}: Error finding container ccff0e9404541f17aa14aa645dffbad87f1aa8a556e1cf24636afcf64f4990d0: Status 404 returned error can't find the container with id ccff0e9404541f17aa14aa645dffbad87f1aa8a556e1cf24636afcf64f4990d0 Jun 15 01:42:30.825453 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:30.825373 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:30.925085 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:30.925057 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:31.303533 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:31.303493 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-swvv6" event={"ID":"649b3814-bffa-4f87-9f11-3b647582aa21","Type":"ContainerStarted","Data":"ccff0e9404541f17aa14aa645dffbad87f1aa8a556e1cf24636afcf64f4990d0"} Jun 15 01:42:32.259406 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:32.259315 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:32.309513 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:32.309470 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-swvv6" event={"ID":"649b3814-bffa-4f87-9f11-3b647582aa21","Type":"ContainerStarted","Data":"9e3b69465984d9910f420ccf2b4259daf87301acddb308aca785b7543370bb46"} Jun 15 01:42:32.309738 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:32.309533 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-swvv6" event={"ID":"649b3814-bffa-4f87-9f11-3b647582aa21","Type":"ContainerStarted","Data":"fc2cbbf133247db74ef7802d0f2e7abf632c1bf96c04cfdeb6fd4e74d3d7d4c1"} Jun 15 01:42:32.324020 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:32.323976 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-swvv6" podStartSLOduration=0.939724012 podStartE2EDuration="2.323959607s" totalImagesPullingTime="1.384235595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:42:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:32.322824516 +0000 UTC m=+248.181647182" watchObservedRunningTime="2026-06-15 01:42:32.323959607 +0000 UTC m=+248.182782276" Jun 15 01:42:34.208211 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.208179 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:34.422921 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.422887 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:34.459307 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.459227 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-lr5gd"] Jun 15 01:42:34.462922 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.462894 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-lr5gd" Jun 15 01:42:34.464878 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.464853 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 15 01:42:34.465078 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.465054 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 15 01:42:34.465254 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.465236 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-whmtk\"" Jun 15 01:42:34.471886 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.471853 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ks5fr"] Jun 15 01:42:34.475477 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.475437 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-lr5gd"] Jun 15 01:42:34.475599 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.475554 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ks5fr" Jun 15 01:42:34.477421 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.477400 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 15 01:42:34.477931 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.477739 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6684v\"" Jun 15 01:42:34.478035 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.478004 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 15 01:42:34.478095 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.478057 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 15 01:42:34.498502 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.498475 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:34.563153 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.563123 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:34.623496 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.623455 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5305acc3-ab90-4bb6-b909-90c6a8fe7bfa-root\") pod \"node-exporter-ks5fr\" (UID: \"5305acc3-ab90-4bb6-b909-90c6a8fe7bfa\") " pod="openshift-monitoring/node-exporter-ks5fr" Jun 15 01:42:34.623684 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.623536 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g6qp\" (UniqueName: \"kubernetes.io/projected/46fece98-78c1-4759-a3df-ddfeb9ca45aa-kube-api-access-9g6qp\") pod \"openshift-state-metrics-6b8d965dd5-lr5gd\" (UID: \"46fece98-78c1-4759-a3df-ddfeb9ca45aa\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-lr5gd" Jun 15 01:42:34.623684 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.623578 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5305acc3-ab90-4bb6-b909-90c6a8fe7bfa-node-exporter-wtmp\") pod \"node-exporter-ks5fr\" (UID: \"5305acc3-ab90-4bb6-b909-90c6a8fe7bfa\") " pod="openshift-monitoring/node-exporter-ks5fr" Jun 15 01:42:34.623684 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.623646 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5305acc3-ab90-4bb6-b909-90c6a8fe7bfa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ks5fr\" (UID: \"5305acc3-ab90-4bb6-b909-90c6a8fe7bfa\") " pod="openshift-monitoring/node-exporter-ks5fr" Jun 15 01:42:34.623847 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.623731 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46fece98-78c1-4759-a3df-ddfeb9ca45aa-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-lr5gd\" (UID: \"46fece98-78c1-4759-a3df-ddfeb9ca45aa\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-lr5gd" Jun 15 01:42:34.623847 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.623776 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5305acc3-ab90-4bb6-b909-90c6a8fe7bfa-node-exporter-tls\") pod \"node-exporter-ks5fr\" (UID: \"5305acc3-ab90-4bb6-b909-90c6a8fe7bfa\") " pod="openshift-monitoring/node-exporter-ks5fr" Jun 15 01:42:34.623847 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.623823 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5305acc3-ab90-4bb6-b909-90c6a8fe7bfa-node-exporter-textfile\") pod \"node-exporter-ks5fr\" (UID: \"5305acc3-ab90-4bb6-b909-90c6a8fe7bfa\") " pod="openshift-monitoring/node-exporter-ks5fr" Jun 15 01:42:34.623979 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.623853 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/46fece98-78c1-4759-a3df-ddfeb9ca45aa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-lr5gd\" (UID: \"46fece98-78c1-4759-a3df-ddfeb9ca45aa\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-lr5gd" Jun 15 01:42:34.623979 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.623916 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46fece98-78c1-4759-a3df-ddfeb9ca45aa-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-lr5gd\" (UID: \"46fece98-78c1-4759-a3df-ddfeb9ca45aa\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-lr5gd" Jun 15 01:42:34.624073 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.623975 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqhmb\" (UniqueName: \"kubernetes.io/projected/5305acc3-ab90-4bb6-b909-90c6a8fe7bfa-kube-api-access-hqhmb\") pod \"node-exporter-ks5fr\" (UID: \"5305acc3-ab90-4bb6-b909-90c6a8fe7bfa\") " pod="openshift-monitoring/node-exporter-ks5fr" Jun 15 01:42:34.624073 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.624011 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5305acc3-ab90-4bb6-b909-90c6a8fe7bfa-sys\") pod \"node-exporter-ks5fr\" (UID: \"5305acc3-ab90-4bb6-b909-90c6a8fe7bfa\") " pod="openshift-monitoring/node-exporter-ks5fr" Jun 15 01:42:34.624073 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.624052 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5305acc3-ab90-4bb6-b909-90c6a8fe7bfa-metrics-client-ca\") pod \"node-exporter-ks5fr\" (UID: \"5305acc3-ab90-4bb6-b909-90c6a8fe7bfa\") " pod="openshift-monitoring/node-exporter-ks5fr" Jun 15 01:42:34.624214 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.624075 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5305acc3-ab90-4bb6-b909-90c6a8fe7bfa-node-exporter-accelerators-collector-config\") pod \"node-exporter-ks5fr\" (UID: \"5305acc3-ab90-4bb6-b909-90c6a8fe7bfa\") " pod="openshift-monitoring/node-exporter-ks5fr" Jun 15 01:42:34.725262 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.725177 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g6qp\" (UniqueName: \"kubernetes.io/projected/46fece98-78c1-4759-a3df-ddfeb9ca45aa-kube-api-access-9g6qp\") pod \"openshift-state-metrics-6b8d965dd5-lr5gd\" (UID: \"46fece98-78c1-4759-a3df-ddfeb9ca45aa\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-lr5gd" Jun 15 01:42:34.725262 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.725240 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5305acc3-ab90-4bb6-b909-90c6a8fe7bfa-node-exporter-wtmp\") pod \"node-exporter-ks5fr\" (UID: \"5305acc3-ab90-4bb6-b909-90c6a8fe7bfa\") " pod="openshift-monitoring/node-exporter-ks5fr" Jun 15 01:42:34.725481 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.725294 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5305acc3-ab90-4bb6-b909-90c6a8fe7bfa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ks5fr\" (UID: \"5305acc3-ab90-4bb6-b909-90c6a8fe7bfa\") " pod="openshift-monitoring/node-exporter-ks5fr" Jun 15 01:42:34.725481 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.725330 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46fece98-78c1-4759-a3df-ddfeb9ca45aa-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-lr5gd\" (UID: \"46fece98-78c1-4759-a3df-ddfeb9ca45aa\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-lr5gd" Jun 15 01:42:34.725481 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.725361 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5305acc3-ab90-4bb6-b909-90c6a8fe7bfa-node-exporter-tls\") pod \"node-exporter-ks5fr\" (UID: \"5305acc3-ab90-4bb6-b909-90c6a8fe7bfa\") " pod="openshift-monitoring/node-exporter-ks5fr" Jun 15 01:42:34.725481 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.725386 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5305acc3-ab90-4bb6-b909-90c6a8fe7bfa-node-exporter-textfile\") pod \"node-exporter-ks5fr\" (UID: \"5305acc3-ab90-4bb6-b909-90c6a8fe7bfa\") " pod="openshift-monitoring/node-exporter-ks5fr" Jun 15 01:42:34.725481 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.725413 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/46fece98-78c1-4759-a3df-ddfeb9ca45aa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-lr5gd\" (UID: \"46fece98-78c1-4759-a3df-ddfeb9ca45aa\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-lr5gd" Jun 15 01:42:34.725481 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.725437 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46fece98-78c1-4759-a3df-ddfeb9ca45aa-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-lr5gd\" (UID: \"46fece98-78c1-4759-a3df-ddfeb9ca45aa\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-lr5gd" Jun 15 01:42:34.725481 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.725464 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5305acc3-ab90-4bb6-b909-90c6a8fe7bfa-node-exporter-wtmp\") pod \"node-exporter-ks5fr\" (UID: \"5305acc3-ab90-4bb6-b909-90c6a8fe7bfa\") " pod="openshift-monitoring/node-exporter-ks5fr" Jun 15 01:42:34.725831 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.725468 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqhmb\" (UniqueName: \"kubernetes.io/projected/5305acc3-ab90-4bb6-b909-90c6a8fe7bfa-kube-api-access-hqhmb\") pod \"node-exporter-ks5fr\" (UID: \"5305acc3-ab90-4bb6-b909-90c6a8fe7bfa\") " pod="openshift-monitoring/node-exporter-ks5fr" Jun 15 01:42:34.725831 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.725535 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5305acc3-ab90-4bb6-b909-90c6a8fe7bfa-sys\") pod \"node-exporter-ks5fr\" (UID: \"5305acc3-ab90-4bb6-b909-90c6a8fe7bfa\") " pod="openshift-monitoring/node-exporter-ks5fr" Jun 15 01:42:34.725831 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:34.725565 2551 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 15 01:42:34.725831 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.725578 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5305acc3-ab90-4bb6-b909-90c6a8fe7bfa-metrics-client-ca\") pod \"node-exporter-ks5fr\" (UID: \"5305acc3-ab90-4bb6-b909-90c6a8fe7bfa\") " pod="openshift-monitoring/node-exporter-ks5fr" Jun 15 01:42:34.725831 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.725609 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5305acc3-ab90-4bb6-b909-90c6a8fe7bfa-node-exporter-accelerators-collector-config\") pod \"node-exporter-ks5fr\" (UID: \"5305acc3-ab90-4bb6-b909-90c6a8fe7bfa\") " pod="openshift-monitoring/node-exporter-ks5fr" Jun 15 01:42:34.725831 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:34.725657 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46fece98-78c1-4759-a3df-ddfeb9ca45aa-openshift-state-metrics-tls podName:46fece98-78c1-4759-a3df-ddfeb9ca45aa nodeName:}" failed. No retries permitted until 2026-06-15 01:42:35.225621793 +0000 UTC m=+251.084444440 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/46fece98-78c1-4759-a3df-ddfeb9ca45aa-openshift-state-metrics-tls") pod "openshift-state-metrics-6b8d965dd5-lr5gd" (UID: "46fece98-78c1-4759-a3df-ddfeb9ca45aa") : secret "openshift-state-metrics-tls" not found Jun 15 01:42:34.725831 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.725710 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5305acc3-ab90-4bb6-b909-90c6a8fe7bfa-root\") pod \"node-exporter-ks5fr\" (UID: \"5305acc3-ab90-4bb6-b909-90c6a8fe7bfa\") " pod="openshift-monitoring/node-exporter-ks5fr" Jun 15 01:42:34.725831 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.725788 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5305acc3-ab90-4bb6-b909-90c6a8fe7bfa-root\") pod \"node-exporter-ks5fr\" (UID: \"5305acc3-ab90-4bb6-b909-90c6a8fe7bfa\") " pod="openshift-monitoring/node-exporter-ks5fr" Jun 15 01:42:34.725831 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:34.725565 2551 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 15 01:42:34.726255 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:42:34.725849 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5305acc3-ab90-4bb6-b909-90c6a8fe7bfa-node-exporter-tls podName:5305acc3-ab90-4bb6-b909-90c6a8fe7bfa nodeName:}" failed. No retries permitted until 2026-06-15 01:42:35.225837828 +0000 UTC m=+251.084660477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5305acc3-ab90-4bb6-b909-90c6a8fe7bfa-node-exporter-tls") pod "node-exporter-ks5fr" (UID: "5305acc3-ab90-4bb6-b909-90c6a8fe7bfa") : secret "node-exporter-tls" not found Jun 15 01:42:34.726255 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.725961 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5305acc3-ab90-4bb6-b909-90c6a8fe7bfa-sys\") pod \"node-exporter-ks5fr\" (UID: \"5305acc3-ab90-4bb6-b909-90c6a8fe7bfa\") " pod="openshift-monitoring/node-exporter-ks5fr" Jun 15 01:42:34.726255 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.726246 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5305acc3-ab90-4bb6-b909-90c6a8fe7bfa-node-exporter-accelerators-collector-config\") pod \"node-exporter-ks5fr\" (UID: \"5305acc3-ab90-4bb6-b909-90c6a8fe7bfa\") " pod="openshift-monitoring/node-exporter-ks5fr" Jun 15 01:42:34.726412 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.726341 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5305acc3-ab90-4bb6-b909-90c6a8fe7bfa-node-exporter-textfile\") pod \"node-exporter-ks5fr\" (UID: \"5305acc3-ab90-4bb6-b909-90c6a8fe7bfa\") " pod="openshift-monitoring/node-exporter-ks5fr" Jun 15 01:42:34.726535 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.726506 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5305acc3-ab90-4bb6-b909-90c6a8fe7bfa-metrics-client-ca\") pod \"node-exporter-ks5fr\" (UID: \"5305acc3-ab90-4bb6-b909-90c6a8fe7bfa\") " pod="openshift-monitoring/node-exporter-ks5fr" Jun 15 01:42:34.726535 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.726514 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46fece98-78c1-4759-a3df-ddfeb9ca45aa-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-lr5gd\" (UID: \"46fece98-78c1-4759-a3df-ddfeb9ca45aa\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-lr5gd" Jun 15 01:42:34.728440 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.728416 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5305acc3-ab90-4bb6-b909-90c6a8fe7bfa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ks5fr\" (UID: \"5305acc3-ab90-4bb6-b909-90c6a8fe7bfa\") " pod="openshift-monitoring/node-exporter-ks5fr" Jun 15 01:42:34.728523 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.728475 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46fece98-78c1-4759-a3df-ddfeb9ca45aa-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-lr5gd\" (UID: \"46fece98-78c1-4759-a3df-ddfeb9ca45aa\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-lr5gd" Jun 15 01:42:34.735756 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.735710 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqhmb\" (UniqueName: \"kubernetes.io/projected/5305acc3-ab90-4bb6-b909-90c6a8fe7bfa-kube-api-access-hqhmb\") pod \"node-exporter-ks5fr\" (UID: \"5305acc3-ab90-4bb6-b909-90c6a8fe7bfa\") " pod="openshift-monitoring/node-exporter-ks5fr" Jun 15 01:42:34.735860 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.735788 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g6qp\" (UniqueName: \"kubernetes.io/projected/46fece98-78c1-4759-a3df-ddfeb9ca45aa-kube-api-access-9g6qp\") pod \"openshift-state-metrics-6b8d965dd5-lr5gd\" (UID: \"46fece98-78c1-4759-a3df-ddfeb9ca45aa\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-lr5gd" Jun 15 01:42:34.753850 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.753826 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:34.853981 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.853946 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:34.955059 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:34.955027 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:35.209770 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:35.209713 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:35.230862 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:35.230835 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5305acc3-ab90-4bb6-b909-90c6a8fe7bfa-node-exporter-tls\") pod \"node-exporter-ks5fr\" (UID: \"5305acc3-ab90-4bb6-b909-90c6a8fe7bfa\") " pod="openshift-monitoring/node-exporter-ks5fr" Jun 15 01:42:35.231026 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:35.230882 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/46fece98-78c1-4759-a3df-ddfeb9ca45aa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-lr5gd\" (UID: \"46fece98-78c1-4759-a3df-ddfeb9ca45aa\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-lr5gd" Jun 15 01:42:35.233558 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:35.233533 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5305acc3-ab90-4bb6-b909-90c6a8fe7bfa-node-exporter-tls\") pod \"node-exporter-ks5fr\" (UID: \"5305acc3-ab90-4bb6-b909-90c6a8fe7bfa\") " pod="openshift-monitoring/node-exporter-ks5fr" Jun 15 01:42:35.233678 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:35.233612 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/46fece98-78c1-4759-a3df-ddfeb9ca45aa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-lr5gd\" (UID: \"46fece98-78c1-4759-a3df-ddfeb9ca45aa\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-lr5gd" Jun 15 01:42:35.374263 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:35.374232 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-lr5gd" Jun 15 01:42:35.387019 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:35.386927 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ks5fr" Jun 15 01:42:35.400684 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:42:35.400652 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5305acc3_ab90_4bb6_b909_90c6a8fe7bfa.slice/crio-23bffb965675178e95e789b8f6af23efc238864fccfbcd8e3346a6e36743e8c5 WatchSource:0}: Error finding container 23bffb965675178e95e789b8f6af23efc238864fccfbcd8e3346a6e36743e8c5: Status 404 returned error can't find the container with id 23bffb965675178e95e789b8f6af23efc238864fccfbcd8e3346a6e36743e8c5 Jun 15 01:42:35.429995 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:35.429960 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:35.517019 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:35.516988 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:35.535073 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:35.534676 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-lr5gd"] Jun 15 01:42:35.539059 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:42:35.539031 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46fece98_78c1_4759_a3df_ddfeb9ca45aa.slice/crio-b5dbb59f643065d41b1d9ef46d9e3737e1710c5308b99255c387bdc754e1bf6f WatchSource:0}: Error finding container b5dbb59f643065d41b1d9ef46d9e3737e1710c5308b99255c387bdc754e1bf6f: Status 404 returned error can't find the container with id b5dbb59f643065d41b1d9ef46d9e3737e1710c5308b99255c387bdc754e1bf6f Jun 15 01:42:35.809314 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:35.809232 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:36.327102 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.327069 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-lr5gd" event={"ID":"46fece98-78c1-4759-a3df-ddfeb9ca45aa","Type":"ContainerStarted","Data":"1cd99c28451b12fd5375eacee8440535a4d27306b3c028b538229bfffbd57445"} Jun 15 01:42:36.327548 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.327127 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-lr5gd" event={"ID":"46fece98-78c1-4759-a3df-ddfeb9ca45aa","Type":"ContainerStarted","Data":"06e5c3e526da3098f0a7ef9f7c60498f7df8463ed45c67e94ab0160732d2a997"} Jun 15 01:42:36.327548 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.327154 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-lr5gd" event={"ID":"46fece98-78c1-4759-a3df-ddfeb9ca45aa","Type":"ContainerStarted","Data":"b5dbb59f643065d41b1d9ef46d9e3737e1710c5308b99255c387bdc754e1bf6f"} Jun 15 01:42:36.328153 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.328127 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ks5fr" event={"ID":"5305acc3-ab90-4bb6-b909-90c6a8fe7bfa","Type":"ContainerStarted","Data":"23bffb965675178e95e789b8f6af23efc238864fccfbcd8e3346a6e36743e8c5"} Jun 15 01:42:36.433542 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.433505 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-696cd556cb-llhlm"] Jun 15 01:42:36.439578 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.439545 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" Jun 15 01:42:36.441645 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.441606 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 15 01:42:36.441775 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.441708 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 15 01:42:36.441868 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.441848 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-zqzqf\"" Jun 15 01:42:36.441955 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.441922 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3c35d53-b5a0-49e4-8964-61d18bbe5be1-metrics-certs\") pod \"network-metrics-daemon-r567p\" (UID: \"b3c35d53-b5a0-49e4-8964-61d18bbe5be1\") " pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:42:36.442081 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.441945 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 15 01:42:36.442169 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.442133 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bukkvjgsqrfj5\"" Jun 15 01:42:36.442256 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.442240 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 15 01:42:36.442358 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.442342 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 15 01:42:36.444710 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.444692 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3c35d53-b5a0-49e4-8964-61d18bbe5be1-metrics-certs\") pod \"network-metrics-daemon-r567p\" (UID: \"b3c35d53-b5a0-49e4-8964-61d18bbe5be1\") " pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:42:36.447405 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.447381 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-696cd556cb-llhlm"] Jun 15 01:42:36.542783 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.542746 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd9510da-43d5-4690-9c1a-094ad0d61156-metrics-client-ca\") pod \"thanos-querier-696cd556cb-llhlm\" (UID: \"bd9510da-43d5-4690-9c1a-094ad0d61156\") " pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" Jun 15 01:42:36.542783 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.542791 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bd9510da-43d5-4690-9c1a-094ad0d61156-secret-thanos-querier-tls\") pod \"thanos-querier-696cd556cb-llhlm\" (UID: \"bd9510da-43d5-4690-9c1a-094ad0d61156\") " pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" Jun 15 01:42:36.543028 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.542891 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd9510da-43d5-4690-9c1a-094ad0d61156-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-696cd556cb-llhlm\" (UID: \"bd9510da-43d5-4690-9c1a-094ad0d61156\") " pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" Jun 15 01:42:36.543028 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.542939 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd9510da-43d5-4690-9c1a-094ad0d61156-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-696cd556cb-llhlm\" (UID: \"bd9510da-43d5-4690-9c1a-094ad0d61156\") " pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" Jun 15 01:42:36.543028 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.542984 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szmdx\" (UniqueName: \"kubernetes.io/projected/bd9510da-43d5-4690-9c1a-094ad0d61156-kube-api-access-szmdx\") pod \"thanos-querier-696cd556cb-llhlm\" (UID: \"bd9510da-43d5-4690-9c1a-094ad0d61156\") " pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" Jun 15 01:42:36.543179 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.543039 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bd9510da-43d5-4690-9c1a-094ad0d61156-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-696cd556cb-llhlm\" (UID: \"bd9510da-43d5-4690-9c1a-094ad0d61156\") " pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" Jun 15 01:42:36.543179 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.543083 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bd9510da-43d5-4690-9c1a-094ad0d61156-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-696cd556cb-llhlm\" (UID: \"bd9510da-43d5-4690-9c1a-094ad0d61156\") " pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" Jun 15 01:42:36.543179 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.543116 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bd9510da-43d5-4690-9c1a-094ad0d61156-secret-grpc-tls\") pod \"thanos-querier-696cd556cb-llhlm\" (UID: \"bd9510da-43d5-4690-9c1a-094ad0d61156\") " pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" Jun 15 01:42:36.644338 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.644303 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-46p56\"" Jun 15 01:42:36.644522 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.644421 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd9510da-43d5-4690-9c1a-094ad0d61156-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-696cd556cb-llhlm\" (UID: \"bd9510da-43d5-4690-9c1a-094ad0d61156\") " pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" Jun 15 01:42:36.644522 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.644463 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd9510da-43d5-4690-9c1a-094ad0d61156-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-696cd556cb-llhlm\" (UID: \"bd9510da-43d5-4690-9c1a-094ad0d61156\") " pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" Jun 15 01:42:36.644522 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.644504 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szmdx\" (UniqueName: \"kubernetes.io/projected/bd9510da-43d5-4690-9c1a-094ad0d61156-kube-api-access-szmdx\") pod \"thanos-querier-696cd556cb-llhlm\" (UID: \"bd9510da-43d5-4690-9c1a-094ad0d61156\") " pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" Jun 15 01:42:36.644725 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.644533 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bd9510da-43d5-4690-9c1a-094ad0d61156-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-696cd556cb-llhlm\" (UID: \"bd9510da-43d5-4690-9c1a-094ad0d61156\") " pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" Jun 15 01:42:36.644725 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.644561 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bd9510da-43d5-4690-9c1a-094ad0d61156-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-696cd556cb-llhlm\" (UID: \"bd9510da-43d5-4690-9c1a-094ad0d61156\") " pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" Jun 15 01:42:36.644725 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.644590 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bd9510da-43d5-4690-9c1a-094ad0d61156-secret-grpc-tls\") pod \"thanos-querier-696cd556cb-llhlm\" (UID: \"bd9510da-43d5-4690-9c1a-094ad0d61156\") " pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" Jun 15 01:42:36.644725 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.644660 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd9510da-43d5-4690-9c1a-094ad0d61156-metrics-client-ca\") pod \"thanos-querier-696cd556cb-llhlm\" (UID: \"bd9510da-43d5-4690-9c1a-094ad0d61156\") " pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" Jun 15 01:42:36.644725 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.644699 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bd9510da-43d5-4690-9c1a-094ad0d61156-secret-thanos-querier-tls\") pod \"thanos-querier-696cd556cb-llhlm\" (UID: \"bd9510da-43d5-4690-9c1a-094ad0d61156\") " pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" Jun 15 01:42:36.645489 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.645431 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd9510da-43d5-4690-9c1a-094ad0d61156-metrics-client-ca\") pod \"thanos-querier-696cd556cb-llhlm\" (UID: \"bd9510da-43d5-4690-9c1a-094ad0d61156\") " pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" Jun 15 01:42:36.647569 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.647471 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd9510da-43d5-4690-9c1a-094ad0d61156-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-696cd556cb-llhlm\" (UID: \"bd9510da-43d5-4690-9c1a-094ad0d61156\") " pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" Jun 15 01:42:36.648081 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.647797 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bd9510da-43d5-4690-9c1a-094ad0d61156-secret-grpc-tls\") pod \"thanos-querier-696cd556cb-llhlm\" (UID: \"bd9510da-43d5-4690-9c1a-094ad0d61156\") " pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" Jun 15 01:42:36.648210 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.648190 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd9510da-43d5-4690-9c1a-094ad0d61156-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-696cd556cb-llhlm\" (UID: \"bd9510da-43d5-4690-9c1a-094ad0d61156\") " pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" Jun 15 01:42:36.648523 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.648500 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bd9510da-43d5-4690-9c1a-094ad0d61156-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-696cd556cb-llhlm\" (UID: \"bd9510da-43d5-4690-9c1a-094ad0d61156\") " pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" Jun 15 01:42:36.648614 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.648585 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bd9510da-43d5-4690-9c1a-094ad0d61156-secret-thanos-querier-tls\") pod \"thanos-querier-696cd556cb-llhlm\" (UID: \"bd9510da-43d5-4690-9c1a-094ad0d61156\") " pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" Jun 15 01:42:36.649426 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.649398 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bd9510da-43d5-4690-9c1a-094ad0d61156-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-696cd556cb-llhlm\" (UID: \"bd9510da-43d5-4690-9c1a-094ad0d61156\") " pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" Jun 15 01:42:36.651780 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.651755 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szmdx\" (UniqueName: \"kubernetes.io/projected/bd9510da-43d5-4690-9c1a-094ad0d61156-kube-api-access-szmdx\") pod \"thanos-querier-696cd556cb-llhlm\" (UID: \"bd9510da-43d5-4690-9c1a-094ad0d61156\") " pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" Jun 15 01:42:36.652331 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.652302 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r567p" Jun 15 01:42:36.760051 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:36.760012 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" Jun 15 01:42:37.368759 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:37.368725 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:37.469643 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:37.469604 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:37.517083 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:37.517051 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:37.859049 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:37.859012 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:39.232069 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:39.232030 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:39.292290 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:39.292251 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:39.908405 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:39.908360 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:40.009027 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.008991 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:40.635310 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.635227 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:40.640974 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.640950 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 01:42:40.645544 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.645108 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.648477 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.648266 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 15 01:42:40.648477 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.648311 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vwtxp\"" Jun 15 01:42:40.648477 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.648266 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 15 01:42:40.648752 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.648558 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 15 01:42:40.648752 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.648598 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 15 01:42:40.649157 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.648929 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 15 01:42:40.649157 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.649084 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 15 01:42:40.649157 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.649145 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-d4v3gajtpm17q\"" Jun 15 01:42:40.649371 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.649233 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 15 01:42:40.649371 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.649311 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 15 01:42:40.649371 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.649334 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 15 01:42:40.649592 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.649552 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 15 01:42:40.649592 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.649575 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 15 01:42:40.649745 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.649688 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 15 01:42:40.649999 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.649981 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 15 01:42:40.651544 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.651525 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 15 01:42:40.663258 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.663233 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 01:42:40.668111 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.668088 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 15 01:42:40.780080 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.780042 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.780356 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.780101 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.780356 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.780167 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.780356 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.780225 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-web-config\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.780356 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.780281 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.780356 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.780340 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/24ec9819-4f93-4dc4-b203-684abb590a14-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.780646 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.780387 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.780646 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.780416 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-config\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.780646 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.780435 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.780646 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.780459 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.780646 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.780535 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.780646 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.780565 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.780646 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.780640 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24ec9819-4f93-4dc4-b203-684abb590a14-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.780979 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.780669 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.780979 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.780694 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.780979 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.780718 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.780979 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.780755 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.780979 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.780771 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7llj4\" (UniqueName: \"kubernetes.io/projected/24ec9819-4f93-4dc4-b203-684abb590a14-kube-api-access-7llj4\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.780979 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.780837 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24ec9819-4f93-4dc4-b203-684abb590a14-config-out\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.780979 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.780859 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.881532 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.881490 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24ec9819-4f93-4dc4-b203-684abb590a14-config-out\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.881532 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.881536 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.881799 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.881564 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.881799 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.881592 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.881799 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.881656 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.881799 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.881678 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-web-config\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.881799 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.881709 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.881799 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.881738 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/24ec9819-4f93-4dc4-b203-684abb590a14-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.881799 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.881772 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.881799 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.881798 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-config\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.882195 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.881820 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.882195 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.881843 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.882195 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.881887 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.882195 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.881908 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.882195 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.881936 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24ec9819-4f93-4dc4-b203-684abb590a14-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.882195 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.881956 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.882195 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.881985 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.882195 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.882010 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.882195 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.882042 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.882195 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.882067 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7llj4\" (UniqueName: \"kubernetes.io/projected/24ec9819-4f93-4dc4-b203-684abb590a14-kube-api-access-7llj4\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.882725 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.882404 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.882725 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.882716 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.882871 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.882840 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.883395 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.883079 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.883395 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.883133 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/24ec9819-4f93-4dc4-b203-684abb590a14-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.886126 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.886063 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.886126 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.886083 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.886957 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.886607 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24ec9819-4f93-4dc4-b203-684abb590a14-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.886957 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.886743 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.888870 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.888524 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-web-config\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.888870 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.888667 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.888870 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.888798 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.888870 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.888810 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24ec9819-4f93-4dc4-b203-684abb590a14-config-out\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.888870 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.888827 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.889457 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.889437 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.890036 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.889918 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.890036 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.889930 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.890395 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.890350 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-config\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.891106 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.891081 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.891950 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.891920 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7llj4\" (UniqueName: \"kubernetes.io/projected/24ec9819-4f93-4dc4-b203-684abb590a14-kube-api-access-7llj4\") pod \"prometheus-k8s-0\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:40.964140 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:40.964103 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:42.898763 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:42.898718 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:43.000416 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:43.000381 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:43.904485 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:43.904449 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r567p"] Jun 15 01:42:43.928967 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:43.928929 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-696cd556cb-llhlm"] Jun 15 01:42:43.930603 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:42:43.930581 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd9510da_43d5_4690_9c1a_094ad0d61156.slice/crio-e84a438270803467e409e7a476a8969b46d5aa1d161afbb673b23de3b1b0fc86 WatchSource:0}: Error finding container e84a438270803467e409e7a476a8969b46d5aa1d161afbb673b23de3b1b0fc86: Status 404 returned error can't find the container with id e84a438270803467e409e7a476a8969b46d5aa1d161afbb673b23de3b1b0fc86 Jun 15 01:42:43.944902 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:43.944877 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 01:42:43.994786 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:42:43.994742 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24ec9819_4f93_4dc4_b203_684abb590a14.slice/crio-b680e510ebe11966c85993cf17da5739c98316a71b328aec2e6b2e43bfb0f201 WatchSource:0}: Error finding container b680e510ebe11966c85993cf17da5739c98316a71b328aec2e6b2e43bfb0f201: Status 404 returned error can't find the container with id b680e510ebe11966c85993cf17da5739c98316a71b328aec2e6b2e43bfb0f201 Jun 15 01:42:44.368981 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:44.368941 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-n4svk" event={"ID":"e2a38d97-bb5c-499b-a908-91fa1d68f4d7","Type":"ContainerStarted","Data":"5a94ab33817435539e411906748e52b0a32dbbaed3401e25e2719362b16b600d"} Jun 15 01:42:44.370529 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:44.370503 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-n4svk" Jun 15 01:42:44.372807 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:44.372781 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" event={"ID":"bd9510da-43d5-4690-9c1a-094ad0d61156","Type":"ContainerStarted","Data":"e84a438270803467e409e7a476a8969b46d5aa1d161afbb673b23de3b1b0fc86"} Jun 15 01:42:44.375079 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:44.375043 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24ec9819-4f93-4dc4-b203-684abb590a14","Type":"ContainerStarted","Data":"b680e510ebe11966c85993cf17da5739c98316a71b328aec2e6b2e43bfb0f201"} Jun 15 01:42:44.385806 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:44.385780 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-n4svk" Jun 15 01:42:44.388255 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:44.388220 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-lr5gd" event={"ID":"46fece98-78c1-4759-a3df-ddfeb9ca45aa","Type":"ContainerStarted","Data":"856b8e142a72e1c315bf439945f38c5e58c6580f6eb1fa9b515f07c0d36bd413"} Jun 15 01:42:44.392715 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:44.392658 2551 generic.go:356] "Generic (PLEG): container finished" podID="5305acc3-ab90-4bb6-b909-90c6a8fe7bfa" containerID="201859297ff4356271a6c2d8b69195ec59bebe87f12e624809fd9992ef2d0493" exitCode=0 Jun 15 01:42:44.392823 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:44.392758 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ks5fr" event={"ID":"5305acc3-ab90-4bb6-b909-90c6a8fe7bfa","Type":"ContainerDied","Data":"201859297ff4356271a6c2d8b69195ec59bebe87f12e624809fd9992ef2d0493"} Jun 15 01:42:44.395725 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:44.395622 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r567p" event={"ID":"b3c35d53-b5a0-49e4-8964-61d18bbe5be1","Type":"ContainerStarted","Data":"3441939f5fcfc4d33b57921273c0eb35fdc54884afb59118d6bb41545fd3d1c2"} Jun 15 01:42:44.403579 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:44.403332 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-n4svk" podStartSLOduration=1.675586035 podStartE2EDuration="18.403314283s" totalImagesPullingTime="16.727728248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:42:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:44.384830488 +0000 UTC m=+260.243653156" watchObservedRunningTime="2026-06-15 01:42:44.403314283 +0000 UTC m=+260.262136951" Jun 15 01:42:44.439158 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:44.438858 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-lr5gd" podStartSLOduration=2.384907376 podStartE2EDuration="10.438835462s" totalImagesPullingTime="8.053928086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:42:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:44.436409409 +0000 UTC m=+260.295232090" watchObservedRunningTime="2026-06-15 01:42:44.438835462 +0000 UTC m=+260.297658130" Jun 15 01:42:45.404754 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:45.404715 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ks5fr" event={"ID":"5305acc3-ab90-4bb6-b909-90c6a8fe7bfa","Type":"ContainerStarted","Data":"f8ec0cb664f9196ea8ffc7abea20b149c55047a6e3259efca6707be643ac4991"} Jun 15 01:42:45.405360 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:45.404779 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ks5fr" event={"ID":"5305acc3-ab90-4bb6-b909-90c6a8fe7bfa","Type":"ContainerStarted","Data":"16f91dfbd0bb62893d167f9ebf0b92803bbff8b08e32567f392b1a4f616e162e"} Jun 15 01:42:45.425684 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:45.425486 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ks5fr" podStartSLOduration=3.014872843 podStartE2EDuration="11.425452325s" totalImagesPullingTime="8.322784258s" totalInitContainerRuntime="87.795224ms" isStatefulPod=true podCreationTimestamp="2026-06-15 01:42:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:45.423888928 +0000 UTC m=+261.282711597" watchObservedRunningTime="2026-06-15 01:42:45.425452325 +0000 UTC m=+261.284274987" Jun 15 01:42:47.421912 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:47.421712 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24ec9819-4f93-4dc4-b203-684abb590a14","Type":"ContainerStarted","Data":"d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6"} Jun 15 01:42:47.423442 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:47.423418 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r567p" event={"ID":"b3c35d53-b5a0-49e4-8964-61d18bbe5be1","Type":"ContainerStarted","Data":"709a1c83a13dce4050512e920f761cf108dd1afea73b9e8e0609ff160ab03bce"} Jun 15 01:42:48.116032 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:48.115997 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:48.170868 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:48.170825 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:48.431935 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:48.431807 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r567p" event={"ID":"b3c35d53-b5a0-49e4-8964-61d18bbe5be1","Type":"ContainerStarted","Data":"f7fec3b58f7ebf6c4c5f5dd256deeebee59009caf2ddfa98917d4c44df00e9e2"} Jun 15 01:42:48.434996 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:48.434964 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" event={"ID":"bd9510da-43d5-4690-9c1a-094ad0d61156","Type":"ContainerStarted","Data":"f9525d5a5ae5399a26d995bbff9695cfb545a387190ab92a965cbf05d9030c7a"} Jun 15 01:42:48.435128 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:48.435029 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" event={"ID":"bd9510da-43d5-4690-9c1a-094ad0d61156","Type":"ContainerStarted","Data":"74ae035fdfb58c0bdd1283568439abab6f750121065e6cd7674709716479379b"} Jun 15 01:42:48.435128 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:48.435069 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" event={"ID":"bd9510da-43d5-4690-9c1a-094ad0d61156","Type":"ContainerStarted","Data":"5f9ab203fa78516916ff156bbaac87632425956561b59ff9ba1133541c725dde"} Jun 15 01:42:48.437310 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:48.437283 2551 generic.go:356] "Generic (PLEG): container finished" podID="24ec9819-4f93-4dc4-b203-684abb590a14" containerID="d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6" exitCode=0 Jun 15 01:42:48.437422 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:48.437329 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24ec9819-4f93-4dc4-b203-684abb590a14","Type":"ContainerDied","Data":"d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6"} Jun 15 01:42:48.447854 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:48.447802 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-r567p" podStartSLOduration=261.115536658 podStartE2EDuration="4m24.447783787s" totalImagesPullingTime="3.332247129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:38:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:48.445859802 +0000 UTC m=+264.304682472" watchObservedRunningTime="2026-06-15 01:42:48.447783787 +0000 UTC m=+264.306606456" Jun 15 01:42:48.541835 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:48.541802 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:48.598945 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:48.598908 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:48.701434 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:48.701340 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:48.752108 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:48.752076 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:49.447655 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:49.447280 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" event={"ID":"bd9510da-43d5-4690-9c1a-094ad0d61156","Type":"ContainerStarted","Data":"fc8b562c3582bcff310c4e2e785b7b06794524aa1d37621411e99478a0b4baf2"} Jun 15 01:42:49.447655 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:49.447361 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" event={"ID":"bd9510da-43d5-4690-9c1a-094ad0d61156","Type":"ContainerStarted","Data":"de6b1cf28edf6278f4e4fc33db749cbad225ff76b3d18dd4c9d5dad21d311ce5"} Jun 15 01:42:49.447655 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:49.447406 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" event={"ID":"bd9510da-43d5-4690-9c1a-094ad0d61156","Type":"ContainerStarted","Data":"0e76eac4636c90ff634b040b658e8c0b74030e4c0745f47f2a768333d1b6d21c"} Jun 15 01:42:49.472616 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:49.472509 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" podStartSLOduration=8.959118867 podStartE2EDuration="13.472468509s" totalImagesPullingTime="4.513349642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:42:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:49.46699335 +0000 UTC m=+265.325816018" watchObservedRunningTime="2026-06-15 01:42:49.472468509 +0000 UTC m=+265.331291187" Jun 15 01:42:50.453257 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:50.453221 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" Jun 15 01:42:53.470591 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:53.470502 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24ec9819-4f93-4dc4-b203-684abb590a14","Type":"ContainerStarted","Data":"93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5"} Jun 15 01:42:53.470591 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:53.470579 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24ec9819-4f93-4dc4-b203-684abb590a14","Type":"ContainerStarted","Data":"619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea"} Jun 15 01:42:53.471047 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:53.470619 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24ec9819-4f93-4dc4-b203-684abb590a14","Type":"ContainerStarted","Data":"96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a"} Jun 15 01:42:53.471047 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:53.470681 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24ec9819-4f93-4dc4-b203-684abb590a14","Type":"ContainerStarted","Data":"0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e"} Jun 15 01:42:53.471047 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:53.470721 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24ec9819-4f93-4dc4-b203-684abb590a14","Type":"ContainerStarted","Data":"2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d"} Jun 15 01:42:53.471047 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:53.470765 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24ec9819-4f93-4dc4-b203-684abb590a14","Type":"ContainerStarted","Data":"23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f"} Jun 15 01:42:53.497471 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:53.497417 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.26104343 podStartE2EDuration="13.497401943s" totalImagesPullingTime="7.22175311s" totalInitContainerRuntime="14.605403ms" isStatefulPod=false podCreationTimestamp="2026-06-15 01:42:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:53.495208451 +0000 UTC m=+269.354031118" watchObservedRunningTime="2026-06-15 01:42:53.497401943 +0000 UTC m=+269.356224634" Jun 15 01:42:55.964505 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:55.964469 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:42:55.995572 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:55.995540 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:56.096505 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:56.096469 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:56.464849 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:56.464822 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-696cd556cb-llhlm" Jun 15 01:42:58.472338 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:58.472301 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:42:58.528644 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:42:58.528593 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:05.731286 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:05.731230 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:05.785269 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:05.785237 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:07.037709 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:43:07.037663 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qqxsf" podUID="0c44f922-cd2d-42e8-99c5-445dae30b40b" Jun 15 01:43:07.037709 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:43:07.037683 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" podUID="317fa362-6021-4fc1-8d2c-f18e70ecb41d" Jun 15 01:43:07.526971 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:07.526940 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:43:07.526971 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:07.526966 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qqxsf" Jun 15 01:43:10.054781 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:10.054739 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-tls\") pod \"image-registry-bfd57b8b7-zh79v\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:43:10.057071 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:10.057045 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-tls\") pod \"image-registry-bfd57b8b7-zh79v\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:43:10.156146 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:10.156117 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c44f922-cd2d-42e8-99c5-445dae30b40b-metrics-tls\") pod \"dns-default-qqxsf\" (UID: \"0c44f922-cd2d-42e8-99c5-445dae30b40b\") " pod="openshift-dns/dns-default-qqxsf" Jun 15 01:43:10.158254 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:10.158232 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c44f922-cd2d-42e8-99c5-445dae30b40b-metrics-tls\") pod \"dns-default-qqxsf\" (UID: \"0c44f922-cd2d-42e8-99c5-445dae30b40b\") " pod="openshift-dns/dns-default-qqxsf" Jun 15 01:43:10.230789 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:10.230763 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-55pqm\"" Jun 15 01:43:10.230931 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:10.230765 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vq2mt\"" Jun 15 01:43:10.238391 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:10.238368 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qqxsf" Jun 15 01:43:10.238480 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:10.238448 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:43:10.386959 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:10.386935 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bfd57b8b7-zh79v"] Jun 15 01:43:10.389697 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:43:10.389656 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod317fa362_6021_4fc1_8d2c_f18e70ecb41d.slice/crio-d1010f78141fa2f36ef479150887c868c29953a64006e65cba02f44ad78f7016 WatchSource:0}: Error finding container d1010f78141fa2f36ef479150887c868c29953a64006e65cba02f44ad78f7016: Status 404 returned error can't find the container with id d1010f78141fa2f36ef479150887c868c29953a64006e65cba02f44ad78f7016 Jun 15 01:43:10.397403 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:10.397380 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qqxsf"] Jun 15 01:43:10.401594 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:43:10.401571 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c44f922_cd2d_42e8_99c5_445dae30b40b.slice/crio-fa3a219db2f1f7082961e78f11b07e153ca4fd16dca51e2fbead96407c3c141d WatchSource:0}: Error finding container fa3a219db2f1f7082961e78f11b07e153ca4fd16dca51e2fbead96407c3c141d: Status 404 returned error can't find the container with id fa3a219db2f1f7082961e78f11b07e153ca4fd16dca51e2fbead96407c3c141d Jun 15 01:43:10.545615 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:10.545584 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qqxsf" event={"ID":"0c44f922-cd2d-42e8-99c5-445dae30b40b","Type":"ContainerStarted","Data":"fa3a219db2f1f7082961e78f11b07e153ca4fd16dca51e2fbead96407c3c141d"} Jun 15 01:43:10.545776 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:10.545647 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" event={"ID":"317fa362-6021-4fc1-8d2c-f18e70ecb41d","Type":"ContainerStarted","Data":"6a5941f7ba49da1495788dcd4126eaa22d3bb9f2d7e32753484945e84fde2424"} Jun 15 01:43:10.545776 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:10.545671 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" event={"ID":"317fa362-6021-4fc1-8d2c-f18e70ecb41d","Type":"ContainerStarted","Data":"d1010f78141fa2f36ef479150887c868c29953a64006e65cba02f44ad78f7016"} Jun 15 01:43:10.545776 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:10.545689 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:43:10.562808 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:10.562763 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" podStartSLOduration=264.562748053 podStartE2EDuration="4m24.562748053s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:38:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:43:10.562060953 +0000 UTC m=+286.420883624" watchObservedRunningTime="2026-06-15 01:43:10.562748053 +0000 UTC m=+286.421570720" Jun 15 01:43:12.554314 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:12.554231 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qqxsf" event={"ID":"0c44f922-cd2d-42e8-99c5-445dae30b40b","Type":"ContainerStarted","Data":"03a7819e86ab28ffbdca1e67db3194bb8a0794e9b90b917576b1da07a2149ed6"} Jun 15 01:43:12.554314 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:12.554277 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qqxsf" event={"ID":"0c44f922-cd2d-42e8-99c5-445dae30b40b","Type":"ContainerStarted","Data":"c8a82a24a28b4f12df3a7b898ce0cc9bda0027d7565050d7fad6e6e4c6277222"} Jun 15 01:43:12.554314 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:12.554302 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qqxsf" Jun 15 01:43:12.572381 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:12.572339 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qqxsf" podStartSLOduration=251.119892642 podStartE2EDuration="4m12.572324152s" totalImagesPullingTime="1.45243151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:39:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:43:12.570446509 +0000 UTC m=+288.429269180" watchObservedRunningTime="2026-06-15 01:43:12.572324152 +0000 UTC m=+288.431146818" Jun 15 01:43:14.569249 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:14.569218 2551 generic.go:356] "Generic (PLEG): container finished" podID="6094a811-09ad-44ff-93b1-dc8fb2b7e706" containerID="2f754655db124861d4629e18d395b6c487e853848389f8e6bbfecd1c7142c05e" exitCode=0 Jun 15 01:43:14.569585 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:14.569257 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-9lwgr" event={"ID":"6094a811-09ad-44ff-93b1-dc8fb2b7e706","Type":"ContainerDied","Data":"2f754655db124861d4629e18d395b6c487e853848389f8e6bbfecd1c7142c05e"} Jun 15 01:43:14.569585 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:14.569550 2551 scope.go:117] "RemoveContainer" containerID="2f754655db124861d4629e18d395b6c487e853848389f8e6bbfecd1c7142c05e" Jun 15 01:43:15.378774 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:15.378741 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:15.429555 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:15.429526 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:15.575882 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:15.575854 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-9lwgr" event={"ID":"6094a811-09ad-44ff-93b1-dc8fb2b7e706","Type":"ContainerStarted","Data":"80e947a971ac06e05e8836e9e1c61f252fb54fab726e873de83c3a27ae49b593"} Jun 15 01:43:15.822709 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:15.822612 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:15.875987 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:15.875955 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:18.684943 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:18.684912 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-4rz9m_8f5cec08-fb70-4116-83fb-a9a5f04b93da/cluster-monitoring-operator/0.log" Jun 15 01:43:20.483022 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:20.482990 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ks5fr_5305acc3-ab90-4bb6-b909-90c6a8fe7bfa/init-textfile/0.log" Jun 15 01:43:20.683946 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:20.683902 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ks5fr_5305acc3-ab90-4bb6-b909-90c6a8fe7bfa/node-exporter/0.log" Jun 15 01:43:20.882692 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:20.882662 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ks5fr_5305acc3-ab90-4bb6-b909-90c6a8fe7bfa/kube-rbac-proxy/0.log" Jun 15 01:43:21.683209 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:21.683178 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-lr5gd_46fece98-78c1-4759-a3df-ddfeb9ca45aa/kube-rbac-proxy-main/0.log" Jun 15 01:43:21.882876 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:21.882840 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-lr5gd_46fece98-78c1-4759-a3df-ddfeb9ca45aa/kube-rbac-proxy-self/0.log" Jun 15 01:43:22.083146 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:22.083071 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-lr5gd_46fece98-78c1-4759-a3df-ddfeb9ca45aa/openshift-state-metrics/0.log" Jun 15 01:43:22.282805 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:22.282778 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24ec9819-4f93-4dc4-b203-684abb590a14/init-config-reloader/0.log" Jun 15 01:43:22.484184 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:22.484157 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24ec9819-4f93-4dc4-b203-684abb590a14/prometheus/0.log" Jun 15 01:43:22.566939 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:22.566915 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qqxsf" Jun 15 01:43:22.683296 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:22.683271 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24ec9819-4f93-4dc4-b203-684abb590a14/config-reloader/0.log" Jun 15 01:43:22.883295 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:22.883270 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24ec9819-4f93-4dc4-b203-684abb590a14/thanos-sidecar/0.log" Jun 15 01:43:23.082996 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:23.082966 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24ec9819-4f93-4dc4-b203-684abb590a14/kube-rbac-proxy-web/0.log" Jun 15 01:43:23.283075 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:23.283001 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24ec9819-4f93-4dc4-b203-684abb590a14/kube-rbac-proxy/0.log" Jun 15 01:43:23.483377 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:23.483349 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24ec9819-4f93-4dc4-b203-684abb590a14/kube-rbac-proxy-thanos/0.log" Jun 15 01:43:23.684834 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:23.684807 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-swvv6_649b3814-bffa-4f87-9f11-3b647582aa21/prometheus-operator/0.log" Jun 15 01:43:23.882784 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:23.882756 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-swvv6_649b3814-bffa-4f87-9f11-3b647582aa21/kube-rbac-proxy/0.log" Jun 15 01:43:24.082796 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:24.082727 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-rwqj5_e62599e1-4578-4a70-80fd-03caef034b8e/prometheus-operator-admission-webhook/0.log" Jun 15 01:43:24.506685 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:24.506657 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c2jms_63f8819b-4ac8-42d2-a662-78721cf2548f/ovn-acl-logging/0.log" Jun 15 01:43:24.508619 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:24.508599 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c2jms_63f8819b-4ac8-42d2-a662-78721cf2548f/ovn-acl-logging/0.log" Jun 15 01:43:24.510619 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:24.510600 2551 kubelet.go:1648] "Image garbage collection succeeded" Jun 15 01:43:24.882697 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:24.882669 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-696cd556cb-llhlm_bd9510da-43d5-4690-9c1a-094ad0d61156/thanos-query/0.log" Jun 15 01:43:24.928059 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:24.928025 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:25.083196 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:25.083165 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-696cd556cb-llhlm_bd9510da-43d5-4690-9c1a-094ad0d61156/kube-rbac-proxy-web/0.log" Jun 15 01:43:25.282498 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:25.282431 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-696cd556cb-llhlm_bd9510da-43d5-4690-9c1a-094ad0d61156/kube-rbac-proxy/0.log" Jun 15 01:43:25.482971 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:25.482943 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-696cd556cb-llhlm_bd9510da-43d5-4690-9c1a-094ad0d61156/prom-label-proxy/0.log" Jun 15 01:43:25.684031 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:25.684007 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-696cd556cb-llhlm_bd9510da-43d5-4690-9c1a-094ad0d61156/kube-rbac-proxy-rules/0.log" Jun 15 01:43:25.884029 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:25.883999 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-696cd556cb-llhlm_bd9510da-43d5-4690-9c1a-094ad0d61156/kube-rbac-proxy-metrics/0.log" Jun 15 01:43:27.284960 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:27.284936 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-n4svk_e2a38d97-bb5c-499b-a908-91fa1d68f4d7/download-server/0.log" Jun 15 01:43:28.283057 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:28.283033 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qqxsf_0c44f922-cd2d-42e8-99c5-445dae30b40b/dns/0.log" Jun 15 01:43:28.483270 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:28.483247 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qqxsf_0c44f922-cd2d-42e8-99c5-445dae30b40b/kube-rbac-proxy/0.log" Jun 15 01:43:28.684171 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:28.684140 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jm8jk_8110134b-d73a-422f-88ca-b6eec684189d/dns-node-resolver/0.log" Jun 15 01:43:29.483404 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:29.483375 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-bfd57b8b7-zh79v_317fa362-6021-4fc1-8d2c-f18e70ecb41d/registry/0.log" Jun 15 01:43:29.634242 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:29.634163 2551 generic.go:356] "Generic (PLEG): container finished" podID="a87d8d2f-e694-40c2-8f7e-9bb66c8db7d6" containerID="6874f30e45ee1228cd450cf652f0f312c045f4e9d2223939209aa6f9f0883147" exitCode=0 Jun 15 01:43:29.634242 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:29.634219 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lgp8k" event={"ID":"a87d8d2f-e694-40c2-8f7e-9bb66c8db7d6","Type":"ContainerDied","Data":"6874f30e45ee1228cd450cf652f0f312c045f4e9d2223939209aa6f9f0883147"} Jun 15 01:43:29.634520 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:29.634507 2551 scope.go:117] "RemoveContainer" containerID="6874f30e45ee1228cd450cf652f0f312c045f4e9d2223939209aa6f9f0883147" Jun 15 01:43:29.883137 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:29.883108 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w97rl_81f80853-3308-4f3a-9cb4-83ce4fb00055/node-ca/0.log" Jun 15 01:43:30.242587 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:30.242555 2551 patch_prober.go:28] interesting pod/image-registry-bfd57b8b7-zh79v container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 15 01:43:30.242771 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:30.242608 2551 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" podUID="317fa362-6021-4fc1-8d2c-f18e70ecb41d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 01:43:30.483142 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:30.483114 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-27cht_2f463e3d-ebaf-481f-9eed-c2c150aca07b/serve-healthcheck-canary/0.log" Jun 15 01:43:30.639289 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:30.639259 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lgp8k" event={"ID":"a87d8d2f-e694-40c2-8f7e-9bb66c8db7d6","Type":"ContainerStarted","Data":"7f37dd076d6796bfc379c37bac8275d643995cb024e970a5ffc6fb0caf294851"} Jun 15 01:43:31.553422 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:31.553389 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:43:31.555880 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:31.555851 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:32.682276 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:32.682242 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:37.411036 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:37.411000 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:37.459440 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:37.459413 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:37.511918 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:37.511894 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:40.964518 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:40.964470 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:40.983207 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:40.983185 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:41.706107 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:41.706075 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:41.942541 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:41.942505 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:42.042717 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:42.042641 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:45.826937 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:45.826901 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:45.928726 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:45.928693 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:49.176210 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:49.176179 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:49.224994 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:49.224960 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:50.505459 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:50.505423 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:50.605335 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:50.605308 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:51.014745 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:51.014715 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:51.116896 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:51.116867 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:51.372141 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:51.372111 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:51.425210 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:51.425185 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:51.507037 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:51.507014 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:51.608752 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:51.608724 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:52.109001 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:52.108967 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:52.160962 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:52.160930 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:54.573071 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:54.573038 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-bfd57b8b7-zh79v"] Jun 15 01:43:54.643525 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:54.643485 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:54.754023 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:54.753988 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:54.841693 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:54.841592 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:54.950149 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:54.950112 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:58.144801 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:58.144755 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:58.246156 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:58.246123 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:43:58.982677 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:58.982618 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 01:43:58.983042 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:58.983004 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="24ec9819-4f93-4dc4-b203-684abb590a14" containerName="thanos-sidecar" containerID="cri-o://0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e" gracePeriod=600 Jun 15 01:43:58.983199 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:58.983021 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="24ec9819-4f93-4dc4-b203-684abb590a14" containerName="kube-rbac-proxy-thanos" containerID="cri-o://93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5" gracePeriod=600 Jun 15 01:43:58.983199 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:58.983043 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="24ec9819-4f93-4dc4-b203-684abb590a14" containerName="config-reloader" containerID="cri-o://2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d" gracePeriod=600 Jun 15 01:43:58.983199 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:58.983004 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="24ec9819-4f93-4dc4-b203-684abb590a14" containerName="prometheus" containerID="cri-o://23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f" gracePeriod=600 Jun 15 01:43:58.983199 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:58.983037 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="24ec9819-4f93-4dc4-b203-684abb590a14" containerName="kube-rbac-proxy-web" containerID="cri-o://96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a" gracePeriod=600 Jun 15 01:43:58.983412 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:58.983026 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="24ec9819-4f93-4dc4-b203-684abb590a14" containerName="kube-rbac-proxy" containerID="cri-o://619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea" gracePeriod=600 Jun 15 01:43:59.237456 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.237389 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.379676 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.379644 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-prometheus-k8s-rulefiles-1\") pod \"24ec9819-4f93-4dc4-b203-684abb590a14\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " Jun 15 01:43:59.379676 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.379678 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-configmap-kubelet-serving-ca-bundle\") pod \"24ec9819-4f93-4dc4-b203-684abb590a14\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " Jun 15 01:43:59.379896 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.379696 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-prometheus-k8s-rulefiles-2\") pod \"24ec9819-4f93-4dc4-b203-684abb590a14\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " Jun 15 01:43:59.379896 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.379727 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-prometheus-k8s-tls\") pod \"24ec9819-4f93-4dc4-b203-684abb590a14\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " Jun 15 01:43:59.379896 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.379753 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-config\") pod \"24ec9819-4f93-4dc4-b203-684abb590a14\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " Jun 15 01:43:59.379896 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.379774 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24ec9819-4f93-4dc4-b203-684abb590a14-tls-assets\") pod \"24ec9819-4f93-4dc4-b203-684abb590a14\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " Jun 15 01:43:59.379896 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.379805 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-kube-rbac-proxy\") pod \"24ec9819-4f93-4dc4-b203-684abb590a14\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " Jun 15 01:43:59.379896 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.379832 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-prometheus-trusted-ca-bundle\") pod \"24ec9819-4f93-4dc4-b203-684abb590a14\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " Jun 15 01:43:59.379896 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.379856 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7llj4\" (UniqueName: \"kubernetes.io/projected/24ec9819-4f93-4dc4-b203-684abb590a14-kube-api-access-7llj4\") pod \"24ec9819-4f93-4dc4-b203-684abb590a14\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " Jun 15 01:43:59.379896 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.379894 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"24ec9819-4f93-4dc4-b203-684abb590a14\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " Jun 15 01:43:59.380298 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.379924 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-metrics-client-certs\") pod \"24ec9819-4f93-4dc4-b203-684abb590a14\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " Jun 15 01:43:59.380298 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.379960 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-configmap-serving-certs-ca-bundle\") pod \"24ec9819-4f93-4dc4-b203-684abb590a14\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " Jun 15 01:43:59.380298 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.379996 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-configmap-metrics-client-ca\") pod \"24ec9819-4f93-4dc4-b203-684abb590a14\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " Jun 15 01:43:59.380298 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.380011 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "24ec9819-4f93-4dc4-b203-684abb590a14" (UID: "24ec9819-4f93-4dc4-b203-684abb590a14"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:43:59.380298 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.380019 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "24ec9819-4f93-4dc4-b203-684abb590a14" (UID: "24ec9819-4f93-4dc4-b203-684abb590a14"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:43:59.380537 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.380356 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "24ec9819-4f93-4dc4-b203-684abb590a14" (UID: "24ec9819-4f93-4dc4-b203-684abb590a14"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:43:59.380537 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.380022 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-thanos-prometheus-http-client-file\") pod \"24ec9819-4f93-4dc4-b203-684abb590a14\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " Jun 15 01:43:59.380537 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.380418 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/24ec9819-4f93-4dc4-b203-684abb590a14-prometheus-k8s-db\") pod \"24ec9819-4f93-4dc4-b203-684abb590a14\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " Jun 15 01:43:59.380537 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.380453 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-grpc-tls\") pod \"24ec9819-4f93-4dc4-b203-684abb590a14\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " Jun 15 01:43:59.380537 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.380478 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-prometheus-k8s-rulefiles-0\") pod \"24ec9819-4f93-4dc4-b203-684abb590a14\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " Jun 15 01:43:59.380537 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.380524 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-web-config\") pod \"24ec9819-4f93-4dc4-b203-684abb590a14\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " Jun 15 01:43:59.380865 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.380564 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"24ec9819-4f93-4dc4-b203-684abb590a14\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " Jun 15 01:43:59.380865 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.380590 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24ec9819-4f93-4dc4-b203-684abb590a14-config-out\") pod \"24ec9819-4f93-4dc4-b203-684abb590a14\" (UID: \"24ec9819-4f93-4dc4-b203-684abb590a14\") " Jun 15 01:43:59.380865 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.380844 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "24ec9819-4f93-4dc4-b203-684abb590a14" (UID: "24ec9819-4f93-4dc4-b203-684abb590a14"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:43:59.381013 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.380878 2551 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:43:59.381013 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.380898 2551 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:43:59.381013 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.380913 2551 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:43:59.381156 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.381105 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "24ec9819-4f93-4dc4-b203-684abb590a14" (UID: "24ec9819-4f93-4dc4-b203-684abb590a14"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:43:59.381749 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.381718 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "24ec9819-4f93-4dc4-b203-684abb590a14" (UID: "24ec9819-4f93-4dc4-b203-684abb590a14"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:43:59.382775 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.382681 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "24ec9819-4f93-4dc4-b203-684abb590a14" (UID: "24ec9819-4f93-4dc4-b203-684abb590a14"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:43:59.382927 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.382904 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24ec9819-4f93-4dc4-b203-684abb590a14-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "24ec9819-4f93-4dc4-b203-684abb590a14" (UID: "24ec9819-4f93-4dc4-b203-684abb590a14"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 01:43:59.383928 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.383890 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24ec9819-4f93-4dc4-b203-684abb590a14-config-out" (OuterVolumeSpecName: "config-out") pod "24ec9819-4f93-4dc4-b203-684abb590a14" (UID: "24ec9819-4f93-4dc4-b203-684abb590a14"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 01:43:59.384034 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.383990 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "24ec9819-4f93-4dc4-b203-684abb590a14" (UID: "24ec9819-4f93-4dc4-b203-684abb590a14"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:43:59.384034 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.384007 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-config" (OuterVolumeSpecName: "config") pod "24ec9819-4f93-4dc4-b203-684abb590a14" (UID: "24ec9819-4f93-4dc4-b203-684abb590a14"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:43:59.384159 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.384048 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "24ec9819-4f93-4dc4-b203-684abb590a14" (UID: "24ec9819-4f93-4dc4-b203-684abb590a14"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:43:59.384159 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.384132 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "24ec9819-4f93-4dc4-b203-684abb590a14" (UID: "24ec9819-4f93-4dc4-b203-684abb590a14"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:43:59.384299 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.384273 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24ec9819-4f93-4dc4-b203-684abb590a14-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "24ec9819-4f93-4dc4-b203-684abb590a14" (UID: "24ec9819-4f93-4dc4-b203-684abb590a14"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:43:59.384410 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.384370 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "24ec9819-4f93-4dc4-b203-684abb590a14" (UID: "24ec9819-4f93-4dc4-b203-684abb590a14"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:43:59.384563 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.384534 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "24ec9819-4f93-4dc4-b203-684abb590a14" (UID: "24ec9819-4f93-4dc4-b203-684abb590a14"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:43:59.384702 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.384682 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24ec9819-4f93-4dc4-b203-684abb590a14-kube-api-access-7llj4" (OuterVolumeSpecName: "kube-api-access-7llj4") pod "24ec9819-4f93-4dc4-b203-684abb590a14" (UID: "24ec9819-4f93-4dc4-b203-684abb590a14"). InnerVolumeSpecName "kube-api-access-7llj4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:43:59.385047 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.385030 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "24ec9819-4f93-4dc4-b203-684abb590a14" (UID: "24ec9819-4f93-4dc4-b203-684abb590a14"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:43:59.385561 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.385520 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "24ec9819-4f93-4dc4-b203-684abb590a14" (UID: "24ec9819-4f93-4dc4-b203-684abb590a14"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:43:59.396272 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.396251 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-web-config" (OuterVolumeSpecName: "web-config") pod "24ec9819-4f93-4dc4-b203-684abb590a14" (UID: "24ec9819-4f93-4dc4-b203-684abb590a14"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:43:59.482192 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.482171 2551 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/24ec9819-4f93-4dc4-b203-684abb590a14-prometheus-k8s-db\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:43:59.482192 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.482194 2551 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-grpc-tls\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:43:59.482318 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.482204 2551 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:43:59.482318 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.482212 2551 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-web-config\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:43:59.482318 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.482222 2551 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:43:59.482318 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.482231 2551 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24ec9819-4f93-4dc4-b203-684abb590a14-config-out\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:43:59.482318 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.482240 2551 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:43:59.482318 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.482248 2551 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-config\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:43:59.482318 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.482258 2551 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24ec9819-4f93-4dc4-b203-684abb590a14-tls-assets\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:43:59.482318 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.482266 2551 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-kube-rbac-proxy\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:43:59.482318 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.482274 2551 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:43:59.482318 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.482282 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7llj4\" (UniqueName: \"kubernetes.io/projected/24ec9819-4f93-4dc4-b203-684abb590a14-kube-api-access-7llj4\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:43:59.482318 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.482291 2551 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:43:59.482318 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.482299 2551 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-secret-metrics-client-certs\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:43:59.482318 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.482308 2551 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:43:59.482318 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.482317 2551 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24ec9819-4f93-4dc4-b203-684abb590a14-configmap-metrics-client-ca\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:43:59.482849 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.482325 2551 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/24ec9819-4f93-4dc4-b203-684abb590a14-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:43:59.764066 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.764038 2551 generic.go:356] "Generic (PLEG): container finished" podID="24ec9819-4f93-4dc4-b203-684abb590a14" containerID="93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5" exitCode=0 Jun 15 01:43:59.764066 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.764062 2551 generic.go:356] "Generic (PLEG): container finished" podID="24ec9819-4f93-4dc4-b203-684abb590a14" containerID="619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea" exitCode=0 Jun 15 01:43:59.764066 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.764071 2551 generic.go:356] "Generic (PLEG): container finished" podID="24ec9819-4f93-4dc4-b203-684abb590a14" containerID="96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a" exitCode=0 Jun 15 01:43:59.764291 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.764079 2551 generic.go:356] "Generic (PLEG): container finished" podID="24ec9819-4f93-4dc4-b203-684abb590a14" containerID="0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e" exitCode=0 Jun 15 01:43:59.764291 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.764087 2551 generic.go:356] "Generic (PLEG): container finished" podID="24ec9819-4f93-4dc4-b203-684abb590a14" containerID="2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d" exitCode=0 Jun 15 01:43:59.764291 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.764094 2551 generic.go:356] "Generic (PLEG): container finished" podID="24ec9819-4f93-4dc4-b203-684abb590a14" containerID="23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f" exitCode=0 Jun 15 01:43:59.764291 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.764104 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.764291 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.764123 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24ec9819-4f93-4dc4-b203-684abb590a14","Type":"ContainerDied","Data":"93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5"} Jun 15 01:43:59.764291 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.764191 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24ec9819-4f93-4dc4-b203-684abb590a14","Type":"ContainerDied","Data":"619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea"} Jun 15 01:43:59.764291 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.764219 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24ec9819-4f93-4dc4-b203-684abb590a14","Type":"ContainerDied","Data":"96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a"} Jun 15 01:43:59.764291 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.764246 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24ec9819-4f93-4dc4-b203-684abb590a14","Type":"ContainerDied","Data":"0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e"} Jun 15 01:43:59.764291 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.764263 2551 scope.go:117] "RemoveContainer" containerID="93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5" Jun 15 01:43:59.764686 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.764271 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24ec9819-4f93-4dc4-b203-684abb590a14","Type":"ContainerDied","Data":"2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d"} Jun 15 01:43:59.764686 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.764366 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24ec9819-4f93-4dc4-b203-684abb590a14","Type":"ContainerDied","Data":"23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f"} Jun 15 01:43:59.764686 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.764396 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24ec9819-4f93-4dc4-b203-684abb590a14","Type":"ContainerDied","Data":"b680e510ebe11966c85993cf17da5739c98316a71b328aec2e6b2e43bfb0f201"} Jun 15 01:43:59.775665 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.775610 2551 scope.go:117] "RemoveContainer" containerID="619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea" Jun 15 01:43:59.782585 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.782568 2551 scope.go:117] "RemoveContainer" containerID="96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a" Jun 15 01:43:59.786556 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.786534 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 01:43:59.790827 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.790810 2551 scope.go:117] "RemoveContainer" containerID="0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e" Jun 15 01:43:59.791071 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.791054 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 01:43:59.797171 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.797155 2551 scope.go:117] "RemoveContainer" containerID="2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d" Jun 15 01:43:59.803522 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.803502 2551 scope.go:117] "RemoveContainer" containerID="23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f" Jun 15 01:43:59.810525 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.810507 2551 scope.go:117] "RemoveContainer" containerID="d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6" Jun 15 01:43:59.815612 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.815592 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 01:43:59.815896 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.815879 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24ec9819-4f93-4dc4-b203-684abb590a14" containerName="kube-rbac-proxy-thanos" Jun 15 01:43:59.815896 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.815895 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="24ec9819-4f93-4dc4-b203-684abb590a14" containerName="kube-rbac-proxy-thanos" Jun 15 01:43:59.816029 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.815907 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24ec9819-4f93-4dc4-b203-684abb590a14" containerName="prometheus" Jun 15 01:43:59.816029 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.815913 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="24ec9819-4f93-4dc4-b203-684abb590a14" containerName="prometheus" Jun 15 01:43:59.816029 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.815920 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24ec9819-4f93-4dc4-b203-684abb590a14" containerName="thanos-sidecar" Jun 15 01:43:59.816029 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.815926 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="24ec9819-4f93-4dc4-b203-684abb590a14" containerName="thanos-sidecar" Jun 15 01:43:59.816029 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.815942 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24ec9819-4f93-4dc4-b203-684abb590a14" containerName="kube-rbac-proxy" Jun 15 01:43:59.816029 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.815949 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="24ec9819-4f93-4dc4-b203-684abb590a14" containerName="kube-rbac-proxy" Jun 15 01:43:59.816029 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.815955 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24ec9819-4f93-4dc4-b203-684abb590a14" containerName="init-config-reloader" Jun 15 01:43:59.816029 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.815962 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="24ec9819-4f93-4dc4-b203-684abb590a14" containerName="init-config-reloader" Jun 15 01:43:59.816029 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.815972 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24ec9819-4f93-4dc4-b203-684abb590a14" containerName="config-reloader" Jun 15 01:43:59.816029 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.815977 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="24ec9819-4f93-4dc4-b203-684abb590a14" containerName="config-reloader" Jun 15 01:43:59.816029 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.815983 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24ec9819-4f93-4dc4-b203-684abb590a14" containerName="kube-rbac-proxy-web" Jun 15 01:43:59.816029 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.815988 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="24ec9819-4f93-4dc4-b203-684abb590a14" containerName="kube-rbac-proxy-web" Jun 15 01:43:59.816351 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.816039 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="24ec9819-4f93-4dc4-b203-684abb590a14" containerName="config-reloader" Jun 15 01:43:59.816351 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.816047 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="24ec9819-4f93-4dc4-b203-684abb590a14" containerName="thanos-sidecar" Jun 15 01:43:59.816351 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.816055 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="24ec9819-4f93-4dc4-b203-684abb590a14" containerName="kube-rbac-proxy" Jun 15 01:43:59.816351 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.816062 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="24ec9819-4f93-4dc4-b203-684abb590a14" containerName="kube-rbac-proxy-thanos" Jun 15 01:43:59.816351 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.816067 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="24ec9819-4f93-4dc4-b203-684abb590a14" containerName="prometheus" Jun 15 01:43:59.816351 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.816073 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="24ec9819-4f93-4dc4-b203-684abb590a14" containerName="kube-rbac-proxy-web" Jun 15 01:43:59.817396 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.817383 2551 scope.go:117] "RemoveContainer" containerID="93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5" Jun 15 01:43:59.817680 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:43:59.817649 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5\": container with ID starting with 93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5 not found: ID does not exist" containerID="93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5" Jun 15 01:43:59.817763 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.817685 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5"} err="failed to get container status \"93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5\": rpc error: code = NotFound desc = could not find container \"93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5\": container with ID starting with 93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5 not found: ID does not exist" Jun 15 01:43:59.817763 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.817719 2551 scope.go:117] "RemoveContainer" containerID="619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea" Jun 15 01:43:59.817957 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:43:59.817939 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea\": container with ID starting with 619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea not found: ID does not exist" containerID="619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea" Jun 15 01:43:59.817996 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.817969 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea"} err="failed to get container status \"619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea\": rpc error: code = NotFound desc = could not find container \"619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea\": container with ID starting with 619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea not found: ID does not exist" Jun 15 01:43:59.817996 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.817988 2551 scope.go:117] "RemoveContainer" containerID="96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a" Jun 15 01:43:59.818219 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:43:59.818199 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a\": container with ID starting with 96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a not found: ID does not exist" containerID="96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a" Jun 15 01:43:59.818262 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.818223 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a"} err="failed to get container status \"96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a\": rpc error: code = NotFound desc = could not find container \"96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a\": container with ID starting with 96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a not found: ID does not exist" Jun 15 01:43:59.818262 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.818238 2551 scope.go:117] "RemoveContainer" containerID="0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e" Jun 15 01:43:59.818476 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:43:59.818460 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e\": container with ID starting with 0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e not found: ID does not exist" containerID="0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e" Jun 15 01:43:59.818525 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.818479 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e"} err="failed to get container status \"0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e\": rpc error: code = NotFound desc = could not find container \"0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e\": container with ID starting with 0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e not found: ID does not exist" Jun 15 01:43:59.818525 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.818491 2551 scope.go:117] "RemoveContainer" containerID="2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d" Jun 15 01:43:59.818759 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:43:59.818739 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d\": container with ID starting with 2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d not found: ID does not exist" containerID="2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d" Jun 15 01:43:59.818836 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.818760 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d"} err="failed to get container status \"2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d\": rpc error: code = NotFound desc = could not find container \"2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d\": container with ID starting with 2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d not found: ID does not exist" Jun 15 01:43:59.818836 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.818771 2551 scope.go:117] "RemoveContainer" containerID="23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f" Jun 15 01:43:59.818933 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.818857 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.819253 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:43:59.819062 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f\": container with ID starting with 23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f not found: ID does not exist" containerID="23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f" Jun 15 01:43:59.819253 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.819092 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f"} err="failed to get container status \"23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f\": rpc error: code = NotFound desc = could not find container \"23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f\": container with ID starting with 23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f not found: ID does not exist" Jun 15 01:43:59.819253 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.819113 2551 scope.go:117] "RemoveContainer" containerID="d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6" Jun 15 01:43:59.819496 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:43:59.819471 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6\": container with ID starting with d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6 not found: ID does not exist" containerID="d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6" Jun 15 01:43:59.819568 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.819505 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6"} err="failed to get container status \"d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6\": rpc error: code = NotFound desc = could not find container \"d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6\": container with ID starting with d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6 not found: ID does not exist" Jun 15 01:43:59.819568 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.819527 2551 scope.go:117] "RemoveContainer" containerID="93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5" Jun 15 01:43:59.819780 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.819752 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5"} err="failed to get container status \"93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5\": rpc error: code = NotFound desc = could not find container \"93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5\": container with ID starting with 93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5 not found: ID does not exist" Jun 15 01:43:59.819780 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.819780 2551 scope.go:117] "RemoveContainer" containerID="619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea" Jun 15 01:43:59.819998 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.819979 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea"} err="failed to get container status \"619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea\": rpc error: code = NotFound desc = could not find container \"619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea\": container with ID starting with 619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea not found: ID does not exist" Jun 15 01:43:59.820076 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.819999 2551 scope.go:117] "RemoveContainer" containerID="96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a" Jun 15 01:43:59.820276 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.820250 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a"} err="failed to get container status \"96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a\": rpc error: code = NotFound desc = could not find container \"96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a\": container with ID starting with 96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a not found: ID does not exist" Jun 15 01:43:59.820354 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.820277 2551 scope.go:117] "RemoveContainer" containerID="0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e" Jun 15 01:43:59.820570 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.820537 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e"} err="failed to get container status \"0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e\": rpc error: code = NotFound desc = could not find container \"0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e\": container with ID starting with 0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e not found: ID does not exist" Jun 15 01:43:59.820570 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.820564 2551 scope.go:117] "RemoveContainer" containerID="2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d" Jun 15 01:43:59.820830 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.820806 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d"} err="failed to get container status \"2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d\": rpc error: code = NotFound desc = could not find container \"2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d\": container with ID starting with 2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d not found: ID does not exist" Jun 15 01:43:59.820899 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.820834 2551 scope.go:117] "RemoveContainer" containerID="23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f" Jun 15 01:43:59.821078 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.821059 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 15 01:43:59.821135 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.821072 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f"} err="failed to get container status \"23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f\": rpc error: code = NotFound desc = could not find container \"23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f\": container with ID starting with 23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f not found: ID does not exist" Jun 15 01:43:59.821135 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.821093 2551 scope.go:117] "RemoveContainer" containerID="d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6" Jun 15 01:43:59.821135 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.821100 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 15 01:43:59.821135 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.821131 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 15 01:43:59.821328 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.821262 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 15 01:43:59.821328 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.821315 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6"} err="failed to get container status \"d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6\": rpc error: code = NotFound desc = could not find container \"d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6\": container with ID starting with d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6 not found: ID does not exist" Jun 15 01:43:59.821429 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.821338 2551 scope.go:117] "RemoveContainer" containerID="93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5" Jun 15 01:43:59.821480 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.821445 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 15 01:43:59.821601 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.821559 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5"} err="failed to get container status \"93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5\": rpc error: code = NotFound desc = could not find container \"93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5\": container with ID starting with 93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5 not found: ID does not exist" Jun 15 01:43:59.821601 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.821583 2551 scope.go:117] "RemoveContainer" containerID="619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea" Jun 15 01:43:59.821795 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.821669 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vwtxp\"" Jun 15 01:43:59.821795 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.821692 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 15 01:43:59.822013 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.821967 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea"} err="failed to get container status \"619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea\": rpc error: code = NotFound desc = could not find container \"619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea\": container with ID starting with 619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea not found: ID does not exist" Jun 15 01:43:59.822013 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.821992 2551 scope.go:117] "RemoveContainer" containerID="96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a" Jun 15 01:43:59.822259 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.822062 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 15 01:43:59.822259 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.822077 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 15 01:43:59.822259 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.822202 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 15 01:43:59.822403 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.822289 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 15 01:43:59.822455 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.822426 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a"} err="failed to get container status \"96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a\": rpc error: code = NotFound desc = could not find container \"96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a\": container with ID starting with 96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a not found: ID does not exist" Jun 15 01:43:59.822455 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.822448 2551 scope.go:117] "RemoveContainer" containerID="0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e" Jun 15 01:43:59.822550 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.822491 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 15 01:43:59.822701 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.822655 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 15 01:43:59.822701 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.822689 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-d4v3gajtpm17q\"" Jun 15 01:43:59.822847 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.822762 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 15 01:43:59.822847 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.822808 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e"} err="failed to get container status \"0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e\": rpc error: code = NotFound desc = could not find container \"0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e\": container with ID starting with 0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e not found: ID does not exist" Jun 15 01:43:59.822847 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.822831 2551 scope.go:117] "RemoveContainer" containerID="2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d" Jun 15 01:43:59.823083 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.823066 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d"} err="failed to get container status \"2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d\": rpc error: code = NotFound desc = could not find container \"2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d\": container with ID starting with 2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d not found: ID does not exist" Jun 15 01:43:59.823143 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.823084 2551 scope.go:117] "RemoveContainer" containerID="23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f" Jun 15 01:43:59.823350 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.823329 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f"} err="failed to get container status \"23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f\": rpc error: code = NotFound desc = could not find container \"23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f\": container with ID starting with 23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f not found: ID does not exist" Jun 15 01:43:59.823412 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.823352 2551 scope.go:117] "RemoveContainer" containerID="d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6" Jun 15 01:43:59.823663 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.823615 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6"} err="failed to get container status \"d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6\": rpc error: code = NotFound desc = could not find container \"d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6\": container with ID starting with d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6 not found: ID does not exist" Jun 15 01:43:59.823663 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.823654 2551 scope.go:117] "RemoveContainer" containerID="93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5" Jun 15 01:43:59.824303 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.824282 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5"} err="failed to get container status \"93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5\": rpc error: code = NotFound desc = could not find container \"93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5\": container with ID starting with 93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5 not found: ID does not exist" Jun 15 01:43:59.824399 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.824304 2551 scope.go:117] "RemoveContainer" containerID="619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea" Jun 15 01:43:59.824650 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.824614 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea"} err="failed to get container status \"619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea\": rpc error: code = NotFound desc = could not find container \"619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea\": container with ID starting with 619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea not found: ID does not exist" Jun 15 01:43:59.824709 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.824654 2551 scope.go:117] "RemoveContainer" containerID="96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a" Jun 15 01:43:59.824873 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.824855 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a"} err="failed to get container status \"96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a\": rpc error: code = NotFound desc = could not find container \"96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a\": container with ID starting with 96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a not found: ID does not exist" Jun 15 01:43:59.824949 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.824874 2551 scope.go:117] "RemoveContainer" containerID="0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e" Jun 15 01:43:59.825161 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.825136 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e"} err="failed to get container status \"0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e\": rpc error: code = NotFound desc = could not find container \"0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e\": container with ID starting with 0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e not found: ID does not exist" Jun 15 01:43:59.825215 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.825164 2551 scope.go:117] "RemoveContainer" containerID="2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d" Jun 15 01:43:59.825474 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.825450 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d"} err="failed to get container status \"2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d\": rpc error: code = NotFound desc = could not find container \"2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d\": container with ID starting with 2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d not found: ID does not exist" Jun 15 01:43:59.825474 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.825474 2551 scope.go:117] "RemoveContainer" containerID="23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f" Jun 15 01:43:59.825778 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.825755 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f"} err="failed to get container status \"23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f\": rpc error: code = NotFound desc = could not find container \"23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f\": container with ID starting with 23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f not found: ID does not exist" Jun 15 01:43:59.825861 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.825781 2551 scope.go:117] "RemoveContainer" containerID="d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6" Jun 15 01:43:59.826065 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.826046 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6"} err="failed to get container status \"d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6\": rpc error: code = NotFound desc = could not find container \"d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6\": container with ID starting with d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6 not found: ID does not exist" Jun 15 01:43:59.826065 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.826064 2551 scope.go:117] "RemoveContainer" containerID="93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5" Jun 15 01:43:59.826221 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.826170 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 15 01:43:59.826321 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.826296 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5"} err="failed to get container status \"93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5\": rpc error: code = NotFound desc = could not find container \"93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5\": container with ID starting with 93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5 not found: ID does not exist" Jun 15 01:43:59.826403 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.826324 2551 scope.go:117] "RemoveContainer" containerID="619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea" Jun 15 01:43:59.826664 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.826597 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea"} err="failed to get container status \"619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea\": rpc error: code = NotFound desc = could not find container \"619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea\": container with ID starting with 619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea not found: ID does not exist" Jun 15 01:43:59.826664 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.826646 2551 scope.go:117] "RemoveContainer" containerID="96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a" Jun 15 01:43:59.826955 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.826926 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a"} err="failed to get container status \"96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a\": rpc error: code = NotFound desc = could not find container \"96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a\": container with ID starting with 96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a not found: ID does not exist" Jun 15 01:43:59.826955 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.826952 2551 scope.go:117] "RemoveContainer" containerID="0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e" Jun 15 01:43:59.827840 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.827809 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e"} err="failed to get container status \"0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e\": rpc error: code = NotFound desc = could not find container \"0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e\": container with ID starting with 0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e not found: ID does not exist" Jun 15 01:43:59.827840 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.827828 2551 scope.go:117] "RemoveContainer" containerID="2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d" Jun 15 01:43:59.828084 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.828061 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d"} err="failed to get container status \"2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d\": rpc error: code = NotFound desc = could not find container \"2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d\": container with ID starting with 2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d not found: ID does not exist" Jun 15 01:43:59.828084 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.828082 2551 scope.go:117] "RemoveContainer" containerID="23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f" Jun 15 01:43:59.828309 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.828290 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f"} err="failed to get container status \"23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f\": rpc error: code = NotFound desc = could not find container \"23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f\": container with ID starting with 23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f not found: ID does not exist" Jun 15 01:43:59.828309 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.828309 2551 scope.go:117] "RemoveContainer" containerID="d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6" Jun 15 01:43:59.828545 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.828526 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6"} err="failed to get container status \"d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6\": rpc error: code = NotFound desc = could not find container \"d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6\": container with ID starting with d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6 not found: ID does not exist" Jun 15 01:43:59.828620 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.828546 2551 scope.go:117] "RemoveContainer" containerID="93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5" Jun 15 01:43:59.828853 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.828833 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5"} err="failed to get container status \"93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5\": rpc error: code = NotFound desc = could not find container \"93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5\": container with ID starting with 93a7ae1a21c84844648927858effeee288106e1de4bc5128e7724ed23e8a3ff5 not found: ID does not exist" Jun 15 01:43:59.828853 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.828851 2551 scope.go:117] "RemoveContainer" containerID="619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea" Jun 15 01:43:59.829031 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.829012 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 15 01:43:59.829100 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.829060 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea"} err="failed to get container status \"619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea\": rpc error: code = NotFound desc = could not find container \"619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea\": container with ID starting with 619eca52336f66910230dcc7414a532aeec83e8510e857343b1d1ca0be17adea not found: ID does not exist" Jun 15 01:43:59.829100 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.829076 2551 scope.go:117] "RemoveContainer" containerID="96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a" Jun 15 01:43:59.829290 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.829272 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a"} err="failed to get container status \"96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a\": rpc error: code = NotFound desc = could not find container \"96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a\": container with ID starting with 96161c8545fcdfff31450a323ef2e77cefa7b33f142a19452132dcccf7048a4a not found: ID does not exist" Jun 15 01:43:59.829290 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.829289 2551 scope.go:117] "RemoveContainer" containerID="0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e" Jun 15 01:43:59.829492 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.829465 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e"} err="failed to get container status \"0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e\": rpc error: code = NotFound desc = could not find container \"0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e\": container with ID starting with 0b26de453b4c1ed71648ef263deb9409751df2875bac6031042c33ad7449ba5e not found: ID does not exist" Jun 15 01:43:59.829556 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.829495 2551 scope.go:117] "RemoveContainer" containerID="2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d" Jun 15 01:43:59.829731 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.829709 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d"} err="failed to get container status \"2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d\": rpc error: code = NotFound desc = could not find container \"2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d\": container with ID starting with 2b01555ac125c93b8d0d6bc5583e1867fb385bb464ec53e71f577ce62cd0d47d not found: ID does not exist" Jun 15 01:43:59.829808 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.829731 2551 scope.go:117] "RemoveContainer" containerID="23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f" Jun 15 01:43:59.829922 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.829907 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f"} err="failed to get container status \"23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f\": rpc error: code = NotFound desc = could not find container \"23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f\": container with ID starting with 23072a4011ad7f91b217110199bd1599227415bdd517d21a5152798aa8ed5a3f not found: ID does not exist" Jun 15 01:43:59.829975 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.829921 2551 scope.go:117] "RemoveContainer" containerID="d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6" Jun 15 01:43:59.830112 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.830095 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6"} err="failed to get container status \"d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6\": rpc error: code = NotFound desc = could not find container \"d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6\": container with ID starting with d03e7245da9f4e02c4bbe9d9c96b940129f0921ca717223db1f95f0d6ab1b4a6 not found: ID does not exist" Jun 15 01:43:59.835528 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.835506 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 01:43:59.884095 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.884063 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/36307760-960d-4134-b077-71284deb1dec-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.884095 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.884098 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/36307760-960d-4134-b077-71284deb1dec-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.884261 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.884121 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/36307760-960d-4134-b077-71284deb1dec-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.884261 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.884170 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6gbc\" (UniqueName: \"kubernetes.io/projected/36307760-960d-4134-b077-71284deb1dec-kube-api-access-p6gbc\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.884261 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.884203 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/36307760-960d-4134-b077-71284deb1dec-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.884261 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.884235 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/36307760-960d-4134-b077-71284deb1dec-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.884261 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.884259 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36307760-960d-4134-b077-71284deb1dec-web-config\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.884421 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.884296 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36307760-960d-4134-b077-71284deb1dec-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.884421 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.884325 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36307760-960d-4134-b077-71284deb1dec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.884421 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.884367 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/36307760-960d-4134-b077-71284deb1dec-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.884421 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.884384 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/36307760-960d-4134-b077-71284deb1dec-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.884421 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.884404 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/36307760-960d-4134-b077-71284deb1dec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.884421 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.884422 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36307760-960d-4134-b077-71284deb1dec-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.884648 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.884466 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36307760-960d-4134-b077-71284deb1dec-config-out\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.884648 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.884497 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36307760-960d-4134-b077-71284deb1dec-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.884648 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.884517 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36307760-960d-4134-b077-71284deb1dec-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.884648 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.884533 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/36307760-960d-4134-b077-71284deb1dec-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.884648 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.884547 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36307760-960d-4134-b077-71284deb1dec-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.884648 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.884563 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36307760-960d-4134-b077-71284deb1dec-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.884648 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.884583 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/36307760-960d-4134-b077-71284deb1dec-config\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.985593 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.985551 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36307760-960d-4134-b077-71284deb1dec-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.985747 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.985601 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36307760-960d-4134-b077-71284deb1dec-config-out\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.985747 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.985653 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36307760-960d-4134-b077-71284deb1dec-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.985747 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.985677 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36307760-960d-4134-b077-71284deb1dec-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.985747 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.985699 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/36307760-960d-4134-b077-71284deb1dec-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.985747 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.985722 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36307760-960d-4134-b077-71284deb1dec-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.985985 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.985860 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36307760-960d-4134-b077-71284deb1dec-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.985985 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.985910 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/36307760-960d-4134-b077-71284deb1dec-config\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.985985 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.985944 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/36307760-960d-4134-b077-71284deb1dec-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.985985 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.985970 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/36307760-960d-4134-b077-71284deb1dec-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.986179 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.986009 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/36307760-960d-4134-b077-71284deb1dec-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.986179 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.986037 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6gbc\" (UniqueName: \"kubernetes.io/projected/36307760-960d-4134-b077-71284deb1dec-kube-api-access-p6gbc\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.986179 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.986070 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/36307760-960d-4134-b077-71284deb1dec-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.986179 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.986096 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/36307760-960d-4134-b077-71284deb1dec-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.986179 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.986130 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36307760-960d-4134-b077-71284deb1dec-web-config\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.986421 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.986183 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36307760-960d-4134-b077-71284deb1dec-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.986421 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.986209 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36307760-960d-4134-b077-71284deb1dec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.986421 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.986237 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/36307760-960d-4134-b077-71284deb1dec-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.986421 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.986263 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/36307760-960d-4134-b077-71284deb1dec-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.986421 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.986303 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/36307760-960d-4134-b077-71284deb1dec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.986421 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.986415 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36307760-960d-4134-b077-71284deb1dec-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.986733 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.986539 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36307760-960d-4134-b077-71284deb1dec-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.987238 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.987217 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36307760-960d-4134-b077-71284deb1dec-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.987380 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.987298 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36307760-960d-4134-b077-71284deb1dec-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.988288 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.988267 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/36307760-960d-4134-b077-71284deb1dec-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.988433 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.988410 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36307760-960d-4134-b077-71284deb1dec-config-out\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.988543 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.988523 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36307760-960d-4134-b077-71284deb1dec-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.989084 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.988772 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/36307760-960d-4134-b077-71284deb1dec-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.989084 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.988896 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/36307760-960d-4134-b077-71284deb1dec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.989084 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.988954 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/36307760-960d-4134-b077-71284deb1dec-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.989354 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.989200 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/36307760-960d-4134-b077-71284deb1dec-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.989415 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.989383 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/36307760-960d-4134-b077-71284deb1dec-config\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.989956 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.989930 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/36307760-960d-4134-b077-71284deb1dec-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.990284 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.990263 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/36307760-960d-4134-b077-71284deb1dec-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.990785 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.990768 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36307760-960d-4134-b077-71284deb1dec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.991235 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.991210 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/36307760-960d-4134-b077-71284deb1dec-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.991393 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.991373 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/36307760-960d-4134-b077-71284deb1dec-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.991462 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.991443 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36307760-960d-4134-b077-71284deb1dec-web-config\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.991547 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.991532 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36307760-960d-4134-b077-71284deb1dec-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:43:59.994409 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:43:59.994387 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6gbc\" (UniqueName: \"kubernetes.io/projected/36307760-960d-4134-b077-71284deb1dec-kube-api-access-p6gbc\") pod \"prometheus-k8s-0\" (UID: \"36307760-960d-4134-b077-71284deb1dec\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:44:00.131107 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:00.131078 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:44:00.267032 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:00.267001 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 01:44:00.271880 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:44:00.271855 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36307760_960d_4134_b077_71284deb1dec.slice/crio-7b26972a97b46708015e954603acda0ec9622d7f7a1c4c0478fd41cfa249f0e1 WatchSource:0}: Error finding container 7b26972a97b46708015e954603acda0ec9622d7f7a1c4c0478fd41cfa249f0e1: Status 404 returned error can't find the container with id 7b26972a97b46708015e954603acda0ec9622d7f7a1c4c0478fd41cfa249f0e1 Jun 15 01:44:00.277342 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:00.277302 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:44:00.334284 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:00.334259 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:44:00.545676 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:00.545604 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24ec9819-4f93-4dc4-b203-684abb590a14" path="/var/lib/kubelet/pods/24ec9819-4f93-4dc4-b203-684abb590a14/volumes" Jun 15 01:44:00.581224 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:00.581198 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:44:00.681262 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:00.681238 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:44:00.737434 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:00.737411 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:44:00.770196 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:00.770172 2551 generic.go:356] "Generic (PLEG): container finished" podID="36307760-960d-4134-b077-71284deb1dec" containerID="6fefd65a56a56ff94b5e2a77a8182aae7919db0cddfe2f715d99131e73d0155e" exitCode=0 Jun 15 01:44:00.770309 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:00.770214 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36307760-960d-4134-b077-71284deb1dec","Type":"ContainerDied","Data":"6fefd65a56a56ff94b5e2a77a8182aae7919db0cddfe2f715d99131e73d0155e"} Jun 15 01:44:00.770309 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:00.770261 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36307760-960d-4134-b077-71284deb1dec","Type":"ContainerStarted","Data":"7b26972a97b46708015e954603acda0ec9622d7f7a1c4c0478fd41cfa249f0e1"} Jun 15 01:44:00.830317 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:00.830279 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:44:00.931635 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:00.931592 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:44:01.778483 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:01.778447 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36307760-960d-4134-b077-71284deb1dec","Type":"ContainerStarted","Data":"77f1bb943719e4b1a2b9145c40952b4b45245cd994b7402a1d5472c5f53a2c66"} Jun 15 01:44:01.778854 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:01.778514 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36307760-960d-4134-b077-71284deb1dec","Type":"ContainerStarted","Data":"f846a60d8b6616925327bfa35e48c51e763ac4e1e53568881f37eff7962bdd8b"} Jun 15 01:44:01.778854 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:01.778543 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36307760-960d-4134-b077-71284deb1dec","Type":"ContainerStarted","Data":"4ea521dc827868d26a2fe96ddd23663ebbd27cf45866722268eec52be3a8990e"} Jun 15 01:44:01.778854 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:01.778571 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36307760-960d-4134-b077-71284deb1dec","Type":"ContainerStarted","Data":"b2cf3cc2f444797eb5b9e6834c98475aac6860546d8f2d0295e68ef8bacec8f2"} Jun 15 01:44:01.778854 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:01.778599 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36307760-960d-4134-b077-71284deb1dec","Type":"ContainerStarted","Data":"b5116c8451267eb1f3933f73119ed593b5e25e263ea135c9eeb661fc4c5235e5"} Jun 15 01:44:01.778854 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:01.778650 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36307760-960d-4134-b077-71284deb1dec","Type":"ContainerStarted","Data":"b1301b2bc9150b1e7b84f4ae53be3fab9af747ea809d6972666d1d9b9e8e71a6"} Jun 15 01:44:02.785675 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:02.785645 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:44:02.831666 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:02.831613 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:44:02.886307 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:02.886280 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:44:02.932887 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:02.932859 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:44:05.131797 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:05.131767 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:44:15.826977 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:15.826940 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:44:15.882067 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:15.882033 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:44:19.592765 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:19.592711 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" podUID="317fa362-6021-4fc1-8d2c-f18e70ecb41d" containerName="registry" containerID="cri-o://6a5941f7ba49da1495788dcd4126eaa22d3bb9f2d7e32753484945e84fde2424" gracePeriod=30 Jun 15 01:44:19.845365 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:19.845308 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:44:19.854311 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:19.854281 2551 generic.go:356] "Generic (PLEG): container finished" podID="317fa362-6021-4fc1-8d2c-f18e70ecb41d" containerID="6a5941f7ba49da1495788dcd4126eaa22d3bb9f2d7e32753484945e84fde2424" exitCode=0 Jun 15 01:44:19.854418 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:19.854324 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" Jun 15 01:44:19.854418 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:19.854324 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" event={"ID":"317fa362-6021-4fc1-8d2c-f18e70ecb41d","Type":"ContainerDied","Data":"6a5941f7ba49da1495788dcd4126eaa22d3bb9f2d7e32753484945e84fde2424"} Jun 15 01:44:19.854486 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:19.854442 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bfd57b8b7-zh79v" event={"ID":"317fa362-6021-4fc1-8d2c-f18e70ecb41d","Type":"ContainerDied","Data":"d1010f78141fa2f36ef479150887c868c29953a64006e65cba02f44ad78f7016"} Jun 15 01:44:19.854486 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:19.854465 2551 scope.go:117] "RemoveContainer" containerID="6a5941f7ba49da1495788dcd4126eaa22d3bb9f2d7e32753484945e84fde2424" Jun 15 01:44:19.862171 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:19.862151 2551 scope.go:117] "RemoveContainer" containerID="6a5941f7ba49da1495788dcd4126eaa22d3bb9f2d7e32753484945e84fde2424" Jun 15 01:44:19.862406 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:44:19.862386 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a5941f7ba49da1495788dcd4126eaa22d3bb9f2d7e32753484945e84fde2424\": container with ID starting with 6a5941f7ba49da1495788dcd4126eaa22d3bb9f2d7e32753484945e84fde2424 not found: ID does not exist" containerID="6a5941f7ba49da1495788dcd4126eaa22d3bb9f2d7e32753484945e84fde2424" Jun 15 01:44:19.862483 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:19.862418 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a5941f7ba49da1495788dcd4126eaa22d3bb9f2d7e32753484945e84fde2424"} err="failed to get container status \"6a5941f7ba49da1495788dcd4126eaa22d3bb9f2d7e32753484945e84fde2424\": rpc error: code = NotFound desc = could not find container \"6a5941f7ba49da1495788dcd4126eaa22d3bb9f2d7e32753484945e84fde2424\": container with ID starting with 6a5941f7ba49da1495788dcd4126eaa22d3bb9f2d7e32753484945e84fde2424 not found: ID does not exist" Jun 15 01:44:19.863891 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:19.863843 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=20.846680158 podStartE2EDuration="20.863825713s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.145555ms" isStatefulPod=false podCreationTimestamp="2026-06-15 01:43:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:44:01.80551314 +0000 UTC m=+337.664335807" watchObservedRunningTime="2026-06-15 01:44:19.863825713 +0000 UTC m=+355.722648387" Jun 15 01:44:19.951505 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:19.951455 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-bound-sa-token\") pod \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " Jun 15 01:44:19.951730 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:19.951529 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/317fa362-6021-4fc1-8d2c-f18e70ecb41d-ca-trust-extracted\") pod \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " Jun 15 01:44:19.951730 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:19.951555 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/317fa362-6021-4fc1-8d2c-f18e70ecb41d-installation-pull-secrets\") pod \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " Jun 15 01:44:19.951730 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:19.951663 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-certificates\") pod \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " Jun 15 01:44:19.951730 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:19.951692 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78jbd\" (UniqueName: \"kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-kube-api-access-78jbd\") pod \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " Jun 15 01:44:19.951730 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:19.951722 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/317fa362-6021-4fc1-8d2c-f18e70ecb41d-trusted-ca\") pod \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " Jun 15 01:44:19.952028 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:19.951757 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/317fa362-6021-4fc1-8d2c-f18e70ecb41d-image-registry-private-configuration\") pod \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " Jun 15 01:44:19.952028 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:19.951780 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-tls\") pod \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\" (UID: \"317fa362-6021-4fc1-8d2c-f18e70ecb41d\") " Jun 15 01:44:19.952232 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:19.952202 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "317fa362-6021-4fc1-8d2c-f18e70ecb41d" (UID: "317fa362-6021-4fc1-8d2c-f18e70ecb41d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:44:19.952352 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:19.952206 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/317fa362-6021-4fc1-8d2c-f18e70ecb41d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "317fa362-6021-4fc1-8d2c-f18e70ecb41d" (UID: "317fa362-6021-4fc1-8d2c-f18e70ecb41d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:44:19.954349 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:19.954308 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "317fa362-6021-4fc1-8d2c-f18e70ecb41d" (UID: "317fa362-6021-4fc1-8d2c-f18e70ecb41d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:44:19.954493 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:19.954465 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/317fa362-6021-4fc1-8d2c-f18e70ecb41d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "317fa362-6021-4fc1-8d2c-f18e70ecb41d" (UID: "317fa362-6021-4fc1-8d2c-f18e70ecb41d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:44:19.954567 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:19.954465 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-kube-api-access-78jbd" (OuterVolumeSpecName: "kube-api-access-78jbd") pod "317fa362-6021-4fc1-8d2c-f18e70ecb41d" (UID: "317fa362-6021-4fc1-8d2c-f18e70ecb41d"). InnerVolumeSpecName "kube-api-access-78jbd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:44:19.954652 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:19.954606 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/317fa362-6021-4fc1-8d2c-f18e70ecb41d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "317fa362-6021-4fc1-8d2c-f18e70ecb41d" (UID: "317fa362-6021-4fc1-8d2c-f18e70ecb41d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:44:19.954840 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:19.954817 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "317fa362-6021-4fc1-8d2c-f18e70ecb41d" (UID: "317fa362-6021-4fc1-8d2c-f18e70ecb41d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:44:19.960010 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:19.959979 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/317fa362-6021-4fc1-8d2c-f18e70ecb41d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "317fa362-6021-4fc1-8d2c-f18e70ecb41d" (UID: "317fa362-6021-4fc1-8d2c-f18e70ecb41d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 01:44:20.053255 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:20.053206 2551 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-certificates\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:44:20.053255 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:20.053248 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78jbd\" (UniqueName: \"kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-kube-api-access-78jbd\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:44:20.053255 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:20.053260 2551 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/317fa362-6021-4fc1-8d2c-f18e70ecb41d-trusted-ca\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:44:20.053255 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:20.053270 2551 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/317fa362-6021-4fc1-8d2c-f18e70ecb41d-image-registry-private-configuration\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:44:20.053500 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:20.053280 2551 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-registry-tls\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:44:20.053500 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:20.053289 2551 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/317fa362-6021-4fc1-8d2c-f18e70ecb41d-bound-sa-token\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:44:20.053500 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:20.053297 2551 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/317fa362-6021-4fc1-8d2c-f18e70ecb41d-ca-trust-extracted\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:44:20.053500 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:20.053305 2551 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/317fa362-6021-4fc1-8d2c-f18e70ecb41d-installation-pull-secrets\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:44:20.174759 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:20.174729 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-bfd57b8b7-zh79v"] Jun 15 01:44:20.178108 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:20.178084 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-bfd57b8b7-zh79v"] Jun 15 01:44:20.546292 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:20.546197 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="317fa362-6021-4fc1-8d2c-f18e70ecb41d" path="/var/lib/kubelet/pods/317fa362-6021-4fc1-8d2c-f18e70ecb41d/volumes" Jun 15 01:44:45.287590 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:45.287553 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:44:45.333904 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:44:45.333878 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:45:00.131743 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:45:00.131699 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:45:00.147113 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:45:00.147088 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:45:01.026312 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:45:01.026286 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:45:29.221042 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:45:29.221005 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:45:35.989287 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:45:35.989180 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:45:45.553264 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:45:45.553230 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:46:42.708471 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:46:42.708433 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:46:42.808484 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:46:42.808449 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:46:44.860677 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:46:44.860646 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:46:44.915421 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:46:44.915390 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:47:00.916564 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:47:00.916522 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:47:01.066329 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:47:01.066297 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:47:07.193311 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:47:07.193226 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:47:16.759169 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:47:16.759127 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:47:16.850245 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:47:16.850210 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:47:43.938669 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:47:43.938610 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:47:44.322683 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:47:44.322605 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:47:47.528858 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:47:47.528823 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:47:47.629922 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:47:47.629897 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:47:50.248548 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:47:50.248515 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:47:50.345030 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:47:50.344999 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:47:50.832054 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:47:50.832021 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:47:51.047606 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:47:51.047582 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:47:53.541328 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:47:53.541292 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:47:53.642116 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:47:53.642085 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:47:53.746921 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:47:53.746894 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:47:54.152242 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:47:54.152207 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:47:59.722555 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:47:59.722518 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:47:59.777917 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:47:59.777887 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:48:01.346336 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:01.346225 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:48:02.221305 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:02.221275 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:48:02.317171 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:02.317139 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:48:06.828486 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:06.828448 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:48:08.183148 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:08.183099 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:48:08.288328 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:08.288296 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:48:10.120813 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:10.120781 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:48:17.646208 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:17.646169 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:48:17.703128 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:17.703082 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:48:17.756883 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:17.756838 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:48:24.533277 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:24.533249 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c2jms_63f8819b-4ac8-42d2-a662-78721cf2548f/ovn-acl-logging/0.log" Jun 15 01:48:24.533853 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:24.533756 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c2jms_63f8819b-4ac8-42d2-a662-78721cf2548f/ovn-acl-logging/0.log" Jun 15 01:48:28.354945 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:28.354896 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:48:28.402081 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:28.402044 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cddd79ffb-vsqtx"] Jun 15 01:48:28.402368 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:28.402356 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="317fa362-6021-4fc1-8d2c-f18e70ecb41d" containerName="registry" Jun 15 01:48:28.402409 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:28.402370 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="317fa362-6021-4fc1-8d2c-f18e70ecb41d" containerName="registry" Jun 15 01:48:28.402446 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:28.402426 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="317fa362-6021-4fc1-8d2c-f18e70ecb41d" containerName="registry" Jun 15 01:48:28.405104 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:28.405085 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-vsqtx" Jun 15 01:48:28.408083 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:28.408060 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 15 01:48:28.408210 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:28.408093 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 15 01:48:28.408210 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:28.408123 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tgvph\"" Jun 15 01:48:28.408210 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:28.408136 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 15 01:48:28.408210 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:28.408094 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 15 01:48:28.408430 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:28.408069 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 15 01:48:28.413752 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:28.413725 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cddd79ffb-vsqtx"] Jun 15 01:48:28.430888 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:28.430866 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:48:28.532584 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:28.532550 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ed68dab-4eb4-49c6-b4b2-ffe4a3460d22-metrics-cert\") pod \"lws-controller-manager-5cddd79ffb-vsqtx\" (UID: \"8ed68dab-4eb4-49c6-b4b2-ffe4a3460d22\") " pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-vsqtx" Jun 15 01:48:28.532584 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:28.532584 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvrsp\" (UniqueName: \"kubernetes.io/projected/8ed68dab-4eb4-49c6-b4b2-ffe4a3460d22-kube-api-access-pvrsp\") pod \"lws-controller-manager-5cddd79ffb-vsqtx\" (UID: \"8ed68dab-4eb4-49c6-b4b2-ffe4a3460d22\") " pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-vsqtx" Jun 15 01:48:28.532852 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:28.532611 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8ed68dab-4eb4-49c6-b4b2-ffe4a3460d22-manager-config\") pod \"lws-controller-manager-5cddd79ffb-vsqtx\" (UID: \"8ed68dab-4eb4-49c6-b4b2-ffe4a3460d22\") " pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-vsqtx" Jun 15 01:48:28.532852 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:28.532745 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ed68dab-4eb4-49c6-b4b2-ffe4a3460d22-cert\") pod \"lws-controller-manager-5cddd79ffb-vsqtx\" (UID: \"8ed68dab-4eb4-49c6-b4b2-ffe4a3460d22\") " pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-vsqtx" Jun 15 01:48:28.633745 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:28.633619 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ed68dab-4eb4-49c6-b4b2-ffe4a3460d22-metrics-cert\") pod \"lws-controller-manager-5cddd79ffb-vsqtx\" (UID: \"8ed68dab-4eb4-49c6-b4b2-ffe4a3460d22\") " pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-vsqtx" Jun 15 01:48:28.633745 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:28.633700 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvrsp\" (UniqueName: \"kubernetes.io/projected/8ed68dab-4eb4-49c6-b4b2-ffe4a3460d22-kube-api-access-pvrsp\") pod \"lws-controller-manager-5cddd79ffb-vsqtx\" (UID: \"8ed68dab-4eb4-49c6-b4b2-ffe4a3460d22\") " pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-vsqtx" Jun 15 01:48:28.633745 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:28.633732 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8ed68dab-4eb4-49c6-b4b2-ffe4a3460d22-manager-config\") pod \"lws-controller-manager-5cddd79ffb-vsqtx\" (UID: \"8ed68dab-4eb4-49c6-b4b2-ffe4a3460d22\") " pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-vsqtx" Jun 15 01:48:28.634008 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:28.633784 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ed68dab-4eb4-49c6-b4b2-ffe4a3460d22-cert\") pod \"lws-controller-manager-5cddd79ffb-vsqtx\" (UID: \"8ed68dab-4eb4-49c6-b4b2-ffe4a3460d22\") " pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-vsqtx" Jun 15 01:48:28.634407 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:28.634384 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8ed68dab-4eb4-49c6-b4b2-ffe4a3460d22-manager-config\") pod \"lws-controller-manager-5cddd79ffb-vsqtx\" (UID: \"8ed68dab-4eb4-49c6-b4b2-ffe4a3460d22\") " pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-vsqtx" Jun 15 01:48:28.636213 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:28.636193 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ed68dab-4eb4-49c6-b4b2-ffe4a3460d22-cert\") pod \"lws-controller-manager-5cddd79ffb-vsqtx\" (UID: \"8ed68dab-4eb4-49c6-b4b2-ffe4a3460d22\") " pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-vsqtx" Jun 15 01:48:28.636332 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:28.636311 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ed68dab-4eb4-49c6-b4b2-ffe4a3460d22-metrics-cert\") pod \"lws-controller-manager-5cddd79ffb-vsqtx\" (UID: \"8ed68dab-4eb4-49c6-b4b2-ffe4a3460d22\") " pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-vsqtx" Jun 15 01:48:28.647382 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:28.647359 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvrsp\" (UniqueName: \"kubernetes.io/projected/8ed68dab-4eb4-49c6-b4b2-ffe4a3460d22-kube-api-access-pvrsp\") pod \"lws-controller-manager-5cddd79ffb-vsqtx\" (UID: \"8ed68dab-4eb4-49c6-b4b2-ffe4a3460d22\") " pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-vsqtx" Jun 15 01:48:28.715537 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:28.715498 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-vsqtx" Jun 15 01:48:28.842339 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:28.842308 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cddd79ffb-vsqtx"] Jun 15 01:48:28.845620 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:48:28.845593 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ed68dab_4eb4_49c6_b4b2_ffe4a3460d22.slice/crio-19b3f473690bfd9068af366fee14089e80f8ba3e04b2085369e59050ca3c5826 WatchSource:0}: Error finding container 19b3f473690bfd9068af366fee14089e80f8ba3e04b2085369e59050ca3c5826: Status 404 returned error can't find the container with id 19b3f473690bfd9068af366fee14089e80f8ba3e04b2085369e59050ca3c5826 Jun 15 01:48:28.847345 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:28.847328 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 01:48:29.810162 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:29.810120 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-vsqtx" event={"ID":"8ed68dab-4eb4-49c6-b4b2-ffe4a3460d22","Type":"ContainerStarted","Data":"19b3f473690bfd9068af366fee14089e80f8ba3e04b2085369e59050ca3c5826"} Jun 15 01:48:31.819662 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:31.819537 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-vsqtx" event={"ID":"8ed68dab-4eb4-49c6-b4b2-ffe4a3460d22","Type":"ContainerStarted","Data":"f7539acfdd66dd6b3602ae7055c17aab7da56c0f54600f7fd04bc7cde67b7f3d"} Jun 15 01:48:31.820104 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:31.819676 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-vsqtx" Jun 15 01:48:31.838274 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:31.838223 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-vsqtx" podStartSLOduration=1.250618992 podStartE2EDuration="3.838210432s" totalImagesPullingTime="2.58759144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:48:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:48:31.837818031 +0000 UTC m=+607.696640698" watchObservedRunningTime="2026-06-15 01:48:31.838210432 +0000 UTC m=+607.697033099" Jun 15 01:48:31.997377 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:31.997344 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:48:32.113476 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:32.113442 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:48:32.610443 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:32.610414 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:48:32.806384 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:32.806352 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:48:32.951833 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:32.951763 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-9rqkb"] Jun 15 01:48:32.955161 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:32.955145 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-9rqkb" Jun 15 01:48:32.961787 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:32.961771 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 15 01:48:32.961878 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:32.961845 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 15 01:48:32.962352 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:32.962336 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 15 01:48:32.962444 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:32.962425 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 15 01:48:32.962847 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:32.962832 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7gcdp\"" Jun 15 01:48:32.969260 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:32.969238 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-9rqkb"] Jun 15 01:48:32.978888 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:32.978851 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5f473ebd-4abe-4273-8b55-d0acdb210ed3-manifests\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-9rqkb\" (UID: \"5f473ebd-4abe-4273-8b55-d0acdb210ed3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-9rqkb" Jun 15 01:48:32.979002 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:32.978913 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5f473ebd-4abe-4273-8b55-d0acdb210ed3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-9rqkb\" (UID: \"5f473ebd-4abe-4273-8b55-d0acdb210ed3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-9rqkb" Jun 15 01:48:32.979002 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:32.978943 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f473ebd-4abe-4273-8b55-d0acdb210ed3-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-9rqkb\" (UID: \"5f473ebd-4abe-4273-8b55-d0acdb210ed3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-9rqkb" Jun 15 01:48:32.979002 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:32.978985 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v66vz\" (UniqueName: \"kubernetes.io/projected/5f473ebd-4abe-4273-8b55-d0acdb210ed3-kube-api-access-v66vz\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-9rqkb\" (UID: \"5f473ebd-4abe-4273-8b55-d0acdb210ed3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-9rqkb" Jun 15 01:48:32.979112 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:32.979049 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f473ebd-4abe-4273-8b55-d0acdb210ed3-tmp\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-9rqkb\" (UID: \"5f473ebd-4abe-4273-8b55-d0acdb210ed3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-9rqkb" Jun 15 01:48:33.080296 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:33.080257 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5f473ebd-4abe-4273-8b55-d0acdb210ed3-manifests\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-9rqkb\" (UID: \"5f473ebd-4abe-4273-8b55-d0acdb210ed3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-9rqkb" Jun 15 01:48:33.080480 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:33.080308 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5f473ebd-4abe-4273-8b55-d0acdb210ed3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-9rqkb\" (UID: \"5f473ebd-4abe-4273-8b55-d0acdb210ed3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-9rqkb" Jun 15 01:48:33.080480 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:33.080335 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f473ebd-4abe-4273-8b55-d0acdb210ed3-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-9rqkb\" (UID: \"5f473ebd-4abe-4273-8b55-d0acdb210ed3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-9rqkb" Jun 15 01:48:33.080480 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:33.080370 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v66vz\" (UniqueName: \"kubernetes.io/projected/5f473ebd-4abe-4273-8b55-d0acdb210ed3-kube-api-access-v66vz\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-9rqkb\" (UID: \"5f473ebd-4abe-4273-8b55-d0acdb210ed3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-9rqkb" Jun 15 01:48:33.080480 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:33.080406 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f473ebd-4abe-4273-8b55-d0acdb210ed3-tmp\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-9rqkb\" (UID: \"5f473ebd-4abe-4273-8b55-d0acdb210ed3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-9rqkb" Jun 15 01:48:33.080762 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:33.080738 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5f473ebd-4abe-4273-8b55-d0acdb210ed3-manifests\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-9rqkb\" (UID: \"5f473ebd-4abe-4273-8b55-d0acdb210ed3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-9rqkb" Jun 15 01:48:33.082855 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:33.082828 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f473ebd-4abe-4273-8b55-d0acdb210ed3-tmp\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-9rqkb\" (UID: \"5f473ebd-4abe-4273-8b55-d0acdb210ed3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-9rqkb" Jun 15 01:48:33.082961 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:33.082878 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f473ebd-4abe-4273-8b55-d0acdb210ed3-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-9rqkb\" (UID: \"5f473ebd-4abe-4273-8b55-d0acdb210ed3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-9rqkb" Jun 15 01:48:33.082961 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:33.082879 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5f473ebd-4abe-4273-8b55-d0acdb210ed3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-9rqkb\" (UID: \"5f473ebd-4abe-4273-8b55-d0acdb210ed3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-9rqkb" Jun 15 01:48:33.088522 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:33.088498 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v66vz\" (UniqueName: \"kubernetes.io/projected/5f473ebd-4abe-4273-8b55-d0acdb210ed3-kube-api-access-v66vz\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-9rqkb\" (UID: \"5f473ebd-4abe-4273-8b55-d0acdb210ed3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-9rqkb" Jun 15 01:48:33.265559 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:33.265476 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-9rqkb" Jun 15 01:48:33.401233 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:33.401202 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-9rqkb"] Jun 15 01:48:33.407296 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:48:33.407263 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f473ebd_4abe_4273_8b55_d0acdb210ed3.slice/crio-80570a92cbe450a69b1a1660e060372b25e8f586a0fbfeab9e45c65f1aa717eb WatchSource:0}: Error finding container 80570a92cbe450a69b1a1660e060372b25e8f586a0fbfeab9e45c65f1aa717eb: Status 404 returned error can't find the container with id 80570a92cbe450a69b1a1660e060372b25e8f586a0fbfeab9e45c65f1aa717eb Jun 15 01:48:33.748994 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:33.748962 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:48:33.828857 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:33.828824 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-9rqkb" event={"ID":"5f473ebd-4abe-4273-8b55-d0acdb210ed3","Type":"ContainerStarted","Data":"80570a92cbe450a69b1a1660e060372b25e8f586a0fbfeab9e45c65f1aa717eb"} Jun 15 01:48:36.845593 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:36.845558 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-9rqkb" event={"ID":"5f473ebd-4abe-4273-8b55-d0acdb210ed3","Type":"ContainerStarted","Data":"ebb4c0513cca51e7e910595325870d657a09cc649fe1bbf306705de6f3c9b490"} Jun 15 01:48:37.851671 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:37.851616 2551 generic.go:356] "Generic (PLEG): container finished" podID="5f473ebd-4abe-4273-8b55-d0acdb210ed3" containerID="ebb4c0513cca51e7e910595325870d657a09cc649fe1bbf306705de6f3c9b490" exitCode=0 Jun 15 01:48:37.852067 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:37.851728 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-9rqkb" event={"ID":"5f473ebd-4abe-4273-8b55-d0acdb210ed3","Type":"ContainerDied","Data":"ebb4c0513cca51e7e910595325870d657a09cc649fe1bbf306705de6f3c9b490"} Jun 15 01:48:38.857384 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:38.857344 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-9rqkb" event={"ID":"5f473ebd-4abe-4273-8b55-d0acdb210ed3","Type":"ContainerStarted","Data":"d607192e951830605b6b260fb40d0455c27131601c8afb4ea2e728a51f3b74e2"} Jun 15 01:48:38.857806 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:38.857485 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-9rqkb" Jun 15 01:48:38.878042 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:38.877995 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-9rqkb" podStartSLOduration=2.588434089 podStartE2EDuration="6.877977633s" totalImagesPullingTime="3.315059162s" totalInitContainerRuntime="974.484382ms" isStatefulPod=false podCreationTimestamp="2026-06-15 01:48:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:48:38.876341286 +0000 UTC m=+614.735163953" watchObservedRunningTime="2026-06-15 01:48:38.877977633 +0000 UTC m=+614.736800299" Jun 15 01:48:42.825508 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:42.825473 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-vsqtx" Jun 15 01:48:43.559308 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:43.559279 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:48:43.628378 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:43.628335 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:48:49.865754 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:49.865722 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-9rqkb" Jun 15 01:48:50.964056 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:50.964022 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:48:51.865099 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:51.865068 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:48:51.974595 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:51.974560 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:48:52.122040 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:52.121950 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:48:52.227827 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:52.227782 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:48:52.409424 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:52.409343 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:48:52.609590 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:52.609556 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-9566dff59-9blvs"] Jun 15 01:48:52.619007 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:52.618981 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-9566dff59-9blvs" Jun 15 01:48:52.621424 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:52.621399 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 15 01:48:52.622106 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:52.622081 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 15 01:48:52.622213 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:52.622128 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-c72n6\"" Jun 15 01:48:52.622306 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:52.622279 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 15 01:48:52.625041 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:52.623349 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 15 01:48:52.625041 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:52.624707 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-9566dff59-9blvs"] Jun 15 01:48:52.632725 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:52.632653 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:48:52.729210 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:52.729137 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:48:52.749885 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:52.749856 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28cf08e4-ee41-45cf-a005-348078fc00c6-tls-certs\") pod \"kube-auth-proxy-9566dff59-9blvs\" (UID: \"28cf08e4-ee41-45cf-a005-348078fc00c6\") " pod="openshift-ingress/kube-auth-proxy-9566dff59-9blvs" Jun 15 01:48:52.750006 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:52.749895 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28cf08e4-ee41-45cf-a005-348078fc00c6-tmp\") pod \"kube-auth-proxy-9566dff59-9blvs\" (UID: \"28cf08e4-ee41-45cf-a005-348078fc00c6\") " pod="openshift-ingress/kube-auth-proxy-9566dff59-9blvs" Jun 15 01:48:52.750054 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:52.750006 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm8gb\" (UniqueName: \"kubernetes.io/projected/28cf08e4-ee41-45cf-a005-348078fc00c6-kube-api-access-bm8gb\") pod \"kube-auth-proxy-9566dff59-9blvs\" (UID: \"28cf08e4-ee41-45cf-a005-348078fc00c6\") " pod="openshift-ingress/kube-auth-proxy-9566dff59-9blvs" Jun 15 01:48:52.825531 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:52.825503 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:48:52.850759 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:52.850728 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm8gb\" (UniqueName: \"kubernetes.io/projected/28cf08e4-ee41-45cf-a005-348078fc00c6-kube-api-access-bm8gb\") pod \"kube-auth-proxy-9566dff59-9blvs\" (UID: \"28cf08e4-ee41-45cf-a005-348078fc00c6\") " pod="openshift-ingress/kube-auth-proxy-9566dff59-9blvs" Jun 15 01:48:52.850886 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:52.850783 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28cf08e4-ee41-45cf-a005-348078fc00c6-tls-certs\") pod \"kube-auth-proxy-9566dff59-9blvs\" (UID: \"28cf08e4-ee41-45cf-a005-348078fc00c6\") " pod="openshift-ingress/kube-auth-proxy-9566dff59-9blvs" Jun 15 01:48:52.850886 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:52.850818 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28cf08e4-ee41-45cf-a005-348078fc00c6-tmp\") pod \"kube-auth-proxy-9566dff59-9blvs\" (UID: \"28cf08e4-ee41-45cf-a005-348078fc00c6\") " pod="openshift-ingress/kube-auth-proxy-9566dff59-9blvs" Jun 15 01:48:52.853192 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:52.853167 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28cf08e4-ee41-45cf-a005-348078fc00c6-tmp\") pod \"kube-auth-proxy-9566dff59-9blvs\" (UID: \"28cf08e4-ee41-45cf-a005-348078fc00c6\") " pod="openshift-ingress/kube-auth-proxy-9566dff59-9blvs" Jun 15 01:48:52.853319 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:52.853303 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28cf08e4-ee41-45cf-a005-348078fc00c6-tls-certs\") pod \"kube-auth-proxy-9566dff59-9blvs\" (UID: \"28cf08e4-ee41-45cf-a005-348078fc00c6\") " pod="openshift-ingress/kube-auth-proxy-9566dff59-9blvs" Jun 15 01:48:52.859584 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:52.859556 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm8gb\" (UniqueName: \"kubernetes.io/projected/28cf08e4-ee41-45cf-a005-348078fc00c6-kube-api-access-bm8gb\") pod \"kube-auth-proxy-9566dff59-9blvs\" (UID: \"28cf08e4-ee41-45cf-a005-348078fc00c6\") " pod="openshift-ingress/kube-auth-proxy-9566dff59-9blvs" Jun 15 01:48:52.925387 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:52.925358 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:48:52.936374 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:52.936354 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-9566dff59-9blvs" Jun 15 01:48:53.026048 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:53.026009 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:48:53.069262 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:53.069228 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-9566dff59-9blvs"] Jun 15 01:48:53.072417 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:48:53.072389 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28cf08e4_ee41_45cf_a005_348078fc00c6.slice/crio-b27a007dc4f4326d0701f67d69adaecfa3dfcbc892b713e387aab51e3ef4b2e3 WatchSource:0}: Error finding container b27a007dc4f4326d0701f67d69adaecfa3dfcbc892b713e387aab51e3ef4b2e3: Status 404 returned error can't find the container with id b27a007dc4f4326d0701f67d69adaecfa3dfcbc892b713e387aab51e3ef4b2e3 Jun 15 01:48:53.224642 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:53.224569 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:48:53.533739 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:53.533707 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:48:53.926788 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:53.926752 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-9566dff59-9blvs" event={"ID":"28cf08e4-ee41-45cf-a005-348078fc00c6","Type":"ContainerStarted","Data":"b27a007dc4f4326d0701f67d69adaecfa3dfcbc892b713e387aab51e3ef4b2e3"} Jun 15 01:48:56.944117 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:56.944082 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-9566dff59-9blvs" event={"ID":"28cf08e4-ee41-45cf-a005-348078fc00c6","Type":"ContainerStarted","Data":"05a04301315a30be636feae12eec8bca4211b1f7607b207974a81892ad2e03c8"} Jun 15 01:48:56.961842 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:48:56.961796 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-9566dff59-9blvs" podStartSLOduration=1.739170989 podStartE2EDuration="4.961779887s" totalImagesPullingTime="3.222608898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:48:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:48:56.960239406 +0000 UTC m=+632.819062278" watchObservedRunningTime="2026-06-15 01:48:56.961779887 +0000 UTC m=+632.820602567" Jun 15 01:49:02.840176 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:49:02.840130 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:49:02.909677 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:49:02.909622 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:49:03.097011 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:49:03.096974 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:49:03.191331 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:49:03.191296 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:49:03.683971 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:49:03.683933 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:49:03.778585 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:49:03.778551 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:49:04.192674 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:49:04.192613 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:49:04.560673 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:49:04.560573 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:49:04.749301 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:49:04.749266 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:49:04.993815 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:49:04.993783 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:49:05.131323 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:49:05.131283 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:49:05.627711 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:49:05.627681 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:49:05.875519 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:49:05.875490 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:49:06.277263 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:49:06.277233 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:49:07.626580 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:49:07.626546 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:49:09.236835 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:49:09.236795 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:49:22.300797 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:49:22.300760 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:49:22.362555 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:49:22.362521 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:49:22.930911 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:49:22.930878 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:49:26.229393 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:49:26.229365 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:49:26.329572 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:49:26.329534 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:49:26.821992 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:49:26.821956 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:49:27.232096 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:49:27.232066 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:49:27.330946 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:49:27.330913 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:49:27.430426 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:49:27.430395 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:49:53.389311 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:49:53.389279 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:49:53.484585 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:49:53.484549 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:49:53.581260 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:49:53.581226 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:49:54.302236 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:49:54.302205 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:49:54.511779 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:49:54.511743 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:49:57.947232 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:49:57.947194 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:50:22.077013 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:22.076979 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:50:25.954170 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:25.954133 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:50:27.702203 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:27.702171 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:50:28.969185 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:28.969146 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-f9z7m"] Jun 15 01:50:28.972670 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:28.972648 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f9z7m" Jun 15 01:50:28.974720 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:28.974697 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 15 01:50:28.974828 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:28.974727 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 15 01:50:28.975316 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:28.975296 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 15 01:50:28.975435 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:28.975414 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-7l4dv\"" Jun 15 01:50:28.982064 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:28.982043 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-f9z7m"] Jun 15 01:50:29.068042 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:29.068013 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khp7j\" (UniqueName: \"kubernetes.io/projected/ab9a317d-cd9a-45ef-9876-50a017554cc6-kube-api-access-khp7j\") pod \"dns-operator-controller-manager-864dd78c4c-f9z7m\" (UID: \"ab9a317d-cd9a-45ef-9876-50a017554cc6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f9z7m" Jun 15 01:50:29.168486 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:29.168450 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khp7j\" (UniqueName: \"kubernetes.io/projected/ab9a317d-cd9a-45ef-9876-50a017554cc6-kube-api-access-khp7j\") pod \"dns-operator-controller-manager-864dd78c4c-f9z7m\" (UID: \"ab9a317d-cd9a-45ef-9876-50a017554cc6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f9z7m" Jun 15 01:50:29.181196 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:29.181168 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khp7j\" (UniqueName: \"kubernetes.io/projected/ab9a317d-cd9a-45ef-9876-50a017554cc6-kube-api-access-khp7j\") pod \"dns-operator-controller-manager-864dd78c4c-f9z7m\" (UID: \"ab9a317d-cd9a-45ef-9876-50a017554cc6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f9z7m" Jun 15 01:50:29.283672 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:29.283576 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f9z7m" Jun 15 01:50:29.410962 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:29.410932 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-f9z7m"] Jun 15 01:50:29.413930 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:50:29.413906 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab9a317d_cd9a_45ef_9876_50a017554cc6.slice/crio-a505f4ee5749587004ebe0d981131fcf80091d565f0cac5004604abb3e70234b WatchSource:0}: Error finding container a505f4ee5749587004ebe0d981131fcf80091d565f0cac5004604abb3e70234b: Status 404 returned error can't find the container with id a505f4ee5749587004ebe0d981131fcf80091d565f0cac5004604abb3e70234b Jun 15 01:50:29.538292 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:29.538211 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:50:29.690909 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:29.690875 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:50:30.349800 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:30.349770 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f9z7m" event={"ID":"ab9a317d-cd9a-45ef-9876-50a017554cc6","Type":"ContainerStarted","Data":"a505f4ee5749587004ebe0d981131fcf80091d565f0cac5004604abb3e70234b"} Jun 15 01:50:31.913399 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:31.913367 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-plvjf"] Jun 15 01:50:31.916467 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:31.916445 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-plvjf" Jun 15 01:50:31.921076 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:31.921060 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-2ngj9\"" Jun 15 01:50:31.928240 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:31.928220 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-plvjf"] Jun 15 01:50:31.944449 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:31.944422 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:50:31.994065 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:31.993995 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g57z\" (UniqueName: \"kubernetes.io/projected/ba7fc43b-6fea-4cfd-aca1-ba60624c9e2a-kube-api-access-8g57z\") pod \"limitador-operator-controller-manager-859d7b78bd-plvjf\" (UID: \"ba7fc43b-6fea-4cfd-aca1-ba60624c9e2a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-plvjf" Jun 15 01:50:32.095799 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:32.095760 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g57z\" (UniqueName: \"kubernetes.io/projected/ba7fc43b-6fea-4cfd-aca1-ba60624c9e2a-kube-api-access-8g57z\") pod \"limitador-operator-controller-manager-859d7b78bd-plvjf\" (UID: \"ba7fc43b-6fea-4cfd-aca1-ba60624c9e2a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-plvjf" Jun 15 01:50:32.096317 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:32.096292 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:50:32.103908 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:32.103881 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g57z\" (UniqueName: \"kubernetes.io/projected/ba7fc43b-6fea-4cfd-aca1-ba60624c9e2a-kube-api-access-8g57z\") pod \"limitador-operator-controller-manager-859d7b78bd-plvjf\" (UID: \"ba7fc43b-6fea-4cfd-aca1-ba60624c9e2a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-plvjf" Jun 15 01:50:32.225980 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:32.225935 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-plvjf" Jun 15 01:50:32.355856 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:32.355834 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-plvjf"] Jun 15 01:50:32.358211 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:50:32.358180 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba7fc43b_6fea_4cfd_aca1_ba60624c9e2a.slice/crio-30941626c22572cebbe31a569e8c7e5494d52079d4fbb85ee542a016911272dd WatchSource:0}: Error finding container 30941626c22572cebbe31a569e8c7e5494d52079d4fbb85ee542a016911272dd: Status 404 returned error can't find the container with id 30941626c22572cebbe31a569e8c7e5494d52079d4fbb85ee542a016911272dd Jun 15 01:50:32.361905 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:32.361880 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f9z7m" event={"ID":"ab9a317d-cd9a-45ef-9876-50a017554cc6","Type":"ContainerStarted","Data":"52b166d8e20a924676abae86e94bbcff13a3b3200c2573ab963b1db1393897a5"} Jun 15 01:50:32.362018 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:32.361998 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f9z7m" Jun 15 01:50:32.378880 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:32.378842 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f9z7m" podStartSLOduration=2.076968377 podStartE2EDuration="4.37882913s" totalImagesPullingTime="2.301860753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:50:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:50:32.376685314 +0000 UTC m=+728.235507984" watchObservedRunningTime="2026-06-15 01:50:32.37882913 +0000 UTC m=+728.237651799" Jun 15 01:50:32.886458 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:32.886429 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:50:33.368325 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:33.368290 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-plvjf" event={"ID":"ba7fc43b-6fea-4cfd-aca1-ba60624c9e2a","Type":"ContainerStarted","Data":"30941626c22572cebbe31a569e8c7e5494d52079d4fbb85ee542a016911272dd"} Jun 15 01:50:34.320797 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:34.320767 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:50:35.378896 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:35.378862 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-plvjf" event={"ID":"ba7fc43b-6fea-4cfd-aca1-ba60624c9e2a","Type":"ContainerStarted","Data":"d8085ff2701f15c25254609591dc7e69587a1a9a72651724dd6f6ec73bac90fc"} Jun 15 01:50:35.379262 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:35.378996 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-plvjf" Jun 15 01:50:37.297007 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:37.296968 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:50:37.318300 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:37.318256 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-plvjf" podStartSLOduration=4.010112656 podStartE2EDuration="6.318239262s" totalImagesPullingTime="2.308126606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:50:35.396008406 +0000 UTC m=+731.254831072" watchObservedRunningTime="2026-06-15 01:50:37.318239262 +0000 UTC m=+733.177061929" Jun 15 01:50:37.319595 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:37.319573 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-44psx"] Jun 15 01:50:37.326912 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:37.326880 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-44psx" Jun 15 01:50:37.329390 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:37.329364 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6whwg\"" Jun 15 01:50:37.329548 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:37.329417 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 15 01:50:37.329686 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:37.329644 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 15 01:50:37.331014 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:37.330991 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-44psx"] Jun 15 01:50:37.366760 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:37.366725 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:50:37.439940 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:37.439905 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e2bc9136-e160-4290-9d02-abef84be5f26-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-44psx\" (UID: \"e2bc9136-e160-4290-9d02-abef84be5f26\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-44psx" Jun 15 01:50:37.440077 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:37.439951 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmbq9\" (UniqueName: \"kubernetes.io/projected/e2bc9136-e160-4290-9d02-abef84be5f26-kube-api-access-zmbq9\") pod \"kuadrant-console-plugin-66b5774985-44psx\" (UID: \"e2bc9136-e160-4290-9d02-abef84be5f26\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-44psx" Jun 15 01:50:37.440077 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:37.439988 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2bc9136-e160-4290-9d02-abef84be5f26-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-44psx\" (UID: \"e2bc9136-e160-4290-9d02-abef84be5f26\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-44psx" Jun 15 01:50:37.540718 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:37.540684 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e2bc9136-e160-4290-9d02-abef84be5f26-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-44psx\" (UID: \"e2bc9136-e160-4290-9d02-abef84be5f26\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-44psx" Jun 15 01:50:37.540841 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:37.540722 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmbq9\" (UniqueName: \"kubernetes.io/projected/e2bc9136-e160-4290-9d02-abef84be5f26-kube-api-access-zmbq9\") pod \"kuadrant-console-plugin-66b5774985-44psx\" (UID: \"e2bc9136-e160-4290-9d02-abef84be5f26\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-44psx" Jun 15 01:50:37.540841 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:37.540754 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2bc9136-e160-4290-9d02-abef84be5f26-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-44psx\" (UID: \"e2bc9136-e160-4290-9d02-abef84be5f26\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-44psx" Jun 15 01:50:37.540926 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:50:37.540852 2551 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 15 01:50:37.540926 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:50:37.540906 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2bc9136-e160-4290-9d02-abef84be5f26-plugin-serving-cert podName:e2bc9136-e160-4290-9d02-abef84be5f26 nodeName:}" failed. No retries permitted until 2026-06-15 01:50:38.040890111 +0000 UTC m=+733.899712756 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/e2bc9136-e160-4290-9d02-abef84be5f26-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-44psx" (UID: "e2bc9136-e160-4290-9d02-abef84be5f26") : secret "plugin-serving-cert" not found Jun 15 01:50:37.541458 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:37.541440 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e2bc9136-e160-4290-9d02-abef84be5f26-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-44psx\" (UID: \"e2bc9136-e160-4290-9d02-abef84be5f26\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-44psx" Jun 15 01:50:37.548693 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:37.548617 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmbq9\" (UniqueName: \"kubernetes.io/projected/e2bc9136-e160-4290-9d02-abef84be5f26-kube-api-access-zmbq9\") pod \"kuadrant-console-plugin-66b5774985-44psx\" (UID: \"e2bc9136-e160-4290-9d02-abef84be5f26\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-44psx" Jun 15 01:50:37.975311 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:37.975263 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:50:38.043858 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:38.043823 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2bc9136-e160-4290-9d02-abef84be5f26-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-44psx\" (UID: \"e2bc9136-e160-4290-9d02-abef84be5f26\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-44psx" Jun 15 01:50:38.046251 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:38.046229 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2bc9136-e160-4290-9d02-abef84be5f26-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-44psx\" (UID: \"e2bc9136-e160-4290-9d02-abef84be5f26\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-44psx" Jun 15 01:50:38.257560 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:38.257479 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-44psx" Jun 15 01:50:38.384428 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:38.384382 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-44psx"] Jun 15 01:50:38.386828 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:50:38.386800 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode2bc9136_e160_4290_9d02_abef84be5f26.slice/crio-258c19c9faa3a224aa5a38eb6bfdd13f82c7278af03ebe9e68fc7a028bc1317a WatchSource:0}: Error finding container 258c19c9faa3a224aa5a38eb6bfdd13f82c7278af03ebe9e68fc7a028bc1317a: Status 404 returned error can't find the container with id 258c19c9faa3a224aa5a38eb6bfdd13f82c7278af03ebe9e68fc7a028bc1317a Jun 15 01:50:38.393054 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:38.393012 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-44psx" event={"ID":"e2bc9136-e160-4290-9d02-abef84be5f26","Type":"ContainerStarted","Data":"258c19c9faa3a224aa5a38eb6bfdd13f82c7278af03ebe9e68fc7a028bc1317a"} Jun 15 01:50:43.371424 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:43.371308 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f9z7m" Jun 15 01:50:44.937977 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:44.937941 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:50:45.037957 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:45.037928 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:50:46.385978 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:46.385946 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-plvjf" Jun 15 01:50:47.705596 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:47.705562 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-plvjf"] Jun 15 01:50:47.706049 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:47.705777 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-plvjf" podUID="ba7fc43b-6fea-4cfd-aca1-ba60624c9e2a" containerName="manager" containerID="cri-o://d8085ff2701f15c25254609591dc7e69587a1a9a72651724dd6f6ec73bac90fc" gracePeriod=2 Jun 15 01:50:47.727400 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:47.727337 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-plvjf"] Jun 15 01:50:47.744171 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:50:47.744127 2551 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ba7fc43b-6fea-4cfd-aca1-ba60624c9e2a\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-plvjf\": pods \"limitador-operator-controller-manager-859d7b78bd-plvjf\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-plvjf" Jun 15 01:50:49.718593 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:49.718557 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:50:49.819504 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:49.819468 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:50:54.499020 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:54.498976 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:50:54.600045 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:54.600014 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:50:58.721224 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:58.721191 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:50:58.819260 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:50:58.819212 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:51:02.283133 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:02.283104 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-plvjf" Jun 15 01:51:02.285255 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:51:02.285220 2551 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-plvjf\" is forbidden: User \"system:node:ip-10-0-137-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-147.ec2.internal' and this object" podUID="ba7fc43b-6fea-4cfd-aca1-ba60624c9e2a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-plvjf" Jun 15 01:51:02.464882 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:02.464799 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8g57z\" (UniqueName: \"kubernetes.io/projected/ba7fc43b-6fea-4cfd-aca1-ba60624c9e2a-kube-api-access-8g57z\") pod \"ba7fc43b-6fea-4cfd-aca1-ba60624c9e2a\" (UID: \"ba7fc43b-6fea-4cfd-aca1-ba60624c9e2a\") " Jun 15 01:51:02.466956 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:02.466922 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba7fc43b-6fea-4cfd-aca1-ba60624c9e2a-kube-api-access-8g57z" (OuterVolumeSpecName: "kube-api-access-8g57z") pod "ba7fc43b-6fea-4cfd-aca1-ba60624c9e2a" (UID: "ba7fc43b-6fea-4cfd-aca1-ba60624c9e2a"). InnerVolumeSpecName "kube-api-access-8g57z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:51:02.516295 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:02.516269 2551 generic.go:356] "Generic (PLEG): container finished" podID="ba7fc43b-6fea-4cfd-aca1-ba60624c9e2a" containerID="d8085ff2701f15c25254609591dc7e69587a1a9a72651724dd6f6ec73bac90fc" exitCode=0 Jun 15 01:51:02.516412 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:02.516307 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-plvjf" Jun 15 01:51:02.516412 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:02.516365 2551 scope.go:117] "RemoveContainer" containerID="d8085ff2701f15c25254609591dc7e69587a1a9a72651724dd6f6ec73bac90fc" Jun 15 01:51:02.518405 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:51:02.518382 2551 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-plvjf\" is forbidden: User \"system:node:ip-10-0-137-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-147.ec2.internal' and this object" podUID="ba7fc43b-6fea-4cfd-aca1-ba60624c9e2a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-plvjf" Jun 15 01:51:02.524512 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:02.524492 2551 scope.go:117] "RemoveContainer" containerID="d8085ff2701f15c25254609591dc7e69587a1a9a72651724dd6f6ec73bac90fc" Jun 15 01:51:02.524871 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:51:02.524850 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8085ff2701f15c25254609591dc7e69587a1a9a72651724dd6f6ec73bac90fc\": container with ID starting with d8085ff2701f15c25254609591dc7e69587a1a9a72651724dd6f6ec73bac90fc not found: ID does not exist" containerID="d8085ff2701f15c25254609591dc7e69587a1a9a72651724dd6f6ec73bac90fc" Jun 15 01:51:02.524964 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:02.524885 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8085ff2701f15c25254609591dc7e69587a1a9a72651724dd6f6ec73bac90fc"} err="failed to get container status \"d8085ff2701f15c25254609591dc7e69587a1a9a72651724dd6f6ec73bac90fc\": rpc error: code = NotFound desc = could not find container \"d8085ff2701f15c25254609591dc7e69587a1a9a72651724dd6f6ec73bac90fc\": container with ID starting with d8085ff2701f15c25254609591dc7e69587a1a9a72651724dd6f6ec73bac90fc not found: ID does not exist" Jun 15 01:51:02.527046 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:51:02.527021 2551 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-plvjf\" is forbidden: User \"system:node:ip-10-0-137-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-147.ec2.internal' and this object" podUID="ba7fc43b-6fea-4cfd-aca1-ba60624c9e2a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-plvjf" Jun 15 01:51:02.545833 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:02.545809 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba7fc43b-6fea-4cfd-aca1-ba60624c9e2a" path="/var/lib/kubelet/pods/ba7fc43b-6fea-4cfd-aca1-ba60624c9e2a/volumes" Jun 15 01:51:02.565497 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:02.565475 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8g57z\" (UniqueName: \"kubernetes.io/projected/ba7fc43b-6fea-4cfd-aca1-ba60624c9e2a-kube-api-access-8g57z\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:51:03.524245 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:03.524208 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-44psx" event={"ID":"e2bc9136-e160-4290-9d02-abef84be5f26","Type":"ContainerStarted","Data":"a6f449485c08dc2eda5ea19961a43f00327bca3d35c0565bd1c91206e02a849f"} Jun 15 01:51:03.539888 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:03.539832 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-44psx" podStartSLOduration=2.427781057 podStartE2EDuration="26.539812383s" totalImagesPullingTime="24.112031326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:50:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:51:03.538898679 +0000 UTC m=+759.397721346" watchObservedRunningTime="2026-06-15 01:51:03.539812383 +0000 UTC m=+759.398635050" Jun 15 01:51:05.911202 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:05.911164 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:51:06.011119 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:06.011078 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:51:08.930569 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:08.930537 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:51:10.112081 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:10.112047 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:51:10.245061 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:10.245025 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:51:14.907047 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:14.906995 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:51:15.007091 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:15.007061 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:51:17.426059 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.426023 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t"] Jun 15 01:51:17.426610 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.426588 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba7fc43b-6fea-4cfd-aca1-ba60624c9e2a" containerName="manager" Jun 15 01:51:17.426610 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.426609 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba7fc43b-6fea-4cfd-aca1-ba60624c9e2a" containerName="manager" Jun 15 01:51:17.426825 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.426733 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba7fc43b-6fea-4cfd-aca1-ba60624c9e2a" containerName="manager" Jun 15 01:51:17.449810 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.449781 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t"] Jun 15 01:51:17.449950 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.449862 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:51:17.452165 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.452144 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 15 01:51:17.452250 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.452183 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9g2wv\"" Jun 15 01:51:17.455771 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.455751 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:51:17.494094 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.494064 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7840efb-7120-42a9-bd47-8427cffcb426-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-c2f5t\" (UID: \"a7840efb-7120-42a9-bd47-8427cffcb426\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:51:17.494249 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.494101 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7840efb-7120-42a9-bd47-8427cffcb426-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-c2f5t\" (UID: \"a7840efb-7120-42a9-bd47-8427cffcb426\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:51:17.494249 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.494131 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7840efb-7120-42a9-bd47-8427cffcb426-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-c2f5t\" (UID: \"a7840efb-7120-42a9-bd47-8427cffcb426\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:51:17.494249 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.494192 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7840efb-7120-42a9-bd47-8427cffcb426-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-c2f5t\" (UID: \"a7840efb-7120-42a9-bd47-8427cffcb426\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:51:17.494383 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.494259 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7840efb-7120-42a9-bd47-8427cffcb426-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-c2f5t\" (UID: \"a7840efb-7120-42a9-bd47-8427cffcb426\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:51:17.494383 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.494280 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7840efb-7120-42a9-bd47-8427cffcb426-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-c2f5t\" (UID: \"a7840efb-7120-42a9-bd47-8427cffcb426\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:51:17.494383 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.494345 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7840efb-7120-42a9-bd47-8427cffcb426-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-c2f5t\" (UID: \"a7840efb-7120-42a9-bd47-8427cffcb426\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:51:17.494383 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.494367 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnjzj\" (UniqueName: \"kubernetes.io/projected/a7840efb-7120-42a9-bd47-8427cffcb426-kube-api-access-pnjzj\") pod \"maas-default-gateway-openshift-default-687ff6996-c2f5t\" (UID: \"a7840efb-7120-42a9-bd47-8427cffcb426\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:51:17.494533 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.494401 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7840efb-7120-42a9-bd47-8427cffcb426-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-c2f5t\" (UID: \"a7840efb-7120-42a9-bd47-8427cffcb426\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:51:17.595537 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.595507 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7840efb-7120-42a9-bd47-8427cffcb426-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-c2f5t\" (UID: \"a7840efb-7120-42a9-bd47-8427cffcb426\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:51:17.595537 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.595541 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7840efb-7120-42a9-bd47-8427cffcb426-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-c2f5t\" (UID: \"a7840efb-7120-42a9-bd47-8427cffcb426\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:51:17.595792 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.595571 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7840efb-7120-42a9-bd47-8427cffcb426-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-c2f5t\" (UID: \"a7840efb-7120-42a9-bd47-8427cffcb426\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:51:17.595792 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.595595 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7840efb-7120-42a9-bd47-8427cffcb426-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-c2f5t\" (UID: \"a7840efb-7120-42a9-bd47-8427cffcb426\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:51:17.595792 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.595677 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7840efb-7120-42a9-bd47-8427cffcb426-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-c2f5t\" (UID: \"a7840efb-7120-42a9-bd47-8427cffcb426\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:51:17.595792 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.595709 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7840efb-7120-42a9-bd47-8427cffcb426-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-c2f5t\" (UID: \"a7840efb-7120-42a9-bd47-8427cffcb426\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:51:17.595792 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.595742 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7840efb-7120-42a9-bd47-8427cffcb426-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-c2f5t\" (UID: \"a7840efb-7120-42a9-bd47-8427cffcb426\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:51:17.595792 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.595767 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnjzj\" (UniqueName: \"kubernetes.io/projected/a7840efb-7120-42a9-bd47-8427cffcb426-kube-api-access-pnjzj\") pod \"maas-default-gateway-openshift-default-687ff6996-c2f5t\" (UID: \"a7840efb-7120-42a9-bd47-8427cffcb426\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:51:17.595792 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.595792 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7840efb-7120-42a9-bd47-8427cffcb426-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-c2f5t\" (UID: \"a7840efb-7120-42a9-bd47-8427cffcb426\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:51:17.596416 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.595988 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7840efb-7120-42a9-bd47-8427cffcb426-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-c2f5t\" (UID: \"a7840efb-7120-42a9-bd47-8427cffcb426\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:51:17.596416 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.596087 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7840efb-7120-42a9-bd47-8427cffcb426-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-c2f5t\" (UID: \"a7840efb-7120-42a9-bd47-8427cffcb426\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:51:17.596416 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.596138 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7840efb-7120-42a9-bd47-8427cffcb426-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-c2f5t\" (UID: \"a7840efb-7120-42a9-bd47-8427cffcb426\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:51:17.596416 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.596187 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7840efb-7120-42a9-bd47-8427cffcb426-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-c2f5t\" (UID: \"a7840efb-7120-42a9-bd47-8427cffcb426\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:51:17.596416 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.596381 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7840efb-7120-42a9-bd47-8427cffcb426-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-c2f5t\" (UID: \"a7840efb-7120-42a9-bd47-8427cffcb426\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:51:17.598008 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.597985 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7840efb-7120-42a9-bd47-8427cffcb426-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-c2f5t\" (UID: \"a7840efb-7120-42a9-bd47-8427cffcb426\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:51:17.598107 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.598058 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7840efb-7120-42a9-bd47-8427cffcb426-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-c2f5t\" (UID: \"a7840efb-7120-42a9-bd47-8427cffcb426\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:51:17.603343 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.603314 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnjzj\" (UniqueName: \"kubernetes.io/projected/a7840efb-7120-42a9-bd47-8427cffcb426-kube-api-access-pnjzj\") pod \"maas-default-gateway-openshift-default-687ff6996-c2f5t\" (UID: \"a7840efb-7120-42a9-bd47-8427cffcb426\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:51:17.603436 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.603324 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7840efb-7120-42a9-bd47-8427cffcb426-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-c2f5t\" (UID: \"a7840efb-7120-42a9-bd47-8427cffcb426\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:51:17.716618 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.716540 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:51:17.760498 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.760465 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:51:17.890049 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:17.889988 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t"] Jun 15 01:51:17.892851 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:51:17.892824 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7840efb_7120_42a9_bd47_8427cffcb426.slice/crio-fab95b850d757b8170c243b162fe8efc280a5f917523b4ed7c0407cbdd81a95e WatchSource:0}: Error finding container fab95b850d757b8170c243b162fe8efc280a5f917523b4ed7c0407cbdd81a95e: Status 404 returned error can't find the container with id fab95b850d757b8170c243b162fe8efc280a5f917523b4ed7c0407cbdd81a95e Jun 15 01:51:18.590542 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:18.590508 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" event={"ID":"a7840efb-7120-42a9-bd47-8427cffcb426","Type":"ContainerStarted","Data":"fab95b850d757b8170c243b162fe8efc280a5f917523b4ed7c0407cbdd81a95e"} Jun 15 01:51:20.740100 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:20.740062 2551 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 01:51:20.740340 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:20.740143 2551 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 01:51:20.740340 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:20.740170 2551 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 01:51:21.609859 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:21.609824 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" event={"ID":"a7840efb-7120-42a9-bd47-8427cffcb426","Type":"ContainerStarted","Data":"a721857cada3ad0b4cb6bfdd779e2caefa17a555619fa041e1a3e3f6469ded16"} Jun 15 01:51:21.632119 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:21.632068 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" podStartSLOduration=1.787016959 podStartE2EDuration="4.632051006s" totalImagesPullingTime="2.845034047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:51:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:51:21.630312658 +0000 UTC m=+777.489135345" watchObservedRunningTime="2026-06-15 01:51:21.632051006 +0000 UTC m=+777.490873673" Jun 15 01:51:21.760797 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:21.760762 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:51:21.765521 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:21.765496 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:51:22.615030 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:22.614992 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:51:22.615964 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:22.615942 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:51:22.646501 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:22.646384 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:51:22.646734 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:22.646695 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-d8cj6"] Jun 15 01:51:22.663551 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:22.663520 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-d8cj6"] Jun 15 01:51:22.663717 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:22.663664 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-d8cj6" Jun 15 01:51:22.665982 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:22.665959 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 15 01:51:22.741619 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:22.741592 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8a64d94d-c463-46ad-bda2-9a9be71bff4e-config-file\") pod \"limitador-limitador-64c94fd64f-d8cj6\" (UID: \"8a64d94d-c463-46ad-bda2-9a9be71bff4e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-d8cj6" Jun 15 01:51:22.741773 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:22.741622 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw69s\" (UniqueName: \"kubernetes.io/projected/8a64d94d-c463-46ad-bda2-9a9be71bff4e-kube-api-access-mw69s\") pod \"limitador-limitador-64c94fd64f-d8cj6\" (UID: \"8a64d94d-c463-46ad-bda2-9a9be71bff4e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-d8cj6" Jun 15 01:51:22.747644 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:22.747600 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-d8cj6"] Jun 15 01:51:22.754783 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:22.754757 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:51:22.808974 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:22.808934 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:51:22.842920 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:22.842895 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8a64d94d-c463-46ad-bda2-9a9be71bff4e-config-file\") pod \"limitador-limitador-64c94fd64f-d8cj6\" (UID: \"8a64d94d-c463-46ad-bda2-9a9be71bff4e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-d8cj6" Jun 15 01:51:22.843048 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:22.842927 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw69s\" (UniqueName: \"kubernetes.io/projected/8a64d94d-c463-46ad-bda2-9a9be71bff4e-kube-api-access-mw69s\") pod \"limitador-limitador-64c94fd64f-d8cj6\" (UID: \"8a64d94d-c463-46ad-bda2-9a9be71bff4e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-d8cj6" Jun 15 01:51:22.843479 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:22.843460 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8a64d94d-c463-46ad-bda2-9a9be71bff4e-config-file\") pod \"limitador-limitador-64c94fd64f-d8cj6\" (UID: \"8a64d94d-c463-46ad-bda2-9a9be71bff4e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-d8cj6" Jun 15 01:51:22.850795 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:22.850765 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw69s\" (UniqueName: \"kubernetes.io/projected/8a64d94d-c463-46ad-bda2-9a9be71bff4e-kube-api-access-mw69s\") pod \"limitador-limitador-64c94fd64f-d8cj6\" (UID: \"8a64d94d-c463-46ad-bda2-9a9be71bff4e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-d8cj6" Jun 15 01:51:22.977202 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:22.977122 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-d8cj6" Jun 15 01:51:23.111220 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:23.111192 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-d8cj6"] Jun 15 01:51:23.113653 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:51:23.113607 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a64d94d_c463_46ad_bda2_9a9be71bff4e.slice/crio-d1857d1bde271df47d55c9c3e84bf15d4e4831ad3f40b497a04acf8bce7de1a8 WatchSource:0}: Error finding container d1857d1bde271df47d55c9c3e84bf15d4e4831ad3f40b497a04acf8bce7de1a8: Status 404 returned error can't find the container with id d1857d1bde271df47d55c9c3e84bf15d4e4831ad3f40b497a04acf8bce7de1a8 Jun 15 01:51:23.508816 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:23.508786 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:51:23.569139 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:23.569106 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:51:23.608604 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:23.608573 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-wqvx4"] Jun 15 01:51:23.613690 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:23.613669 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wqvx4" Jun 15 01:51:23.615736 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:23.615712 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6xchh\"" Jun 15 01:51:23.616006 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:23.615978 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wqvx4"] Jun 15 01:51:23.621929 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:23.621891 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-d8cj6" event={"ID":"8a64d94d-c463-46ad-bda2-9a9be71bff4e","Type":"ContainerStarted","Data":"d1857d1bde271df47d55c9c3e84bf15d4e4831ad3f40b497a04acf8bce7de1a8"} Jun 15 01:51:23.651108 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:23.651080 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdfdq\" (UniqueName: \"kubernetes.io/projected/26194d68-a7ca-4284-9d91-e86d2a70d4a1-kube-api-access-cdfdq\") pod \"authorino-75d556bd77-wqvx4\" (UID: \"26194d68-a7ca-4284-9d91-e86d2a70d4a1\") " pod="kuadrant-system/authorino-75d556bd77-wqvx4" Jun 15 01:51:23.752472 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:23.752433 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdfdq\" (UniqueName: \"kubernetes.io/projected/26194d68-a7ca-4284-9d91-e86d2a70d4a1-kube-api-access-cdfdq\") pod \"authorino-75d556bd77-wqvx4\" (UID: \"26194d68-a7ca-4284-9d91-e86d2a70d4a1\") " pod="kuadrant-system/authorino-75d556bd77-wqvx4" Jun 15 01:51:23.760228 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:23.760171 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdfdq\" (UniqueName: \"kubernetes.io/projected/26194d68-a7ca-4284-9d91-e86d2a70d4a1-kube-api-access-cdfdq\") pod \"authorino-75d556bd77-wqvx4\" (UID: \"26194d68-a7ca-4284-9d91-e86d2a70d4a1\") " pod="kuadrant-system/authorino-75d556bd77-wqvx4" Jun 15 01:51:23.925111 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:23.924873 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wqvx4" Jun 15 01:51:24.110173 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:24.110135 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wqvx4"] Jun 15 01:51:24.112305 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:51:24.112274 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26194d68_a7ca_4284_9d91_e86d2a70d4a1.slice/crio-eca1c2eccd76f0b6bf2236987aeb946af51e041c02ebbd49d89ec7b3e507579c WatchSource:0}: Error finding container eca1c2eccd76f0b6bf2236987aeb946af51e041c02ebbd49d89ec7b3e507579c: Status 404 returned error can't find the container with id eca1c2eccd76f0b6bf2236987aeb946af51e041c02ebbd49d89ec7b3e507579c Jun 15 01:51:24.632140 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:24.632083 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wqvx4" event={"ID":"26194d68-a7ca-4284-9d91-e86d2a70d4a1","Type":"ContainerStarted","Data":"eca1c2eccd76f0b6bf2236987aeb946af51e041c02ebbd49d89ec7b3e507579c"} Jun 15 01:51:25.590712 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:25.590674 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:51:28.652859 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:28.652822 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wqvx4" event={"ID":"26194d68-a7ca-4284-9d91-e86d2a70d4a1","Type":"ContainerStarted","Data":"dd9a55cebe78c19f7f5f2afa5c66abaab5a63964747c6abe48e27bcec45274ac"} Jun 15 01:51:28.654237 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:28.654213 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-d8cj6" event={"ID":"8a64d94d-c463-46ad-bda2-9a9be71bff4e","Type":"ContainerStarted","Data":"d3d7c619bb1d627608d57e52da0e057c9848f018e6b9941bc9b81a8ea325872d"} Jun 15 01:51:28.654379 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:28.654262 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-d8cj6" Jun 15 01:51:28.666188 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:28.666147 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-wqvx4" podStartSLOduration=1.998929257 podStartE2EDuration="5.666134899s" totalImagesPullingTime="3.667205642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:51:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:51:28.665916284 +0000 UTC m=+784.524738953" watchObservedRunningTime="2026-06-15 01:51:28.666134899 +0000 UTC m=+784.524957567" Jun 15 01:51:28.682528 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:28.682484 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-d8cj6" podStartSLOduration=2.007247249 podStartE2EDuration="6.682468756s" totalImagesPullingTime="4.675221507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:51:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:51:28.680562835 +0000 UTC m=+784.539385501" watchObservedRunningTime="2026-06-15 01:51:28.682468756 +0000 UTC m=+784.541291439" Jun 15 01:51:39.340618 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:39.340541 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-d8cj6"] Jun 15 01:51:39.341140 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:39.340795 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-d8cj6" podUID="8a64d94d-c463-46ad-bda2-9a9be71bff4e" containerName="limitador" containerID="cri-o://d3d7c619bb1d627608d57e52da0e057c9848f018e6b9941bc9b81a8ea325872d" gracePeriod=30 Jun 15 01:51:39.341493 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:39.341449 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-d8cj6" Jun 15 01:51:39.895348 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:39.895325 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-d8cj6" Jun 15 01:51:40.001991 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:40.001913 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mw69s\" (UniqueName: \"kubernetes.io/projected/8a64d94d-c463-46ad-bda2-9a9be71bff4e-kube-api-access-mw69s\") pod \"8a64d94d-c463-46ad-bda2-9a9be71bff4e\" (UID: \"8a64d94d-c463-46ad-bda2-9a9be71bff4e\") " Jun 15 01:51:40.002137 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:40.002009 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8a64d94d-c463-46ad-bda2-9a9be71bff4e-config-file\") pod \"8a64d94d-c463-46ad-bda2-9a9be71bff4e\" (UID: \"8a64d94d-c463-46ad-bda2-9a9be71bff4e\") " Jun 15 01:51:40.002379 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:40.002346 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a64d94d-c463-46ad-bda2-9a9be71bff4e-config-file" (OuterVolumeSpecName: "config-file") pod "8a64d94d-c463-46ad-bda2-9a9be71bff4e" (UID: "8a64d94d-c463-46ad-bda2-9a9be71bff4e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:51:40.004166 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:40.004141 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a64d94d-c463-46ad-bda2-9a9be71bff4e-kube-api-access-mw69s" (OuterVolumeSpecName: "kube-api-access-mw69s") pod "8a64d94d-c463-46ad-bda2-9a9be71bff4e" (UID: "8a64d94d-c463-46ad-bda2-9a9be71bff4e"). InnerVolumeSpecName "kube-api-access-mw69s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:51:40.103440 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:40.103403 2551 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8a64d94d-c463-46ad-bda2-9a9be71bff4e-config-file\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:51:40.103440 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:40.103433 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mw69s\" (UniqueName: \"kubernetes.io/projected/8a64d94d-c463-46ad-bda2-9a9be71bff4e-kube-api-access-mw69s\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:51:40.708143 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:40.708100 2551 generic.go:356] "Generic (PLEG): container finished" podID="8a64d94d-c463-46ad-bda2-9a9be71bff4e" containerID="d3d7c619bb1d627608d57e52da0e057c9848f018e6b9941bc9b81a8ea325872d" exitCode=0 Jun 15 01:51:40.708143 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:40.708146 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-d8cj6" Jun 15 01:51:40.708705 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:40.708145 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-d8cj6" event={"ID":"8a64d94d-c463-46ad-bda2-9a9be71bff4e","Type":"ContainerDied","Data":"d3d7c619bb1d627608d57e52da0e057c9848f018e6b9941bc9b81a8ea325872d"} Jun 15 01:51:40.708705 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:40.708265 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-d8cj6" event={"ID":"8a64d94d-c463-46ad-bda2-9a9be71bff4e","Type":"ContainerDied","Data":"d1857d1bde271df47d55c9c3e84bf15d4e4831ad3f40b497a04acf8bce7de1a8"} Jun 15 01:51:40.708705 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:40.708312 2551 scope.go:117] "RemoveContainer" containerID="d3d7c619bb1d627608d57e52da0e057c9848f018e6b9941bc9b81a8ea325872d" Jun 15 01:51:40.716759 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:40.716724 2551 scope.go:117] "RemoveContainer" containerID="d3d7c619bb1d627608d57e52da0e057c9848f018e6b9941bc9b81a8ea325872d" Jun 15 01:51:40.717031 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:51:40.717011 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3d7c619bb1d627608d57e52da0e057c9848f018e6b9941bc9b81a8ea325872d\": container with ID starting with d3d7c619bb1d627608d57e52da0e057c9848f018e6b9941bc9b81a8ea325872d not found: ID does not exist" containerID="d3d7c619bb1d627608d57e52da0e057c9848f018e6b9941bc9b81a8ea325872d" Jun 15 01:51:40.717092 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:40.717040 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3d7c619bb1d627608d57e52da0e057c9848f018e6b9941bc9b81a8ea325872d"} err="failed to get container status \"d3d7c619bb1d627608d57e52da0e057c9848f018e6b9941bc9b81a8ea325872d\": rpc error: code = NotFound desc = could not find container \"d3d7c619bb1d627608d57e52da0e057c9848f018e6b9941bc9b81a8ea325872d\": container with ID starting with d3d7c619bb1d627608d57e52da0e057c9848f018e6b9941bc9b81a8ea325872d not found: ID does not exist" Jun 15 01:51:40.723042 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:40.723023 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-d8cj6"] Jun 15 01:51:40.726699 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:40.726678 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-d8cj6"] Jun 15 01:51:42.547803 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:42.547774 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a64d94d-c463-46ad-bda2-9a9be71bff4e" path="/var/lib/kubelet/pods/8a64d94d-c463-46ad-bda2-9a9be71bff4e/volumes" Jun 15 01:51:44.121401 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:44.121359 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:51:54.818028 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:54.817994 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:51:54.917459 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:54.917411 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:51:55.104045 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:51:55.104014 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:52:09.274933 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:09.274896 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-4rkgh"] Jun 15 01:52:09.275333 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:09.275230 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a64d94d-c463-46ad-bda2-9a9be71bff4e" containerName="limitador" Jun 15 01:52:09.275333 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:09.275242 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a64d94d-c463-46ad-bda2-9a9be71bff4e" containerName="limitador" Jun 15 01:52:09.275333 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:09.275310 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a64d94d-c463-46ad-bda2-9a9be71bff4e" containerName="limitador" Jun 15 01:52:09.277188 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:09.277170 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-4rkgh" Jun 15 01:52:09.279278 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:09.279255 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 15 01:52:09.279278 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:09.279266 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-smgjp\"" Jun 15 01:52:09.279449 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:09.279311 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 15 01:52:09.286839 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:09.286815 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-4rkgh"] Jun 15 01:52:09.352691 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:09.352657 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmsxj\" (UniqueName: \"kubernetes.io/projected/bd796e74-5012-41cb-8bc5-74b72b9f3851-kube-api-access-cmsxj\") pod \"keycloak-operator-d67dbbb48-4rkgh\" (UID: \"bd796e74-5012-41cb-8bc5-74b72b9f3851\") " pod="keycloak-system/keycloak-operator-d67dbbb48-4rkgh" Jun 15 01:52:09.453312 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:09.453265 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmsxj\" (UniqueName: \"kubernetes.io/projected/bd796e74-5012-41cb-8bc5-74b72b9f3851-kube-api-access-cmsxj\") pod \"keycloak-operator-d67dbbb48-4rkgh\" (UID: \"bd796e74-5012-41cb-8bc5-74b72b9f3851\") " pod="keycloak-system/keycloak-operator-d67dbbb48-4rkgh" Jun 15 01:52:09.461121 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:09.461095 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmsxj\" (UniqueName: \"kubernetes.io/projected/bd796e74-5012-41cb-8bc5-74b72b9f3851-kube-api-access-cmsxj\") pod \"keycloak-operator-d67dbbb48-4rkgh\" (UID: \"bd796e74-5012-41cb-8bc5-74b72b9f3851\") " pod="keycloak-system/keycloak-operator-d67dbbb48-4rkgh" Jun 15 01:52:09.589313 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:09.589237 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-4rkgh" Jun 15 01:52:09.715606 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:09.715566 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-4rkgh"] Jun 15 01:52:09.718952 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:52:09.718924 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd796e74_5012_41cb_8bc5_74b72b9f3851.slice/crio-1dfc856f64c8ae81c8b06b9ac14d2dc14cd2a69370a41562b93f568c842bb3da WatchSource:0}: Error finding container 1dfc856f64c8ae81c8b06b9ac14d2dc14cd2a69370a41562b93f568c842bb3da: Status 404 returned error can't find the container with id 1dfc856f64c8ae81c8b06b9ac14d2dc14cd2a69370a41562b93f568c842bb3da Jun 15 01:52:09.847466 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:09.847436 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-4rkgh" event={"ID":"bd796e74-5012-41cb-8bc5-74b72b9f3851","Type":"ContainerStarted","Data":"1dfc856f64c8ae81c8b06b9ac14d2dc14cd2a69370a41562b93f568c842bb3da"} Jun 15 01:52:15.882951 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:15.882913 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-4rkgh" event={"ID":"bd796e74-5012-41cb-8bc5-74b72b9f3851","Type":"ContainerStarted","Data":"b806715f33f834db56d4ad212ace373284282395c82a5f03ba224552546c69a5"} Jun 15 01:52:15.900276 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:15.900227 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-4rkgh" podStartSLOduration=1.742975637 podStartE2EDuration="6.900212837s" totalImagesPullingTime="5.1572372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:52:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:52:15.898053419 +0000 UTC m=+831.756876099" watchObservedRunningTime="2026-06-15 01:52:15.900212837 +0000 UTC m=+831.759035503" Jun 15 01:52:23.939597 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:23.939562 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:52:24.039480 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:24.039443 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:52:53.340355 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:53.340324 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:52:53.469928 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:53.469892 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:52:53.564270 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:53.564234 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2wfv7"] Jun 15 01:52:53.570182 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:53.570163 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2wfv7" Jun 15 01:52:53.573105 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:53.573082 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2wfv7"] Jun 15 01:52:53.638096 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:53.638057 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2znl\" (UniqueName: \"kubernetes.io/projected/40f54a43-8625-4453-b130-14f5bf1658a1-kube-api-access-j2znl\") pod \"authorino-5d4b67c446-2wfv7\" (UID: \"40f54a43-8625-4453-b130-14f5bf1658a1\") " pod="kuadrant-system/authorino-5d4b67c446-2wfv7" Jun 15 01:52:53.739406 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:53.739369 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2znl\" (UniqueName: \"kubernetes.io/projected/40f54a43-8625-4453-b130-14f5bf1658a1-kube-api-access-j2znl\") pod \"authorino-5d4b67c446-2wfv7\" (UID: \"40f54a43-8625-4453-b130-14f5bf1658a1\") " pod="kuadrant-system/authorino-5d4b67c446-2wfv7" Jun 15 01:52:53.747838 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:53.747809 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2znl\" (UniqueName: \"kubernetes.io/projected/40f54a43-8625-4453-b130-14f5bf1658a1-kube-api-access-j2znl\") pod \"authorino-5d4b67c446-2wfv7\" (UID: \"40f54a43-8625-4453-b130-14f5bf1658a1\") " pod="kuadrant-system/authorino-5d4b67c446-2wfv7" Jun 15 01:52:53.749118 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:53.749096 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2wfv7"] Jun 15 01:52:53.749348 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:53.749334 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2wfv7" Jun 15 01:52:53.844765 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:53.844733 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b96664d7f-cwxbr"] Jun 15 01:52:53.850526 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:53.850500 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b96664d7f-cwxbr" Jun 15 01:52:53.856411 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:53.856389 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 15 01:52:53.863587 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:53.863563 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b96664d7f-cwxbr"] Jun 15 01:52:53.887832 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:53.887809 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2wfv7"] Jun 15 01:52:53.890431 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:52:53.890408 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40f54a43_8625_4453_b130_14f5bf1658a1.slice/crio-7c6558b88ec4b7d3bd5437f333e0a684d626385721e6d34bfaa88d7a7f1b2fe1 WatchSource:0}: Error finding container 7c6558b88ec4b7d3bd5437f333e0a684d626385721e6d34bfaa88d7a7f1b2fe1: Status 404 returned error can't find the container with id 7c6558b88ec4b7d3bd5437f333e0a684d626385721e6d34bfaa88d7a7f1b2fe1 Jun 15 01:52:53.941135 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:53.941107 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b1fa6d71-1765-4eca-a065-bd2b9b2f7c37-tls-cert\") pod \"authorino-b96664d7f-cwxbr\" (UID: \"b1fa6d71-1765-4eca-a065-bd2b9b2f7c37\") " pod="kuadrant-system/authorino-b96664d7f-cwxbr" Jun 15 01:52:53.941281 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:53.941156 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd4sc\" (UniqueName: \"kubernetes.io/projected/b1fa6d71-1765-4eca-a065-bd2b9b2f7c37-kube-api-access-gd4sc\") pod \"authorino-b96664d7f-cwxbr\" (UID: \"b1fa6d71-1765-4eca-a065-bd2b9b2f7c37\") " pod="kuadrant-system/authorino-b96664d7f-cwxbr" Jun 15 01:52:54.041864 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:54.041813 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd4sc\" (UniqueName: \"kubernetes.io/projected/b1fa6d71-1765-4eca-a065-bd2b9b2f7c37-kube-api-access-gd4sc\") pod \"authorino-b96664d7f-cwxbr\" (UID: \"b1fa6d71-1765-4eca-a065-bd2b9b2f7c37\") " pod="kuadrant-system/authorino-b96664d7f-cwxbr" Jun 15 01:52:54.042053 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:54.041931 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b1fa6d71-1765-4eca-a065-bd2b9b2f7c37-tls-cert\") pod \"authorino-b96664d7f-cwxbr\" (UID: \"b1fa6d71-1765-4eca-a065-bd2b9b2f7c37\") " pod="kuadrant-system/authorino-b96664d7f-cwxbr" Jun 15 01:52:54.044270 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:54.044245 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b1fa6d71-1765-4eca-a065-bd2b9b2f7c37-tls-cert\") pod \"authorino-b96664d7f-cwxbr\" (UID: \"b1fa6d71-1765-4eca-a065-bd2b9b2f7c37\") " pod="kuadrant-system/authorino-b96664d7f-cwxbr" Jun 15 01:52:54.048739 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:54.048716 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd4sc\" (UniqueName: \"kubernetes.io/projected/b1fa6d71-1765-4eca-a065-bd2b9b2f7c37-kube-api-access-gd4sc\") pod \"authorino-b96664d7f-cwxbr\" (UID: \"b1fa6d71-1765-4eca-a065-bd2b9b2f7c37\") " pod="kuadrant-system/authorino-b96664d7f-cwxbr" Jun 15 01:52:54.059218 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:54.059192 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2wfv7" event={"ID":"40f54a43-8625-4453-b130-14f5bf1658a1","Type":"ContainerStarted","Data":"7c6558b88ec4b7d3bd5437f333e0a684d626385721e6d34bfaa88d7a7f1b2fe1"} Jun 15 01:52:54.160700 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:54.160603 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b96664d7f-cwxbr" Jun 15 01:52:54.294101 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:54.294078 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b96664d7f-cwxbr"] Jun 15 01:52:54.304647 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:52:54.304594 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1fa6d71_1765_4eca_a065_bd2b9b2f7c37.slice/crio-8c7450715a2a9d291e05dc4ddcb474f0b3565e4ba7f28af412becacb05e464a6 WatchSource:0}: Error finding container 8c7450715a2a9d291e05dc4ddcb474f0b3565e4ba7f28af412becacb05e464a6: Status 404 returned error can't find the container with id 8c7450715a2a9d291e05dc4ddcb474f0b3565e4ba7f28af412becacb05e464a6 Jun 15 01:52:55.065182 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:55.065146 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-2wfv7" podUID="40f54a43-8625-4453-b130-14f5bf1658a1" containerName="authorino" containerID="cri-o://d4df07d264a8c886a7e9c255a857d0fe712d96ca21211310a685e2358e08ea23" gracePeriod=30 Jun 15 01:52:55.065654 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:55.065104 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2wfv7" event={"ID":"40f54a43-8625-4453-b130-14f5bf1658a1","Type":"ContainerStarted","Data":"d4df07d264a8c886a7e9c255a857d0fe712d96ca21211310a685e2358e08ea23"} Jun 15 01:52:55.066770 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:55.066748 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b96664d7f-cwxbr" event={"ID":"b1fa6d71-1765-4eca-a065-bd2b9b2f7c37","Type":"ContainerStarted","Data":"0d2a4728d6ed43db71fb2bc392ab298344a0182fb8775e2eb8cce327559debe3"} Jun 15 01:52:55.066859 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:55.066779 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b96664d7f-cwxbr" event={"ID":"b1fa6d71-1765-4eca-a065-bd2b9b2f7c37","Type":"ContainerStarted","Data":"8c7450715a2a9d291e05dc4ddcb474f0b3565e4ba7f28af412becacb05e464a6"} Jun 15 01:52:55.080341 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:55.080297 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-2wfv7" podStartSLOduration=1.7106215869999999 podStartE2EDuration="2.080284512s" totalImagesPullingTime="369.662925ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:52:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:52:55.078429206 +0000 UTC m=+870.937251884" watchObservedRunningTime="2026-06-15 01:52:55.080284512 +0000 UTC m=+870.939107179" Jun 15 01:52:55.092479 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:55.092440 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b96664d7f-cwxbr" podStartSLOduration=1.8451469409999999 podStartE2EDuration="2.092428829s" totalImagesPullingTime="247.281888ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:52:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:52:55.090900712 +0000 UTC m=+870.949723378" watchObservedRunningTime="2026-06-15 01:52:55.092428829 +0000 UTC m=+870.951251495" Jun 15 01:52:55.115574 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:55.115546 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wqvx4"] Jun 15 01:52:55.115810 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:55.115774 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-wqvx4" podUID="26194d68-a7ca-4284-9d91-e86d2a70d4a1" containerName="authorino" containerID="cri-o://dd9a55cebe78c19f7f5f2afa5c66abaab5a63964747c6abe48e27bcec45274ac" gracePeriod=30 Jun 15 01:52:55.348701 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:55.348673 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2wfv7" Jun 15 01:52:55.375854 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:55.375833 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wqvx4" Jun 15 01:52:55.454131 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:55.454097 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdfdq\" (UniqueName: \"kubernetes.io/projected/26194d68-a7ca-4284-9d91-e86d2a70d4a1-kube-api-access-cdfdq\") pod \"26194d68-a7ca-4284-9d91-e86d2a70d4a1\" (UID: \"26194d68-a7ca-4284-9d91-e86d2a70d4a1\") " Jun 15 01:52:55.454312 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:55.454196 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2znl\" (UniqueName: \"kubernetes.io/projected/40f54a43-8625-4453-b130-14f5bf1658a1-kube-api-access-j2znl\") pod \"40f54a43-8625-4453-b130-14f5bf1658a1\" (UID: \"40f54a43-8625-4453-b130-14f5bf1658a1\") " Jun 15 01:52:55.456132 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:55.456105 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26194d68-a7ca-4284-9d91-e86d2a70d4a1-kube-api-access-cdfdq" (OuterVolumeSpecName: "kube-api-access-cdfdq") pod "26194d68-a7ca-4284-9d91-e86d2a70d4a1" (UID: "26194d68-a7ca-4284-9d91-e86d2a70d4a1"). InnerVolumeSpecName "kube-api-access-cdfdq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:52:55.456244 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:55.456148 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40f54a43-8625-4453-b130-14f5bf1658a1-kube-api-access-j2znl" (OuterVolumeSpecName: "kube-api-access-j2znl") pod "40f54a43-8625-4453-b130-14f5bf1658a1" (UID: "40f54a43-8625-4453-b130-14f5bf1658a1"). InnerVolumeSpecName "kube-api-access-j2znl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:52:55.555700 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:55.555671 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2znl\" (UniqueName: \"kubernetes.io/projected/40f54a43-8625-4453-b130-14f5bf1658a1-kube-api-access-j2znl\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:52:55.555700 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:55.555696 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdfdq\" (UniqueName: \"kubernetes.io/projected/26194d68-a7ca-4284-9d91-e86d2a70d4a1-kube-api-access-cdfdq\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:52:56.075157 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:56.075066 2551 generic.go:356] "Generic (PLEG): container finished" podID="26194d68-a7ca-4284-9d91-e86d2a70d4a1" containerID="dd9a55cebe78c19f7f5f2afa5c66abaab5a63964747c6abe48e27bcec45274ac" exitCode=0 Jun 15 01:52:56.075157 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:56.075110 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wqvx4" Jun 15 01:52:56.075725 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:56.075154 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wqvx4" event={"ID":"26194d68-a7ca-4284-9d91-e86d2a70d4a1","Type":"ContainerDied","Data":"dd9a55cebe78c19f7f5f2afa5c66abaab5a63964747c6abe48e27bcec45274ac"} Jun 15 01:52:56.075725 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:56.075194 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wqvx4" event={"ID":"26194d68-a7ca-4284-9d91-e86d2a70d4a1","Type":"ContainerDied","Data":"eca1c2eccd76f0b6bf2236987aeb946af51e041c02ebbd49d89ec7b3e507579c"} Jun 15 01:52:56.075725 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:56.075213 2551 scope.go:117] "RemoveContainer" containerID="dd9a55cebe78c19f7f5f2afa5c66abaab5a63964747c6abe48e27bcec45274ac" Jun 15 01:52:56.076516 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:56.076498 2551 generic.go:356] "Generic (PLEG): container finished" podID="40f54a43-8625-4453-b130-14f5bf1658a1" containerID="d4df07d264a8c886a7e9c255a857d0fe712d96ca21211310a685e2358e08ea23" exitCode=0 Jun 15 01:52:56.076598 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:56.076536 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2wfv7" Jun 15 01:52:56.076598 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:56.076583 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2wfv7" event={"ID":"40f54a43-8625-4453-b130-14f5bf1658a1","Type":"ContainerDied","Data":"d4df07d264a8c886a7e9c255a857d0fe712d96ca21211310a685e2358e08ea23"} Jun 15 01:52:56.076894 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:56.076619 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2wfv7" event={"ID":"40f54a43-8625-4453-b130-14f5bf1658a1","Type":"ContainerDied","Data":"7c6558b88ec4b7d3bd5437f333e0a684d626385721e6d34bfaa88d7a7f1b2fe1"} Jun 15 01:52:56.085007 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:56.084870 2551 scope.go:117] "RemoveContainer" containerID="dd9a55cebe78c19f7f5f2afa5c66abaab5a63964747c6abe48e27bcec45274ac" Jun 15 01:52:56.085158 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:52:56.085134 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd9a55cebe78c19f7f5f2afa5c66abaab5a63964747c6abe48e27bcec45274ac\": container with ID starting with dd9a55cebe78c19f7f5f2afa5c66abaab5a63964747c6abe48e27bcec45274ac not found: ID does not exist" containerID="dd9a55cebe78c19f7f5f2afa5c66abaab5a63964747c6abe48e27bcec45274ac" Jun 15 01:52:56.085292 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:56.085168 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd9a55cebe78c19f7f5f2afa5c66abaab5a63964747c6abe48e27bcec45274ac"} err="failed to get container status \"dd9a55cebe78c19f7f5f2afa5c66abaab5a63964747c6abe48e27bcec45274ac\": rpc error: code = NotFound desc = could not find container \"dd9a55cebe78c19f7f5f2afa5c66abaab5a63964747c6abe48e27bcec45274ac\": container with ID starting with dd9a55cebe78c19f7f5f2afa5c66abaab5a63964747c6abe48e27bcec45274ac not found: ID does not exist" Jun 15 01:52:56.085292 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:56.085194 2551 scope.go:117] "RemoveContainer" containerID="d4df07d264a8c886a7e9c255a857d0fe712d96ca21211310a685e2358e08ea23" Jun 15 01:52:56.092893 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:56.092873 2551 scope.go:117] "RemoveContainer" containerID="d4df07d264a8c886a7e9c255a857d0fe712d96ca21211310a685e2358e08ea23" Jun 15 01:52:56.093135 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:52:56.093117 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4df07d264a8c886a7e9c255a857d0fe712d96ca21211310a685e2358e08ea23\": container with ID starting with d4df07d264a8c886a7e9c255a857d0fe712d96ca21211310a685e2358e08ea23 not found: ID does not exist" containerID="d4df07d264a8c886a7e9c255a857d0fe712d96ca21211310a685e2358e08ea23" Jun 15 01:52:56.093183 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:56.093142 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4df07d264a8c886a7e9c255a857d0fe712d96ca21211310a685e2358e08ea23"} err="failed to get container status \"d4df07d264a8c886a7e9c255a857d0fe712d96ca21211310a685e2358e08ea23\": rpc error: code = NotFound desc = could not find container \"d4df07d264a8c886a7e9c255a857d0fe712d96ca21211310a685e2358e08ea23\": container with ID starting with d4df07d264a8c886a7e9c255a857d0fe712d96ca21211310a685e2358e08ea23 not found: ID does not exist" Jun 15 01:52:56.098761 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:56.098732 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2wfv7"] Jun 15 01:52:56.101963 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:56.101943 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2wfv7"] Jun 15 01:52:56.110181 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:56.110162 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wqvx4"] Jun 15 01:52:56.115557 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:56.115537 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wqvx4"] Jun 15 01:52:56.546671 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:56.546615 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26194d68-a7ca-4284-9d91-e86d2a70d4a1" path="/var/lib/kubelet/pods/26194d68-a7ca-4284-9d91-e86d2a70d4a1/volumes" Jun 15 01:52:56.546966 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:56.546953 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40f54a43-8625-4453-b130-14f5bf1658a1" path="/var/lib/kubelet/pods/40f54a43-8625-4453-b130-14f5bf1658a1/volumes" Jun 15 01:52:58.612250 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:58.612206 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:52:58.705953 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:58.705912 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:52:58.791246 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:58.791208 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:52:58.848423 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:52:58.848390 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:53:01.024447 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:53:01.024415 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:53:01.106786 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:53:01.106748 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:53:24.565806 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:53:24.565779 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c2jms_63f8819b-4ac8-42d2-a662-78721cf2548f/ovn-acl-logging/0.log" Jun 15 01:53:24.566745 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:53:24.566728 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c2jms_63f8819b-4ac8-42d2-a662-78721cf2548f/ovn-acl-logging/0.log" Jun 15 01:53:30.133277 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:53:30.133241 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:53:30.523841 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:53:30.523758 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:53:30.618209 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:53:30.618177 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:53:30.681952 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:53:30.681920 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:53:38.158154 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:53:38.158101 2551 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-c2f5t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": read tcp 10.132.0.2:44538->10.132.0.28:15021: read: connection reset by peer" start-of-body= Jun 15 01:53:38.158590 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:53:38.158236 2551 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" podUID="a7840efb-7120-42a9-bd47-8427cffcb426" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": read tcp 10.132.0.2:44538->10.132.0.28:15021: read: connection reset by peer" Jun 15 01:53:38.274890 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:53:38.274861 2551 generic.go:356] "Generic (PLEG): container finished" podID="a7840efb-7120-42a9-bd47-8427cffcb426" containerID="a721857cada3ad0b4cb6bfdd779e2caefa17a555619fa041e1a3e3f6469ded16" exitCode=0 Jun 15 01:53:38.275053 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:53:38.274910 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" event={"ID":"a7840efb-7120-42a9-bd47-8427cffcb426","Type":"ContainerDied","Data":"a721857cada3ad0b4cb6bfdd779e2caefa17a555619fa041e1a3e3f6469ded16"} Jun 15 01:53:38.275277 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:53:38.275264 2551 scope.go:117] "RemoveContainer" containerID="a721857cada3ad0b4cb6bfdd779e2caefa17a555619fa041e1a3e3f6469ded16" Jun 15 01:53:38.276294 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:53:38.276255 2551 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 01:53:38.276353 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:53:38.276323 2551 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 01:53:38.276396 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:53:38.276353 2551 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 01:53:39.281797 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:53:39.281765 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" event={"ID":"a7840efb-7120-42a9-bd47-8427cffcb426","Type":"ContainerStarted","Data":"57257cc458d4f60d50c9dba7a3fccf66081dd517c9a65aa6be3966612aace281"} Jun 15 01:53:39.761500 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:53:39.761457 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:53:39.761792 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:53:39.761766 2551 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-c2f5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body= Jun 15 01:53:39.761886 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:53:39.761836 2551 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" podUID="a7840efb-7120-42a9-bd47-8427cffcb426" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" Jun 15 01:53:40.761508 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:53:40.761467 2551 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-c2f5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body= Jun 15 01:53:40.761928 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:53:40.761525 2551 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" podUID="a7840efb-7120-42a9-bd47-8427cffcb426" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" Jun 15 01:53:41.761497 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:53:41.761454 2551 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-c2f5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body= Jun 15 01:53:41.761705 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:53:41.761530 2551 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" podUID="a7840efb-7120-42a9-bd47-8427cffcb426" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" Jun 15 01:53:42.760971 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:53:42.760936 2551 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-c2f5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body= Jun 15 01:53:42.761137 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:53:42.760998 2551 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" podUID="a7840efb-7120-42a9-bd47-8427cffcb426" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" Jun 15 01:53:43.764926 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:53:43.764895 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:53:43.765436 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:53:43.765278 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:53:43.766096 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:53:43.766080 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c2f5t" Jun 15 01:54:01.405101 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:01.405067 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:54:07.578002 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:07.577960 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:54:07.675874 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:07.675829 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:54:12.411760 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:12.411722 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:54:19.266896 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:19.266861 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5b549f746c-gs7j7"] Jun 15 01:54:19.267258 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:19.267241 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40f54a43-8625-4453-b130-14f5bf1658a1" containerName="authorino" Jun 15 01:54:19.267258 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:19.267253 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="40f54a43-8625-4453-b130-14f5bf1658a1" containerName="authorino" Jun 15 01:54:19.267330 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:19.267261 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26194d68-a7ca-4284-9d91-e86d2a70d4a1" containerName="authorino" Jun 15 01:54:19.267330 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:19.267267 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="26194d68-a7ca-4284-9d91-e86d2a70d4a1" containerName="authorino" Jun 15 01:54:19.267397 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:19.267332 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="26194d68-a7ca-4284-9d91-e86d2a70d4a1" containerName="authorino" Jun 15 01:54:19.267397 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:19.267344 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="40f54a43-8625-4453-b130-14f5bf1658a1" containerName="authorino" Jun 15 01:54:19.270371 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:19.270352 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b549f746c-gs7j7" Jun 15 01:54:19.272435 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:19.272419 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 15 01:54:19.276581 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:19.276552 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b549f746c-gs7j7"] Jun 15 01:54:19.375467 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:19.375432 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e44b4c5d-8e28-45ff-807c-e8cfacffcc59-tls-cert\") pod \"authorino-5b549f746c-gs7j7\" (UID: \"e44b4c5d-8e28-45ff-807c-e8cfacffcc59\") " pod="kuadrant-system/authorino-5b549f746c-gs7j7" Jun 15 01:54:19.375680 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:19.375476 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/e44b4c5d-8e28-45ff-807c-e8cfacffcc59-oidc-ca\") pod \"authorino-5b549f746c-gs7j7\" (UID: \"e44b4c5d-8e28-45ff-807c-e8cfacffcc59\") " pod="kuadrant-system/authorino-5b549f746c-gs7j7" Jun 15 01:54:19.375680 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:19.375556 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57hls\" (UniqueName: \"kubernetes.io/projected/e44b4c5d-8e28-45ff-807c-e8cfacffcc59-kube-api-access-57hls\") pod \"authorino-5b549f746c-gs7j7\" (UID: \"e44b4c5d-8e28-45ff-807c-e8cfacffcc59\") " pod="kuadrant-system/authorino-5b549f746c-gs7j7" Jun 15 01:54:19.476850 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:19.476815 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57hls\" (UniqueName: \"kubernetes.io/projected/e44b4c5d-8e28-45ff-807c-e8cfacffcc59-kube-api-access-57hls\") pod \"authorino-5b549f746c-gs7j7\" (UID: \"e44b4c5d-8e28-45ff-807c-e8cfacffcc59\") " pod="kuadrant-system/authorino-5b549f746c-gs7j7" Jun 15 01:54:19.477050 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:19.476856 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e44b4c5d-8e28-45ff-807c-e8cfacffcc59-tls-cert\") pod \"authorino-5b549f746c-gs7j7\" (UID: \"e44b4c5d-8e28-45ff-807c-e8cfacffcc59\") " pod="kuadrant-system/authorino-5b549f746c-gs7j7" Jun 15 01:54:19.477050 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:19.476888 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/e44b4c5d-8e28-45ff-807c-e8cfacffcc59-oidc-ca\") pod \"authorino-5b549f746c-gs7j7\" (UID: \"e44b4c5d-8e28-45ff-807c-e8cfacffcc59\") " pod="kuadrant-system/authorino-5b549f746c-gs7j7" Jun 15 01:54:19.477500 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:19.477475 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/e44b4c5d-8e28-45ff-807c-e8cfacffcc59-oidc-ca\") pod \"authorino-5b549f746c-gs7j7\" (UID: \"e44b4c5d-8e28-45ff-807c-e8cfacffcc59\") " pod="kuadrant-system/authorino-5b549f746c-gs7j7" Jun 15 01:54:19.479218 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:19.479198 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e44b4c5d-8e28-45ff-807c-e8cfacffcc59-tls-cert\") pod \"authorino-5b549f746c-gs7j7\" (UID: \"e44b4c5d-8e28-45ff-807c-e8cfacffcc59\") " pod="kuadrant-system/authorino-5b549f746c-gs7j7" Jun 15 01:54:19.483903 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:19.483876 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57hls\" (UniqueName: \"kubernetes.io/projected/e44b4c5d-8e28-45ff-807c-e8cfacffcc59-kube-api-access-57hls\") pod \"authorino-5b549f746c-gs7j7\" (UID: \"e44b4c5d-8e28-45ff-807c-e8cfacffcc59\") " pod="kuadrant-system/authorino-5b549f746c-gs7j7" Jun 15 01:54:19.580481 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:19.580400 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b549f746c-gs7j7" Jun 15 01:54:19.708592 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:19.708558 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b549f746c-gs7j7"] Jun 15 01:54:19.712189 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:54:19.712159 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode44b4c5d_8e28_45ff_807c_e8cfacffcc59.slice/crio-46b52286e4f44a632bf2f9b74dd93cefe05342261636bce16b29426cff725109 WatchSource:0}: Error finding container 46b52286e4f44a632bf2f9b74dd93cefe05342261636bce16b29426cff725109: Status 404 returned error can't find the container with id 46b52286e4f44a632bf2f9b74dd93cefe05342261636bce16b29426cff725109 Jun 15 01:54:19.713521 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:19.713500 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 01:54:20.479239 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:20.479151 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b549f746c-gs7j7" event={"ID":"e44b4c5d-8e28-45ff-807c-e8cfacffcc59","Type":"ContainerStarted","Data":"cccdb7036320356a62d3ea0dbd56b174149eaa0d9495f8a1963fd4d455e598eb"} Jun 15 01:54:20.479239 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:20.479193 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b549f746c-gs7j7" event={"ID":"e44b4c5d-8e28-45ff-807c-e8cfacffcc59","Type":"ContainerStarted","Data":"46b52286e4f44a632bf2f9b74dd93cefe05342261636bce16b29426cff725109"} Jun 15 01:54:20.500238 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:20.500186 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5b549f746c-gs7j7" podStartSLOduration=1.095287089 podStartE2EDuration="1.500171209s" totalImagesPullingTime="404.88412ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:54:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:54:20.498857569 +0000 UTC m=+956.357680237" watchObservedRunningTime="2026-06-15 01:54:20.500171209 +0000 UTC m=+956.358993875" Jun 15 01:54:20.522502 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:20.522470 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b96664d7f-cwxbr"] Jun 15 01:54:20.522705 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:20.522671 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-b96664d7f-cwxbr" podUID="b1fa6d71-1765-4eca-a065-bd2b9b2f7c37" containerName="authorino" containerID="cri-o://0d2a4728d6ed43db71fb2bc392ab298344a0182fb8775e2eb8cce327559debe3" gracePeriod=30 Jun 15 01:54:20.769329 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:20.769302 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b96664d7f-cwxbr" Jun 15 01:54:20.889556 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:20.889524 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gd4sc\" (UniqueName: \"kubernetes.io/projected/b1fa6d71-1765-4eca-a065-bd2b9b2f7c37-kube-api-access-gd4sc\") pod \"b1fa6d71-1765-4eca-a065-bd2b9b2f7c37\" (UID: \"b1fa6d71-1765-4eca-a065-bd2b9b2f7c37\") " Jun 15 01:54:20.889764 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:20.889585 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b1fa6d71-1765-4eca-a065-bd2b9b2f7c37-tls-cert\") pod \"b1fa6d71-1765-4eca-a065-bd2b9b2f7c37\" (UID: \"b1fa6d71-1765-4eca-a065-bd2b9b2f7c37\") " Jun 15 01:54:20.891694 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:20.891667 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1fa6d71-1765-4eca-a065-bd2b9b2f7c37-kube-api-access-gd4sc" (OuterVolumeSpecName: "kube-api-access-gd4sc") pod "b1fa6d71-1765-4eca-a065-bd2b9b2f7c37" (UID: "b1fa6d71-1765-4eca-a065-bd2b9b2f7c37"). InnerVolumeSpecName "kube-api-access-gd4sc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:54:20.901448 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:20.901419 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1fa6d71-1765-4eca-a065-bd2b9b2f7c37-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "b1fa6d71-1765-4eca-a065-bd2b9b2f7c37" (UID: "b1fa6d71-1765-4eca-a065-bd2b9b2f7c37"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:54:20.990800 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:20.990770 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gd4sc\" (UniqueName: \"kubernetes.io/projected/b1fa6d71-1765-4eca-a065-bd2b9b2f7c37-kube-api-access-gd4sc\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:54:20.990800 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:20.990796 2551 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b1fa6d71-1765-4eca-a065-bd2b9b2f7c37-tls-cert\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:54:21.136021 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:21.135995 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:54:21.235472 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:21.235440 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:54:21.485215 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:21.485131 2551 generic.go:356] "Generic (PLEG): container finished" podID="b1fa6d71-1765-4eca-a065-bd2b9b2f7c37" containerID="0d2a4728d6ed43db71fb2bc392ab298344a0182fb8775e2eb8cce327559debe3" exitCode=0 Jun 15 01:54:21.485215 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:21.485176 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b96664d7f-cwxbr" Jun 15 01:54:21.485678 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:21.485218 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b96664d7f-cwxbr" event={"ID":"b1fa6d71-1765-4eca-a065-bd2b9b2f7c37","Type":"ContainerDied","Data":"0d2a4728d6ed43db71fb2bc392ab298344a0182fb8775e2eb8cce327559debe3"} Jun 15 01:54:21.485678 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:21.485257 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b96664d7f-cwxbr" event={"ID":"b1fa6d71-1765-4eca-a065-bd2b9b2f7c37","Type":"ContainerDied","Data":"8c7450715a2a9d291e05dc4ddcb474f0b3565e4ba7f28af412becacb05e464a6"} Jun 15 01:54:21.485678 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:21.485275 2551 scope.go:117] "RemoveContainer" containerID="0d2a4728d6ed43db71fb2bc392ab298344a0182fb8775e2eb8cce327559debe3" Jun 15 01:54:21.494507 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:21.494488 2551 scope.go:117] "RemoveContainer" containerID="0d2a4728d6ed43db71fb2bc392ab298344a0182fb8775e2eb8cce327559debe3" Jun 15 01:54:21.494812 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:54:21.494792 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d2a4728d6ed43db71fb2bc392ab298344a0182fb8775e2eb8cce327559debe3\": container with ID starting with 0d2a4728d6ed43db71fb2bc392ab298344a0182fb8775e2eb8cce327559debe3 not found: ID does not exist" containerID="0d2a4728d6ed43db71fb2bc392ab298344a0182fb8775e2eb8cce327559debe3" Jun 15 01:54:21.494867 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:21.494821 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d2a4728d6ed43db71fb2bc392ab298344a0182fb8775e2eb8cce327559debe3"} err="failed to get container status \"0d2a4728d6ed43db71fb2bc392ab298344a0182fb8775e2eb8cce327559debe3\": rpc error: code = NotFound desc = could not find container \"0d2a4728d6ed43db71fb2bc392ab298344a0182fb8775e2eb8cce327559debe3\": container with ID starting with 0d2a4728d6ed43db71fb2bc392ab298344a0182fb8775e2eb8cce327559debe3 not found: ID does not exist" Jun 15 01:54:21.504979 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:21.504958 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b96664d7f-cwxbr"] Jun 15 01:54:21.512947 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:21.512925 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b96664d7f-cwxbr"] Jun 15 01:54:22.547336 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:22.547307 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1fa6d71-1765-4eca-a065-bd2b9b2f7c37" path="/var/lib/kubelet/pods/b1fa6d71-1765-4eca-a065-bd2b9b2f7c37/volumes" Jun 15 01:54:36.330948 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:36.330865 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:54:48.091733 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:48.091700 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-724sm"] Jun 15 01:54:48.092163 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:48.092072 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1fa6d71-1765-4eca-a065-bd2b9b2f7c37" containerName="authorino" Jun 15 01:54:48.092163 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:48.092085 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1fa6d71-1765-4eca-a065-bd2b9b2f7c37" containerName="authorino" Jun 15 01:54:48.092163 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:48.092148 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1fa6d71-1765-4eca-a065-bd2b9b2f7c37" containerName="authorino" Jun 15 01:54:48.095218 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:48.095195 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-724sm" Jun 15 01:54:48.098172 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:48.098149 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 15 01:54:48.098891 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:48.098870 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 15 01:54:48.099010 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:48.098940 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2tdsw\"" Jun 15 01:54:48.099010 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:48.098938 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 15 01:54:48.108478 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:48.108456 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-724sm"] Jun 15 01:54:48.128696 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:48.128659 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9438c9a-338b-4a5f-aadc-1f1341e9d353-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-724sm\" (UID: \"a9438c9a-338b-4a5f-aadc-1f1341e9d353\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-724sm" Jun 15 01:54:48.128848 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:48.128761 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9438c9a-338b-4a5f-aadc-1f1341e9d353-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-724sm\" (UID: \"a9438c9a-338b-4a5f-aadc-1f1341e9d353\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-724sm" Jun 15 01:54:48.128848 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:48.128806 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9438c9a-338b-4a5f-aadc-1f1341e9d353-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-724sm\" (UID: \"a9438c9a-338b-4a5f-aadc-1f1341e9d353\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-724sm" Jun 15 01:54:48.128848 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:48.128842 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhxs6\" (UniqueName: \"kubernetes.io/projected/a9438c9a-338b-4a5f-aadc-1f1341e9d353-kube-api-access-fhxs6\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-724sm\" (UID: \"a9438c9a-338b-4a5f-aadc-1f1341e9d353\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-724sm" Jun 15 01:54:48.129011 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:48.128923 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9438c9a-338b-4a5f-aadc-1f1341e9d353-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-724sm\" (UID: \"a9438c9a-338b-4a5f-aadc-1f1341e9d353\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-724sm" Jun 15 01:54:48.129011 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:48.128956 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a9438c9a-338b-4a5f-aadc-1f1341e9d353-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-724sm\" (UID: \"a9438c9a-338b-4a5f-aadc-1f1341e9d353\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-724sm" Jun 15 01:54:48.134534 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:48.134505 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:54:48.229814 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:48.229779 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9438c9a-338b-4a5f-aadc-1f1341e9d353-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-724sm\" (UID: \"a9438c9a-338b-4a5f-aadc-1f1341e9d353\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-724sm" Jun 15 01:54:48.229963 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:48.229820 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9438c9a-338b-4a5f-aadc-1f1341e9d353-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-724sm\" (UID: \"a9438c9a-338b-4a5f-aadc-1f1341e9d353\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-724sm" Jun 15 01:54:48.229963 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:48.229839 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhxs6\" (UniqueName: \"kubernetes.io/projected/a9438c9a-338b-4a5f-aadc-1f1341e9d353-kube-api-access-fhxs6\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-724sm\" (UID: \"a9438c9a-338b-4a5f-aadc-1f1341e9d353\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-724sm" Jun 15 01:54:48.229963 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:48.229879 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9438c9a-338b-4a5f-aadc-1f1341e9d353-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-724sm\" (UID: \"a9438c9a-338b-4a5f-aadc-1f1341e9d353\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-724sm" Jun 15 01:54:48.229963 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:48.229898 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a9438c9a-338b-4a5f-aadc-1f1341e9d353-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-724sm\" (UID: \"a9438c9a-338b-4a5f-aadc-1f1341e9d353\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-724sm" Jun 15 01:54:48.230168 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:48.230074 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9438c9a-338b-4a5f-aadc-1f1341e9d353-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-724sm\" (UID: \"a9438c9a-338b-4a5f-aadc-1f1341e9d353\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-724sm" Jun 15 01:54:48.230226 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:48.230193 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9438c9a-338b-4a5f-aadc-1f1341e9d353-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-724sm\" (UID: \"a9438c9a-338b-4a5f-aadc-1f1341e9d353\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-724sm" Jun 15 01:54:48.230282 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:48.230262 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a9438c9a-338b-4a5f-aadc-1f1341e9d353-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-724sm\" (UID: \"a9438c9a-338b-4a5f-aadc-1f1341e9d353\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-724sm" Jun 15 01:54:48.230361 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:48.230337 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9438c9a-338b-4a5f-aadc-1f1341e9d353-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-724sm\" (UID: \"a9438c9a-338b-4a5f-aadc-1f1341e9d353\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-724sm" Jun 15 01:54:48.232174 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:48.232148 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9438c9a-338b-4a5f-aadc-1f1341e9d353-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-724sm\" (UID: \"a9438c9a-338b-4a5f-aadc-1f1341e9d353\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-724sm" Jun 15 01:54:48.232375 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:48.232357 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9438c9a-338b-4a5f-aadc-1f1341e9d353-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-724sm\" (UID: \"a9438c9a-338b-4a5f-aadc-1f1341e9d353\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-724sm" Jun 15 01:54:48.238843 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:48.238824 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhxs6\" (UniqueName: \"kubernetes.io/projected/a9438c9a-338b-4a5f-aadc-1f1341e9d353-kube-api-access-fhxs6\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-724sm\" (UID: \"a9438c9a-338b-4a5f-aadc-1f1341e9d353\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-724sm" Jun 15 01:54:48.406158 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:48.406121 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-724sm" Jun 15 01:54:48.545775 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:54:48.545743 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9438c9a_338b_4a5f_aadc_1f1341e9d353.slice/crio-c559be705fed82b005c342790d28a71775cbf9f94a5293e8179adda3a0f46f59 WatchSource:0}: Error finding container c559be705fed82b005c342790d28a71775cbf9f94a5293e8179adda3a0f46f59: Status 404 returned error can't find the container with id c559be705fed82b005c342790d28a71775cbf9f94a5293e8179adda3a0f46f59 Jun 15 01:54:48.547882 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:48.547855 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-724sm"] Jun 15 01:54:48.610926 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:48.610891 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-724sm" event={"ID":"a9438c9a-338b-4a5f-aadc-1f1341e9d353","Type":"ContainerStarted","Data":"c559be705fed82b005c342790d28a71775cbf9f94a5293e8179adda3a0f46f59"} Jun 15 01:54:51.627168 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:51.627123 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-724sm" event={"ID":"a9438c9a-338b-4a5f-aadc-1f1341e9d353","Type":"ContainerStarted","Data":"bf400ab065a1c3cc8f1114140e0f2519f741b9b7709d9ec2c50314143bfafe71"} Jun 15 01:54:57.010944 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:54:57.010912 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:55:02.921420 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:02.921375 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:55:10.289173 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:10.289140 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-zpztb"] Jun 15 01:55:10.292810 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:10.292784 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zpztb" Jun 15 01:55:10.294934 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:10.294914 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 15 01:55:10.302343 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:10.302320 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-zpztb"] Jun 15 01:55:10.312324 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:10.312266 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:55:10.436623 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:10.436585 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zpztb\" (UID: \"bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zpztb" Jun 15 01:55:10.436823 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:10.436688 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4vhd\" (UniqueName: \"kubernetes.io/projected/bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2-kube-api-access-v4vhd\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zpztb\" (UID: \"bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zpztb" Jun 15 01:55:10.436823 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:10.436775 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zpztb\" (UID: \"bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zpztb" Jun 15 01:55:10.436823 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:10.436814 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zpztb\" (UID: \"bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zpztb" Jun 15 01:55:10.436961 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:10.436842 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zpztb\" (UID: \"bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zpztb" Jun 15 01:55:10.436961 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:10.436871 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zpztb\" (UID: \"bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zpztb" Jun 15 01:55:10.537523 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:10.537486 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zpztb\" (UID: \"bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zpztb" Jun 15 01:55:10.537523 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:10.537530 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4vhd\" (UniqueName: \"kubernetes.io/projected/bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2-kube-api-access-v4vhd\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zpztb\" (UID: \"bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zpztb" Jun 15 01:55:10.537795 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:10.537580 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zpztb\" (UID: \"bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zpztb" Jun 15 01:55:10.537795 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:10.537599 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zpztb\" (UID: \"bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zpztb" Jun 15 01:55:10.537795 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:10.537619 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zpztb\" (UID: \"bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zpztb" Jun 15 01:55:10.537795 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:10.537669 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zpztb\" (UID: \"bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zpztb" Jun 15 01:55:10.538001 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:10.537972 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zpztb\" (UID: \"bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zpztb" Jun 15 01:55:10.538001 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:10.537984 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zpztb\" (UID: \"bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zpztb" Jun 15 01:55:10.538108 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:10.538037 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zpztb\" (UID: \"bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zpztb" Jun 15 01:55:10.539965 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:10.539905 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zpztb\" (UID: \"bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zpztb" Jun 15 01:55:10.540258 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:10.540241 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zpztb\" (UID: \"bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zpztb" Jun 15 01:55:10.544712 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:10.544687 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4vhd\" (UniqueName: \"kubernetes.io/projected/bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2-kube-api-access-v4vhd\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-zpztb\" (UID: \"bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zpztb" Jun 15 01:55:10.604379 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:10.604354 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zpztb" Jun 15 01:55:10.738090 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:10.737959 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-zpztb"] Jun 15 01:55:10.740881 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:55:10.740853 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb0ffb3a_b5ea_4a8b_9a4a_dd15253724e2.slice/crio-759ab1173b7803cd29f184ca7714416973aa0bdcb8f9fa15b6b87b89d0c94e92 WatchSource:0}: Error finding container 759ab1173b7803cd29f184ca7714416973aa0bdcb8f9fa15b6b87b89d0c94e92: Status 404 returned error can't find the container with id 759ab1173b7803cd29f184ca7714416973aa0bdcb8f9fa15b6b87b89d0c94e92 Jun 15 01:55:11.723408 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:11.723377 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zpztb" event={"ID":"bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2","Type":"ContainerStarted","Data":"f02db8d32360ad281d809611db27e7f9b54c12f515245cc9a07fe8f0da79aea7"} Jun 15 01:55:11.723795 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:11.723429 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zpztb" event={"ID":"bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2","Type":"ContainerStarted","Data":"759ab1173b7803cd29f184ca7714416973aa0bdcb8f9fa15b6b87b89d0c94e92"} Jun 15 01:55:14.189107 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:14.189064 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-58glj"] Jun 15 01:55:14.194494 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:14.194475 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-58glj" Jun 15 01:55:14.196402 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:14.196377 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 15 01:55:14.200350 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:14.200327 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-58glj"] Jun 15 01:55:14.223863 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:14.223825 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:55:14.371874 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:14.371837 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-58glj\" (UID: \"66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-58glj" Jun 15 01:55:14.372059 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:14.371959 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-58glj\" (UID: \"66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-58glj" Jun 15 01:55:14.372128 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:14.372055 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-58glj\" (UID: \"66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-58glj" Jun 15 01:55:14.372178 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:14.372117 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-58glj\" (UID: \"66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-58glj" Jun 15 01:55:14.372276 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:14.372231 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7cc2\" (UniqueName: \"kubernetes.io/projected/66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab-kube-api-access-l7cc2\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-58glj\" (UID: \"66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-58glj" Jun 15 01:55:14.372334 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:14.372290 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-58glj\" (UID: \"66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-58glj" Jun 15 01:55:14.473544 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:14.473459 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-58glj\" (UID: \"66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-58glj" Jun 15 01:55:14.473544 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:14.473507 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7cc2\" (UniqueName: \"kubernetes.io/projected/66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab-kube-api-access-l7cc2\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-58glj\" (UID: \"66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-58glj" Jun 15 01:55:14.473813 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:14.473652 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-58glj\" (UID: \"66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-58glj" Jun 15 01:55:14.473813 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:14.473736 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-58glj\" (UID: \"66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-58glj" Jun 15 01:55:14.473813 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:14.473803 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-58glj\" (UID: \"66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-58glj" Jun 15 01:55:14.473956 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:14.473871 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-58glj\" (UID: \"66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-58glj" Jun 15 01:55:14.474015 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:14.473992 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-58glj\" (UID: \"66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-58glj" Jun 15 01:55:14.474081 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:14.474061 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-58glj\" (UID: \"66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-58glj" Jun 15 01:55:14.474116 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:14.474094 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-58glj\" (UID: \"66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-58glj" Jun 15 01:55:14.475883 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:14.475853 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-58glj\" (UID: \"66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-58glj" Jun 15 01:55:14.476001 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:14.475985 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-58glj\" (UID: \"66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-58glj" Jun 15 01:55:14.481163 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:14.481138 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7cc2\" (UniqueName: \"kubernetes.io/projected/66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab-kube-api-access-l7cc2\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-58glj\" (UID: \"66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-58glj" Jun 15 01:55:14.507209 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:14.507183 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-58glj" Jun 15 01:55:14.640076 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:14.640050 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-58glj"] Jun 15 01:55:14.642132 ip-10-0-137-147 kubenswrapper[2551]: W0615 01:55:14.642100 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66e17cd3_cebd_4e8f_9ec6_13357d6bf7ab.slice/crio-d2e76c71dba144f6b8020ec646089ce15d8ebd7fe270d688cd9ce0252251de56 WatchSource:0}: Error finding container d2e76c71dba144f6b8020ec646089ce15d8ebd7fe270d688cd9ce0252251de56: Status 404 returned error can't find the container with id d2e76c71dba144f6b8020ec646089ce15d8ebd7fe270d688cd9ce0252251de56 Jun 15 01:55:14.738314 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:14.738230 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-58glj" event={"ID":"66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab","Type":"ContainerStarted","Data":"3b13fb6c9e6719c787f0d22c9aa121ab676608dc4f9bc0d1d62090b1233cad84"} Jun 15 01:55:14.738314 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:14.738273 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-58glj" event={"ID":"66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab","Type":"ContainerStarted","Data":"d2e76c71dba144f6b8020ec646089ce15d8ebd7fe270d688cd9ce0252251de56"} Jun 15 01:55:15.747809 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:15.747704 2551 generic.go:356] "Generic (PLEG): container finished" podID="bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2" containerID="f02db8d32360ad281d809611db27e7f9b54c12f515245cc9a07fe8f0da79aea7" exitCode=0 Jun 15 01:55:15.748329 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:15.748302 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zpztb" event={"ID":"bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2","Type":"ContainerDied","Data":"f02db8d32360ad281d809611db27e7f9b54c12f515245cc9a07fe8f0da79aea7"} Jun 15 01:55:16.755571 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:16.755525 2551 generic.go:356] "Generic (PLEG): container finished" podID="66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab" containerID="3b13fb6c9e6719c787f0d22c9aa121ab676608dc4f9bc0d1d62090b1233cad84" exitCode=0 Jun 15 01:55:16.756088 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:16.755605 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-58glj" event={"ID":"66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab","Type":"ContainerDied","Data":"3b13fb6c9e6719c787f0d22c9aa121ab676608dc4f9bc0d1d62090b1233cad84"} Jun 15 01:55:17.762773 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:17.762733 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zpztb" event={"ID":"bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2","Type":"ContainerStarted","Data":"0bc859bbf9b5fdd3a304e1ff9612332054839ac2f1c511b71d8e7e99ba262f2e"} Jun 15 01:55:17.764502 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:17.764482 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-58glj" event={"ID":"66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab","Type":"ContainerStarted","Data":"6001b622ec0877e83550cbfd4f8ad18a34aa84d4331283c3a23b9e93f51f66d3"} Jun 15 01:55:17.780821 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:17.780779 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zpztb" podStartSLOduration=2.59736445 podStartE2EDuration="7.780764747s" totalImagesPullingTime="1.102493606s" totalInitContainerRuntime="4.080906691s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:55:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:55:17.779360967 +0000 UTC m=+1013.638183636" watchObservedRunningTime="2026-06-15 01:55:17.780764747 +0000 UTC m=+1013.639587413" Jun 15 01:55:17.796864 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:17.796819 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-58glj" podStartSLOduration=2.25656283 podStartE2EDuration="3.79680413s" totalImagesPullingTime="172.299368ms" totalInitContainerRuntime="1.367941932s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:55:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:55:17.794655756 +0000 UTC m=+1013.653478420" watchObservedRunningTime="2026-06-15 01:55:17.79680413 +0000 UTC m=+1013.655626796" Jun 15 01:55:20.605183 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:20.605148 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zpztb" Jun 15 01:55:20.605564 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:20.605220 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zpztb" Jun 15 01:55:20.617663 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:20.617616 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zpztb" Jun 15 01:55:20.789409 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:20.789382 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-zpztb" Jun 15 01:55:24.507700 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:24.507668 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-58glj" Jun 15 01:55:24.508080 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:24.507786 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-58glj" Jun 15 01:55:24.520576 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:24.520552 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-58glj" Jun 15 01:55:24.811131 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:55:24.811055 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-58glj" Jun 15 01:56:05.421589 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:56:05.421471 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:56:05.521526 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:56:05.521495 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:56:05.977602 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:56:05.977564 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b549f746c-gs7j7"] Jun 15 01:56:05.977800 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:56:05.977777 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5b549f746c-gs7j7" podUID="e44b4c5d-8e28-45ff-807c-e8cfacffcc59" containerName="authorino" containerID="cri-o://cccdb7036320356a62d3ea0dbd56b174149eaa0d9495f8a1963fd4d455e598eb" gracePeriod=30 Jun 15 01:56:06.232788 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:56:06.232724 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b549f746c-gs7j7" Jun 15 01:56:06.328588 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:56:06.327508 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e44b4c5d-8e28-45ff-807c-e8cfacffcc59-tls-cert\") pod \"e44b4c5d-8e28-45ff-807c-e8cfacffcc59\" (UID: \"e44b4c5d-8e28-45ff-807c-e8cfacffcc59\") " Jun 15 01:56:06.328588 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:56:06.327560 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/e44b4c5d-8e28-45ff-807c-e8cfacffcc59-oidc-ca\") pod \"e44b4c5d-8e28-45ff-807c-e8cfacffcc59\" (UID: \"e44b4c5d-8e28-45ff-807c-e8cfacffcc59\") " Jun 15 01:56:06.328588 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:56:06.327608 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57hls\" (UniqueName: \"kubernetes.io/projected/e44b4c5d-8e28-45ff-807c-e8cfacffcc59-kube-api-access-57hls\") pod \"e44b4c5d-8e28-45ff-807c-e8cfacffcc59\" (UID: \"e44b4c5d-8e28-45ff-807c-e8cfacffcc59\") " Jun 15 01:56:06.330942 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:56:06.330686 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e44b4c5d-8e28-45ff-807c-e8cfacffcc59-kube-api-access-57hls" (OuterVolumeSpecName: "kube-api-access-57hls") pod "e44b4c5d-8e28-45ff-807c-e8cfacffcc59" (UID: "e44b4c5d-8e28-45ff-807c-e8cfacffcc59"). InnerVolumeSpecName "kube-api-access-57hls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:56:06.336445 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:56:06.336410 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e44b4c5d-8e28-45ff-807c-e8cfacffcc59-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "e44b4c5d-8e28-45ff-807c-e8cfacffcc59" (UID: "e44b4c5d-8e28-45ff-807c-e8cfacffcc59"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:56:06.342801 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:56:06.342778 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e44b4c5d-8e28-45ff-807c-e8cfacffcc59-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e44b4c5d-8e28-45ff-807c-e8cfacffcc59" (UID: "e44b4c5d-8e28-45ff-807c-e8cfacffcc59"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:56:06.429091 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:56:06.429047 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57hls\" (UniqueName: \"kubernetes.io/projected/e44b4c5d-8e28-45ff-807c-e8cfacffcc59-kube-api-access-57hls\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:56:06.429091 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:56:06.429087 2551 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e44b4c5d-8e28-45ff-807c-e8cfacffcc59-tls-cert\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:56:06.429091 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:56:06.429098 2551 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/e44b4c5d-8e28-45ff-807c-e8cfacffcc59-oidc-ca\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 01:56:06.508813 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:56:06.508701 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:56:06.614432 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:56:06.614396 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:56:07.013379 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:56:07.013353 2551 generic.go:356] "Generic (PLEG): container finished" podID="e44b4c5d-8e28-45ff-807c-e8cfacffcc59" containerID="cccdb7036320356a62d3ea0dbd56b174149eaa0d9495f8a1963fd4d455e598eb" exitCode=0 Jun 15 01:56:07.013516 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:56:07.013407 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b549f746c-gs7j7" Jun 15 01:56:07.013516 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:56:07.013438 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b549f746c-gs7j7" event={"ID":"e44b4c5d-8e28-45ff-807c-e8cfacffcc59","Type":"ContainerDied","Data":"cccdb7036320356a62d3ea0dbd56b174149eaa0d9495f8a1963fd4d455e598eb"} Jun 15 01:56:07.013516 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:56:07.013479 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b549f746c-gs7j7" event={"ID":"e44b4c5d-8e28-45ff-807c-e8cfacffcc59","Type":"ContainerDied","Data":"46b52286e4f44a632bf2f9b74dd93cefe05342261636bce16b29426cff725109"} Jun 15 01:56:07.013516 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:56:07.013495 2551 scope.go:117] "RemoveContainer" containerID="cccdb7036320356a62d3ea0dbd56b174149eaa0d9495f8a1963fd4d455e598eb" Jun 15 01:56:07.022529 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:56:07.022511 2551 scope.go:117] "RemoveContainer" containerID="cccdb7036320356a62d3ea0dbd56b174149eaa0d9495f8a1963fd4d455e598eb" Jun 15 01:56:07.022892 ip-10-0-137-147 kubenswrapper[2551]: E0615 01:56:07.022869 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cccdb7036320356a62d3ea0dbd56b174149eaa0d9495f8a1963fd4d455e598eb\": container with ID starting with cccdb7036320356a62d3ea0dbd56b174149eaa0d9495f8a1963fd4d455e598eb not found: ID does not exist" containerID="cccdb7036320356a62d3ea0dbd56b174149eaa0d9495f8a1963fd4d455e598eb" Jun 15 01:56:07.022985 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:56:07.022901 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cccdb7036320356a62d3ea0dbd56b174149eaa0d9495f8a1963fd4d455e598eb"} err="failed to get container status \"cccdb7036320356a62d3ea0dbd56b174149eaa0d9495f8a1963fd4d455e598eb\": rpc error: code = NotFound desc = could not find container \"cccdb7036320356a62d3ea0dbd56b174149eaa0d9495f8a1963fd4d455e598eb\": container with ID starting with cccdb7036320356a62d3ea0dbd56b174149eaa0d9495f8a1963fd4d455e598eb not found: ID does not exist" Jun 15 01:56:07.032593 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:56:07.032571 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b549f746c-gs7j7"] Jun 15 01:56:07.037013 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:56:07.036989 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5b549f746c-gs7j7"] Jun 15 01:56:08.546493 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:56:08.546464 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e44b4c5d-8e28-45ff-807c-e8cfacffcc59" path="/var/lib/kubelet/pods/e44b4c5d-8e28-45ff-807c-e8cfacffcc59/volumes" Jun 15 01:56:16.427804 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:56:16.427770 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:56:19.328549 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:56:19.328514 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:56:44.691200 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:56:44.691160 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:56:44.742113 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:56:44.742073 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:56:56.814801 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:56:56.814761 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:56:56.914397 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:56:56.914364 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:57:32.990070 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:57:32.990027 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:57:34.810125 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:57:34.810091 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:57:54.812718 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:57:54.812620 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:57:54.868573 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:57:54.868532 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:08.592203 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:58:08.592111 2551 generic.go:356] "Generic (PLEG): container finished" podID="a9438c9a-338b-4a5f-aadc-1f1341e9d353" containerID="bf400ab065a1c3cc8f1114140e0f2519f741b9b7709d9ec2c50314143bfafe71" exitCode=0 Jun 15 01:58:08.592203 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:58:08.592161 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-724sm" event={"ID":"a9438c9a-338b-4a5f-aadc-1f1341e9d353","Type":"ContainerDied","Data":"bf400ab065a1c3cc8f1114140e0f2519f741b9b7709d9ec2c50314143bfafe71"} Jun 15 01:58:09.598285 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:58:09.598251 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-724sm" event={"ID":"a9438c9a-338b-4a5f-aadc-1f1341e9d353","Type":"ContainerStarted","Data":"03b392719dd3822b637ff82b879aa9e6fd22b1c0420b9edc396eb1763586ba00"} Jun 15 01:58:09.622183 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:58:09.622133 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-724sm" podStartSLOduration=1.792789564 podStartE2EDuration="3m21.622117901s" totalImagesPullingTime="2.915510205s" totalInitContainerRuntime="3m16.913818132s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:54:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:58:09.61968391 +0000 UTC m=+1185.478506578" watchObservedRunningTime="2026-06-15 01:58:09.622117901 +0000 UTC m=+1185.480940616" Jun 15 01:58:14.646900 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:58:14.646862 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:14.749202 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:58:14.749142 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:18.406424 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:58:18.406380 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-724sm" Jun 15 01:58:18.406882 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:58:18.406448 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-724sm" Jun 15 01:58:18.419487 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:58:18.419462 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-724sm" Jun 15 01:58:18.654495 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:58:18.654469 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-724sm" Jun 15 01:58:23.154113 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:58:23.154069 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:24.595044 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:58:24.595014 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c2jms_63f8819b-4ac8-42d2-a662-78721cf2548f/ovn-acl-logging/0.log" Jun 15 01:58:24.597239 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:58:24.597218 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c2jms_63f8819b-4ac8-42d2-a662-78721cf2548f/ovn-acl-logging/0.log" Jun 15 01:58:28.947436 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:58:28.947405 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:29.006442 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:58:29.006412 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:01.160151 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:59:01.160106 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:01.258656 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:59:01.258612 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:25.111145 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:59:25.111106 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:30.728603 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:59:30.728567 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:30.832179 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:59:30.832133 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:30.931217 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:59:30.931185 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:31.166646 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:59:31.166602 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:31.263756 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:59:31.263692 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:47.728459 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:59:47.728421 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:47.840060 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:59:47.840008 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:47.943753 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:59:47.943720 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:53.755701 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:59:53.755652 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:53.811435 ip-10-0-137-147 kubenswrapper[2551]: I0615 01:59:53.811404 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:00:01.909789 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:00:01.909752 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:00:02.006102 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:00:02.006058 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:00:02.108484 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:00:02.108450 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:00:02.209151 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:00:02.209072 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:00:18.603495 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:00:18.603462 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:00:18.711192 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:00:18.711149 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:00:18.822351 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:00:18.822316 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:00:24.492684 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:00:24.492654 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:00:24.593336 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:00:24.593305 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:00:40.672052 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:00:40.671974 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:00:40.770743 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:00:40.770707 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:00:40.886239 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:00:40.886204 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:00:46.505934 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:00:46.505896 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:00:46.607876 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:00:46.607842 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:00:46.706168 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:00:46.706136 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:00:46.822093 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:00:46.822009 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:00:52.437261 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:00:52.437228 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:00:52.539256 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:00:52.539219 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:01:53.326899 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:01:53.326863 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:24.625999 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:03:24.625967 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c2jms_63f8819b-4ac8-42d2-a662-78721cf2548f/ovn-acl-logging/0.log" Jun 15 02:03:24.628717 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:03:24.628699 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c2jms_63f8819b-4ac8-42d2-a662-78721cf2548f/ovn-acl-logging/0.log" Jun 15 02:05:57.180845 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:05:57.180809 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:08:24.663820 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:08:24.663789 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c2jms_63f8819b-4ac8-42d2-a662-78721cf2548f/ovn-acl-logging/0.log" Jun 15 02:08:24.666128 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:08:24.666108 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c2jms_63f8819b-4ac8-42d2-a662-78721cf2548f/ovn-acl-logging/0.log" Jun 15 02:08:45.097956 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:08:45.097924 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:08:45.183250 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:08:45.183220 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:13:24.693906 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:13:24.693875 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c2jms_63f8819b-4ac8-42d2-a662-78721cf2548f/ovn-acl-logging/0.log" Jun 15 02:13:24.697840 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:13:24.697820 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c2jms_63f8819b-4ac8-42d2-a662-78721cf2548f/ovn-acl-logging/0.log" Jun 15 02:14:06.354091 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:14:06.353995 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:14:48.260010 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:14:48.259965 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:14:48.360529 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:14:48.360493 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:17:09.306352 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:09.306315 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:17:14.692847 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:14.692816 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:17:38.958434 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:38.958397 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:17:51.990410 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:51.990367 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:17:53.553201 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.553165 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p"] Jun 15 02:17:53.553766 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.553749 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e44b4c5d-8e28-45ff-807c-e8cfacffcc59" containerName="authorino" Jun 15 02:17:53.553828 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.553770 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="e44b4c5d-8e28-45ff-807c-e8cfacffcc59" containerName="authorino" Jun 15 02:17:53.553898 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.553887 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="e44b4c5d-8e28-45ff-807c-e8cfacffcc59" containerName="authorino" Jun 15 02:17:53.557040 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.557024 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:17:53.558988 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.558961 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-2ec13d1c-openshift-default-dockercfg-75dtf\"" Jun 15 02:17:53.575414 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.575389 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p"] Jun 15 02:17:53.588529 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.588505 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:17:53.621706 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.621679 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-istio-token\") pod \"e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:17:53.621803 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.621729 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-istio-podinfo\") pod \"e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:17:53.621803 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.621751 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-workload-certs\") pod \"e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:17:53.621803 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.621795 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-istio-envoy\") pod \"e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:17:53.621911 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.621815 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-istiod-ca-cert\") pod \"e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:17:53.621911 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.621855 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-workload-socket\") pod \"e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:17:53.621977 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.621922 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-istio-data\") pod \"e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:17:53.621977 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.621940 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlpvv\" (UniqueName: \"kubernetes.io/projected/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-kube-api-access-jlpvv\") pod \"e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:17:53.621977 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.621966 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-credential-socket\") pod \"e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:17:53.645314 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.645288 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:17:53.722768 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.722740 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-credential-socket\") pod \"e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:17:53.722932 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.722780 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-istio-token\") pod \"e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:17:53.722932 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.722821 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-istio-podinfo\") pod \"e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:17:53.722932 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.722838 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-workload-certs\") pod \"e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:17:53.722932 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.722856 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-istio-envoy\") pod \"e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:17:53.722932 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.722872 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-istiod-ca-cert\") pod \"e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:17:53.722932 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.722902 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-workload-socket\") pod \"e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:17:53.723224 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.722990 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-istio-data\") pod \"e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:17:53.723224 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.723017 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlpvv\" (UniqueName: \"kubernetes.io/projected/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-kube-api-access-jlpvv\") pod \"e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:17:53.723368 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.723232 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-workload-certs\") pod \"e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:17:53.723368 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.723354 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-credential-socket\") pod \"e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:17:53.723482 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.723422 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-workload-socket\") pod \"e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:17:53.723525 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.723504 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-istio-data\") pod \"e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:17:53.723672 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.723652 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-istiod-ca-cert\") pod \"e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:17:53.725206 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.725185 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-istio-envoy\") pod \"e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:17:53.725420 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.725403 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-istio-podinfo\") pod \"e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:17:53.732369 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.732349 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-istio-token\") pod \"e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:17:53.732492 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.732406 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlpvv\" (UniqueName: \"kubernetes.io/projected/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-kube-api-access-jlpvv\") pod \"e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:17:53.804021 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.803937 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:17:53.868255 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.868221 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:17:53.903459 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:53.903425 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:17:54.003073 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:54.003049 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p"] Jun 15 02:17:54.004920 ip-10-0-137-147 kubenswrapper[2551]: W0615 02:17:54.004891 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14a19d0f_485d_4343_88b1_96e8dcdcd2a9.slice/crio-ddf25df10debd3b144533f070d89c8c5f20ba822b4a76178c3077b869970e4f3 WatchSource:0}: Error finding container ddf25df10debd3b144533f070d89c8c5f20ba822b4a76178c3077b869970e4f3: Status 404 returned error can't find the container with id ddf25df10debd3b144533f070d89c8c5f20ba822b4a76178c3077b869970e4f3 Jun 15 02:17:54.007096 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:54.007061 2551 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 02:17:54.007180 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:54.007129 2551 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 02:17:54.007219 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:54.007186 2551 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 02:17:54.226645 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:54.226591 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" event={"ID":"14a19d0f-485d-4343-88b1-96e8dcdcd2a9","Type":"ContainerStarted","Data":"75c113b74db2f5796fa1df8a8a3be209122ab484c89f70211a9c9d332a901499"} Jun 15 02:17:54.226832 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:54.226673 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" event={"ID":"14a19d0f-485d-4343-88b1-96e8dcdcd2a9","Type":"ContainerStarted","Data":"ddf25df10debd3b144533f070d89c8c5f20ba822b4a76178c3077b869970e4f3"} Jun 15 02:17:54.245151 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:54.245101 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" podStartSLOduration=1.245083657 podStartE2EDuration="1.245083657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:17:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:17:54.242949297 +0000 UTC m=+2370.101771963" watchObservedRunningTime="2026-06-15 02:17:54.245083657 +0000 UTC m=+2370.103906324" Jun 15 02:17:54.868458 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:54.868426 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:17:55.873194 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:55.873162 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:17:56.236325 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:56.236228 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:17:56.237153 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:56.237135 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:17:57.036898 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:57.036866 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:17:59.834768 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:59.834731 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:17:59.991170 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:59.991133 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p"] Jun 15 02:17:59.991390 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:17:59.991360 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" podUID="14a19d0f-485d-4343-88b1-96e8dcdcd2a9" containerName="istio-proxy" containerID="cri-o://75c113b74db2f5796fa1df8a8a3be209122ab484c89f70211a9c9d332a901499" gracePeriod=30 Jun 15 02:18:00.014502 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:00.014459 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:18:00.114551 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:00.114522 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:18:01.629137 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:01.629099 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:18:05.239066 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.239038 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:18:05.281423 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.281336 2551 generic.go:356] "Generic (PLEG): container finished" podID="14a19d0f-485d-4343-88b1-96e8dcdcd2a9" containerID="75c113b74db2f5796fa1df8a8a3be209122ab484c89f70211a9c9d332a901499" exitCode=0 Jun 15 02:18:05.281423 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.281394 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" Jun 15 02:18:05.281656 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.281426 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" event={"ID":"14a19d0f-485d-4343-88b1-96e8dcdcd2a9","Type":"ContainerDied","Data":"75c113b74db2f5796fa1df8a8a3be209122ab484c89f70211a9c9d332a901499"} Jun 15 02:18:05.281656 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.281494 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p" event={"ID":"14a19d0f-485d-4343-88b1-96e8dcdcd2a9","Type":"ContainerDied","Data":"ddf25df10debd3b144533f070d89c8c5f20ba822b4a76178c3077b869970e4f3"} Jun 15 02:18:05.281656 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.281515 2551 scope.go:117] "RemoveContainer" containerID="75c113b74db2f5796fa1df8a8a3be209122ab484c89f70211a9c9d332a901499" Jun 15 02:18:05.290007 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.289988 2551 scope.go:117] "RemoveContainer" containerID="75c113b74db2f5796fa1df8a8a3be209122ab484c89f70211a9c9d332a901499" Jun 15 02:18:05.290266 ip-10-0-137-147 kubenswrapper[2551]: E0615 02:18:05.290243 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75c113b74db2f5796fa1df8a8a3be209122ab484c89f70211a9c9d332a901499\": container with ID starting with 75c113b74db2f5796fa1df8a8a3be209122ab484c89f70211a9c9d332a901499 not found: ID does not exist" containerID="75c113b74db2f5796fa1df8a8a3be209122ab484c89f70211a9c9d332a901499" Jun 15 02:18:05.290364 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.290273 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75c113b74db2f5796fa1df8a8a3be209122ab484c89f70211a9c9d332a901499"} err="failed to get container status \"75c113b74db2f5796fa1df8a8a3be209122ab484c89f70211a9c9d332a901499\": rpc error: code = NotFound desc = could not find container \"75c113b74db2f5796fa1df8a8a3be209122ab484c89f70211a9c9d332a901499\": container with ID starting with 75c113b74db2f5796fa1df8a8a3be209122ab484c89f70211a9c9d332a901499 not found: ID does not exist" Jun 15 02:18:05.339514 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.339490 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-istio-podinfo\") pod \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " Jun 15 02:18:05.339648 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.339540 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-istio-envoy\") pod \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " Jun 15 02:18:05.339648 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.339569 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlpvv\" (UniqueName: \"kubernetes.io/projected/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-kube-api-access-jlpvv\") pod \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " Jun 15 02:18:05.339733 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.339690 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-istio-token\") pod \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " Jun 15 02:18:05.339776 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.339756 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-istio-data\") pod \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " Jun 15 02:18:05.339816 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.339796 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-istiod-ca-cert\") pod \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " Jun 15 02:18:05.339866 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.339851 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-workload-socket\") pod \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " Jun 15 02:18:05.339925 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.339905 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-workload-certs\") pod \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " Jun 15 02:18:05.339980 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.339963 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-credential-socket\") pod \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\" (UID: \"14a19d0f-485d-4343-88b1-96e8dcdcd2a9\") " Jun 15 02:18:05.340094 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.340044 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-istio-data" (OuterVolumeSpecName: "istio-data") pod "14a19d0f-485d-4343-88b1-96e8dcdcd2a9" (UID: "14a19d0f-485d-4343-88b1-96e8dcdcd2a9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 02:18:05.340320 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.340204 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "14a19d0f-485d-4343-88b1-96e8dcdcd2a9" (UID: "14a19d0f-485d-4343-88b1-96e8dcdcd2a9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 02:18:05.340405 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.340320 2551 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-istio-data\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 02:18:05.340468 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.340417 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "14a19d0f-485d-4343-88b1-96e8dcdcd2a9" (UID: "14a19d0f-485d-4343-88b1-96e8dcdcd2a9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 02:18:05.340520 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.340483 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "14a19d0f-485d-4343-88b1-96e8dcdcd2a9" (UID: "14a19d0f-485d-4343-88b1-96e8dcdcd2a9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 02:18:05.340520 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.340499 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "14a19d0f-485d-4343-88b1-96e8dcdcd2a9" (UID: "14a19d0f-485d-4343-88b1-96e8dcdcd2a9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 02:18:05.341978 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.341954 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-istio-token" (OuterVolumeSpecName: "istio-token") pod "14a19d0f-485d-4343-88b1-96e8dcdcd2a9" (UID: "14a19d0f-485d-4343-88b1-96e8dcdcd2a9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 02:18:05.341978 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.341965 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "14a19d0f-485d-4343-88b1-96e8dcdcd2a9" (UID: "14a19d0f-485d-4343-88b1-96e8dcdcd2a9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 15 02:18:05.342116 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.342083 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "14a19d0f-485d-4343-88b1-96e8dcdcd2a9" (UID: "14a19d0f-485d-4343-88b1-96e8dcdcd2a9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 02:18:05.342116 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.342094 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-kube-api-access-jlpvv" (OuterVolumeSpecName: "kube-api-access-jlpvv") pod "14a19d0f-485d-4343-88b1-96e8dcdcd2a9" (UID: "14a19d0f-485d-4343-88b1-96e8dcdcd2a9"). InnerVolumeSpecName "kube-api-access-jlpvv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 02:18:05.441509 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.441476 2551 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-istiod-ca-cert\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 02:18:05.441509 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.441503 2551 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-workload-socket\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 02:18:05.441509 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.441512 2551 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-workload-certs\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 02:18:05.441765 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.441521 2551 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-credential-socket\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 02:18:05.441765 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.441531 2551 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-istio-podinfo\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 02:18:05.441765 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.441539 2551 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-istio-envoy\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 02:18:05.441765 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.441547 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlpvv\" (UniqueName: \"kubernetes.io/projected/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-kube-api-access-jlpvv\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 02:18:05.441765 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.441556 2551 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14a19d0f-485d-4343-88b1-96e8dcdcd2a9-istio-token\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 02:18:05.603154 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.603116 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p"] Jun 15 02:18:05.604776 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:05.604751 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-2ec13d1c-openshift-default-85bccf9498-hwx5p"] Jun 15 02:18:06.182531 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.182494 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:18:06.306210 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.306161 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:18:06.324431 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.324400 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n"] Jun 15 02:18:06.325007 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.324984 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14a19d0f-485d-4343-88b1-96e8dcdcd2a9" containerName="istio-proxy" Jun 15 02:18:06.325007 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.325006 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="14a19d0f-485d-4343-88b1-96e8dcdcd2a9" containerName="istio-proxy" Jun 15 02:18:06.325231 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.325123 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="14a19d0f-485d-4343-88b1-96e8dcdcd2a9" containerName="istio-proxy" Jun 15 02:18:06.329917 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.329894 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:06.331916 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.331888 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-fce28127-openshift-default-dockercfg-c99bz\"" Jun 15 02:18:06.340979 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.340959 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n"] Jun 15 02:18:06.382076 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.382044 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:18:06.450726 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.450609 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/375b73fc-632e-49bd-bfd5-a82490a60100-istio-data\") pod \"e2e-ait-fce28127-openshift-default-68794f9546-6xq5n\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:06.450726 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.450675 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/375b73fc-632e-49bd-bfd5-a82490a60100-istiod-ca-cert\") pod \"e2e-ait-fce28127-openshift-default-68794f9546-6xq5n\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:06.450726 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.450702 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj5vf\" (UniqueName: \"kubernetes.io/projected/375b73fc-632e-49bd-bfd5-a82490a60100-kube-api-access-qj5vf\") pod \"e2e-ait-fce28127-openshift-default-68794f9546-6xq5n\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:06.451020 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.450752 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/375b73fc-632e-49bd-bfd5-a82490a60100-istio-podinfo\") pod \"e2e-ait-fce28127-openshift-default-68794f9546-6xq5n\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:06.451020 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.450801 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/375b73fc-632e-49bd-bfd5-a82490a60100-istio-envoy\") pod \"e2e-ait-fce28127-openshift-default-68794f9546-6xq5n\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:06.451020 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.450869 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/375b73fc-632e-49bd-bfd5-a82490a60100-credential-socket\") pod \"e2e-ait-fce28127-openshift-default-68794f9546-6xq5n\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:06.451020 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.450901 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/375b73fc-632e-49bd-bfd5-a82490a60100-workload-socket\") pod \"e2e-ait-fce28127-openshift-default-68794f9546-6xq5n\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:06.451020 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.450959 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/375b73fc-632e-49bd-bfd5-a82490a60100-istio-token\") pod \"e2e-ait-fce28127-openshift-default-68794f9546-6xq5n\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:06.451020 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.450982 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/375b73fc-632e-49bd-bfd5-a82490a60100-workload-certs\") pod \"e2e-ait-fce28127-openshift-default-68794f9546-6xq5n\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:06.547530 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.547495 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14a19d0f-485d-4343-88b1-96e8dcdcd2a9" path="/var/lib/kubelet/pods/14a19d0f-485d-4343-88b1-96e8dcdcd2a9/volumes" Jun 15 02:18:06.549620 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.549582 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:18:06.551617 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.551601 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/375b73fc-632e-49bd-bfd5-a82490a60100-istio-data\") pod \"e2e-ait-fce28127-openshift-default-68794f9546-6xq5n\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:06.551694 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.551654 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/375b73fc-632e-49bd-bfd5-a82490a60100-istiod-ca-cert\") pod \"e2e-ait-fce28127-openshift-default-68794f9546-6xq5n\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:06.551694 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.551676 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj5vf\" (UniqueName: \"kubernetes.io/projected/375b73fc-632e-49bd-bfd5-a82490a60100-kube-api-access-qj5vf\") pod \"e2e-ait-fce28127-openshift-default-68794f9546-6xq5n\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:06.551787 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.551711 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/375b73fc-632e-49bd-bfd5-a82490a60100-istio-podinfo\") pod \"e2e-ait-fce28127-openshift-default-68794f9546-6xq5n\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:06.551787 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.551731 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/375b73fc-632e-49bd-bfd5-a82490a60100-istio-envoy\") pod \"e2e-ait-fce28127-openshift-default-68794f9546-6xq5n\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:06.551787 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.551779 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/375b73fc-632e-49bd-bfd5-a82490a60100-credential-socket\") pod \"e2e-ait-fce28127-openshift-default-68794f9546-6xq5n\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:06.551939 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.551809 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/375b73fc-632e-49bd-bfd5-a82490a60100-workload-socket\") pod \"e2e-ait-fce28127-openshift-default-68794f9546-6xq5n\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:06.551939 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.551864 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/375b73fc-632e-49bd-bfd5-a82490a60100-istio-token\") pod \"e2e-ait-fce28127-openshift-default-68794f9546-6xq5n\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:06.551939 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.551898 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/375b73fc-632e-49bd-bfd5-a82490a60100-workload-certs\") pod \"e2e-ait-fce28127-openshift-default-68794f9546-6xq5n\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:06.552138 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.552097 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/375b73fc-632e-49bd-bfd5-a82490a60100-istio-data\") pod \"e2e-ait-fce28127-openshift-default-68794f9546-6xq5n\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:06.552262 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.552229 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/375b73fc-632e-49bd-bfd5-a82490a60100-credential-socket\") pod \"e2e-ait-fce28127-openshift-default-68794f9546-6xq5n\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:06.552389 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.552241 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/375b73fc-632e-49bd-bfd5-a82490a60100-workload-socket\") pod \"e2e-ait-fce28127-openshift-default-68794f9546-6xq5n\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:06.552456 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.552400 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/375b73fc-632e-49bd-bfd5-a82490a60100-workload-certs\") pod \"e2e-ait-fce28127-openshift-default-68794f9546-6xq5n\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:06.552554 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.552532 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/375b73fc-632e-49bd-bfd5-a82490a60100-istiod-ca-cert\") pod \"e2e-ait-fce28127-openshift-default-68794f9546-6xq5n\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:06.553922 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.553902 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/375b73fc-632e-49bd-bfd5-a82490a60100-istio-envoy\") pod \"e2e-ait-fce28127-openshift-default-68794f9546-6xq5n\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:06.554438 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.554416 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/375b73fc-632e-49bd-bfd5-a82490a60100-istio-podinfo\") pod \"e2e-ait-fce28127-openshift-default-68794f9546-6xq5n\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:06.563292 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.563271 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj5vf\" (UniqueName: \"kubernetes.io/projected/375b73fc-632e-49bd-bfd5-a82490a60100-kube-api-access-qj5vf\") pod \"e2e-ait-fce28127-openshift-default-68794f9546-6xq5n\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:06.563391 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.563358 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/375b73fc-632e-49bd-bfd5-a82490a60100-istio-token\") pod \"e2e-ait-fce28127-openshift-default-68794f9546-6xq5n\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:06.641115 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.641083 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:06.649026 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.648993 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:18:06.776219 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.776196 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n"] Jun 15 02:18:06.778371 ip-10-0-137-147 kubenswrapper[2551]: W0615 02:18:06.778342 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod375b73fc_632e_49bd_bfd5_a82490a60100.slice/crio-ebe947bc92b2b48c05beb4e3c5645fd23bb9fb561e9f0a6a0c81f2c1d52ed12a WatchSource:0}: Error finding container ebe947bc92b2b48c05beb4e3c5645fd23bb9fb561e9f0a6a0c81f2c1d52ed12a: Status 404 returned error can't find the container with id ebe947bc92b2b48c05beb4e3c5645fd23bb9fb561e9f0a6a0c81f2c1d52ed12a Jun 15 02:18:06.780427 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.780388 2551 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 02:18:06.780531 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.780468 2551 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 02:18:06.780531 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:06.780521 2551 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 02:18:07.293882 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:07.293841 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" event={"ID":"375b73fc-632e-49bd-bfd5-a82490a60100","Type":"ContainerStarted","Data":"551c31c286ea4e60d33de6681f3a770e606d5d0724c68d11fe11238503bdd382"} Jun 15 02:18:07.294061 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:07.293904 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" event={"ID":"375b73fc-632e-49bd-bfd5-a82490a60100","Type":"ContainerStarted","Data":"ebe947bc92b2b48c05beb4e3c5645fd23bb9fb561e9f0a6a0c81f2c1d52ed12a"} Jun 15 02:18:07.320144 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:07.320097 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" podStartSLOduration=1.320080935 podStartE2EDuration="1.320080935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:18:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:18:07.317500727 +0000 UTC m=+2383.176323393" watchObservedRunningTime="2026-06-15 02:18:07.320080935 +0000 UTC m=+2383.178903601" Jun 15 02:18:07.641708 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:07.641675 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:07.646290 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:07.646265 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:08.299131 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:08.299100 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:08.300082 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:08.300062 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:10.180959 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:10.180903 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:18:12.571662 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:12.571610 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:18:13.684952 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:13.684916 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n"] Jun 15 02:18:13.685324 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:13.685095 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" podUID="375b73fc-632e-49bd-bfd5-a82490a60100" containerName="istio-proxy" containerID="cri-o://551c31c286ea4e60d33de6681f3a770e606d5d0724c68d11fe11238503bdd382" gracePeriod=30 Jun 15 02:18:13.710237 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:13.710197 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:18:13.809446 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:13.809411 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:18:15.189948 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:15.189905 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:18:18.939703 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:18.939682 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:18.964345 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:18.964283 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/375b73fc-632e-49bd-bfd5-a82490a60100-istio-data\") pod \"375b73fc-632e-49bd-bfd5-a82490a60100\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " Jun 15 02:18:18.964345 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:18.964338 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qj5vf\" (UniqueName: \"kubernetes.io/projected/375b73fc-632e-49bd-bfd5-a82490a60100-kube-api-access-qj5vf\") pod \"375b73fc-632e-49bd-bfd5-a82490a60100\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " Jun 15 02:18:18.964534 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:18.964355 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/375b73fc-632e-49bd-bfd5-a82490a60100-credential-socket\") pod \"375b73fc-632e-49bd-bfd5-a82490a60100\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " Jun 15 02:18:18.964534 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:18.964376 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/375b73fc-632e-49bd-bfd5-a82490a60100-istio-envoy\") pod \"375b73fc-632e-49bd-bfd5-a82490a60100\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " Jun 15 02:18:18.964534 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:18.964474 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/375b73fc-632e-49bd-bfd5-a82490a60100-istio-token\") pod \"375b73fc-632e-49bd-bfd5-a82490a60100\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " Jun 15 02:18:18.964534 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:18.964514 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/375b73fc-632e-49bd-bfd5-a82490a60100-workload-certs\") pod \"375b73fc-632e-49bd-bfd5-a82490a60100\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " Jun 15 02:18:18.964765 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:18.964568 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/375b73fc-632e-49bd-bfd5-a82490a60100-istio-podinfo\") pod \"375b73fc-632e-49bd-bfd5-a82490a60100\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " Jun 15 02:18:18.964765 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:18.964586 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/375b73fc-632e-49bd-bfd5-a82490a60100-istio-data" (OuterVolumeSpecName: "istio-data") pod "375b73fc-632e-49bd-bfd5-a82490a60100" (UID: "375b73fc-632e-49bd-bfd5-a82490a60100"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 02:18:18.964765 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:18.964598 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/375b73fc-632e-49bd-bfd5-a82490a60100-workload-socket\") pod \"375b73fc-632e-49bd-bfd5-a82490a60100\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " Jun 15 02:18:18.964765 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:18.964671 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/375b73fc-632e-49bd-bfd5-a82490a60100-istiod-ca-cert\") pod \"375b73fc-632e-49bd-bfd5-a82490a60100\" (UID: \"375b73fc-632e-49bd-bfd5-a82490a60100\") " Jun 15 02:18:18.964948 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:18.964832 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/375b73fc-632e-49bd-bfd5-a82490a60100-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "375b73fc-632e-49bd-bfd5-a82490a60100" (UID: "375b73fc-632e-49bd-bfd5-a82490a60100"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 02:18:18.964999 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:18.964977 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/375b73fc-632e-49bd-bfd5-a82490a60100-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "375b73fc-632e-49bd-bfd5-a82490a60100" (UID: "375b73fc-632e-49bd-bfd5-a82490a60100"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 02:18:18.965090 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:18.965073 2551 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/375b73fc-632e-49bd-bfd5-a82490a60100-credential-socket\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 02:18:18.965148 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:18.965098 2551 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/375b73fc-632e-49bd-bfd5-a82490a60100-workload-socket\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 02:18:18.965148 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:18.965113 2551 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/375b73fc-632e-49bd-bfd5-a82490a60100-istio-data\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 02:18:18.965216 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:18.965181 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/375b73fc-632e-49bd-bfd5-a82490a60100-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "375b73fc-632e-49bd-bfd5-a82490a60100" (UID: "375b73fc-632e-49bd-bfd5-a82490a60100"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 02:18:18.965270 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:18.965247 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/375b73fc-632e-49bd-bfd5-a82490a60100-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "375b73fc-632e-49bd-bfd5-a82490a60100" (UID: "375b73fc-632e-49bd-bfd5-a82490a60100"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 02:18:18.967109 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:18.967077 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/375b73fc-632e-49bd-bfd5-a82490a60100-kube-api-access-qj5vf" (OuterVolumeSpecName: "kube-api-access-qj5vf") pod "375b73fc-632e-49bd-bfd5-a82490a60100" (UID: "375b73fc-632e-49bd-bfd5-a82490a60100"). InnerVolumeSpecName "kube-api-access-qj5vf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 02:18:18.967237 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:18.967212 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/375b73fc-632e-49bd-bfd5-a82490a60100-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "375b73fc-632e-49bd-bfd5-a82490a60100" (UID: "375b73fc-632e-49bd-bfd5-a82490a60100"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 02:18:18.967342 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:18.967287 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/375b73fc-632e-49bd-bfd5-a82490a60100-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "375b73fc-632e-49bd-bfd5-a82490a60100" (UID: "375b73fc-632e-49bd-bfd5-a82490a60100"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 15 02:18:18.967342 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:18.967316 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/375b73fc-632e-49bd-bfd5-a82490a60100-istio-token" (OuterVolumeSpecName: "istio-token") pod "375b73fc-632e-49bd-bfd5-a82490a60100" (UID: "375b73fc-632e-49bd-bfd5-a82490a60100"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 02:18:19.065836 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:19.065806 2551 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/375b73fc-632e-49bd-bfd5-a82490a60100-workload-certs\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 02:18:19.065836 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:19.065833 2551 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/375b73fc-632e-49bd-bfd5-a82490a60100-istio-podinfo\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 02:18:19.065836 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:19.065842 2551 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/375b73fc-632e-49bd-bfd5-a82490a60100-istiod-ca-cert\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 02:18:19.066026 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:19.065850 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qj5vf\" (UniqueName: \"kubernetes.io/projected/375b73fc-632e-49bd-bfd5-a82490a60100-kube-api-access-qj5vf\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 02:18:19.066026 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:19.065860 2551 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/375b73fc-632e-49bd-bfd5-a82490a60100-istio-envoy\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 02:18:19.066026 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:19.065868 2551 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/375b73fc-632e-49bd-bfd5-a82490a60100-istio-token\") on node \"ip-10-0-137-147.ec2.internal\" DevicePath \"\"" Jun 15 02:18:19.358448 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:19.358417 2551 generic.go:356] "Generic (PLEG): container finished" podID="375b73fc-632e-49bd-bfd5-a82490a60100" containerID="551c31c286ea4e60d33de6681f3a770e606d5d0724c68d11fe11238503bdd382" exitCode=0 Jun 15 02:18:19.358619 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:19.358463 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" Jun 15 02:18:19.358619 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:19.358506 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" event={"ID":"375b73fc-632e-49bd-bfd5-a82490a60100","Type":"ContainerDied","Data":"551c31c286ea4e60d33de6681f3a770e606d5d0724c68d11fe11238503bdd382"} Jun 15 02:18:19.358619 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:19.358558 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n" event={"ID":"375b73fc-632e-49bd-bfd5-a82490a60100","Type":"ContainerDied","Data":"ebe947bc92b2b48c05beb4e3c5645fd23bb9fb561e9f0a6a0c81f2c1d52ed12a"} Jun 15 02:18:19.358619 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:19.358579 2551 scope.go:117] "RemoveContainer" containerID="551c31c286ea4e60d33de6681f3a770e606d5d0724c68d11fe11238503bdd382" Jun 15 02:18:19.367872 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:19.367855 2551 scope.go:117] "RemoveContainer" containerID="551c31c286ea4e60d33de6681f3a770e606d5d0724c68d11fe11238503bdd382" Jun 15 02:18:19.368160 ip-10-0-137-147 kubenswrapper[2551]: E0615 02:18:19.368143 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"551c31c286ea4e60d33de6681f3a770e606d5d0724c68d11fe11238503bdd382\": container with ID starting with 551c31c286ea4e60d33de6681f3a770e606d5d0724c68d11fe11238503bdd382 not found: ID does not exist" containerID="551c31c286ea4e60d33de6681f3a770e606d5d0724c68d11fe11238503bdd382" Jun 15 02:18:19.368213 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:19.368170 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"551c31c286ea4e60d33de6681f3a770e606d5d0724c68d11fe11238503bdd382"} err="failed to get container status \"551c31c286ea4e60d33de6681f3a770e606d5d0724c68d11fe11238503bdd382\": rpc error: code = NotFound desc = could not find container \"551c31c286ea4e60d33de6681f3a770e606d5d0724c68d11fe11238503bdd382\": container with ID starting with 551c31c286ea4e60d33de6681f3a770e606d5d0724c68d11fe11238503bdd382 not found: ID does not exist" Jun 15 02:18:19.381911 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:19.381885 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n"] Jun 15 02:18:19.385848 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:19.385824 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-fce28127-openshift-default-68794f9546-6xq5n"] Jun 15 02:18:19.546662 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:19.546619 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:18:19.646498 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:19.646413 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:18:20.546990 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:20.546958 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="375b73fc-632e-49bd-bfd5-a82490a60100" path="/var/lib/kubelet/pods/375b73fc-632e-49bd-bfd5-a82490a60100/volumes" Jun 15 02:18:24.724984 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:24.724948 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c2jms_63f8819b-4ac8-42d2-a662-78721cf2548f/ovn-acl-logging/0.log" Jun 15 02:18:24.730667 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:24.730649 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c2jms_63f8819b-4ac8-42d2-a662-78721cf2548f/ovn-acl-logging/0.log" Jun 15 02:18:31.338272 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:31.338241 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d6d6cd49-9rqkb_5f473ebd-4abe-4273-8b55-d0acdb210ed3/copy-manifests/0.log" Jun 15 02:18:31.346967 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:31.346907 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d6d6cd49-9rqkb_5f473ebd-4abe-4273-8b55-d0acdb210ed3/manager/0.log" Jun 15 02:18:33.181084 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:33.181056 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-f9z7m_ab9a317d-cd9a-45ef-9876-50a017554cc6/manager/0.log" Jun 15 02:18:33.291853 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:33.291828 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-44psx_e2bc9136-e160-4290-9d02-abef84be5f26/kuadrant-console-plugin/0.log" Jun 15 02:18:34.328989 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:34.328954 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9566dff59-9blvs_28cf08e4-ee41-45cf-a005-348078fc00c6/kube-auth-proxy/0.log" Jun 15 02:18:34.554961 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:34.554913 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-c2f5t_a7840efb-7120-42a9-bd47-8427cffcb426/istio-proxy/1.log" Jun 15 02:18:35.374534 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:35.374446 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-724sm_a9438c9a-338b-4a5f-aadc-1f1341e9d353/storage-initializer/0.log" Jun 15 02:18:35.382882 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:35.382858 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-724sm_a9438c9a-338b-4a5f-aadc-1f1341e9d353/main/0.log" Jun 15 02:18:35.723214 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:35.723113 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-zpztb_bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2/storage-initializer/0.log" Jun 15 02:18:35.731502 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:35.731470 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-zpztb_bb0ffb3a-b5ea-4a8b-9a4a-dd15253724e2/main/0.log" Jun 15 02:18:35.839267 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:35.839241 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-58glj_66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab/storage-initializer/0.log" Jun 15 02:18:35.847238 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:35.847214 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-58glj_66e17cd3-cebd-4e8f-9ec6-13357d6bf7ab/main/0.log" Jun 15 02:18:39.776044 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:39.776010 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2jt7g/must-gather-lkgpm"] Jun 15 02:18:39.776563 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:39.776543 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="375b73fc-632e-49bd-bfd5-a82490a60100" containerName="istio-proxy" Jun 15 02:18:39.776680 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:39.776567 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="375b73fc-632e-49bd-bfd5-a82490a60100" containerName="istio-proxy" Jun 15 02:18:39.776747 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:39.776708 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="375b73fc-632e-49bd-bfd5-a82490a60100" containerName="istio-proxy" Jun 15 02:18:39.781475 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:39.781452 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2jt7g/must-gather-lkgpm" Jun 15 02:18:39.783671 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:39.783650 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2jt7g\"/\"default-dockercfg-kldtp\"" Jun 15 02:18:39.783776 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:39.783688 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2jt7g\"/\"kube-root-ca.crt\"" Jun 15 02:18:39.783969 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:39.783949 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2jt7g\"/\"openshift-service-ca.crt\"" Jun 15 02:18:39.788878 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:39.788853 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:18:39.788999 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:39.788953 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2jt7g/must-gather-lkgpm"] Jun 15 02:18:39.845890 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:39.845854 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" limit=1024 Jun 15 02:18:39.849963 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:39.849942 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b98d79e2-978f-487b-a8d1-b59cf7b8178d-must-gather-output\") pod \"must-gather-lkgpm\" (UID: \"b98d79e2-978f-487b-a8d1-b59cf7b8178d\") " pod="openshift-must-gather-2jt7g/must-gather-lkgpm" Jun 15 02:18:39.850052 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:39.849997 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krjmj\" (UniqueName: \"kubernetes.io/projected/b98d79e2-978f-487b-a8d1-b59cf7b8178d-kube-api-access-krjmj\") pod \"must-gather-lkgpm\" (UID: \"b98d79e2-978f-487b-a8d1-b59cf7b8178d\") " pod="openshift-must-gather-2jt7g/must-gather-lkgpm" Jun 15 02:18:39.950978 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:39.950941 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b98d79e2-978f-487b-a8d1-b59cf7b8178d-must-gather-output\") pod \"must-gather-lkgpm\" (UID: \"b98d79e2-978f-487b-a8d1-b59cf7b8178d\") " pod="openshift-must-gather-2jt7g/must-gather-lkgpm" Jun 15 02:18:39.951150 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:39.951000 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krjmj\" (UniqueName: \"kubernetes.io/projected/b98d79e2-978f-487b-a8d1-b59cf7b8178d-kube-api-access-krjmj\") pod \"must-gather-lkgpm\" (UID: \"b98d79e2-978f-487b-a8d1-b59cf7b8178d\") " pod="openshift-must-gather-2jt7g/must-gather-lkgpm" Jun 15 02:18:39.951287 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:39.951267 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b98d79e2-978f-487b-a8d1-b59cf7b8178d-must-gather-output\") pod \"must-gather-lkgpm\" (UID: \"b98d79e2-978f-487b-a8d1-b59cf7b8178d\") " pod="openshift-must-gather-2jt7g/must-gather-lkgpm" Jun 15 02:18:39.957836 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:39.957814 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krjmj\" (UniqueName: \"kubernetes.io/projected/b98d79e2-978f-487b-a8d1-b59cf7b8178d-kube-api-access-krjmj\") pod \"must-gather-lkgpm\" (UID: \"b98d79e2-978f-487b-a8d1-b59cf7b8178d\") " pod="openshift-must-gather-2jt7g/must-gather-lkgpm" Jun 15 02:18:40.092525 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:40.092425 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2jt7g/must-gather-lkgpm" Jun 15 02:18:40.221846 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:40.221818 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2jt7g/must-gather-lkgpm"] Jun 15 02:18:40.223711 ip-10-0-137-147 kubenswrapper[2551]: W0615 02:18:40.223666 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb98d79e2_978f_487b_a8d1_b59cf7b8178d.slice/crio-908b20975e853e9b55a331de4d8c6481269c44be99b350cf0d5de75c1a427f7b WatchSource:0}: Error finding container 908b20975e853e9b55a331de4d8c6481269c44be99b350cf0d5de75c1a427f7b: Status 404 returned error can't find the container with id 908b20975e853e9b55a331de4d8c6481269c44be99b350cf0d5de75c1a427f7b Jun 15 02:18:40.225580 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:40.225563 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 02:18:40.462905 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:40.462870 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2jt7g/must-gather-lkgpm" event={"ID":"b98d79e2-978f-487b-a8d1-b59cf7b8178d","Type":"ContainerStarted","Data":"908b20975e853e9b55a331de4d8c6481269c44be99b350cf0d5de75c1a427f7b"} Jun 15 02:18:41.473049 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:41.472794 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2jt7g/must-gather-lkgpm" event={"ID":"b98d79e2-978f-487b-a8d1-b59cf7b8178d","Type":"ContainerStarted","Data":"402849e287f21e8b8595895746a12ca5eb903beac3b8a7a553478d8915e78e4a"} Jun 15 02:18:41.473049 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:41.472852 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2jt7g/must-gather-lkgpm" event={"ID":"b98d79e2-978f-487b-a8d1-b59cf7b8178d","Type":"ContainerStarted","Data":"1d1858c64b2d99c93a9a0f84d39875e4aa548a95084a09b8b2d0ce8993d03d7f"} Jun 15 02:18:41.490343 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:41.490293 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2jt7g/must-gather-lkgpm" podStartSLOduration=1.7457321700000001 podStartE2EDuration="2.490277792s" totalImagesPullingTime="744.545622ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:18:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:18:41.486957178 +0000 UTC m=+2417.345779842" watchObservedRunningTime="2026-06-15 02:18:41.490277792 +0000 UTC m=+2417.349100459" Jun 15 02:18:42.835402 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:42.835366 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wlt8m_009c9c69-be75-43fc-96ba-3ce6a1082805/global-pull-secret-syncer/0.log" Jun 15 02:18:42.892785 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:42.892749 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6rwhz_26d9c93d-7f11-4e53-91fe-b863d7bd96ce/konnectivity-agent/0.log" Jun 15 02:18:43.035476 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:43.035428 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-147.ec2.internal_4a0fa8a0ec9211c9d89de751bfc47d7e/haproxy/0.log" Jun 15 02:18:47.699275 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:47.699227 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-f9z7m_ab9a317d-cd9a-45ef-9876-50a017554cc6/manager/0.log" Jun 15 02:18:47.745971 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:47.745935 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-44psx_e2bc9136-e160-4290-9d02-abef84be5f26/kuadrant-console-plugin/0.log" Jun 15 02:18:49.853515 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:49.853463 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-4rz9m_8f5cec08-fb70-4116-83fb-a9a5f04b93da/cluster-monitoring-operator/0.log" Jun 15 02:18:50.103143 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:50.103109 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ks5fr_5305acc3-ab90-4bb6-b909-90c6a8fe7bfa/node-exporter/0.log" Jun 15 02:18:50.127085 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:50.127005 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ks5fr_5305acc3-ab90-4bb6-b909-90c6a8fe7bfa/kube-rbac-proxy/0.log" Jun 15 02:18:50.160329 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:50.160300 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ks5fr_5305acc3-ab90-4bb6-b909-90c6a8fe7bfa/init-textfile/0.log" Jun 15 02:18:50.278196 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:50.278161 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-lr5gd_46fece98-78c1-4759-a3df-ddfeb9ca45aa/kube-rbac-proxy-main/0.log" Jun 15 02:18:50.302093 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:50.301942 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-lr5gd_46fece98-78c1-4759-a3df-ddfeb9ca45aa/kube-rbac-proxy-self/0.log" Jun 15 02:18:50.327751 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:50.327719 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-lr5gd_46fece98-78c1-4759-a3df-ddfeb9ca45aa/openshift-state-metrics/0.log" Jun 15 02:18:50.372004 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:50.371941 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36307760-960d-4134-b077-71284deb1dec/prometheus/0.log" Jun 15 02:18:50.392572 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:50.392500 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36307760-960d-4134-b077-71284deb1dec/config-reloader/0.log" Jun 15 02:18:50.417935 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:50.417910 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36307760-960d-4134-b077-71284deb1dec/thanos-sidecar/0.log" Jun 15 02:18:50.439457 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:50.439421 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36307760-960d-4134-b077-71284deb1dec/kube-rbac-proxy-web/0.log" Jun 15 02:18:50.463983 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:50.463956 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36307760-960d-4134-b077-71284deb1dec/kube-rbac-proxy/0.log" Jun 15 02:18:50.486988 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:50.486955 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36307760-960d-4134-b077-71284deb1dec/kube-rbac-proxy-thanos/0.log" Jun 15 02:18:50.513722 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:50.513682 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36307760-960d-4134-b077-71284deb1dec/init-config-reloader/0.log" Jun 15 02:18:50.545789 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:50.545754 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-swvv6_649b3814-bffa-4f87-9f11-3b647582aa21/prometheus-operator/0.log" Jun 15 02:18:50.578538 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:50.578496 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-swvv6_649b3814-bffa-4f87-9f11-3b647582aa21/kube-rbac-proxy/0.log" Jun 15 02:18:50.632376 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:50.632336 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-rwqj5_e62599e1-4578-4a70-80fd-03caef034b8e/prometheus-operator-admission-webhook/0.log" Jun 15 02:18:50.769172 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:50.769094 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-696cd556cb-llhlm_bd9510da-43d5-4690-9c1a-094ad0d61156/thanos-query/0.log" Jun 15 02:18:50.800057 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:50.800027 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-696cd556cb-llhlm_bd9510da-43d5-4690-9c1a-094ad0d61156/kube-rbac-proxy-web/0.log" Jun 15 02:18:50.822298 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:50.822266 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-696cd556cb-llhlm_bd9510da-43d5-4690-9c1a-094ad0d61156/kube-rbac-proxy/0.log" Jun 15 02:18:50.877603 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:50.877567 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-696cd556cb-llhlm_bd9510da-43d5-4690-9c1a-094ad0d61156/prom-label-proxy/0.log" Jun 15 02:18:50.901814 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:50.901783 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-696cd556cb-llhlm_bd9510da-43d5-4690-9c1a-094ad0d61156/kube-rbac-proxy-rules/0.log" Jun 15 02:18:50.925685 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:50.925592 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-696cd556cb-llhlm_bd9510da-43d5-4690-9c1a-094ad0d61156/kube-rbac-proxy-metrics/0.log" Jun 15 02:18:53.693568 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:53.693538 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-n4svk_e2a38d97-bb5c-499b-a908-91fa1d68f4d7/download-server/0.log" Jun 15 02:18:54.840693 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:54.840653 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2jt7g/perf-node-gather-daemonset-kmk62"] Jun 15 02:18:54.848913 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:54.848876 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-kmk62" Jun 15 02:18:54.850085 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:54.850057 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2jt7g/perf-node-gather-daemonset-kmk62"] Jun 15 02:18:55.011054 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:55.011013 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e3a1248b-7ab1-43b7-a29b-a50f84c40722-proc\") pod \"perf-node-gather-daemonset-kmk62\" (UID: \"e3a1248b-7ab1-43b7-a29b-a50f84c40722\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-kmk62" Jun 15 02:18:55.011245 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:55.011069 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c42t2\" (UniqueName: \"kubernetes.io/projected/e3a1248b-7ab1-43b7-a29b-a50f84c40722-kube-api-access-c42t2\") pod \"perf-node-gather-daemonset-kmk62\" (UID: \"e3a1248b-7ab1-43b7-a29b-a50f84c40722\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-kmk62" Jun 15 02:18:55.011245 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:55.011124 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e3a1248b-7ab1-43b7-a29b-a50f84c40722-lib-modules\") pod \"perf-node-gather-daemonset-kmk62\" (UID: \"e3a1248b-7ab1-43b7-a29b-a50f84c40722\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-kmk62" Jun 15 02:18:55.011245 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:55.011223 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e3a1248b-7ab1-43b7-a29b-a50f84c40722-podres\") pod \"perf-node-gather-daemonset-kmk62\" (UID: \"e3a1248b-7ab1-43b7-a29b-a50f84c40722\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-kmk62" Jun 15 02:18:55.011449 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:55.011284 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3a1248b-7ab1-43b7-a29b-a50f84c40722-sys\") pod \"perf-node-gather-daemonset-kmk62\" (UID: \"e3a1248b-7ab1-43b7-a29b-a50f84c40722\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-kmk62" Jun 15 02:18:55.112419 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:55.112379 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3a1248b-7ab1-43b7-a29b-a50f84c40722-sys\") pod \"perf-node-gather-daemonset-kmk62\" (UID: \"e3a1248b-7ab1-43b7-a29b-a50f84c40722\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-kmk62" Jun 15 02:18:55.112747 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:55.112535 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3a1248b-7ab1-43b7-a29b-a50f84c40722-sys\") pod \"perf-node-gather-daemonset-kmk62\" (UID: \"e3a1248b-7ab1-43b7-a29b-a50f84c40722\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-kmk62" Jun 15 02:18:55.112948 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:55.112729 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e3a1248b-7ab1-43b7-a29b-a50f84c40722-proc\") pod \"perf-node-gather-daemonset-kmk62\" (UID: \"e3a1248b-7ab1-43b7-a29b-a50f84c40722\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-kmk62" Jun 15 02:18:55.113052 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:55.112997 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c42t2\" (UniqueName: \"kubernetes.io/projected/e3a1248b-7ab1-43b7-a29b-a50f84c40722-kube-api-access-c42t2\") pod \"perf-node-gather-daemonset-kmk62\" (UID: \"e3a1248b-7ab1-43b7-a29b-a50f84c40722\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-kmk62" Jun 15 02:18:55.113449 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:55.112789 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e3a1248b-7ab1-43b7-a29b-a50f84c40722-proc\") pod \"perf-node-gather-daemonset-kmk62\" (UID: \"e3a1248b-7ab1-43b7-a29b-a50f84c40722\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-kmk62" Jun 15 02:18:55.113522 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:55.113487 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e3a1248b-7ab1-43b7-a29b-a50f84c40722-lib-modules\") pod \"perf-node-gather-daemonset-kmk62\" (UID: \"e3a1248b-7ab1-43b7-a29b-a50f84c40722\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-kmk62" Jun 15 02:18:55.113696 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:55.113673 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e3a1248b-7ab1-43b7-a29b-a50f84c40722-lib-modules\") pod \"perf-node-gather-daemonset-kmk62\" (UID: \"e3a1248b-7ab1-43b7-a29b-a50f84c40722\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-kmk62" Jun 15 02:18:55.113877 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:55.113854 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e3a1248b-7ab1-43b7-a29b-a50f84c40722-podres\") pod \"perf-node-gather-daemonset-kmk62\" (UID: \"e3a1248b-7ab1-43b7-a29b-a50f84c40722\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-kmk62" Jun 15 02:18:55.113952 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:55.113761 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e3a1248b-7ab1-43b7-a29b-a50f84c40722-podres\") pod \"perf-node-gather-daemonset-kmk62\" (UID: \"e3a1248b-7ab1-43b7-a29b-a50f84c40722\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-kmk62" Jun 15 02:18:55.123388 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:55.123012 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c42t2\" (UniqueName: \"kubernetes.io/projected/e3a1248b-7ab1-43b7-a29b-a50f84c40722-kube-api-access-c42t2\") pod \"perf-node-gather-daemonset-kmk62\" (UID: \"e3a1248b-7ab1-43b7-a29b-a50f84c40722\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-kmk62" Jun 15 02:18:55.163332 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:55.163043 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-kmk62" Jun 15 02:18:55.357504 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:55.357407 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2jt7g/perf-node-gather-daemonset-kmk62"] Jun 15 02:18:55.359749 ip-10-0-137-147 kubenswrapper[2551]: W0615 02:18:55.359722 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode3a1248b_7ab1_43b7_a29b_a50f84c40722.slice/crio-cec4d40723f72361cf43be47fce9f4ea0458c6af6a888db9b15ddb6ebadb461c WatchSource:0}: Error finding container cec4d40723f72361cf43be47fce9f4ea0458c6af6a888db9b15ddb6ebadb461c: Status 404 returned error can't find the container with id cec4d40723f72361cf43be47fce9f4ea0458c6af6a888db9b15ddb6ebadb461c Jun 15 02:18:55.582556 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:55.582520 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-kmk62" event={"ID":"e3a1248b-7ab1-43b7-a29b-a50f84c40722","Type":"ContainerStarted","Data":"22e48d8d63824090663b3388a583de6a7d6cb70e758615adab21841818e20404"} Jun 15 02:18:55.582726 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:55.582569 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-kmk62" event={"ID":"e3a1248b-7ab1-43b7-a29b-a50f84c40722","Type":"ContainerStarted","Data":"cec4d40723f72361cf43be47fce9f4ea0458c6af6a888db9b15ddb6ebadb461c"} Jun 15 02:18:55.582726 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:55.582601 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-kmk62" Jun 15 02:18:55.599170 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:55.599109 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-kmk62" podStartSLOduration=1.5990869 podStartE2EDuration="1.5990869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 02:18:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:18:55.596366212 +0000 UTC m=+2431.455188882" watchObservedRunningTime="2026-06-15 02:18:55.5990869 +0000 UTC m=+2431.457909568" Jun 15 02:18:55.707008 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:55.706923 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qqxsf_0c44f922-cd2d-42e8-99c5-445dae30b40b/dns/0.log" Jun 15 02:18:55.728618 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:55.728590 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qqxsf_0c44f922-cd2d-42e8-99c5-445dae30b40b/kube-rbac-proxy/0.log" Jun 15 02:18:55.753352 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:55.753325 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jm8jk_8110134b-d73a-422f-88ca-b6eec684189d/dns-node-resolver/0.log" Jun 15 02:18:56.463970 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:56.463919 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w97rl_81f80853-3308-4f3a-9cb4-83ce4fb00055/node-ca/0.log" Jun 15 02:18:57.544998 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:57.544968 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9566dff59-9blvs_28cf08e4-ee41-45cf-a005-348078fc00c6/kube-auth-proxy/0.log" Jun 15 02:18:57.603532 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:57.603505 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-c2f5t_a7840efb-7120-42a9-bd47-8427cffcb426/istio-proxy/0.log" Jun 15 02:18:57.678480 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:57.678437 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-c2f5t_a7840efb-7120-42a9-bd47-8427cffcb426/istio-proxy/1.log" Jun 15 02:18:58.464794 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:58.464759 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-27cht_2f463e3d-ebaf-481f-9eed-c2c150aca07b/serve-healthcheck-canary/0.log" Jun 15 02:18:59.064842 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:59.064804 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-9lwgr_6094a811-09ad-44ff-93b1-dc8fb2b7e706/insights-operator/0.log" Jun 15 02:18:59.066421 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:59.066394 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-9lwgr_6094a811-09ad-44ff-93b1-dc8fb2b7e706/insights-operator/1.log" Jun 15 02:18:59.089990 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:59.089944 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l76dr_1afa52ec-3fc6-4780-8da4-588b1ff7e8c8/kube-rbac-proxy/0.log" Jun 15 02:18:59.112767 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:59.112744 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l76dr_1afa52ec-3fc6-4780-8da4-588b1ff7e8c8/exporter/0.log" Jun 15 02:18:59.137411 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:18:59.137385 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l76dr_1afa52ec-3fc6-4780-8da4-588b1ff7e8c8/extractor/0.log" Jun 15 02:19:01.602382 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:19:01.602355 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-kmk62" Jun 15 02:19:01.904220 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:19:01.904143 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d6d6cd49-9rqkb_5f473ebd-4abe-4273-8b55-d0acdb210ed3/manager/0.log" Jun 15 02:19:01.929151 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:19:01.929122 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d6d6cd49-9rqkb_5f473ebd-4abe-4273-8b55-d0acdb210ed3/copy-manifests/0.log" Jun 15 02:19:03.775239 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:19:03.775208 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5cddd79ffb-vsqtx_8ed68dab-4eb4-49c6-b4b2-ffe4a3460d22/manager/0.log" Jun 15 02:19:08.001953 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:19:08.001918 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9566dff59-9blvs_28cf08e4-ee41-45cf-a005-348078fc00c6/kube-auth-proxy/0.log" Jun 15 02:19:08.040985 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:19:08.040950 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-c2f5t_a7840efb-7120-42a9-bd47-8427cffcb426/istio-proxy/0.log" Jun 15 02:19:08.108249 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:19:08.108218 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-c2f5t_a7840efb-7120-42a9-bd47-8427cffcb426/istio-proxy/1.log" Jun 15 02:19:09.255458 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:19:09.255411 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-cv8mp_822aba9d-e387-4e4b-b1fa-a3f4d66261ab/migrator/0.log" Jun 15 02:19:09.284432 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:19:09.284403 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-cv8mp_822aba9d-e387-4e4b-b1fa-a3f4d66261ab/graceful-termination/0.log" Jun 15 02:19:09.521227 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:19:09.521153 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9566dff59-9blvs_28cf08e4-ee41-45cf-a005-348078fc00c6/kube-auth-proxy/0.log" Jun 15 02:19:09.558984 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:19:09.558954 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-c2f5t_a7840efb-7120-42a9-bd47-8427cffcb426/istio-proxy/0.log" Jun 15 02:19:09.618651 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:19:09.618594 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-c2f5t_a7840efb-7120-42a9-bd47-8427cffcb426/istio-proxy/1.log" Jun 15 02:19:09.689234 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:19:09.689202 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-lgp8k_a87d8d2f-e694-40c2-8f7e-9bb66c8db7d6/kube-storage-version-migrator-operator/1.log" Jun 15 02:19:09.691057 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:19:09.691035 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-lgp8k_a87d8d2f-e694-40c2-8f7e-9bb66c8db7d6/kube-storage-version-migrator-operator/0.log" Jun 15 02:19:11.275826 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:19:11.275787 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lpfqj_6e7c476e-f3a4-446a-b8e5-f4028b6af346/kube-multus-additional-cni-plugins/0.log" Jun 15 02:19:11.299156 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:19:11.299125 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lpfqj_6e7c476e-f3a4-446a-b8e5-f4028b6af346/egress-router-binary-copy/0.log" Jun 15 02:19:11.320889 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:19:11.320864 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lpfqj_6e7c476e-f3a4-446a-b8e5-f4028b6af346/cni-plugins/0.log" Jun 15 02:19:11.343554 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:19:11.343525 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lpfqj_6e7c476e-f3a4-446a-b8e5-f4028b6af346/bond-cni-plugin/0.log" Jun 15 02:19:11.370596 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:19:11.370564 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lpfqj_6e7c476e-f3a4-446a-b8e5-f4028b6af346/routeoverride-cni/0.log" Jun 15 02:19:11.393401 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:19:11.393373 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lpfqj_6e7c476e-f3a4-446a-b8e5-f4028b6af346/whereabouts-cni-bincopy/0.log" Jun 15 02:19:11.420647 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:19:11.420606 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lpfqj_6e7c476e-f3a4-446a-b8e5-f4028b6af346/whereabouts-cni/0.log" Jun 15 02:19:11.502046 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:19:11.502013 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sj95p_10769daa-e827-4216-81c6-eeff8dedfb96/kube-multus/0.log" Jun 15 02:19:11.521662 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:19:11.521619 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9566dff59-9blvs_28cf08e4-ee41-45cf-a005-348078fc00c6/kube-auth-proxy/0.log" Jun 15 02:19:11.561396 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:19:11.561326 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-c2f5t_a7840efb-7120-42a9-bd47-8427cffcb426/istio-proxy/0.log" Jun 15 02:19:11.637263 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:19:11.637216 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-c2f5t_a7840efb-7120-42a9-bd47-8427cffcb426/istio-proxy/1.log" Jun 15 02:19:11.695396 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:19:11.695366 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r567p_b3c35d53-b5a0-49e4-8964-61d18bbe5be1/network-metrics-daemon/0.log" Jun 15 02:19:11.716661 ip-10-0-137-147 kubenswrapper[2551]: I0615 02:19:11.716617 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r567p_b3c35d53-b5a0-49e4-8964-61d18bbe5be1/kube-rbac-proxy/0.log"