Jun 14 13:30:15.462234 ip-10-0-131-48 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 14 13:30:15.462242 ip-10-0-131-48 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 14 13:30:15.462249 ip-10-0-131-48 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 14 13:30:15.462472 ip-10-0-131-48 systemd[1]: Failed to start Kubernetes Kubelet. Jun 14 13:30:25.620463 ip-10-0-131-48 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 14 13:30:25.620485 ip-10-0-131-48 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 603189a13d9d40b8b385d4065b7accc9 -- Jun 14 13:32:47.212963 ip-10-0-131-48 systemd[1]: Starting Kubernetes Kubelet... Jun 14 13:32:47.586445 ip-10-0-131-48 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 13:32:47.586445 ip-10-0-131-48 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 14 13:32:47.586445 ip-10-0-131-48 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 13:32:47.586445 ip-10-0-131-48 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 14 13:32:47.586445 ip-10-0-131-48 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 13:32:47.587870 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.587780 2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 14 13:32:47.591922 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.591907 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 13:32:47.591922 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.591922 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 13:32:47.591988 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.591927 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 13:32:47.591988 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.591931 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 13:32:47.591988 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.591934 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 13:32:47.591988 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.591937 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 13:32:47.591988 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.591940 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 13:32:47.591988 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.591943 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 13:32:47.591988 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.591946 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 13:32:47.591988 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.591949 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 13:32:47.591988 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.591952 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 13:32:47.591988 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.591954 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 13:32:47.591988 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.591957 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 13:32:47.591988 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.591965 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 13:32:47.591988 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.591968 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 13:32:47.591988 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.591971 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 13:32:47.591988 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.591974 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 13:32:47.591988 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.591977 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 13:32:47.591988 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.591980 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 13:32:47.591988 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.591982 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 13:32:47.591988 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.591985 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 13:32:47.591988 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.591988 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 13:32:47.592465 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.591990 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 13:32:47.592465 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.591993 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 13:32:47.592465 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.591996 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 13:32:47.592465 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.591999 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 13:32:47.592465 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592002 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 13:32:47.592465 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592004 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 13:32:47.592465 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592007 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 13:32:47.592465 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592009 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 13:32:47.592465 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592012 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 13:32:47.592465 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592016 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 13:32:47.592465 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592019 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 13:32:47.592465 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592022 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 13:32:47.592465 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592025 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 13:32:47.592465 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592028 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 13:32:47.592465 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592032 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 13:32:47.592465 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592036 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 13:32:47.592465 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592039 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 13:32:47.592465 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592042 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 13:32:47.592465 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592044 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 13:32:47.592947 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592047 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 13:32:47.592947 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592050 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 13:32:47.592947 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592052 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 13:32:47.592947 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592054 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 13:32:47.592947 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592057 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 13:32:47.592947 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592059 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 13:32:47.592947 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592062 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 13:32:47.592947 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592065 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 13:32:47.592947 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592068 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 13:32:47.592947 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592070 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 13:32:47.592947 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592073 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 13:32:47.592947 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592075 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 13:32:47.592947 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592078 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 13:32:47.592947 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592080 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 13:32:47.592947 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592085 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 13:32:47.592947 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592089 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 13:32:47.592947 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592092 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 13:32:47.592947 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592094 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 13:32:47.592947 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592097 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 13:32:47.593424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592100 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 13:32:47.593424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592103 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 13:32:47.593424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592106 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 13:32:47.593424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592109 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 13:32:47.593424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592112 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 13:32:47.593424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592114 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 13:32:47.593424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592117 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 14 13:32:47.593424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592119 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 13:32:47.593424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592122 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 13:32:47.593424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592124 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 13:32:47.593424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592127 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 13:32:47.593424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592130 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 13:32:47.593424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592132 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 13:32:47.593424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592135 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 13:32:47.593424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592137 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 13:32:47.593424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592140 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 13:32:47.593424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592142 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 13:32:47.593424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592145 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 13:32:47.593424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592147 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 13:32:47.593424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592150 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 13:32:47.593917 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592153 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 13:32:47.593917 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592155 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 13:32:47.593917 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592158 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 13:32:47.593917 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592161 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 13:32:47.593917 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592163 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 13:32:47.593917 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592166 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 13:32:47.593917 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592168 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 13:32:47.593917 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592172 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 13:32:47.593917 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592174 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 13:32:47.593917 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592177 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 13:32:47.593917 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592179 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 13:32:47.593917 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592182 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 13:32:47.593917 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592184 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 13:32:47.593917 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592187 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 13:32:47.593917 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592189 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 13:32:47.593917 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592192 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 13:32:47.593917 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592194 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 13:32:47.593917 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592197 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 13:32:47.593917 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592199 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 13:32:47.593917 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592910 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 13:32:47.594400 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592917 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 13:32:47.594400 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592920 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 13:32:47.594400 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592923 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 13:32:47.594400 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592925 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 13:32:47.594400 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592929 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 13:32:47.594400 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592932 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 13:32:47.594400 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592935 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 13:32:47.594400 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592938 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 13:32:47.594400 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592940 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 13:32:47.594400 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592944 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 14 13:32:47.594400 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592947 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 13:32:47.594400 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592949 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 13:32:47.594400 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592952 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 13:32:47.594400 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592955 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 13:32:47.594400 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592958 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 13:32:47.594400 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592963 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 13:32:47.594400 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592967 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 13:32:47.594400 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592970 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 13:32:47.594400 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592973 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 13:32:47.594400 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592977 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 13:32:47.594912 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592980 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 13:32:47.594912 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592983 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 13:32:47.594912 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592985 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 13:32:47.594912 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592988 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 13:32:47.594912 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592991 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 13:32:47.594912 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592994 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 13:32:47.594912 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.592996 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 13:32:47.594912 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593000 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 13:32:47.594912 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593004 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 13:32:47.594912 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593008 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 13:32:47.594912 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593010 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 13:32:47.594912 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593014 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 13:32:47.594912 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593017 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 13:32:47.594912 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593019 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 13:32:47.594912 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593022 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 13:32:47.594912 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593025 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 13:32:47.594912 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593027 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 13:32:47.594912 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593032 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 13:32:47.594912 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593036 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 13:32:47.595382 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593039 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 13:32:47.595382 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593042 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 13:32:47.595382 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593045 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 13:32:47.595382 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593048 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 13:32:47.595382 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593051 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 13:32:47.595382 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593054 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 13:32:47.595382 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593056 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 13:32:47.595382 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593060 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 13:32:47.595382 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593063 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 13:32:47.595382 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593065 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 13:32:47.595382 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593068 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 13:32:47.595382 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593072 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 13:32:47.595382 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593075 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 13:32:47.595382 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593077 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 13:32:47.595382 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593080 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 13:32:47.595382 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593083 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 13:32:47.595382 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593085 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 13:32:47.595382 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593088 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 13:32:47.595382 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593091 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 13:32:47.595382 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593093 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 13:32:47.595921 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593096 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 13:32:47.595921 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593099 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 13:32:47.595921 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593101 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 13:32:47.595921 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593104 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 13:32:47.595921 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593107 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 13:32:47.595921 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593109 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 13:32:47.595921 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593112 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 13:32:47.595921 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593115 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 13:32:47.595921 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593118 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 13:32:47.595921 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593121 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 13:32:47.595921 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593124 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 13:32:47.595921 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593127 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 13:32:47.595921 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593130 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 13:32:47.595921 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593133 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 13:32:47.595921 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593135 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 13:32:47.595921 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593138 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 13:32:47.595921 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593140 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 13:32:47.595921 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593143 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 13:32:47.595921 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593145 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 13:32:47.595921 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593148 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 13:32:47.596417 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593152 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 13:32:47.596417 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593155 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 13:32:47.596417 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593158 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 13:32:47.596417 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593160 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 13:32:47.596417 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593163 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 13:32:47.596417 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593166 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 13:32:47.596417 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593169 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 13:32:47.596417 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593171 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 13:32:47.596417 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593174 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 13:32:47.596417 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593176 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 13:32:47.596417 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593179 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 13:32:47.596417 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593181 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 13:32:47.596417 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593184 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 13:32:47.596417 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593187 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 13:32:47.596417 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593189 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 13:32:47.596417 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593191 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 13:32:47.596417 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593194 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 13:32:47.596417 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593197 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 13:32:47.596417 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593199 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 13:32:47.596417 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593568 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 13:32:47.596941 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593575 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 13:32:47.596941 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593578 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 13:32:47.596941 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593581 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 13:32:47.596941 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593586 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 13:32:47.596941 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593590 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 13:32:47.596941 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593593 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 13:32:47.596941 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593596 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 13:32:47.596941 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593598 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 13:32:47.596941 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593601 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 13:32:47.596941 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593603 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 13:32:47.596941 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593606 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 13:32:47.596941 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593609 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 13:32:47.596941 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593612 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 13:32:47.596941 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593615 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 13:32:47.596941 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593618 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 13:32:47.596941 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593621 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 13:32:47.596941 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593623 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 13:32:47.596941 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593626 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 13:32:47.596941 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593628 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 13:32:47.597519 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593631 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 13:32:47.597519 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593635 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 13:32:47.597519 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593638 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 13:32:47.597519 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593641 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 13:32:47.597519 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593644 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 13:32:47.597519 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593648 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 13:32:47.597519 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593650 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 13:32:47.597519 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593653 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 13:32:47.597519 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593655 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 13:32:47.597519 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593658 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 13:32:47.597519 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593661 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 13:32:47.597519 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593664 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 13:32:47.597519 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593667 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 13:32:47.597519 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593670 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 13:32:47.597519 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593673 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 13:32:47.597519 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593675 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 13:32:47.597519 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593693 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 13:32:47.597519 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593698 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 13:32:47.597519 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593702 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 13:32:47.597996 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593706 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 13:32:47.597996 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593710 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 13:32:47.597996 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593713 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 13:32:47.597996 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593715 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 13:32:47.597996 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593718 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 13:32:47.597996 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593721 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 13:32:47.597996 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593724 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 13:32:47.597996 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593726 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 13:32:47.597996 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593729 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 13:32:47.597996 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593732 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 13:32:47.597996 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593734 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 13:32:47.597996 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593737 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 13:32:47.597996 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593739 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 13:32:47.597996 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593742 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 13:32:47.597996 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593745 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 13:32:47.597996 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593747 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 13:32:47.597996 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593750 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 13:32:47.597996 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593755 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 13:32:47.597996 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593758 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 13:32:47.597996 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593760 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 13:32:47.598493 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593763 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 13:32:47.598493 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593766 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 13:32:47.598493 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593769 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 13:32:47.598493 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593771 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 13:32:47.598493 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593774 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 13:32:47.598493 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593776 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 13:32:47.598493 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593779 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 13:32:47.598493 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593781 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 13:32:47.598493 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593784 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 13:32:47.598493 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593786 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 13:32:47.598493 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593789 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 13:32:47.598493 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593798 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 13:32:47.598493 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593802 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 13:32:47.598493 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593804 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 13:32:47.598493 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593807 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 13:32:47.598493 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593810 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 13:32:47.598493 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593812 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 13:32:47.598493 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593818 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 13:32:47.598493 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593821 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 13:32:47.598493 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593824 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 13:32:47.599031 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593826 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 13:32:47.599031 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593829 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 13:32:47.599031 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593832 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 13:32:47.599031 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593835 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 13:32:47.599031 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593837 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 13:32:47.599031 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593840 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 13:32:47.599031 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593842 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 14 13:32:47.599031 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593845 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 13:32:47.599031 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593847 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 13:32:47.599031 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593851 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 13:32:47.599031 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593854 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 13:32:47.599031 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593856 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 13:32:47.599031 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593859 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 13:32:47.599031 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593861 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 13:32:47.599031 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593864 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 13:32:47.599031 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593866 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 13:32:47.599031 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593869 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 13:32:47.599031 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593871 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 13:32:47.599031 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593874 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 13:32:47.599031 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.593876 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 13:32:47.599519 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.593948 2557 flags.go:64] FLAG: --address="0.0.0.0" Jun 14 13:32:47.599519 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.593955 2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 14 13:32:47.599519 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.593962 2557 flags.go:64] FLAG: --anonymous-auth="true" Jun 14 13:32:47.599519 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.593966 2557 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 14 13:32:47.599519 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.593971 2557 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 14 13:32:47.599519 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.593974 2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 14 13:32:47.599519 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.593978 2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 14 13:32:47.599519 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.593983 2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 14 13:32:47.599519 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.593986 2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 14 13:32:47.599519 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.593990 2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 14 13:32:47.599519 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.593994 2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 14 13:32:47.599519 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.593997 2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 14 13:32:47.599519 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594000 2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 14 13:32:47.599519 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594003 2557 flags.go:64] FLAG: --cgroup-root="" Jun 14 13:32:47.599519 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594006 2557 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 14 13:32:47.599519 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594009 2557 flags.go:64] FLAG: --client-ca-file="" Jun 14 13:32:47.599519 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594012 2557 flags.go:64] FLAG: --cloud-provider="external" Jun 14 13:32:47.599519 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594015 2557 flags.go:64] FLAG: --cluster-dns="[]" Jun 14 13:32:47.599519 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594019 2557 flags.go:64] FLAG: --cluster-domain="" Jun 14 13:32:47.599519 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594022 2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 14 13:32:47.599519 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594025 2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 14 13:32:47.599519 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594030 2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 14 13:32:47.599519 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594033 2557 flags.go:64] FLAG: --container-log-max-files="5" Jun 14 13:32:47.599519 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594036 2557 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 14 13:32:47.600110 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594039 2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 14 13:32:47.600110 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594042 2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 14 13:32:47.600110 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594046 2557 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 14 13:32:47.600110 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594049 2557 flags.go:64] FLAG: --contention-profiling="false" Jun 14 13:32:47.600110 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594052 2557 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 14 13:32:47.600110 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594055 2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 14 13:32:47.600110 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594058 2557 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 14 13:32:47.600110 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594061 2557 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 14 13:32:47.600110 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594065 2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 14 13:32:47.600110 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594068 2557 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 14 13:32:47.600110 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594071 2557 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 14 13:32:47.600110 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594073 2557 flags.go:64] FLAG: --enable-load-reader="false" Jun 14 13:32:47.600110 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594076 2557 flags.go:64] FLAG: --enable-server="true" Jun 14 13:32:47.600110 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594080 2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 14 13:32:47.600110 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594085 2557 flags.go:64] FLAG: --event-burst="100" Jun 14 13:32:47.600110 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594088 2557 flags.go:64] FLAG: --event-qps="50" Jun 14 13:32:47.600110 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594091 2557 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 14 13:32:47.600110 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594096 2557 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 14 13:32:47.600110 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594099 2557 flags.go:64] FLAG: --eviction-hard="" Jun 14 13:32:47.600110 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594102 2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 14 13:32:47.600110 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594105 2557 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 14 13:32:47.600110 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594108 2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 14 13:32:47.600110 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594111 2557 flags.go:64] FLAG: --eviction-soft="" Jun 14 13:32:47.600110 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594114 2557 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 14 13:32:47.600110 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594117 2557 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 14 13:32:47.600805 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594120 2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 14 13:32:47.600805 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594123 2557 flags.go:64] FLAG: --experimental-mounter-path="" Jun 14 13:32:47.600805 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594126 2557 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 14 13:32:47.600805 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594129 2557 flags.go:64] FLAG: --fail-swap-on="true" Jun 14 13:32:47.600805 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594133 2557 flags.go:64] FLAG: --feature-gates="" Jun 14 13:32:47.600805 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594137 2557 flags.go:64] FLAG: --file-check-frequency="20s" Jun 14 13:32:47.600805 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594140 2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 14 13:32:47.600805 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594143 2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 14 13:32:47.600805 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594146 2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 14 13:32:47.600805 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594149 2557 flags.go:64] FLAG: --healthz-port="10248" Jun 14 13:32:47.600805 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594152 2557 flags.go:64] FLAG: --help="false" Jun 14 13:32:47.600805 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594155 2557 flags.go:64] FLAG: --hostname-override="ip-10-0-131-48.ec2.internal" Jun 14 13:32:47.600805 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594157 2557 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 14 13:32:47.600805 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594160 2557 flags.go:64] FLAG: --http-check-frequency="20s" Jun 14 13:32:47.600805 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594163 2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 14 13:32:47.600805 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594166 2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 14 13:32:47.600805 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594170 2557 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 14 13:32:47.600805 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594172 2557 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 14 13:32:47.600805 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594175 2557 flags.go:64] FLAG: --image-service-endpoint="" Jun 14 13:32:47.600805 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594178 2557 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 14 13:32:47.600805 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594181 2557 flags.go:64] FLAG: --kube-api-burst="100" Jun 14 13:32:47.600805 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594184 2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 14 13:32:47.600805 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594187 2557 flags.go:64] FLAG: --kube-api-qps="50" Jun 14 13:32:47.600805 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594190 2557 flags.go:64] FLAG: --kube-reserved="" Jun 14 13:32:47.601405 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594194 2557 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 14 13:32:47.601405 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594197 2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 14 13:32:47.601405 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594200 2557 flags.go:64] FLAG: --kubelet-cgroups="" Jun 14 13:32:47.601405 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594202 2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 14 13:32:47.601405 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594205 2557 flags.go:64] FLAG: --lock-file="" Jun 14 13:32:47.601405 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594208 2557 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 14 13:32:47.601405 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594211 2557 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 14 13:32:47.601405 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594214 2557 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 14 13:32:47.601405 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594220 2557 flags.go:64] FLAG: --log-json-split-stream="false" Jun 14 13:32:47.601405 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594223 2557 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 14 13:32:47.601405 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594226 2557 flags.go:64] FLAG: --log-text-split-stream="false" Jun 14 13:32:47.601405 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594228 2557 flags.go:64] FLAG: --logging-format="text" Jun 14 13:32:47.601405 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594233 2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 14 13:32:47.601405 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594236 2557 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 14 13:32:47.601405 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594239 2557 flags.go:64] FLAG: --manifest-url="" Jun 14 13:32:47.601405 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594242 2557 flags.go:64] FLAG: --manifest-url-header="" Jun 14 13:32:47.601405 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594246 2557 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 14 13:32:47.601405 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594249 2557 flags.go:64] FLAG: --max-open-files="1000000" Jun 14 13:32:47.601405 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594253 2557 flags.go:64] FLAG: --max-pods="110" Jun 14 13:32:47.601405 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594256 2557 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 14 13:32:47.601405 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594259 2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 14 13:32:47.601405 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594262 2557 flags.go:64] FLAG: --memory-manager-policy="None" Jun 14 13:32:47.601405 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594265 2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 14 13:32:47.601405 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594268 2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 14 13:32:47.601405 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594272 2557 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 14 13:32:47.602049 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594275 2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 14 13:32:47.602049 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594281 2557 flags.go:64] FLAG: --node-status-max-images="50" Jun 14 13:32:47.602049 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594284 2557 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 14 13:32:47.602049 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594287 2557 flags.go:64] FLAG: --oom-score-adj="-999" Jun 14 13:32:47.602049 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594290 2557 flags.go:64] FLAG: --pod-cidr="" Jun 14 13:32:47.602049 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594294 2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 14 13:32:47.602049 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594299 2557 flags.go:64] FLAG: --pod-manifest-path="" Jun 14 13:32:47.602049 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594302 2557 flags.go:64] FLAG: --pod-max-pids="-1" Jun 14 13:32:47.602049 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594306 2557 flags.go:64] FLAG: --pods-per-core="0" Jun 14 13:32:47.602049 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594309 2557 flags.go:64] FLAG: --port="10250" Jun 14 13:32:47.602049 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594312 2557 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 14 13:32:47.602049 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594316 2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-030f851a1b4102d49" Jun 14 13:32:47.602049 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594319 2557 flags.go:64] FLAG: --qos-reserved="" Jun 14 13:32:47.602049 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594321 2557 flags.go:64] FLAG: --read-only-port="10255" Jun 14 13:32:47.602049 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594324 2557 flags.go:64] FLAG: --register-node="true" Jun 14 13:32:47.602049 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594327 2557 flags.go:64] FLAG: --register-with-taints="" Jun 14 13:32:47.602049 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594331 2557 flags.go:64] FLAG: --registry-burst="10" Jun 14 13:32:47.602049 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594334 2557 flags.go:64] FLAG: --registry-qps="5" Jun 14 13:32:47.602049 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594336 2557 flags.go:64] FLAG: --reserved-cpus="" Jun 14 13:32:47.602049 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594340 2557 flags.go:64] FLAG: --reserved-memory="" Jun 14 13:32:47.602049 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594344 2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 14 13:32:47.602049 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594347 2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 14 13:32:47.602049 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594350 2557 flags.go:64] FLAG: --rotate-certificates="false" Jun 14 13:32:47.602049 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594353 2557 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 14 13:32:47.602049 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594356 2557 flags.go:64] FLAG: --runonce="false" Jun 14 13:32:47.602699 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594358 2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 14 13:32:47.602699 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594361 2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 14 13:32:47.602699 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594364 2557 flags.go:64] FLAG: --seccomp-default="false" Jun 14 13:32:47.602699 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594367 2557 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 14 13:32:47.602699 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594369 2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 14 13:32:47.602699 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594372 2557 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 14 13:32:47.602699 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594375 2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 14 13:32:47.602699 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594379 2557 flags.go:64] FLAG: --storage-driver-password="root" Jun 14 13:32:47.602699 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594382 2557 flags.go:64] FLAG: --storage-driver-secure="false" Jun 14 13:32:47.602699 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594384 2557 flags.go:64] FLAG: --storage-driver-table="stats" Jun 14 13:32:47.602699 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594387 2557 flags.go:64] FLAG: --storage-driver-user="root" Jun 14 13:32:47.602699 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594390 2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 14 13:32:47.602699 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594393 2557 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 14 13:32:47.602699 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594396 2557 flags.go:64] FLAG: --system-cgroups="" Jun 14 13:32:47.602699 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594399 2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 14 13:32:47.602699 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594406 2557 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 14 13:32:47.602699 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594409 2557 flags.go:64] FLAG: --tls-cert-file="" Jun 14 13:32:47.602699 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594412 2557 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 14 13:32:47.602699 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594416 2557 flags.go:64] FLAG: --tls-min-version="" Jun 14 13:32:47.602699 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594419 2557 flags.go:64] FLAG: --tls-private-key-file="" Jun 14 13:32:47.602699 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594422 2557 flags.go:64] FLAG: --topology-manager-policy="none" Jun 14 13:32:47.602699 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594425 2557 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 14 13:32:47.602699 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594428 2557 flags.go:64] FLAG: --topology-manager-scope="container" Jun 14 13:32:47.602699 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594431 2557 flags.go:64] FLAG: --v="2" Jun 14 13:32:47.602699 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594435 2557 flags.go:64] FLAG: --version="false" Jun 14 13:32:47.603325 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594439 2557 flags.go:64] FLAG: --vmodule="" Jun 14 13:32:47.603325 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594444 2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 14 13:32:47.603325 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.594448 2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 14 13:32:47.603325 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594569 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 13:32:47.603325 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594573 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 13:32:47.603325 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594576 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 13:32:47.603325 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594579 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 13:32:47.603325 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594582 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 13:32:47.603325 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594584 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 13:32:47.603325 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594587 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 13:32:47.603325 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594590 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 13:32:47.603325 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594593 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 13:32:47.603325 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594596 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 13:32:47.603325 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594599 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 13:32:47.603325 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594601 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 13:32:47.603325 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594604 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 13:32:47.603325 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594606 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 13:32:47.603325 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594609 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 13:32:47.603325 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594612 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 13:32:47.603325 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594614 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 13:32:47.603845 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594617 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 13:32:47.603845 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594619 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 13:32:47.603845 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594623 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 13:32:47.603845 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594626 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 13:32:47.603845 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594628 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 13:32:47.603845 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594631 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 13:32:47.603845 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594633 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 13:32:47.603845 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594636 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 13:32:47.603845 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594638 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 13:32:47.603845 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594641 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 13:32:47.603845 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594643 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 13:32:47.603845 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594646 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 13:32:47.603845 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594648 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 13:32:47.603845 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594653 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 13:32:47.603845 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594656 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 13:32:47.603845 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594660 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 13:32:47.603845 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594664 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 13:32:47.603845 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594667 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 13:32:47.603845 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594670 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 13:32:47.604306 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594673 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 13:32:47.604306 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594676 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 13:32:47.604306 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594691 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 13:32:47.604306 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594694 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 13:32:47.604306 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594697 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 13:32:47.604306 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594700 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 13:32:47.604306 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594702 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 13:32:47.604306 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594705 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 13:32:47.604306 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594707 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 13:32:47.604306 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594710 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 13:32:47.604306 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594712 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 13:32:47.604306 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594715 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 13:32:47.604306 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594717 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 13:32:47.604306 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594720 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 13:32:47.604306 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594722 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 13:32:47.604306 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594726 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 13:32:47.604306 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594729 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 13:32:47.604306 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594731 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 13:32:47.604306 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594734 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 13:32:47.604306 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594737 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 13:32:47.604828 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594739 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 13:32:47.604828 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594742 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 13:32:47.604828 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594745 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 13:32:47.604828 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594748 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 13:32:47.604828 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594750 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 13:32:47.604828 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594753 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 13:32:47.604828 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594757 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 13:32:47.604828 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594760 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 13:32:47.604828 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594762 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 13:32:47.604828 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594764 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 13:32:47.604828 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594767 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 13:32:47.604828 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594769 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 13:32:47.604828 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594772 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 13:32:47.604828 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594774 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 13:32:47.604828 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594777 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 13:32:47.604828 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594779 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 13:32:47.604828 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594782 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 13:32:47.604828 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594784 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 14 13:32:47.604828 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594786 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 13:32:47.604828 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594789 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 13:32:47.604828 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594792 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 13:32:47.605333 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594794 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 13:32:47.605333 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594796 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 13:32:47.605333 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594800 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 13:32:47.605333 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594803 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 13:32:47.605333 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594806 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 13:32:47.605333 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594809 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 13:32:47.605333 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594812 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 13:32:47.605333 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594815 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 13:32:47.605333 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594817 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 13:32:47.605333 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594820 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 13:32:47.605333 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594822 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 13:32:47.605333 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594825 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 13:32:47.605333 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594827 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 13:32:47.605333 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594830 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 13:32:47.605333 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594832 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 13:32:47.605333 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594835 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 13:32:47.605333 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594837 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 13:32:47.605333 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594841 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 13:32:47.605333 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594844 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 13:32:47.605823 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594846 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 13:32:47.605823 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594848 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 13:32:47.605823 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.594851 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 13:32:47.605823 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.595563 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 13:32:47.605823 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.602077 2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 14 13:32:47.605823 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.602092 2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 14 13:32:47.605823 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.602111 2557 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 14 13:32:47.605823 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.602119 2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 14 13:32:47.605823 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602183 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 13:32:47.605823 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602187 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 13:32:47.605823 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602191 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 13:32:47.605823 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602195 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 13:32:47.605823 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602198 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 13:32:47.605823 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602201 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 13:32:47.606194 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602205 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 13:32:47.606194 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602209 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 13:32:47.606194 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602212 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 13:32:47.606194 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602216 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 13:32:47.606194 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602221 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 13:32:47.606194 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602226 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 13:32:47.606194 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602231 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 13:32:47.606194 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602234 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 14 13:32:47.606194 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602237 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 13:32:47.606194 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602239 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 13:32:47.606194 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602242 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 13:32:47.606194 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602245 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 13:32:47.606194 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602247 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 13:32:47.606194 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602250 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 13:32:47.606194 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602252 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 13:32:47.606194 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602255 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 13:32:47.606194 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602257 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 13:32:47.606194 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602260 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 13:32:47.606194 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602263 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 13:32:47.606644 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602265 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 13:32:47.606644 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602268 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 13:32:47.606644 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602270 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 13:32:47.606644 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602273 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 13:32:47.606644 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602277 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 13:32:47.606644 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602280 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 13:32:47.606644 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602283 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 13:32:47.606644 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602285 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 13:32:47.606644 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602288 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 13:32:47.606644 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602291 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 13:32:47.606644 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602293 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 13:32:47.606644 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602296 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 13:32:47.606644 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602298 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 13:32:47.606644 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602302 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 13:32:47.606644 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602304 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 13:32:47.606644 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602307 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 13:32:47.606644 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602309 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 13:32:47.606644 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602312 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 13:32:47.606644 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602314 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 13:32:47.606644 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602317 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 13:32:47.607147 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602320 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 13:32:47.607147 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602323 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 13:32:47.607147 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602325 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 13:32:47.607147 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602328 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 13:32:47.607147 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602331 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 13:32:47.607147 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602334 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 13:32:47.607147 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602336 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 13:32:47.607147 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602339 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 13:32:47.607147 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602341 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 13:32:47.607147 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602344 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 13:32:47.607147 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602346 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 13:32:47.607147 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602349 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 13:32:47.607147 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602351 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 13:32:47.607147 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602354 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 13:32:47.607147 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602358 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 13:32:47.607147 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602361 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 13:32:47.607147 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602364 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 13:32:47.607147 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602367 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 13:32:47.607147 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602370 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 13:32:47.607610 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602372 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 13:32:47.607610 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602375 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 13:32:47.607610 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602378 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 13:32:47.607610 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602381 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 13:32:47.607610 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602383 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 13:32:47.607610 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602386 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 13:32:47.607610 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602388 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 13:32:47.607610 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602391 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 13:32:47.607610 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602394 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 13:32:47.607610 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602396 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 13:32:47.607610 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602399 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 13:32:47.607610 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602402 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 13:32:47.607610 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602405 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 13:32:47.607610 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602409 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 13:32:47.607610 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602413 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 13:32:47.607610 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602416 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 13:32:47.607610 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602418 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 13:32:47.607610 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602422 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 13:32:47.607610 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602424 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 13:32:47.608120 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602427 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 13:32:47.608120 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602430 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 13:32:47.608120 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602433 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 13:32:47.608120 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602436 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 13:32:47.608120 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602438 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 13:32:47.608120 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602441 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 13:32:47.608120 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602444 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 13:32:47.608120 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602446 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 13:32:47.608120 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602449 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 13:32:47.608120 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602452 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 13:32:47.608120 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602455 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 13:32:47.608120 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602458 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 13:32:47.608120 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602461 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 13:32:47.608120 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602464 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 13:32:47.608120 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602467 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 13:32:47.608120 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602469 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 13:32:47.608500 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.602474 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 13:32:47.608500 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602606 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 13:32:47.608500 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602611 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 13:32:47.608500 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602614 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 13:32:47.608500 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602617 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 13:32:47.608500 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602620 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 13:32:47.608500 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602623 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 13:32:47.608500 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602626 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 13:32:47.608500 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602628 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 13:32:47.608500 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602631 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 13:32:47.608500 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602633 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 13:32:47.608500 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602636 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 13:32:47.608500 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602640 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 13:32:47.608500 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602642 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 13:32:47.608500 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602645 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 13:32:47.609019 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602648 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 13:32:47.609019 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602650 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 13:32:47.609019 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602653 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 13:32:47.609019 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602656 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 13:32:47.609019 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602658 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 13:32:47.609019 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602661 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 13:32:47.609019 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602663 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 13:32:47.609019 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602667 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 13:32:47.609019 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602670 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 13:32:47.609019 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602673 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 13:32:47.609019 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602676 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 13:32:47.609019 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602692 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 13:32:47.609019 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602696 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 13:32:47.609019 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602699 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 13:32:47.609019 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602701 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 13:32:47.609019 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602704 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 13:32:47.609019 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602707 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 13:32:47.609019 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602711 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 13:32:47.609019 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602715 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 13:32:47.609768 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602718 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 13:32:47.609768 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602721 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 13:32:47.609768 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602723 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 13:32:47.609768 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602726 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 13:32:47.609768 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602729 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 13:32:47.609768 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602732 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 13:32:47.609768 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602734 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 13:32:47.609768 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602737 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 13:32:47.609768 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602739 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 13:32:47.609768 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602742 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 13:32:47.609768 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602744 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 13:32:47.609768 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602747 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 13:32:47.609768 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602750 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 13:32:47.609768 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602753 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 13:32:47.609768 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602755 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 13:32:47.609768 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602758 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 13:32:47.609768 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602760 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 13:32:47.609768 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602763 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 13:32:47.609768 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602765 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 13:32:47.609768 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602768 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 13:32:47.610424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602770 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 13:32:47.610424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602772 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 13:32:47.610424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602775 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 14 13:32:47.610424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602777 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 13:32:47.610424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602781 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 13:32:47.610424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602784 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 13:32:47.610424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602787 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 13:32:47.610424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602789 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 13:32:47.610424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602792 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 13:32:47.610424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602794 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 13:32:47.610424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602797 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 13:32:47.610424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602800 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 13:32:47.610424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602802 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 13:32:47.610424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602805 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 13:32:47.610424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602807 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 13:32:47.610424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602810 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 13:32:47.610424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602813 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 13:32:47.610424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602815 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 13:32:47.610424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602818 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 13:32:47.610424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602820 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 13:32:47.611100 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602823 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 13:32:47.611100 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602825 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 13:32:47.611100 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602828 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 13:32:47.611100 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602830 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 13:32:47.611100 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602833 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 13:32:47.611100 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602835 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 13:32:47.611100 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602839 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 13:32:47.611100 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602843 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 13:32:47.611100 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602845 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 13:32:47.611100 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602848 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 13:32:47.611100 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602851 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 13:32:47.611100 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602853 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 13:32:47.611100 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602856 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 13:32:47.611100 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602858 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 13:32:47.611100 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602861 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 13:32:47.611100 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602863 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 13:32:47.611100 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602866 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 13:32:47.611100 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602869 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 13:32:47.611100 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602872 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 13:32:47.611767 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602874 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 13:32:47.611767 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602876 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 13:32:47.611767 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602879 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 13:32:47.611767 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602882 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 13:32:47.611767 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602884 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 13:32:47.611767 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602887 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 13:32:47.611767 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:47.602889 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 13:32:47.611767 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.602893 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 13:32:47.611767 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.603004 2557 server.go:962] "Client rotation is on, will bootstrap in background" Jun 14 13:32:47.611767 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.605049 2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 14 13:32:47.611767 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.606328 2557 server.go:1019] "Starting client certificate rotation" Jun 14 13:32:47.611767 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.606426 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 13:32:47.611767 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.606457 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 13:32:47.611767 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.608551 2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 13:32:47.612786 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.612767 2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 13:32:47.621769 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.621753 2557 log.go:25] "Validated CRI v1 runtime API" Jun 14 13:32:47.626740 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.626724 2557 log.go:25] "Validated CRI v1 image API" Jun 14 13:32:47.627548 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.627521 2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 14 13:32:47.631006 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.630982 2557 fs.go:135] Filesystem UUIDs: map[6a707170-5872-433a-8180-46ea07e8f2fc:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e777f61e-0946-42c1-8b5f-6193064947cc:/dev/nvme0n1p3] Jun 14 13:32:47.631086 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.631004 2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 14 13:32:47.636317 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.636210 2557 manager.go:216] Machine: {Timestamp:2026-06-14 13:32:47.634790782 +0000 UTC m=+0.308058720 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3112838 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b2dcfcafab0002b93a97aa9439d69 SystemUUID:ec2b2dcf-cafa-b000-2b93-a97aa9439d69 BootID:603189a1-3d9d-40b8-b385-d4065b7accc9 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2f:c4:c3:2f:ab Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2f:c4:c3:2f:ab Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:ee:63:b0:08:23 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 14 13:32:47.636317 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.636314 2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 14 13:32:47.636429 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.636393 2557 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 14 13:32:47.639228 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.639204 2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 14 13:32:47.639349 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.639334 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 13:32:47.639387 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.639229 2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-48.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 14 13:32:47.640503 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.640492 2557 topology_manager.go:138] "Creating topology manager with none policy" Jun 14 13:32:47.640536 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.640506 2557 container_manager_linux.go:309] "Creating device plugin manager" Jun 14 13:32:47.640536 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.640514 2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 13:32:47.641129 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.641117 2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 13:32:47.642361 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.642352 2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 14 13:32:47.645880 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.645869 2557 state_mem.go:36] "Initialized new in-memory state store" Jun 14 13:32:47.645995 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.645985 2557 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 14 13:32:47.646039 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.646014 2557 kubelet.go:486] "Attempting to sync node with API server" Jun 14 13:32:47.646039 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.646024 2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 14 13:32:47.646039 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.646038 2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 14 13:32:47.646144 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.646047 2557 kubelet.go:398] "Adding apiserver pod source" Jun 14 13:32:47.646144 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.646055 2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 14 13:32:47.646476 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.646465 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 13:32:47.646508 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.646484 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 13:32:47.649720 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.649671 2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 14 13:32:47.651344 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.651328 2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 14 13:32:47.651418 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.651359 2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 14 13:32:47.651538 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.651524 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 14 13:32:47.651597 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.651544 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 14 13:32:47.651597 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.651552 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 14 13:32:47.651597 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.651558 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 14 13:32:47.651597 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.651566 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 14 13:32:47.651597 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.651575 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 14 13:32:47.651986 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.651977 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 14 13:32:47.651986 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.651986 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 14 13:32:47.652046 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.651993 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 14 13:32:47.652046 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.651998 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 14 13:32:47.652046 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.652007 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 14 13:32:47.652046 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.652014 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 14 13:32:47.652732 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.652721 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 14 13:32:47.652732 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.652732 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 14 13:32:47.655979 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.655963 2557 server.go:1268] "Started kubelet" Jun 14 13:32:47.656101 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.656067 2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 14 13:32:47.656194 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.656113 2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 14 13:32:47.656194 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.656180 2557 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 14 13:32:47.656888 ip-10-0-131-48 systemd[1]: Started Kubernetes Kubelet. Jun 14 13:32:47.657962 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.657945 2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 14 13:32:47.658565 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.658541 2557 server.go:310] "Adding debug handlers to kubelet server" Jun 14 13:32:47.659996 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.659977 2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-48.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 14 13:32:47.660071 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:47.660016 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 14 13:32:47.660071 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:47.660020 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-48.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 14 13:32:47.660855 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:47.659988 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-48.ec2.internal.18b8f5d99f650ac6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-48.ec2.internal,UID:ip-10-0-131-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-48.ec2.internal,},FirstTimestamp:2026-06-14 13:32:47.655938758 +0000 UTC m=+0.329206694,LastTimestamp:2026-06-14 13:32:47.655938758 +0000 UTC m=+0.329206694,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-48.ec2.internal,}" Jun 14 13:32:47.662807 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.662789 2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 14 13:32:47.662919 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.662900 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 14 13:32:47.662977 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:47.662952 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-48.ec2.internal\" not found" Jun 14 13:32:47.663592 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.663573 2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 14 13:32:47.663700 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.663569 2557 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 14 13:32:47.663793 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.663780 2557 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 14 13:32:47.663997 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.663978 2557 factory.go:55] Registering systemd factory Jun 14 13:32:47.663997 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.663999 2557 factory.go:223] Registration of the systemd container factory successfully Jun 14 13:32:47.664156 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.664080 2557 reconstruct.go:97] "Volume reconstruction finished" Jun 14 13:32:47.664156 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.664090 2557 reconciler.go:29] "Reconciler: start to sync state" Jun 14 13:32:47.664156 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:47.664150 2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 14 13:32:47.664303 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.664254 2557 factory.go:153] Registering CRI-O factory Jun 14 13:32:47.664303 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.664267 2557 factory.go:223] Registration of the crio container factory successfully Jun 14 13:32:47.664401 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.664313 2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 14 13:32:47.664401 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.664335 2557 factory.go:103] Registering Raw factory Jun 14 13:32:47.664401 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.664365 2557 manager.go:1196] Started watching for new ooms in manager Jun 14 13:32:47.665121 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:47.665091 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 14 13:32:47.665191 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.665150 2557 manager.go:349] Starting recovery of all containers Jun 14 13:32:47.665191 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:47.665149 2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-48.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 14 13:32:47.678311 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.678183 2557 manager.go:354] Recovery completed Jun 14 13:32:47.682418 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.682405 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 13:32:47.685200 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.685179 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasSufficientMemory" Jun 14 13:32:47.685265 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.685226 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 13:32:47.685265 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.685240 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasSufficientPID" Jun 14 13:32:47.685840 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.685825 2557 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 14 13:32:47.685924 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.685841 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 13:32:47.685924 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.685840 2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 14 13:32:47.685994 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.685922 2557 state_mem.go:36] "Initialized new in-memory state store" Jun 14 13:32:47.686571 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.686556 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasSufficientMemory" Jun 14 13:32:47.686644 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.686582 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 13:32:47.686644 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.686592 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasSufficientPID" Jun 14 13:32:47.688113 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.688100 2557 policy_none.go:49] "None policy: Start" Jun 14 13:32:47.688161 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.688117 2557 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 14 13:32:47.688161 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.688128 2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 14 13:32:47.689205 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.689191 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4zr2m" Jun 14 13:32:47.690015 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.689999 2557 policy_none.go:47] "Start" Jun 14 13:32:47.695145 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:47.695074 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-48.ec2.internal.18b8f5d9a1238b65 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-48.ec2.internal,UID:ip-10-0-131-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-48.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-48.ec2.internal,},FirstTimestamp:2026-06-14 13:32:47.685200741 +0000 UTC m=+0.358468680,LastTimestamp:2026-06-14 13:32:47.685200741 +0000 UTC m=+0.358468680,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-48.ec2.internal,}" Jun 14 13:32:47.697670 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.697656 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4zr2m" Jun 14 13:32:47.742282 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.725294 2557 manager.go:337] "Starting Device Plugin manager" Jun 14 13:32:47.742282 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:47.725322 2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 14 13:32:47.742282 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.725332 2557 server.go:87] "Starting device plugin registration server" Jun 14 13:32:47.742282 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.725622 2557 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 14 13:32:47.742282 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.725639 2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 14 13:32:47.742282 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.725792 2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 14 13:32:47.742282 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.725909 2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 14 13:32:47.742282 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.726408 2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 14 13:32:47.742282 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:47.726411 2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 14 13:32:47.742282 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:47.726465 2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-48.ec2.internal\" not found" Jun 14 13:32:47.742282 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.726460 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 14 13:32:47.742282 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.727805 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 14 13:32:47.742282 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.727836 2557 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 14 13:32:47.742282 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.727861 2557 kubelet.go:2448] "Starting kubelet main sync loop" Jun 14 13:32:47.742282 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:47.727890 2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 14 13:32:47.742282 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.729802 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 13:32:47.826257 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.826231 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 13:32:47.827422 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.827405 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasSufficientMemory" Jun 14 13:32:47.827487 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.827437 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 13:32:47.827487 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.827450 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasSufficientPID" Jun 14 13:32:47.827487 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.827478 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-48.ec2.internal" Jun 14 13:32:47.828462 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.828436 2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-48.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal"] Jun 14 13:32:47.828509 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.828500 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 13:32:47.829513 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.829498 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasSufficientMemory" Jun 14 13:32:47.829594 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.829535 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 13:32:47.829594 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.829553 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasSufficientPID" Jun 14 13:32:47.831886 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.831871 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 13:32:47.832027 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.832010 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-48.ec2.internal" Jun 14 13:32:47.832083 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.832038 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 13:32:47.832746 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.832726 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasSufficientMemory" Jun 14 13:32:47.832746 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.832745 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasSufficientMemory" Jun 14 13:32:47.832872 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.832760 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 13:32:47.832872 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.832777 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasSufficientPID" Jun 14 13:32:47.832872 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.832781 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 13:32:47.832872 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.832795 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasSufficientPID" Jun 14 13:32:47.835440 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.835425 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal" Jun 14 13:32:47.835509 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.835461 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 13:32:47.836505 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.836464 2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-48.ec2.internal" Jun 14 13:32:47.836505 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:47.836482 2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-48.ec2.internal\": node \"ip-10-0-131-48.ec2.internal\" not found" Jun 14 13:32:47.839207 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.839189 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasSufficientMemory" Jun 14 13:32:47.839291 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.839216 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 13:32:47.839291 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.839229 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasSufficientPID" Jun 14 13:32:47.850280 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:47.850260 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-48.ec2.internal\" not found" node="ip-10-0-131-48.ec2.internal" Jun 14 13:32:47.856175 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:47.856159 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-48.ec2.internal\" not found" node="ip-10-0-131-48.ec2.internal" Jun 14 13:32:47.860858 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:47.860841 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-48.ec2.internal\" not found" Jun 14 13:32:47.865516 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.865498 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1f8d5b9457c4cf20b7d985158db08cef-config\") pod \"kube-apiserver-proxy-ip-10-0-131-48.ec2.internal\" (UID: \"1f8d5b9457c4cf20b7d985158db08cef\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-48.ec2.internal" Jun 14 13:32:47.865584 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.865522 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5347bab5c0151c1c15069d4f37484c09-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal\" (UID: \"5347bab5c0151c1c15069d4f37484c09\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal" Jun 14 13:32:47.865584 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.865545 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5347bab5c0151c1c15069d4f37484c09-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal\" (UID: \"5347bab5c0151c1c15069d4f37484c09\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal" Jun 14 13:32:47.960946 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:47.960916 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-48.ec2.internal\" not found" Jun 14 13:32:47.966355 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.966336 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1f8d5b9457c4cf20b7d985158db08cef-config\") pod \"kube-apiserver-proxy-ip-10-0-131-48.ec2.internal\" (UID: \"1f8d5b9457c4cf20b7d985158db08cef\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-48.ec2.internal" Jun 14 13:32:47.966419 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.966375 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5347bab5c0151c1c15069d4f37484c09-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal\" (UID: \"5347bab5c0151c1c15069d4f37484c09\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal" Jun 14 13:32:47.966419 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.966393 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5347bab5c0151c1c15069d4f37484c09-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal\" (UID: \"5347bab5c0151c1c15069d4f37484c09\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal" Jun 14 13:32:47.966492 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.966421 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5347bab5c0151c1c15069d4f37484c09-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal\" (UID: \"5347bab5c0151c1c15069d4f37484c09\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal" Jun 14 13:32:47.966492 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.966338 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1f8d5b9457c4cf20b7d985158db08cef-config\") pod \"kube-apiserver-proxy-ip-10-0-131-48.ec2.internal\" (UID: \"1f8d5b9457c4cf20b7d985158db08cef\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-48.ec2.internal" Jun 14 13:32:47.966492 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:47.966463 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5347bab5c0151c1c15069d4f37484c09-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal\" (UID: \"5347bab5c0151c1c15069d4f37484c09\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal" Jun 14 13:32:48.061535 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:48.061498 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-48.ec2.internal\" not found" Jun 14 13:32:48.152223 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.152196 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-48.ec2.internal" Jun 14 13:32:48.159528 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.159507 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal" Jun 14 13:32:48.161600 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:48.161578 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-48.ec2.internal\" not found" Jun 14 13:32:48.262627 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:48.262584 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-48.ec2.internal\" not found" Jun 14 13:32:48.363043 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:48.363013 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-48.ec2.internal\" not found" Jun 14 13:32:48.463537 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:48.463454 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-48.ec2.internal\" not found" Jun 14 13:32:48.488416 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.488392 2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 13:32:48.563949 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.563912 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-48.ec2.internal" Jun 14 13:32:48.573553 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.573530 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 13:32:48.575110 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.575097 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal" Jun 14 13:32:48.590332 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.590316 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 13:32:48.606482 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.606461 2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 14 13:32:48.606605 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.606588 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 13:32:48.621675 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.621651 2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 13:32:48.646649 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.646631 2557 apiserver.go:52] "Watching apiserver" Jun 14 13:32:48.652181 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.652159 2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 14 13:32:48.652515 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.652494 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-dqj5p","kube-system/global-pull-secret-syncer-6swkj","kube-system/konnectivity-agent-7x8bl","openshift-cluster-node-tuning-operator/tuned-6gf6j","openshift-dns/node-resolver-hcsvf","openshift-multus/multus-additional-cni-plugins-9x9kd","openshift-multus/multus-mblwf","kube-system/kube-apiserver-proxy-ip-10-0-131-48.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5dbb","openshift-image-registry/node-ca-vhpwp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal","openshift-multus/network-metrics-daemon-xq27q","openshift-network-diagnostics/network-check-target-lhzpp","openshift-network-operator/iptables-alerter-dx6mn"] Jun 14 13:32:48.654645 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.654631 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vhpwp" Jun 14 13:32:48.656903 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.656884 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 14 13:32:48.656995 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.656904 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9x9kd" Jun 14 13:32:48.657130 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.657114 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 14 13:32:48.657185 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.657170 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-t6t47\"" Jun 14 13:32:48.657228 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.657197 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 14 13:32:48.659007 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.658990 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:32:48.659082 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:48.659065 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq27q" podUID="a5cff939-d984-4037-9dbb-2f4bbf3a6073" Jun 14 13:32:48.659139 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.659105 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 14 13:32:48.659427 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.659407 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 14 13:32:48.659519 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.659416 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5kjkm\"" Jun 14 13:32:48.659519 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.659435 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 14 13:32:48.659619 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.659569 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 14 13:32:48.659827 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.659813 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 14 13:32:48.661269 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.661256 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.663224 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.663200 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 14 13:32:48.663374 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.663352 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lhzpp" Jun 14 13:32:48.663484 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.663456 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 14 13:32:48.663583 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.663566 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 14 13:32:48.663625 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:48.663561 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lhzpp" podUID="881168eb-b04c-4047-b61e-38c07200a455" Jun 14 13:32:48.663997 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.663968 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jf4qp\"" Jun 14 13:32:48.666629 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.666609 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hcsvf" Jun 14 13:32:48.668500 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.668478 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5dbb" Jun 14 13:32:48.668967 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.668948 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xbg8r\"" Jun 14 13:32:48.669056 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.669012 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01786353-4e34-48af-90ce-aea4533819b1-cnibin\") pod \"multus-additional-cni-plugins-9x9kd\" (UID: \"01786353-4e34-48af-90ce-aea4533819b1\") " pod="openshift-multus/multus-additional-cni-plugins-9x9kd" Jun 14 13:32:48.669056 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.669043 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4zcg\" (UniqueName: \"kubernetes.io/projected/01786353-4e34-48af-90ce-aea4533819b1-kube-api-access-k4zcg\") pod \"multus-additional-cni-plugins-9x9kd\" (UID: \"01786353-4e34-48af-90ce-aea4533819b1\") " pod="openshift-multus/multus-additional-cni-plugins-9x9kd" Jun 14 13:32:48.669148 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.669070 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/540cb96e-de34-405b-bfea-463cfeead99c-etc-sysctl-d\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.669148 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.669099 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plhkq\" (UniqueName: \"kubernetes.io/projected/881168eb-b04c-4047-b61e-38c07200a455-kube-api-access-plhkq\") pod \"network-check-target-lhzpp\" (UID: \"881168eb-b04c-4047-b61e-38c07200a455\") " pod="openshift-network-diagnostics/network-check-target-lhzpp" Jun 14 13:32:48.669148 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.669124 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/31339707-4ec8-4cbb-8014-695a9f156efa-hosts-file\") pod \"node-resolver-hcsvf\" (UID: \"31339707-4ec8-4cbb-8014-695a9f156efa\") " pod="openshift-dns/node-resolver-hcsvf" Jun 14 13:32:48.669148 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.669146 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31339707-4ec8-4cbb-8014-695a9f156efa-tmp-dir\") pod \"node-resolver-hcsvf\" (UID: \"31339707-4ec8-4cbb-8014-695a9f156efa\") " pod="openshift-dns/node-resolver-hcsvf" Jun 14 13:32:48.669334 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.669167 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 14 13:32:48.669334 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.669171 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5cff939-d984-4037-9dbb-2f4bbf3a6073-metrics-certs\") pod \"network-metrics-daemon-xq27q\" (UID: \"a5cff939-d984-4037-9dbb-2f4bbf3a6073\") " pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:32:48.669334 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.669210 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/540cb96e-de34-405b-bfea-463cfeead99c-etc-modprobe-d\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.669334 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.669240 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/540cb96e-de34-405b-bfea-463cfeead99c-etc-sysconfig\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.669334 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.669263 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/540cb96e-de34-405b-bfea-463cfeead99c-var-lib-kubelet\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.669334 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.669280 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/540cb96e-de34-405b-bfea-463cfeead99c-tmp\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.669334 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.669314 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/be7e69d3-6286-4f5c-a895-51baff1834b8-serviceca\") pod \"node-ca-vhpwp\" (UID: \"be7e69d3-6286-4f5c-a895-51baff1834b8\") " pod="openshift-image-registry/node-ca-vhpwp" Jun 14 13:32:48.669601 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.669353 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/540cb96e-de34-405b-bfea-463cfeead99c-lib-modules\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.669601 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.669381 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n75gg\" (UniqueName: \"kubernetes.io/projected/be7e69d3-6286-4f5c-a895-51baff1834b8-kube-api-access-n75gg\") pod \"node-ca-vhpwp\" (UID: \"be7e69d3-6286-4f5c-a895-51baff1834b8\") " pod="openshift-image-registry/node-ca-vhpwp" Jun 14 13:32:48.669601 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.669402 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/01786353-4e34-48af-90ce-aea4533819b1-os-release\") pod \"multus-additional-cni-plugins-9x9kd\" (UID: \"01786353-4e34-48af-90ce-aea4533819b1\") " pod="openshift-multus/multus-additional-cni-plugins-9x9kd" Jun 14 13:32:48.669601 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.669417 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01786353-4e34-48af-90ce-aea4533819b1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9x9kd\" (UID: \"01786353-4e34-48af-90ce-aea4533819b1\") " pod="openshift-multus/multus-additional-cni-plugins-9x9kd" Jun 14 13:32:48.669601 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.669438 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/01786353-4e34-48af-90ce-aea4533819b1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9x9kd\" (UID: \"01786353-4e34-48af-90ce-aea4533819b1\") " pod="openshift-multus/multus-additional-cni-plugins-9x9kd" Jun 14 13:32:48.669601 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.669459 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/540cb96e-de34-405b-bfea-463cfeead99c-etc-sysctl-conf\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.669601 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.669474 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/540cb96e-de34-405b-bfea-463cfeead99c-run\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.669601 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.669498 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/540cb96e-de34-405b-bfea-463cfeead99c-sys\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.669601 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.669537 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 14 13:32:48.669601 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.669566 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8thwv\" (UniqueName: \"kubernetes.io/projected/31339707-4ec8-4cbb-8014-695a9f156efa-kube-api-access-8thwv\") pod \"node-resolver-hcsvf\" (UID: \"31339707-4ec8-4cbb-8014-695a9f156efa\") " pod="openshift-dns/node-resolver-hcsvf" Jun 14 13:32:48.670042 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.669594 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/540cb96e-de34-405b-bfea-463cfeead99c-etc-kubernetes\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.670042 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.669636 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/540cb96e-de34-405b-bfea-463cfeead99c-etc-tuned\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.670042 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.669661 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be7e69d3-6286-4f5c-a895-51baff1834b8-host\") pod \"node-ca-vhpwp\" (UID: \"be7e69d3-6286-4f5c-a895-51baff1834b8\") " pod="openshift-image-registry/node-ca-vhpwp" Jun 14 13:32:48.670042 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.669694 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/01786353-4e34-48af-90ce-aea4533819b1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9x9kd\" (UID: \"01786353-4e34-48af-90ce-aea4533819b1\") " pod="openshift-multus/multus-additional-cni-plugins-9x9kd" Jun 14 13:32:48.670042 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.669714 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7thn\" (UniqueName: \"kubernetes.io/projected/a5cff939-d984-4037-9dbb-2f4bbf3a6073-kube-api-access-n7thn\") pod \"network-metrics-daemon-xq27q\" (UID: \"a5cff939-d984-4037-9dbb-2f4bbf3a6073\") " pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:32:48.670042 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.669727 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/540cb96e-de34-405b-bfea-463cfeead99c-host\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.670042 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.669741 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/540cb96e-de34-405b-bfea-463cfeead99c-etc-systemd\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.670042 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.669776 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01786353-4e34-48af-90ce-aea4533819b1-cni-binary-copy\") pod \"multus-additional-cni-plugins-9x9kd\" (UID: \"01786353-4e34-48af-90ce-aea4533819b1\") " pod="openshift-multus/multus-additional-cni-plugins-9x9kd" Jun 14 13:32:48.670042 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.669819 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgrjc\" (UniqueName: \"kubernetes.io/projected/540cb96e-de34-405b-bfea-463cfeead99c-kube-api-access-vgrjc\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.670042 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.669850 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01786353-4e34-48af-90ce-aea4533819b1-system-cni-dir\") pod \"multus-additional-cni-plugins-9x9kd\" (UID: \"01786353-4e34-48af-90ce-aea4533819b1\") " pod="openshift-multus/multus-additional-cni-plugins-9x9kd" Jun 14 13:32:48.670766 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.670749 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 14 13:32:48.670848 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.670835 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sc7hq\"" Jun 14 13:32:48.670937 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.670919 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 14 13:32:48.671020 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.671003 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 14 13:32:48.671291 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.671278 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.673549 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.673532 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rx2dl\"" Jun 14 13:32:48.673619 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.673534 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 14 13:32:48.673756 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.673742 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:32:48.673830 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:48.673792 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6swkj" podUID="303004c7-a3eb-4fb8-9008-5aef0795ab73" Jun 14 13:32:48.676064 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.676045 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 13:32:48.676529 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.676512 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.678806 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.678788 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 14 13:32:48.678883 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.678820 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 14 13:32:48.679129 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.679111 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 14 13:32:48.679232 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.679218 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7x8bl" Jun 14 13:32:48.679388 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.679370 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 14 13:32:48.679453 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.679408 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-plbmc\"" Jun 14 13:32:48.679528 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.679514 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 14 13:32:48.679567 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.679518 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 14 13:32:48.681480 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.681464 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 14 13:32:48.681549 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.681514 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-l4mdb\"" Jun 14 13:32:48.681629 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.681617 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 14 13:32:48.681929 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.681915 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dx6mn" Jun 14 13:32:48.684188 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.684170 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dvk49\"" Jun 14 13:32:48.684279 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.684173 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 14 13:32:48.684430 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.684416 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 14 13:32:48.684504 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.684420 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 14 13:32:48.699902 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.699884 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gw8m7" Jun 14 13:32:48.702113 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.702050 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-13 13:27:47 +0000 UTC" deadline="2028-02-25 18:40:11.433225156 +0000 UTC" Jun 14 13:32:48.702113 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.702106 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14909h7m22.731123351s" Jun 14 13:32:48.709352 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.709337 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gw8m7" Jun 14 13:32:48.718172 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.718113 2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 13:32:48.764240 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.764219 2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 14 13:32:48.770860 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.770840 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/540cb96e-de34-405b-bfea-463cfeead99c-lib-modules\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.770952 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.770867 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01786353-4e34-48af-90ce-aea4533819b1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9x9kd\" (UID: \"01786353-4e34-48af-90ce-aea4533819b1\") " pod="openshift-multus/multus-additional-cni-plugins-9x9kd" Jun 14 13:32:48.770952 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.770890 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/01786353-4e34-48af-90ce-aea4533819b1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9x9kd\" (UID: \"01786353-4e34-48af-90ce-aea4533819b1\") " pod="openshift-multus/multus-additional-cni-plugins-9x9kd" Jun 14 13:32:48.770952 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.770918 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-multus-socket-dir-parent\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.771085 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.770960 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-multus-daemon-config\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.771085 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.770994 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/540cb96e-de34-405b-bfea-463cfeead99c-etc-sysctl-conf\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.771085 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771004 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/540cb96e-de34-405b-bfea-463cfeead99c-lib-modules\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.771085 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771024 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01786353-4e34-48af-90ce-aea4533819b1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9x9kd\" (UID: \"01786353-4e34-48af-90ce-aea4533819b1\") " pod="openshift-multus/multus-additional-cni-plugins-9x9kd" Jun 14 13:32:48.771085 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771018 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8thwv\" (UniqueName: \"kubernetes.io/projected/31339707-4ec8-4cbb-8014-695a9f156efa-kube-api-access-8thwv\") pod \"node-resolver-hcsvf\" (UID: \"31339707-4ec8-4cbb-8014-695a9f156efa\") " pod="openshift-dns/node-resolver-hcsvf" Jun 14 13:32:48.771085 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771053 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-host-slash\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.771085 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771074 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-node-log\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.771392 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771095 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9a92ad1-c2f3-4fc4-a168-5ac8ba34c07b-host-slash\") pod \"iptables-alerter-dx6mn\" (UID: \"d9a92ad1-c2f3-4fc4-a168-5ac8ba34c07b\") " pod="openshift-network-operator/iptables-alerter-dx6mn" Jun 14 13:32:48.771392 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771124 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/540cb96e-de34-405b-bfea-463cfeead99c-etc-sysctl-conf\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.771392 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771139 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/03d93714-6cee-4e26-baa2-4206ac504233-registration-dir\") pod \"aws-ebs-csi-driver-node-z5dbb\" (UID: \"03d93714-6cee-4e26-baa2-4206ac504233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5dbb" Jun 14 13:32:48.771392 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771181 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng827\" (UniqueName: \"kubernetes.io/projected/03d93714-6cee-4e26-baa2-4206ac504233-kube-api-access-ng827\") pod \"aws-ebs-csi-driver-node-z5dbb\" (UID: \"03d93714-6cee-4e26-baa2-4206ac504233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5dbb" Jun 14 13:32:48.771392 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771211 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/540cb96e-de34-405b-bfea-463cfeead99c-etc-kubernetes\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.771392 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771236 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/540cb96e-de34-405b-bfea-463cfeead99c-etc-tuned\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.771392 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771252 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/540cb96e-de34-405b-bfea-463cfeead99c-etc-kubernetes\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.771392 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771258 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be7e69d3-6286-4f5c-a895-51baff1834b8-host\") pod \"node-ca-vhpwp\" (UID: \"be7e69d3-6286-4f5c-a895-51baff1834b8\") " pod="openshift-image-registry/node-ca-vhpwp" Jun 14 13:32:48.771392 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771306 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be7e69d3-6286-4f5c-a895-51baff1834b8-host\") pod \"node-ca-vhpwp\" (UID: \"be7e69d3-6286-4f5c-a895-51baff1834b8\") " pod="openshift-image-registry/node-ca-vhpwp" Jun 14 13:32:48.771392 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771325 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-var-lib-openvswitch\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.771392 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771355 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/08819fe4-b654-44d1-9773-a007a6044ec2-env-overrides\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.771392 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771372 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-host-run-k8s-cni-cncf-io\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.771392 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771393 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-host-var-lib-cni-multus\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.772025 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771419 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7thn\" (UniqueName: \"kubernetes.io/projected/a5cff939-d984-4037-9dbb-2f4bbf3a6073-kube-api-access-n7thn\") pod \"network-metrics-daemon-xq27q\" (UID: \"a5cff939-d984-4037-9dbb-2f4bbf3a6073\") " pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:32:48.772025 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771434 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-host-run-netns\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.772025 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771440 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/01786353-4e34-48af-90ce-aea4533819b1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9x9kd\" (UID: \"01786353-4e34-48af-90ce-aea4533819b1\") " pod="openshift-multus/multus-additional-cni-plugins-9x9kd" Jun 14 13:32:48.772025 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771453 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-multus-conf-dir\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.772025 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771477 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01786353-4e34-48af-90ce-aea4533819b1-cni-binary-copy\") pod \"multus-additional-cni-plugins-9x9kd\" (UID: \"01786353-4e34-48af-90ce-aea4533819b1\") " pod="openshift-multus/multus-additional-cni-plugins-9x9kd" Jun 14 13:32:48.772025 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771498 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/303004c7-a3eb-4fb8-9008-5aef0795ab73-dbus\") pod \"global-pull-secret-syncer-6swkj\" (UID: \"303004c7-a3eb-4fb8-9008-5aef0795ab73\") " pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:32:48.772025 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771514 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/08819fe4-b654-44d1-9773-a007a6044ec2-ovnkube-script-lib\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.772025 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771529 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpnsc\" (UniqueName: \"kubernetes.io/projected/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-kube-api-access-lpnsc\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.772025 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771545 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgrjc\" (UniqueName: \"kubernetes.io/projected/540cb96e-de34-405b-bfea-463cfeead99c-kube-api-access-vgrjc\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.772025 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771580 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01786353-4e34-48af-90ce-aea4533819b1-system-cni-dir\") pod \"multus-additional-cni-plugins-9x9kd\" (UID: \"01786353-4e34-48af-90ce-aea4533819b1\") " pod="openshift-multus/multus-additional-cni-plugins-9x9kd" Jun 14 13:32:48.772025 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771564 2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 14 13:32:48.772025 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771613 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-systemd-units\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.772025 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771645 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01786353-4e34-48af-90ce-aea4533819b1-system-cni-dir\") pod \"multus-additional-cni-plugins-9x9kd\" (UID: \"01786353-4e34-48af-90ce-aea4533819b1\") " pod="openshift-multus/multus-additional-cni-plugins-9x9kd" Jun 14 13:32:48.772025 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771651 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnqbp\" (UniqueName: \"kubernetes.io/projected/d9a92ad1-c2f3-4fc4-a168-5ac8ba34c07b-kube-api-access-hnqbp\") pod \"iptables-alerter-dx6mn\" (UID: \"d9a92ad1-c2f3-4fc4-a168-5ac8ba34c07b\") " pod="openshift-network-operator/iptables-alerter-dx6mn" Jun 14 13:32:48.772025 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771677 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/31339707-4ec8-4cbb-8014-695a9f156efa-hosts-file\") pod \"node-resolver-hcsvf\" (UID: \"31339707-4ec8-4cbb-8014-695a9f156efa\") " pod="openshift-dns/node-resolver-hcsvf" Jun 14 13:32:48.772025 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771718 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.772025 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771742 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-host-var-lib-kubelet\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.772831 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771747 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/31339707-4ec8-4cbb-8014-695a9f156efa-hosts-file\") pod \"node-resolver-hcsvf\" (UID: \"31339707-4ec8-4cbb-8014-695a9f156efa\") " pod="openshift-dns/node-resolver-hcsvf" Jun 14 13:32:48.772831 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771765 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-host-run-multus-certs\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.772831 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771799 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-etc-openvswitch\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.772831 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771852 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-run-openvswitch\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.772831 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771882 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/08819fe4-b654-44d1-9773-a007a6044ec2-ovn-node-metrics-cert\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.772831 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771911 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5cff939-d984-4037-9dbb-2f4bbf3a6073-metrics-certs\") pod \"network-metrics-daemon-xq27q\" (UID: \"a5cff939-d984-4037-9dbb-2f4bbf3a6073\") " pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:32:48.772831 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771918 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01786353-4e34-48af-90ce-aea4533819b1-cni-binary-copy\") pod \"multus-additional-cni-plugins-9x9kd\" (UID: \"01786353-4e34-48af-90ce-aea4533819b1\") " pod="openshift-multus/multus-additional-cni-plugins-9x9kd" Jun 14 13:32:48.772831 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771945 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/540cb96e-de34-405b-bfea-463cfeead99c-etc-sysconfig\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.772831 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.771980 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/540cb96e-de34-405b-bfea-463cfeead99c-var-lib-kubelet\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.772831 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772007 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/540cb96e-de34-405b-bfea-463cfeead99c-tmp\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.772831 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772025 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/540cb96e-de34-405b-bfea-463cfeead99c-etc-sysconfig\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.772831 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772029 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/540cb96e-de34-405b-bfea-463cfeead99c-var-lib-kubelet\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.772831 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772033 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/be7e69d3-6286-4f5c-a895-51baff1834b8-serviceca\") pod \"node-ca-vhpwp\" (UID: \"be7e69d3-6286-4f5c-a895-51baff1834b8\") " pod="openshift-image-registry/node-ca-vhpwp" Jun 14 13:32:48.772831 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:48.772044 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 13:32:48.772831 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772071 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n75gg\" (UniqueName: \"kubernetes.io/projected/be7e69d3-6286-4f5c-a895-51baff1834b8-kube-api-access-n75gg\") pod \"node-ca-vhpwp\" (UID: \"be7e69d3-6286-4f5c-a895-51baff1834b8\") " pod="openshift-image-registry/node-ca-vhpwp" Jun 14 13:32:48.772831 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772095 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/01786353-4e34-48af-90ce-aea4533819b1-os-release\") pod \"multus-additional-cni-plugins-9x9kd\" (UID: \"01786353-4e34-48af-90ce-aea4533819b1\") " pod="openshift-multus/multus-additional-cni-plugins-9x9kd" Jun 14 13:32:48.772831 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772120 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/303004c7-a3eb-4fb8-9008-5aef0795ab73-kubelet-config\") pod \"global-pull-secret-syncer-6swkj\" (UID: \"303004c7-a3eb-4fb8-9008-5aef0795ab73\") " pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:32:48.773643 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:48.772191 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5cff939-d984-4037-9dbb-2f4bbf3a6073-metrics-certs podName:a5cff939-d984-4037-9dbb-2f4bbf3a6073 nodeName:}" failed. No retries permitted until 2026-06-14 13:32:49.272133915 +0000 UTC m=+1.945401841 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5cff939-d984-4037-9dbb-2f4bbf3a6073-metrics-certs") pod "network-metrics-daemon-xq27q" (UID: "a5cff939-d984-4037-9dbb-2f4bbf3a6073") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 13:32:48.773643 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772216 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/303004c7-a3eb-4fb8-9008-5aef0795ab73-original-pull-secret\") pod \"global-pull-secret-syncer-6swkj\" (UID: \"303004c7-a3eb-4fb8-9008-5aef0795ab73\") " pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:32:48.773643 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772262 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-run-systemd\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.773643 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772288 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d2ff2189-8eba-41f8-a401-e8384449247f-agent-certs\") pod \"konnectivity-agent-7x8bl\" (UID: \"d2ff2189-8eba-41f8-a401-e8384449247f\") " pod="kube-system/konnectivity-agent-7x8bl" Jun 14 13:32:48.773643 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772328 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-host-run-netns\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.773643 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772357 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/540cb96e-de34-405b-bfea-463cfeead99c-run\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.773643 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772380 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/540cb96e-de34-405b-bfea-463cfeead99c-sys\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.773643 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772404 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d9a92ad1-c2f3-4fc4-a168-5ac8ba34c07b-iptables-alerter-script\") pod \"iptables-alerter-dx6mn\" (UID: \"d9a92ad1-c2f3-4fc4-a168-5ac8ba34c07b\") " pod="openshift-network-operator/iptables-alerter-dx6mn" Jun 14 13:32:48.773643 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772392 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/01786353-4e34-48af-90ce-aea4533819b1-os-release\") pod \"multus-additional-cni-plugins-9x9kd\" (UID: \"01786353-4e34-48af-90ce-aea4533819b1\") " pod="openshift-multus/multus-additional-cni-plugins-9x9kd" Jun 14 13:32:48.773643 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772430 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-host-var-lib-cni-bin\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.773643 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772432 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/be7e69d3-6286-4f5c-a895-51baff1834b8-serviceca\") pod \"node-ca-vhpwp\" (UID: \"be7e69d3-6286-4f5c-a895-51baff1834b8\") " pod="openshift-image-registry/node-ca-vhpwp" Jun 14 13:32:48.773643 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772458 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/01786353-4e34-48af-90ce-aea4533819b1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9x9kd\" (UID: \"01786353-4e34-48af-90ce-aea4533819b1\") " pod="openshift-multus/multus-additional-cni-plugins-9x9kd" Jun 14 13:32:48.773643 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772506 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/540cb96e-de34-405b-bfea-463cfeead99c-run\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.773643 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772518 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-run-ovn\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.773643 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772544 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-host-cni-bin\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.773643 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772549 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/540cb96e-de34-405b-bfea-463cfeead99c-sys\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.774470 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772585 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th58f\" (UniqueName: \"kubernetes.io/projected/08819fe4-b654-44d1-9773-a007a6044ec2-kube-api-access-th58f\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.774470 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772620 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/03d93714-6cee-4e26-baa2-4206ac504233-device-dir\") pod \"aws-ebs-csi-driver-node-z5dbb\" (UID: \"03d93714-6cee-4e26-baa2-4206ac504233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5dbb" Jun 14 13:32:48.774470 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772651 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/03d93714-6cee-4e26-baa2-4206ac504233-sys-fs\") pod \"aws-ebs-csi-driver-node-z5dbb\" (UID: \"03d93714-6cee-4e26-baa2-4206ac504233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5dbb" Jun 14 13:32:48.774470 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772710 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-multus-cni-dir\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.774470 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772732 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-hostroot\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.774470 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772757 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/540cb96e-de34-405b-bfea-463cfeead99c-host\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.774470 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772780 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-log-socket\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.774470 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772803 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/03d93714-6cee-4e26-baa2-4206ac504233-socket-dir\") pod \"aws-ebs-csi-driver-node-z5dbb\" (UID: \"03d93714-6cee-4e26-baa2-4206ac504233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5dbb" Jun 14 13:32:48.774470 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772824 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/03d93714-6cee-4e26-baa2-4206ac504233-etc-selinux\") pod \"aws-ebs-csi-driver-node-z5dbb\" (UID: \"03d93714-6cee-4e26-baa2-4206ac504233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5dbb" Jun 14 13:32:48.774470 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772828 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/540cb96e-de34-405b-bfea-463cfeead99c-host\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.774470 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772849 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/540cb96e-de34-405b-bfea-463cfeead99c-etc-systemd\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.774470 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772875 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-host-kubelet\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.774470 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772896 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/540cb96e-de34-405b-bfea-463cfeead99c-etc-systemd\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.774470 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772899 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-host-run-ovn-kubernetes\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.774470 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772943 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01786353-4e34-48af-90ce-aea4533819b1-cnibin\") pod \"multus-additional-cni-plugins-9x9kd\" (UID: \"01786353-4e34-48af-90ce-aea4533819b1\") " pod="openshift-multus/multus-additional-cni-plugins-9x9kd" Jun 14 13:32:48.774470 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772980 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4zcg\" (UniqueName: \"kubernetes.io/projected/01786353-4e34-48af-90ce-aea4533819b1-kube-api-access-k4zcg\") pod \"multus-additional-cni-plugins-9x9kd\" (UID: \"01786353-4e34-48af-90ce-aea4533819b1\") " pod="openshift-multus/multus-additional-cni-plugins-9x9kd" Jun 14 13:32:48.774470 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772996 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/01786353-4e34-48af-90ce-aea4533819b1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9x9kd\" (UID: \"01786353-4e34-48af-90ce-aea4533819b1\") " pod="openshift-multus/multus-additional-cni-plugins-9x9kd" Jun 14 13:32:48.775135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.773006 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-os-release\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.775135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.772999 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01786353-4e34-48af-90ce-aea4533819b1-cnibin\") pod \"multus-additional-cni-plugins-9x9kd\" (UID: \"01786353-4e34-48af-90ce-aea4533819b1\") " pod="openshift-multus/multus-additional-cni-plugins-9x9kd" Jun 14 13:32:48.775135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.773028 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-cni-binary-copy\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.775135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.773055 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/540cb96e-de34-405b-bfea-463cfeead99c-etc-sysctl-d\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.775135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.773080 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plhkq\" (UniqueName: \"kubernetes.io/projected/881168eb-b04c-4047-b61e-38c07200a455-kube-api-access-plhkq\") pod \"network-check-target-lhzpp\" (UID: \"881168eb-b04c-4047-b61e-38c07200a455\") " pod="openshift-network-diagnostics/network-check-target-lhzpp" Jun 14 13:32:48.775135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.773102 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31339707-4ec8-4cbb-8014-695a9f156efa-tmp-dir\") pod \"node-resolver-hcsvf\" (UID: \"31339707-4ec8-4cbb-8014-695a9f156efa\") " pod="openshift-dns/node-resolver-hcsvf" Jun 14 13:32:48.775135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.773201 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/540cb96e-de34-405b-bfea-463cfeead99c-etc-sysctl-d\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.775135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.773268 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d2ff2189-8eba-41f8-a401-e8384449247f-konnectivity-ca\") pod \"konnectivity-agent-7x8bl\" (UID: \"d2ff2189-8eba-41f8-a401-e8384449247f\") " pod="kube-system/konnectivity-agent-7x8bl" Jun 14 13:32:48.775135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.773301 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/03d93714-6cee-4e26-baa2-4206ac504233-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z5dbb\" (UID: \"03d93714-6cee-4e26-baa2-4206ac504233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5dbb" Jun 14 13:32:48.775135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.773329 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31339707-4ec8-4cbb-8014-695a9f156efa-tmp-dir\") pod \"node-resolver-hcsvf\" (UID: \"31339707-4ec8-4cbb-8014-695a9f156efa\") " pod="openshift-dns/node-resolver-hcsvf" Jun 14 13:32:48.775135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.773330 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-cnibin\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.775135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.773390 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-etc-kubernetes\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.775135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.773416 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-host-cni-netd\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.775135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.773451 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/540cb96e-de34-405b-bfea-463cfeead99c-etc-modprobe-d\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.775135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.773474 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-system-cni-dir\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.775135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.773491 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/08819fe4-b654-44d1-9773-a007a6044ec2-ovnkube-config\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.775135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.773565 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/540cb96e-de34-405b-bfea-463cfeead99c-etc-modprobe-d\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.775634 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.775002 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/540cb96e-de34-405b-bfea-463cfeead99c-tmp\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.775634 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.775060 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/540cb96e-de34-405b-bfea-463cfeead99c-etc-tuned\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.779414 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.779393 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8thwv\" (UniqueName: \"kubernetes.io/projected/31339707-4ec8-4cbb-8014-695a9f156efa-kube-api-access-8thwv\") pod \"node-resolver-hcsvf\" (UID: \"31339707-4ec8-4cbb-8014-695a9f156efa\") " pod="openshift-dns/node-resolver-hcsvf" Jun 14 13:32:48.779551 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.779532 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7thn\" (UniqueName: \"kubernetes.io/projected/a5cff939-d984-4037-9dbb-2f4bbf3a6073-kube-api-access-n7thn\") pod \"network-metrics-daemon-xq27q\" (UID: \"a5cff939-d984-4037-9dbb-2f4bbf3a6073\") " pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:32:48.779595 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.779580 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgrjc\" (UniqueName: \"kubernetes.io/projected/540cb96e-de34-405b-bfea-463cfeead99c-kube-api-access-vgrjc\") pod \"tuned-6gf6j\" (UID: \"540cb96e-de34-405b-bfea-463cfeead99c\") " pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:48.781705 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:48.781672 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 13:32:48.781805 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:48.781707 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 13:32:48.781805 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:48.781722 2557 projected.go:196] Error preparing data for projected volume kube-api-access-plhkq for pod openshift-network-diagnostics/network-check-target-lhzpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 13:32:48.781805 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:48.781769 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/881168eb-b04c-4047-b61e-38c07200a455-kube-api-access-plhkq podName:881168eb-b04c-4047-b61e-38c07200a455 nodeName:}" failed. No retries permitted until 2026-06-14 13:32:49.281757852 +0000 UTC m=+1.955025779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-plhkq" (UniqueName: "kubernetes.io/projected/881168eb-b04c-4047-b61e-38c07200a455-kube-api-access-plhkq") pod "network-check-target-lhzpp" (UID: "881168eb-b04c-4047-b61e-38c07200a455") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 13:32:48.782231 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.782210 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n75gg\" (UniqueName: \"kubernetes.io/projected/be7e69d3-6286-4f5c-a895-51baff1834b8-kube-api-access-n75gg\") pod \"node-ca-vhpwp\" (UID: \"be7e69d3-6286-4f5c-a895-51baff1834b8\") " pod="openshift-image-registry/node-ca-vhpwp" Jun 14 13:32:48.783301 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.783286 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4zcg\" (UniqueName: \"kubernetes.io/projected/01786353-4e34-48af-90ce-aea4533819b1-kube-api-access-k4zcg\") pod \"multus-additional-cni-plugins-9x9kd\" (UID: \"01786353-4e34-48af-90ce-aea4533819b1\") " pod="openshift-multus/multus-additional-cni-plugins-9x9kd" Jun 14 13:32:48.830339 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:48.830314 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5347bab5c0151c1c15069d4f37484c09.slice/crio-03a1e14a73849beac526c188e1f8c66250384e8454732fae972e9921ccec82bf WatchSource:0}: Error finding container 03a1e14a73849beac526c188e1f8c66250384e8454732fae972e9921ccec82bf: Status 404 returned error can't find the container with id 03a1e14a73849beac526c188e1f8c66250384e8454732fae972e9921ccec82bf Jun 14 13:32:48.835856 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.835836 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 13:32:48.841482 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:48.841459 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f8d5b9457c4cf20b7d985158db08cef.slice/crio-ebe119eb4919763bde8bfc5f6b52d12f868eec630ba42b6225794b61a12e173b WatchSource:0}: Error finding container ebe119eb4919763bde8bfc5f6b52d12f868eec630ba42b6225794b61a12e173b: Status 404 returned error can't find the container with id ebe119eb4919763bde8bfc5f6b52d12f868eec630ba42b6225794b61a12e173b Jun 14 13:32:48.873706 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.873667 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-multus-conf-dir\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.873819 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.873744 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-multus-conf-dir\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.873819 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.873779 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/303004c7-a3eb-4fb8-9008-5aef0795ab73-dbus\") pod \"global-pull-secret-syncer-6swkj\" (UID: \"303004c7-a3eb-4fb8-9008-5aef0795ab73\") " pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:32:48.873819 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.873797 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/08819fe4-b654-44d1-9773-a007a6044ec2-ovnkube-script-lib\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.873819 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.873812 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpnsc\" (UniqueName: \"kubernetes.io/projected/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-kube-api-access-lpnsc\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.874030 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.873829 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-systemd-units\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.874030 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.873845 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnqbp\" (UniqueName: \"kubernetes.io/projected/d9a92ad1-c2f3-4fc4-a168-5ac8ba34c07b-kube-api-access-hnqbp\") pod \"iptables-alerter-dx6mn\" (UID: \"d9a92ad1-c2f3-4fc4-a168-5ac8ba34c07b\") " pod="openshift-network-operator/iptables-alerter-dx6mn" Jun 14 13:32:48.874030 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.873862 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.874030 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.873877 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-host-var-lib-kubelet\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.874030 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.873897 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-host-run-multus-certs\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.874030 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.873923 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-etc-openvswitch\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.874030 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.873943 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-systemd-units\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.874030 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.873966 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-host-run-multus-certs\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.874030 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.873945 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-host-var-lib-kubelet\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.874030 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.873992 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/303004c7-a3eb-4fb8-9008-5aef0795ab73-dbus\") pod \"global-pull-secret-syncer-6swkj\" (UID: \"303004c7-a3eb-4fb8-9008-5aef0795ab73\") " pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:32:48.874030 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.874015 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-run-openvswitch\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.874030 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.873987 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.874493 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.873999 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-etc-openvswitch\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.874493 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.873946 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-run-openvswitch\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.874493 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.874089 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/08819fe4-b654-44d1-9773-a007a6044ec2-ovn-node-metrics-cert\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.874493 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.874124 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/303004c7-a3eb-4fb8-9008-5aef0795ab73-kubelet-config\") pod \"global-pull-secret-syncer-6swkj\" (UID: \"303004c7-a3eb-4fb8-9008-5aef0795ab73\") " pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:32:48.874493 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.874138 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/303004c7-a3eb-4fb8-9008-5aef0795ab73-original-pull-secret\") pod \"global-pull-secret-syncer-6swkj\" (UID: \"303004c7-a3eb-4fb8-9008-5aef0795ab73\") " pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:32:48.874493 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.874161 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-run-systemd\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.874493 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.874183 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d2ff2189-8eba-41f8-a401-e8384449247f-agent-certs\") pod \"konnectivity-agent-7x8bl\" (UID: \"d2ff2189-8eba-41f8-a401-e8384449247f\") " pod="kube-system/konnectivity-agent-7x8bl" Jun 14 13:32:48.874493 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.874197 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/303004c7-a3eb-4fb8-9008-5aef0795ab73-kubelet-config\") pod \"global-pull-secret-syncer-6swkj\" (UID: \"303004c7-a3eb-4fb8-9008-5aef0795ab73\") " pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:32:48.874493 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.874206 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-host-run-netns\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.874493 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.874229 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d9a92ad1-c2f3-4fc4-a168-5ac8ba34c07b-iptables-alerter-script\") pod \"iptables-alerter-dx6mn\" (UID: \"d9a92ad1-c2f3-4fc4-a168-5ac8ba34c07b\") " pod="openshift-network-operator/iptables-alerter-dx6mn" Jun 14 13:32:48.874493 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:48.874238 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 13:32:48.874493 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.874248 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-host-var-lib-cni-bin\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.874493 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.874264 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-run-ovn\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.874493 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.874276 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-host-run-netns\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.874493 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:48.874290 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/303004c7-a3eb-4fb8-9008-5aef0795ab73-original-pull-secret podName:303004c7-a3eb-4fb8-9008-5aef0795ab73 nodeName:}" failed. No retries permitted until 2026-06-14 13:32:49.374274163 +0000 UTC m=+2.047542102 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/303004c7-a3eb-4fb8-9008-5aef0795ab73-original-pull-secret") pod "global-pull-secret-syncer-6swkj" (UID: "303004c7-a3eb-4fb8-9008-5aef0795ab73") : object "kube-system"/"original-pull-secret" not registered Jun 14 13:32:48.874493 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.874316 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-host-var-lib-cni-bin\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.874493 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.874354 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/08819fe4-b654-44d1-9773-a007a6044ec2-ovnkube-script-lib\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.875305 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.874463 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-host-cni-bin\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.875305 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.874614 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th58f\" (UniqueName: \"kubernetes.io/projected/08819fe4-b654-44d1-9773-a007a6044ec2-kube-api-access-th58f\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.875305 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.874654 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/03d93714-6cee-4e26-baa2-4206ac504233-device-dir\") pod \"aws-ebs-csi-driver-node-z5dbb\" (UID: \"03d93714-6cee-4e26-baa2-4206ac504233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5dbb" Jun 14 13:32:48.875305 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.874702 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/03d93714-6cee-4e26-baa2-4206ac504233-sys-fs\") pod \"aws-ebs-csi-driver-node-z5dbb\" (UID: \"03d93714-6cee-4e26-baa2-4206ac504233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5dbb" Jun 14 13:32:48.875305 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.874717 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-host-cni-bin\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.875305 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.874735 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-multus-cni-dir\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.875305 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.874762 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-hostroot\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.875305 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.874320 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-run-ovn\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.875305 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.874795 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-log-socket\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.875305 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.874827 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/03d93714-6cee-4e26-baa2-4206ac504233-socket-dir\") pod \"aws-ebs-csi-driver-node-z5dbb\" (UID: \"03d93714-6cee-4e26-baa2-4206ac504233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5dbb" Jun 14 13:32:48.875305 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.874848 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-multus-cni-dir\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.875305 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.874857 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/03d93714-6cee-4e26-baa2-4206ac504233-etc-selinux\") pod \"aws-ebs-csi-driver-node-z5dbb\" (UID: \"03d93714-6cee-4e26-baa2-4206ac504233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5dbb" Jun 14 13:32:48.875305 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.874889 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-host-kubelet\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.875305 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.874922 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/03d93714-6cee-4e26-baa2-4206ac504233-device-dir\") pod \"aws-ebs-csi-driver-node-z5dbb\" (UID: \"03d93714-6cee-4e26-baa2-4206ac504233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5dbb" Jun 14 13:32:48.875305 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.874925 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-host-run-ovn-kubernetes\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.875305 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.874969 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-host-run-ovn-kubernetes\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.875305 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.875092 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/03d93714-6cee-4e26-baa2-4206ac504233-socket-dir\") pod \"aws-ebs-csi-driver-node-z5dbb\" (UID: \"03d93714-6cee-4e26-baa2-4206ac504233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5dbb" Jun 14 13:32:48.876135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.875154 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-os-release\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.876135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.875156 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-hostroot\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.876135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.875208 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-host-kubelet\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.876135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.875264 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d9a92ad1-c2f3-4fc4-a168-5ac8ba34c07b-iptables-alerter-script\") pod \"iptables-alerter-dx6mn\" (UID: \"d9a92ad1-c2f3-4fc4-a168-5ac8ba34c07b\") " pod="openshift-network-operator/iptables-alerter-dx6mn" Jun 14 13:32:48.876135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.874969 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-os-release\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.876135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.875311 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-log-socket\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.876135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.875310 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/03d93714-6cee-4e26-baa2-4206ac504233-etc-selinux\") pod \"aws-ebs-csi-driver-node-z5dbb\" (UID: \"03d93714-6cee-4e26-baa2-4206ac504233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5dbb" Jun 14 13:32:48.876135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.875334 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-cni-binary-copy\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.876135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.875400 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/03d93714-6cee-4e26-baa2-4206ac504233-sys-fs\") pod \"aws-ebs-csi-driver-node-z5dbb\" (UID: \"03d93714-6cee-4e26-baa2-4206ac504233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5dbb" Jun 14 13:32:48.876135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.875415 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d2ff2189-8eba-41f8-a401-e8384449247f-konnectivity-ca\") pod \"konnectivity-agent-7x8bl\" (UID: \"d2ff2189-8eba-41f8-a401-e8384449247f\") " pod="kube-system/konnectivity-agent-7x8bl" Jun 14 13:32:48.876135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.874240 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-run-systemd\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.876135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.875452 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/03d93714-6cee-4e26-baa2-4206ac504233-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z5dbb\" (UID: \"03d93714-6cee-4e26-baa2-4206ac504233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5dbb" Jun 14 13:32:48.876135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.875508 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-cnibin\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.876135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.875544 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-etc-kubernetes\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.876135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.875574 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-host-cni-netd\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.876135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.875581 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/03d93714-6cee-4e26-baa2-4206ac504233-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z5dbb\" (UID: \"03d93714-6cee-4e26-baa2-4206ac504233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5dbb" Jun 14 13:32:48.876135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.875602 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-system-cni-dir\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.876135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.875635 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/08819fe4-b654-44d1-9773-a007a6044ec2-ovnkube-config\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.877001 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.875647 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-cnibin\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.877001 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.875670 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-multus-socket-dir-parent\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.877001 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.875710 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-etc-kubernetes\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.877001 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.875721 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-multus-daemon-config\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.877001 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.875752 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-host-slash\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.877001 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.875783 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-node-log\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.877001 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.875815 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9a92ad1-c2f3-4fc4-a168-5ac8ba34c07b-host-slash\") pod \"iptables-alerter-dx6mn\" (UID: \"d9a92ad1-c2f3-4fc4-a168-5ac8ba34c07b\") " pod="openshift-network-operator/iptables-alerter-dx6mn" Jun 14 13:32:48.877001 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.875845 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/03d93714-6cee-4e26-baa2-4206ac504233-registration-dir\") pod \"aws-ebs-csi-driver-node-z5dbb\" (UID: \"03d93714-6cee-4e26-baa2-4206ac504233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5dbb" Jun 14 13:32:48.877001 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.875878 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng827\" (UniqueName: \"kubernetes.io/projected/03d93714-6cee-4e26-baa2-4206ac504233-kube-api-access-ng827\") pod \"aws-ebs-csi-driver-node-z5dbb\" (UID: \"03d93714-6cee-4e26-baa2-4206ac504233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5dbb" Jun 14 13:32:48.877001 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.875908 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-var-lib-openvswitch\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.877001 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.875938 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/08819fe4-b654-44d1-9773-a007a6044ec2-env-overrides\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.877001 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.875969 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-host-run-k8s-cni-cncf-io\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.877001 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.875986 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d2ff2189-8eba-41f8-a401-e8384449247f-konnectivity-ca\") pod \"konnectivity-agent-7x8bl\" (UID: \"d2ff2189-8eba-41f8-a401-e8384449247f\") " pod="kube-system/konnectivity-agent-7x8bl" Jun 14 13:32:48.877001 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.876002 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-host-var-lib-cni-multus\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.877001 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.876039 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-host-run-netns\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.877001 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.876207 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-system-cni-dir\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.877001 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.876221 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/08819fe4-b654-44d1-9773-a007a6044ec2-ovnkube-config\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.877001 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.876283 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-multus-socket-dir-parent\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.877824 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.876299 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/03d93714-6cee-4e26-baa2-4206ac504233-registration-dir\") pod \"aws-ebs-csi-driver-node-z5dbb\" (UID: \"03d93714-6cee-4e26-baa2-4206ac504233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5dbb" Jun 14 13:32:48.877824 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.876362 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-host-slash\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.877824 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.876352 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-host-cni-netd\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.877824 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.876431 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9a92ad1-c2f3-4fc4-a168-5ac8ba34c07b-host-slash\") pod \"iptables-alerter-dx6mn\" (UID: \"d9a92ad1-c2f3-4fc4-a168-5ac8ba34c07b\") " pod="openshift-network-operator/iptables-alerter-dx6mn" Jun 14 13:32:48.877824 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.876696 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-cni-binary-copy\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.877824 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.876770 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-host-run-k8s-cni-cncf-io\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.877824 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.876824 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-host-var-lib-cni-multus\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.877824 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.876843 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/08819fe4-b654-44d1-9773-a007a6044ec2-env-overrides\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.877824 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.876876 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-multus-daemon-config\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.877824 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.876884 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-host-run-netns\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.877824 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.876943 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-node-log\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.877824 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.877006 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08819fe4-b654-44d1-9773-a007a6044ec2-var-lib-openvswitch\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.877824 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.877250 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/08819fe4-b654-44d1-9773-a007a6044ec2-ovn-node-metrics-cert\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.877824 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.877614 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d2ff2189-8eba-41f8-a401-e8384449247f-agent-certs\") pod \"konnectivity-agent-7x8bl\" (UID: \"d2ff2189-8eba-41f8-a401-e8384449247f\") " pod="kube-system/konnectivity-agent-7x8bl" Jun 14 13:32:48.887720 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.887671 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpnsc\" (UniqueName: \"kubernetes.io/projected/6cb96268-7f2e-421e-9e23-c22d5d10bd0d-kube-api-access-lpnsc\") pod \"multus-mblwf\" (UID: \"6cb96268-7f2e-421e-9e23-c22d5d10bd0d\") " pod="openshift-multus/multus-mblwf" Jun 14 13:32:48.887940 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.887923 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-th58f\" (UniqueName: \"kubernetes.io/projected/08819fe4-b654-44d1-9773-a007a6044ec2-kube-api-access-th58f\") pod \"ovnkube-node-dqj5p\" (UID: \"08819fe4-b654-44d1-9773-a007a6044ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:48.888197 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.888181 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnqbp\" (UniqueName: \"kubernetes.io/projected/d9a92ad1-c2f3-4fc4-a168-5ac8ba34c07b-kube-api-access-hnqbp\") pod \"iptables-alerter-dx6mn\" (UID: \"d9a92ad1-c2f3-4fc4-a168-5ac8ba34c07b\") " pod="openshift-network-operator/iptables-alerter-dx6mn" Jun 14 13:32:48.888471 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.888454 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng827\" (UniqueName: \"kubernetes.io/projected/03d93714-6cee-4e26-baa2-4206ac504233-kube-api-access-ng827\") pod \"aws-ebs-csi-driver-node-z5dbb\" (UID: \"03d93714-6cee-4e26-baa2-4206ac504233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5dbb" Jun 14 13:32:48.985745 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.985671 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vhpwp" Jun 14 13:32:48.991656 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:48.991636 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9x9kd" Jun 14 13:32:48.996002 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:48.995979 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe7e69d3_6286_4f5c_a895_51baff1834b8.slice/crio-15ca0403332971a0cc3d0332246b18432d45b7d170c258d0851292410f9ca57e WatchSource:0}: Error finding container 15ca0403332971a0cc3d0332246b18432d45b7d170c258d0851292410f9ca57e: Status 404 returned error can't find the container with id 15ca0403332971a0cc3d0332246b18432d45b7d170c258d0851292410f9ca57e Jun 14 13:32:49.000944 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:49.000922 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01786353_4e34_48af_90ce_aea4533819b1.slice/crio-ac07c33d8f1e5f861fa7f1dc2b3c082dd0b06133ea81a2663db69c8adc6318e0 WatchSource:0}: Error finding container ac07c33d8f1e5f861fa7f1dc2b3c082dd0b06133ea81a2663db69c8adc6318e0: Status 404 returned error can't find the container with id ac07c33d8f1e5f861fa7f1dc2b3c082dd0b06133ea81a2663db69c8adc6318e0 Jun 14 13:32:49.005992 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:49.005973 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" Jun 14 13:32:49.016368 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:49.016347 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod540cb96e_de34_405b_bfea_463cfeead99c.slice/crio-35c907490a57f803a1322d789919b2686dcc494f52bbc2c11bf2ef5acd7f8228 WatchSource:0}: Error finding container 35c907490a57f803a1322d789919b2686dcc494f52bbc2c11bf2ef5acd7f8228: Status 404 returned error can't find the container with id 35c907490a57f803a1322d789919b2686dcc494f52bbc2c11bf2ef5acd7f8228 Jun 14 13:32:49.025449 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:49.025427 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hcsvf" Jun 14 13:32:49.033145 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:49.033126 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31339707_4ec8_4cbb_8014_695a9f156efa.slice/crio-821b4693bb496a382a662b9612ac03e0807bf87b42e6006037b6af87f03493bd WatchSource:0}: Error finding container 821b4693bb496a382a662b9612ac03e0807bf87b42e6006037b6af87f03493bd: Status 404 returned error can't find the container with id 821b4693bb496a382a662b9612ac03e0807bf87b42e6006037b6af87f03493bd Jun 14 13:32:49.042968 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:49.042950 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5dbb" Jun 14 13:32:49.050646 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:49.050625 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03d93714_6cee_4e26_baa2_4206ac504233.slice/crio-20f9d7911a02bca525439a992e1510d6546e307bba753516f72157d976c82b97 WatchSource:0}: Error finding container 20f9d7911a02bca525439a992e1510d6546e307bba753516f72157d976c82b97: Status 404 returned error can't find the container with id 20f9d7911a02bca525439a992e1510d6546e307bba753516f72157d976c82b97 Jun 14 13:32:49.054466 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:49.054449 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mblwf" Jun 14 13:32:49.061499 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:49.061482 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:32:49.062995 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:49.062978 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cb96268_7f2e_421e_9e23_c22d5d10bd0d.slice/crio-0d94fa74174851522f145b98dd30b4179173cec3627a9d4ca268a03b286aefec WatchSource:0}: Error finding container 0d94fa74174851522f145b98dd30b4179173cec3627a9d4ca268a03b286aefec: Status 404 returned error can't find the container with id 0d94fa74174851522f145b98dd30b4179173cec3627a9d4ca268a03b286aefec Jun 14 13:32:49.069255 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:49.069235 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08819fe4_b654_44d1_9773_a007a6044ec2.slice/crio-df60e80d977ac943d8b42b41b3afecbca2d007ffab34646964e1cd490ccea6b7 WatchSource:0}: Error finding container df60e80d977ac943d8b42b41b3afecbca2d007ffab34646964e1cd490ccea6b7: Status 404 returned error can't find the container with id df60e80d977ac943d8b42b41b3afecbca2d007ffab34646964e1cd490ccea6b7 Jun 14 13:32:49.074901 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:49.074885 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7x8bl" Jun 14 13:32:49.083722 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:49.083697 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2ff2189_8eba_41f8_a401_e8384449247f.slice/crio-7a7598b9e1d123da4e7cfe2c73918764c8afd5b0dffd7f770841b0733675fdd3 WatchSource:0}: Error finding container 7a7598b9e1d123da4e7cfe2c73918764c8afd5b0dffd7f770841b0733675fdd3: Status 404 returned error can't find the container with id 7a7598b9e1d123da4e7cfe2c73918764c8afd5b0dffd7f770841b0733675fdd3 Jun 14 13:32:49.089849 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:49.089833 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dx6mn" Jun 14 13:32:49.097491 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:32:49.097472 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9a92ad1_c2f3_4fc4_a168_5ac8ba34c07b.slice/crio-af3e07b63cd9ec36e23aaa1989e9a8b9126f1957c21585b81e921b0cf7cd1132 WatchSource:0}: Error finding container af3e07b63cd9ec36e23aaa1989e9a8b9126f1957c21585b81e921b0cf7cd1132: Status 404 returned error can't find the container with id af3e07b63cd9ec36e23aaa1989e9a8b9126f1957c21585b81e921b0cf7cd1132 Jun 14 13:32:49.278664 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:49.278588 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5cff939-d984-4037-9dbb-2f4bbf3a6073-metrics-certs\") pod \"network-metrics-daemon-xq27q\" (UID: \"a5cff939-d984-4037-9dbb-2f4bbf3a6073\") " pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:32:49.278796 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:49.278735 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 13:32:49.278796 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:49.278790 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5cff939-d984-4037-9dbb-2f4bbf3a6073-metrics-certs podName:a5cff939-d984-4037-9dbb-2f4bbf3a6073 nodeName:}" failed. No retries permitted until 2026-06-14 13:32:50.278775954 +0000 UTC m=+2.952043878 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5cff939-d984-4037-9dbb-2f4bbf3a6073-metrics-certs") pod "network-metrics-daemon-xq27q" (UID: "a5cff939-d984-4037-9dbb-2f4bbf3a6073") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 13:32:49.379422 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:49.379375 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plhkq\" (UniqueName: \"kubernetes.io/projected/881168eb-b04c-4047-b61e-38c07200a455-kube-api-access-plhkq\") pod \"network-check-target-lhzpp\" (UID: \"881168eb-b04c-4047-b61e-38c07200a455\") " pod="openshift-network-diagnostics/network-check-target-lhzpp" Jun 14 13:32:49.379580 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:49.379477 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/303004c7-a3eb-4fb8-9008-5aef0795ab73-original-pull-secret\") pod \"global-pull-secret-syncer-6swkj\" (UID: \"303004c7-a3eb-4fb8-9008-5aef0795ab73\") " pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:32:49.379648 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:49.379594 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 13:32:49.379719 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:49.379665 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/303004c7-a3eb-4fb8-9008-5aef0795ab73-original-pull-secret podName:303004c7-a3eb-4fb8-9008-5aef0795ab73 nodeName:}" failed. No retries permitted until 2026-06-14 13:32:50.379633294 +0000 UTC m=+3.052901242 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/303004c7-a3eb-4fb8-9008-5aef0795ab73-original-pull-secret") pod "global-pull-secret-syncer-6swkj" (UID: "303004c7-a3eb-4fb8-9008-5aef0795ab73") : object "kube-system"/"original-pull-secret" not registered Jun 14 13:32:49.379808 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:49.379786 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 13:32:49.379874 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:49.379817 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 13:32:49.379874 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:49.379831 2557 projected.go:196] Error preparing data for projected volume kube-api-access-plhkq for pod openshift-network-diagnostics/network-check-target-lhzpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 13:32:49.379974 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:49.379890 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/881168eb-b04c-4047-b61e-38c07200a455-kube-api-access-plhkq podName:881168eb-b04c-4047-b61e-38c07200a455 nodeName:}" failed. No retries permitted until 2026-06-14 13:32:50.379871687 +0000 UTC m=+3.053139628 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-plhkq" (UniqueName: "kubernetes.io/projected/881168eb-b04c-4047-b61e-38c07200a455-kube-api-access-plhkq") pod "network-check-target-lhzpp" (UID: "881168eb-b04c-4047-b61e-38c07200a455") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 13:32:49.555557 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:49.555469 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 13:32:49.712463 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:49.711948 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 13:27:48 +0000 UTC" deadline="2027-11-24 16:52:00.277562091 +0000 UTC" Jun 14 13:32:49.712463 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:49.712009 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12675h19m10.565558696s" Jun 14 13:32:49.777973 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:49.777676 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mblwf" event={"ID":"6cb96268-7f2e-421e-9e23-c22d5d10bd0d","Type":"ContainerStarted","Data":"0d94fa74174851522f145b98dd30b4179173cec3627a9d4ca268a03b286aefec"} Jun 14 13:32:49.795984 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:49.785030 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5dbb" event={"ID":"03d93714-6cee-4e26-baa2-4206ac504233","Type":"ContainerStarted","Data":"20f9d7911a02bca525439a992e1510d6546e307bba753516f72157d976c82b97"} Jun 14 13:32:49.795984 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:49.795613 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hcsvf" event={"ID":"31339707-4ec8-4cbb-8014-695a9f156efa","Type":"ContainerStarted","Data":"821b4693bb496a382a662b9612ac03e0807bf87b42e6006037b6af87f03493bd"} Jun 14 13:32:49.815121 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:49.815041 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-48.ec2.internal" event={"ID":"1f8d5b9457c4cf20b7d985158db08cef","Type":"ContainerStarted","Data":"ebe119eb4919763bde8bfc5f6b52d12f868eec630ba42b6225794b61a12e173b"} Jun 14 13:32:49.834706 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:49.834605 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dx6mn" event={"ID":"d9a92ad1-c2f3-4fc4-a168-5ac8ba34c07b","Type":"ContainerStarted","Data":"af3e07b63cd9ec36e23aaa1989e9a8b9126f1957c21585b81e921b0cf7cd1132"} Jun 14 13:32:49.843926 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:49.843891 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7x8bl" event={"ID":"d2ff2189-8eba-41f8-a401-e8384449247f","Type":"ContainerStarted","Data":"7a7598b9e1d123da4e7cfe2c73918764c8afd5b0dffd7f770841b0733675fdd3"} Jun 14 13:32:49.874402 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:49.874292 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" event={"ID":"08819fe4-b654-44d1-9773-a007a6044ec2","Type":"ContainerStarted","Data":"df60e80d977ac943d8b42b41b3afecbca2d007ffab34646964e1cd490ccea6b7"} Jun 14 13:32:49.899608 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:49.899570 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" event={"ID":"540cb96e-de34-405b-bfea-463cfeead99c","Type":"ContainerStarted","Data":"35c907490a57f803a1322d789919b2686dcc494f52bbc2c11bf2ef5acd7f8228"} Jun 14 13:32:49.922266 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:49.922216 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9x9kd" event={"ID":"01786353-4e34-48af-90ce-aea4533819b1","Type":"ContainerStarted","Data":"ac07c33d8f1e5f861fa7f1dc2b3c082dd0b06133ea81a2663db69c8adc6318e0"} Jun 14 13:32:49.949111 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:49.949020 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vhpwp" event={"ID":"be7e69d3-6286-4f5c-a895-51baff1834b8","Type":"ContainerStarted","Data":"15ca0403332971a0cc3d0332246b18432d45b7d170c258d0851292410f9ca57e"} Jun 14 13:32:49.960140 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:49.960065 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal" event={"ID":"5347bab5c0151c1c15069d4f37484c09","Type":"ContainerStarted","Data":"03a1e14a73849beac526c188e1f8c66250384e8454732fae972e9921ccec82bf"} Jun 14 13:32:50.288568 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:50.288526 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5cff939-d984-4037-9dbb-2f4bbf3a6073-metrics-certs\") pod \"network-metrics-daemon-xq27q\" (UID: \"a5cff939-d984-4037-9dbb-2f4bbf3a6073\") " pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:32:50.288816 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:50.288748 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 13:32:50.288816 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:50.288812 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5cff939-d984-4037-9dbb-2f4bbf3a6073-metrics-certs podName:a5cff939-d984-4037-9dbb-2f4bbf3a6073 nodeName:}" failed. No retries permitted until 2026-06-14 13:32:52.288793895 +0000 UTC m=+4.962061833 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5cff939-d984-4037-9dbb-2f4bbf3a6073-metrics-certs") pod "network-metrics-daemon-xq27q" (UID: "a5cff939-d984-4037-9dbb-2f4bbf3a6073") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 13:32:50.390746 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:50.389709 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/303004c7-a3eb-4fb8-9008-5aef0795ab73-original-pull-secret\") pod \"global-pull-secret-syncer-6swkj\" (UID: \"303004c7-a3eb-4fb8-9008-5aef0795ab73\") " pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:32:50.390746 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:50.389779 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plhkq\" (UniqueName: \"kubernetes.io/projected/881168eb-b04c-4047-b61e-38c07200a455-kube-api-access-plhkq\") pod \"network-check-target-lhzpp\" (UID: \"881168eb-b04c-4047-b61e-38c07200a455\") " pod="openshift-network-diagnostics/network-check-target-lhzpp" Jun 14 13:32:50.390746 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:50.390072 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 13:32:50.390746 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:50.390092 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 13:32:50.390746 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:50.390126 2557 projected.go:196] Error preparing data for projected volume kube-api-access-plhkq for pod openshift-network-diagnostics/network-check-target-lhzpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 13:32:50.390746 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:50.390204 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/881168eb-b04c-4047-b61e-38c07200a455-kube-api-access-plhkq podName:881168eb-b04c-4047-b61e-38c07200a455 nodeName:}" failed. No retries permitted until 2026-06-14 13:32:52.390185656 +0000 UTC m=+5.063453600 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-plhkq" (UniqueName: "kubernetes.io/projected/881168eb-b04c-4047-b61e-38c07200a455-kube-api-access-plhkq") pod "network-check-target-lhzpp" (UID: "881168eb-b04c-4047-b61e-38c07200a455") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 13:32:50.390746 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:50.390635 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 13:32:50.390746 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:50.390698 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/303004c7-a3eb-4fb8-9008-5aef0795ab73-original-pull-secret podName:303004c7-a3eb-4fb8-9008-5aef0795ab73 nodeName:}" failed. No retries permitted until 2026-06-14 13:32:52.390668963 +0000 UTC m=+5.063936891 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/303004c7-a3eb-4fb8-9008-5aef0795ab73-original-pull-secret") pod "global-pull-secret-syncer-6swkj" (UID: "303004c7-a3eb-4fb8-9008-5aef0795ab73") : object "kube-system"/"original-pull-secret" not registered Jun 14 13:32:50.712896 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:50.712853 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 13:27:48 +0000 UTC" deadline="2027-11-11 11:30:46.193736174 +0000 UTC" Jun 14 13:32:50.712896 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:50.712895 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12357h57m55.480846018s" Jun 14 13:32:50.728389 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:50.728360 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:32:50.728651 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:50.728616 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6swkj" podUID="303004c7-a3eb-4fb8-9008-5aef0795ab73" Jun 14 13:32:50.728778 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:50.728762 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:32:50.728894 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:50.728859 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq27q" podUID="a5cff939-d984-4037-9dbb-2f4bbf3a6073" Jun 14 13:32:50.728969 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:50.728943 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lhzpp" Jun 14 13:32:50.729033 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:50.729011 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lhzpp" podUID="881168eb-b04c-4047-b61e-38c07200a455" Jun 14 13:32:52.307408 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:52.307365 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5cff939-d984-4037-9dbb-2f4bbf3a6073-metrics-certs\") pod \"network-metrics-daemon-xq27q\" (UID: \"a5cff939-d984-4037-9dbb-2f4bbf3a6073\") " pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:32:52.307894 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:52.307531 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 13:32:52.307894 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:52.307597 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5cff939-d984-4037-9dbb-2f4bbf3a6073-metrics-certs podName:a5cff939-d984-4037-9dbb-2f4bbf3a6073 nodeName:}" failed. No retries permitted until 2026-06-14 13:32:56.307578747 +0000 UTC m=+8.980846688 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5cff939-d984-4037-9dbb-2f4bbf3a6073-metrics-certs") pod "network-metrics-daemon-xq27q" (UID: "a5cff939-d984-4037-9dbb-2f4bbf3a6073") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 13:32:52.408817 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:52.408774 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/303004c7-a3eb-4fb8-9008-5aef0795ab73-original-pull-secret\") pod \"global-pull-secret-syncer-6swkj\" (UID: \"303004c7-a3eb-4fb8-9008-5aef0795ab73\") " pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:32:52.408991 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:52.408848 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plhkq\" (UniqueName: \"kubernetes.io/projected/881168eb-b04c-4047-b61e-38c07200a455-kube-api-access-plhkq\") pod \"network-check-target-lhzpp\" (UID: \"881168eb-b04c-4047-b61e-38c07200a455\") " pod="openshift-network-diagnostics/network-check-target-lhzpp" Jun 14 13:32:52.409055 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:52.409018 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 13:32:52.409055 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:52.409035 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 13:32:52.409055 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:52.409048 2557 projected.go:196] Error preparing data for projected volume kube-api-access-plhkq for pod openshift-network-diagnostics/network-check-target-lhzpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 13:32:52.409202 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:52.409110 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/881168eb-b04c-4047-b61e-38c07200a455-kube-api-access-plhkq podName:881168eb-b04c-4047-b61e-38c07200a455 nodeName:}" failed. No retries permitted until 2026-06-14 13:32:56.409089913 +0000 UTC m=+9.082357856 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-plhkq" (UniqueName: "kubernetes.io/projected/881168eb-b04c-4047-b61e-38c07200a455-kube-api-access-plhkq") pod "network-check-target-lhzpp" (UID: "881168eb-b04c-4047-b61e-38c07200a455") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 13:32:52.409525 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:52.409507 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 13:32:52.409627 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:52.409556 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/303004c7-a3eb-4fb8-9008-5aef0795ab73-original-pull-secret podName:303004c7-a3eb-4fb8-9008-5aef0795ab73 nodeName:}" failed. No retries permitted until 2026-06-14 13:32:56.409542281 +0000 UTC m=+9.082810207 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/303004c7-a3eb-4fb8-9008-5aef0795ab73-original-pull-secret") pod "global-pull-secret-syncer-6swkj" (UID: "303004c7-a3eb-4fb8-9008-5aef0795ab73") : object "kube-system"/"original-pull-secret" not registered Jun 14 13:32:52.728616 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:52.728380 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lhzpp" Jun 14 13:32:52.728616 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:52.728388 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:32:52.728616 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:52.728498 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lhzpp" podUID="881168eb-b04c-4047-b61e-38c07200a455" Jun 14 13:32:52.728616 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:52.728528 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:32:52.729292 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:52.728632 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6swkj" podUID="303004c7-a3eb-4fb8-9008-5aef0795ab73" Jun 14 13:32:52.729292 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:52.728733 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq27q" podUID="a5cff939-d984-4037-9dbb-2f4bbf3a6073" Jun 14 13:32:54.728708 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:54.728643 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lhzpp" Jun 14 13:32:54.729170 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:54.728715 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:32:54.729170 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:54.728848 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq27q" podUID="a5cff939-d984-4037-9dbb-2f4bbf3a6073" Jun 14 13:32:54.729170 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:54.728715 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:32:54.729170 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:54.729103 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6swkj" podUID="303004c7-a3eb-4fb8-9008-5aef0795ab73" Jun 14 13:32:54.729386 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:54.729232 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lhzpp" podUID="881168eb-b04c-4047-b61e-38c07200a455" Jun 14 13:32:56.338555 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:56.338516 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5cff939-d984-4037-9dbb-2f4bbf3a6073-metrics-certs\") pod \"network-metrics-daemon-xq27q\" (UID: \"a5cff939-d984-4037-9dbb-2f4bbf3a6073\") " pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:32:56.339031 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:56.338710 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 13:32:56.339031 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:56.338784 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5cff939-d984-4037-9dbb-2f4bbf3a6073-metrics-certs podName:a5cff939-d984-4037-9dbb-2f4bbf3a6073 nodeName:}" failed. No retries permitted until 2026-06-14 13:33:04.338765086 +0000 UTC m=+17.012033023 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5cff939-d984-4037-9dbb-2f4bbf3a6073-metrics-certs") pod "network-metrics-daemon-xq27q" (UID: "a5cff939-d984-4037-9dbb-2f4bbf3a6073") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 13:32:56.439631 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:56.439588 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plhkq\" (UniqueName: \"kubernetes.io/projected/881168eb-b04c-4047-b61e-38c07200a455-kube-api-access-plhkq\") pod \"network-check-target-lhzpp\" (UID: \"881168eb-b04c-4047-b61e-38c07200a455\") " pod="openshift-network-diagnostics/network-check-target-lhzpp" Jun 14 13:32:56.439831 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:56.439700 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/303004c7-a3eb-4fb8-9008-5aef0795ab73-original-pull-secret\") pod \"global-pull-secret-syncer-6swkj\" (UID: \"303004c7-a3eb-4fb8-9008-5aef0795ab73\") " pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:32:56.439831 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:56.439804 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 13:32:56.439831 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:56.439827 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 13:32:56.439831 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:56.439833 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 13:32:56.440045 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:56.439848 2557 projected.go:196] Error preparing data for projected volume kube-api-access-plhkq for pod openshift-network-diagnostics/network-check-target-lhzpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 13:32:56.440045 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:56.439888 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/303004c7-a3eb-4fb8-9008-5aef0795ab73-original-pull-secret podName:303004c7-a3eb-4fb8-9008-5aef0795ab73 nodeName:}" failed. No retries permitted until 2026-06-14 13:33:04.439870599 +0000 UTC m=+17.113138540 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/303004c7-a3eb-4fb8-9008-5aef0795ab73-original-pull-secret") pod "global-pull-secret-syncer-6swkj" (UID: "303004c7-a3eb-4fb8-9008-5aef0795ab73") : object "kube-system"/"original-pull-secret" not registered Jun 14 13:32:56.440045 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:56.439908 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/881168eb-b04c-4047-b61e-38c07200a455-kube-api-access-plhkq podName:881168eb-b04c-4047-b61e-38c07200a455 nodeName:}" failed. No retries permitted until 2026-06-14 13:33:04.439898902 +0000 UTC m=+17.113166828 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-plhkq" (UniqueName: "kubernetes.io/projected/881168eb-b04c-4047-b61e-38c07200a455-kube-api-access-plhkq") pod "network-check-target-lhzpp" (UID: "881168eb-b04c-4047-b61e-38c07200a455") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 13:32:56.728897 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:56.728821 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lhzpp" Jun 14 13:32:56.729084 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:56.728964 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lhzpp" podUID="881168eb-b04c-4047-b61e-38c07200a455" Jun 14 13:32:56.729278 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:56.729249 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:32:56.729406 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:56.729318 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:32:56.729475 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:56.729423 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq27q" podUID="a5cff939-d984-4037-9dbb-2f4bbf3a6073" Jun 14 13:32:56.729531 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:56.729512 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6swkj" podUID="303004c7-a3eb-4fb8-9008-5aef0795ab73" Jun 14 13:32:58.728671 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:58.728409 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lhzpp" Jun 14 13:32:58.729162 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:58.728445 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:32:58.729162 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:32:58.728446 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:32:58.729162 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:58.728793 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lhzpp" podUID="881168eb-b04c-4047-b61e-38c07200a455" Jun 14 13:32:58.729162 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:58.728875 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6swkj" podUID="303004c7-a3eb-4fb8-9008-5aef0795ab73" Jun 14 13:32:58.729162 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:32:58.728961 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq27q" podUID="a5cff939-d984-4037-9dbb-2f4bbf3a6073" Jun 14 13:33:00.728210 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:00.728126 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:33:00.728210 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:00.728126 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:33:00.728210 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:00.728131 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lhzpp" Jun 14 13:33:00.728756 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:00.728249 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6swkj" podUID="303004c7-a3eb-4fb8-9008-5aef0795ab73" Jun 14 13:33:00.728756 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:00.728323 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lhzpp" podUID="881168eb-b04c-4047-b61e-38c07200a455" Jun 14 13:33:00.728756 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:00.728428 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq27q" podUID="a5cff939-d984-4037-9dbb-2f4bbf3a6073" Jun 14 13:33:02.728519 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:02.728481 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lhzpp" Jun 14 13:33:02.729015 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:02.728602 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:33:02.729015 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:02.728611 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lhzpp" podUID="881168eb-b04c-4047-b61e-38c07200a455" Jun 14 13:33:02.729015 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:02.728752 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq27q" podUID="a5cff939-d984-4037-9dbb-2f4bbf3a6073" Jun 14 13:33:02.729015 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:02.728626 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:33:02.729015 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:02.728842 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6swkj" podUID="303004c7-a3eb-4fb8-9008-5aef0795ab73" Jun 14 13:33:04.401463 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:04.401433 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5cff939-d984-4037-9dbb-2f4bbf3a6073-metrics-certs\") pod \"network-metrics-daemon-xq27q\" (UID: \"a5cff939-d984-4037-9dbb-2f4bbf3a6073\") " pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:33:04.401926 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:04.401599 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 13:33:04.401926 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:04.401671 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5cff939-d984-4037-9dbb-2f4bbf3a6073-metrics-certs podName:a5cff939-d984-4037-9dbb-2f4bbf3a6073 nodeName:}" failed. No retries permitted until 2026-06-14 13:33:20.401650384 +0000 UTC m=+33.074918315 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5cff939-d984-4037-9dbb-2f4bbf3a6073-metrics-certs") pod "network-metrics-daemon-xq27q" (UID: "a5cff939-d984-4037-9dbb-2f4bbf3a6073") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 13:33:04.502594 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:04.502502 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plhkq\" (UniqueName: \"kubernetes.io/projected/881168eb-b04c-4047-b61e-38c07200a455-kube-api-access-plhkq\") pod \"network-check-target-lhzpp\" (UID: \"881168eb-b04c-4047-b61e-38c07200a455\") " pod="openshift-network-diagnostics/network-check-target-lhzpp" Jun 14 13:33:04.502765 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:04.502702 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 13:33:04.502765 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:04.502727 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 13:33:04.502765 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:04.502738 2557 projected.go:196] Error preparing data for projected volume kube-api-access-plhkq for pod openshift-network-diagnostics/network-check-target-lhzpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 13:33:04.502930 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:04.502704 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/303004c7-a3eb-4fb8-9008-5aef0795ab73-original-pull-secret\") pod \"global-pull-secret-syncer-6swkj\" (UID: \"303004c7-a3eb-4fb8-9008-5aef0795ab73\") " pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:33:04.502930 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:04.502798 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/881168eb-b04c-4047-b61e-38c07200a455-kube-api-access-plhkq podName:881168eb-b04c-4047-b61e-38c07200a455 nodeName:}" failed. No retries permitted until 2026-06-14 13:33:20.502780183 +0000 UTC m=+33.176048130 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-plhkq" (UniqueName: "kubernetes.io/projected/881168eb-b04c-4047-b61e-38c07200a455-kube-api-access-plhkq") pod "network-check-target-lhzpp" (UID: "881168eb-b04c-4047-b61e-38c07200a455") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 13:33:04.502930 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:04.502802 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 13:33:04.502930 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:04.502864 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/303004c7-a3eb-4fb8-9008-5aef0795ab73-original-pull-secret podName:303004c7-a3eb-4fb8-9008-5aef0795ab73 nodeName:}" failed. No retries permitted until 2026-06-14 13:33:20.502849754 +0000 UTC m=+33.176117681 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/303004c7-a3eb-4fb8-9008-5aef0795ab73-original-pull-secret") pod "global-pull-secret-syncer-6swkj" (UID: "303004c7-a3eb-4fb8-9008-5aef0795ab73") : object "kube-system"/"original-pull-secret" not registered Jun 14 13:33:04.728548 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:04.728514 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:33:04.728757 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:04.728640 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:33:04.728757 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:04.728649 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6swkj" podUID="303004c7-a3eb-4fb8-9008-5aef0795ab73" Jun 14 13:33:04.728757 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:04.728694 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lhzpp" Jun 14 13:33:04.728911 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:04.728798 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq27q" podUID="a5cff939-d984-4037-9dbb-2f4bbf3a6073" Jun 14 13:33:04.728911 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:04.728887 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lhzpp" podUID="881168eb-b04c-4047-b61e-38c07200a455" Jun 14 13:33:06.728665 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:06.728635 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:33:06.728665 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:06.728669 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:33:06.729172 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:06.728635 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lhzpp" Jun 14 13:33:06.729172 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:06.728773 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6swkj" podUID="303004c7-a3eb-4fb8-9008-5aef0795ab73" Jun 14 13:33:06.729172 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:06.728900 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lhzpp" podUID="881168eb-b04c-4047-b61e-38c07200a455" Jun 14 13:33:06.729172 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:06.729002 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq27q" podUID="a5cff939-d984-4037-9dbb-2f4bbf3a6073" Jun 14 13:33:08.728949 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:08.728927 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:33:08.729218 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:08.729028 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:33:08.729218 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:08.729042 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6swkj" podUID="303004c7-a3eb-4fb8-9008-5aef0795ab73" Jun 14 13:33:08.729218 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:08.729054 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lhzpp" Jun 14 13:33:08.729218 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:08.729137 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq27q" podUID="a5cff939-d984-4037-9dbb-2f4bbf3a6073" Jun 14 13:33:08.729218 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:08.729199 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lhzpp" podUID="881168eb-b04c-4047-b61e-38c07200a455" Jun 14 13:33:09.019868 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:09.019834 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-48.ec2.internal" event={"ID":"1f8d5b9457c4cf20b7d985158db08cef","Type":"ContainerStarted","Data":"6ab8dd79319cb9b6d82133bf903a4442cd9cce3849caba73497b7e17aab82b2f"} Jun 14 13:33:09.021449 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:09.021427 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" event={"ID":"08819fe4-b654-44d1-9773-a007a6044ec2","Type":"ContainerStarted","Data":"d01d02d8123400585e72bac4be5adc8baf7f30f045738e68074c0a06c3571111"} Jun 14 13:33:09.022865 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:09.022840 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" event={"ID":"540cb96e-de34-405b-bfea-463cfeead99c","Type":"ContainerStarted","Data":"9529127be0c4129ad3f7e2746952d184de3a613898d4273657a32059941f93b7"} Jun 14 13:33:09.024360 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:09.024339 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mblwf" event={"ID":"6cb96268-7f2e-421e-9e23-c22d5d10bd0d","Type":"ContainerStarted","Data":"49a612fe8b82ba7a35b4b310069daad778e52a4ab9332b234d00cc60c99bb1af"} Jun 14 13:33:09.034107 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:09.034068 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-48.ec2.internal" podStartSLOduration=21.034054445 podStartE2EDuration="21.034054445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 13:32:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:33:09.033452618 +0000 UTC m=+21.706720564" watchObservedRunningTime="2026-06-14 13:33:09.034054445 +0000 UTC m=+21.707322390" Jun 14 13:33:09.072894 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:09.071630 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6gf6j" podStartSLOduration=2.502973832 podStartE2EDuration="22.07160989s" totalImagesPullingTime="19.568636058s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 13:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:33:09.050599545 +0000 UTC m=+21.723867495" watchObservedRunningTime="2026-06-14 13:33:09.07160989 +0000 UTC m=+21.744877838" Jun 14 13:33:09.073016 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:09.072979 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mblwf" podStartSLOduration=1.51900608 podStartE2EDuration="21.072966603s" totalImagesPullingTime="19.553960523s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 13:32:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:33:09.070960742 +0000 UTC m=+21.744228688" watchObservedRunningTime="2026-06-14 13:33:09.072966603 +0000 UTC m=+21.746234564" Jun 14 13:33:10.027870 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:10.027548 2557 generic.go:356] "Generic (PLEG): container finished" podID="01786353-4e34-48af-90ce-aea4533819b1" containerID="b4f62b4794fba7c722e6d18a3bea09c6d82af73a49e1cc4c37804360b3e5bcc4" exitCode=0 Jun 14 13:33:10.028587 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:10.027631 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9x9kd" event={"ID":"01786353-4e34-48af-90ce-aea4533819b1","Type":"ContainerDied","Data":"b4f62b4794fba7c722e6d18a3bea09c6d82af73a49e1cc4c37804360b3e5bcc4"} Jun 14 13:33:10.029482 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:10.029455 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vhpwp" event={"ID":"be7e69d3-6286-4f5c-a895-51baff1834b8","Type":"ContainerStarted","Data":"7a80686a1bca90e5ed4407cff8a24fc121f0018c3299e5c410cf1d4c0a2583d4"} Jun 14 13:33:10.030857 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:10.030833 2557 generic.go:356] "Generic (PLEG): container finished" podID="5347bab5c0151c1c15069d4f37484c09" containerID="f9fa2e23dd8c6850ec63c6ddd9c38cfec7f839bab84828412d19e666271ad0ba" exitCode=0 Jun 14 13:33:10.030957 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:10.030904 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal" event={"ID":"5347bab5c0151c1c15069d4f37484c09","Type":"ContainerDied","Data":"f9fa2e23dd8c6850ec63c6ddd9c38cfec7f839bab84828412d19e666271ad0ba"} Jun 14 13:33:10.032338 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:10.032316 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5dbb" event={"ID":"03d93714-6cee-4e26-baa2-4206ac504233","Type":"ContainerStarted","Data":"935f46f7fc2b5607b662c641e59e803582b6d626e8a8bd3d7d602cbe7776fd20"} Jun 14 13:33:10.033869 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:10.033843 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hcsvf" event={"ID":"31339707-4ec8-4cbb-8014-695a9f156efa","Type":"ContainerStarted","Data":"cb41f4c8494f42fc2433adc26fc41bdf4c0567f2a2445fa602290b304f5c9124"} Jun 14 13:33:10.035109 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:10.035091 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dx6mn" event={"ID":"d9a92ad1-c2f3-4fc4-a168-5ac8ba34c07b","Type":"ContainerStarted","Data":"b859d8e735d9f32eee101c9dd708e0ca0b8395dccd5b3e59f07157760d1ee87e"} Jun 14 13:33:10.036311 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:10.036292 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7x8bl" event={"ID":"d2ff2189-8eba-41f8-a401-e8384449247f","Type":"ContainerStarted","Data":"c4c69a07dc9bb3bc3130b5921dcc5540a42b442ac7fc7f41e5725675e1971c18"} Jun 14 13:33:10.038919 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:10.038904 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqj5p_08819fe4-b654-44d1-9773-a007a6044ec2/ovn-acl-logging/0.log" Jun 14 13:33:10.039224 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:10.039207 2557 generic.go:356] "Generic (PLEG): container finished" podID="08819fe4-b654-44d1-9773-a007a6044ec2" containerID="3b7424b350bfae697a4f88fb6bcd2ef921b39a95c15c4fe1779b2085349dff63" exitCode=1 Jun 14 13:33:10.039303 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:10.039285 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" event={"ID":"08819fe4-b654-44d1-9773-a007a6044ec2","Type":"ContainerStarted","Data":"234d47409aac0dd37be12ee407993a0ecc8971f007bfad2e9fd55bd9f45371a8"} Jun 14 13:33:10.039357 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:10.039346 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" event={"ID":"08819fe4-b654-44d1-9773-a007a6044ec2","Type":"ContainerStarted","Data":"b87c730cb657a9fbf61ac475a3c6e619e2d1deb8d953a9967463a65eedc6e565"} Jun 14 13:33:10.039390 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:10.039380 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" event={"ID":"08819fe4-b654-44d1-9773-a007a6044ec2","Type":"ContainerStarted","Data":"a7d41dc78b47af7f252603c9ba97337586916491ce77ae7cb888935bd08d4a98"} Jun 14 13:33:10.039426 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:10.039416 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" event={"ID":"08819fe4-b654-44d1-9773-a007a6044ec2","Type":"ContainerStarted","Data":"367b07be7d0c3720ef603148ea29de3581faee2fc66c69ae14a18c85ee2413ef"} Jun 14 13:33:10.039468 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:10.039452 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" event={"ID":"08819fe4-b654-44d1-9773-a007a6044ec2","Type":"ContainerDied","Data":"3b7424b350bfae697a4f88fb6bcd2ef921b39a95c15c4fe1779b2085349dff63"} Jun 14 13:33:10.093191 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:10.093087 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vhpwp" podStartSLOduration=7.776456519 podStartE2EDuration="23.093071955s" totalImagesPullingTime="15.316615436s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 13:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:33:10.069199875 +0000 UTC m=+22.742467823" watchObservedRunningTime="2026-06-14 13:33:10.093071955 +0000 UTC m=+22.766339900" Jun 14 13:33:10.093305 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:10.093255 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dx6mn" podStartSLOduration=2.607940306 podStartE2EDuration="22.093248831s" totalImagesPullingTime="19.485308525s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 13:32:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:33:10.092615874 +0000 UTC m=+22.765883817" watchObservedRunningTime="2026-06-14 13:33:10.093248831 +0000 UTC m=+22.766516776" Jun 14 13:33:10.140404 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:10.140362 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7x8bl" podStartSLOduration=6.941145338 podStartE2EDuration="22.140346202s" totalImagesPullingTime="15.199200864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:32:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:33:10.13995578 +0000 UTC m=+22.813223726" watchObservedRunningTime="2026-06-14 13:33:10.140346202 +0000 UTC m=+22.813614147" Jun 14 13:33:10.140509 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:10.140481 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hcsvf" podStartSLOduration=2.590306961 podStartE2EDuration="22.140476762s" totalImagesPullingTime="19.550169801s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 13:32:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:33:10.125419517 +0000 UTC m=+22.798687466" watchObservedRunningTime="2026-06-14 13:33:10.140476762 +0000 UTC m=+22.813744707" Jun 14 13:33:10.728736 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:10.728703 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lhzpp" Jun 14 13:33:10.728991 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:10.728824 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lhzpp" podUID="881168eb-b04c-4047-b61e-38c07200a455" Jun 14 13:33:10.728991 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:10.728704 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:33:10.728991 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:10.728715 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:33:10.728991 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:10.728957 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq27q" podUID="a5cff939-d984-4037-9dbb-2f4bbf3a6073" Jun 14 13:33:10.729198 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:10.729000 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6swkj" podUID="303004c7-a3eb-4fb8-9008-5aef0795ab73" Jun 14 13:33:11.043828 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:11.043739 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal" event={"ID":"5347bab5c0151c1c15069d4f37484c09","Type":"ContainerStarted","Data":"2a7110feed278c235b8108ecc6aea9578c1ec4f63d46e52fe8eb4ece8360c1f9"} Jun 14 13:33:11.059908 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:11.059183 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal" podStartSLOduration=23.059165696 podStartE2EDuration="23.059165696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 13:32:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:33:11.058462644 +0000 UTC m=+23.731730589" watchObservedRunningTime="2026-06-14 13:33:11.059165696 +0000 UTC m=+23.732433642" Jun 14 13:33:11.200537 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:11.200511 2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 14 13:33:11.738451 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:11.738336 2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-14T13:33:11.200533657Z","UUID":"e32bd78d-4255-47b5-9b31-92afa8edf6b7","Handler":null,"Name":"","Endpoint":""} Jun 14 13:33:11.740240 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:11.740149 2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 14 13:33:11.740240 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:11.740193 2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 14 13:33:12.048148 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:12.048105 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5dbb" event={"ID":"03d93714-6cee-4e26-baa2-4206ac504233","Type":"ContainerStarted","Data":"ccbd6401dbf952de766add911aced33dcb7cd8e3ad4279f246793549c1166040"} Jun 14 13:33:12.052088 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:12.052063 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqj5p_08819fe4-b654-44d1-9773-a007a6044ec2/ovn-acl-logging/0.log" Jun 14 13:33:12.052522 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:12.052493 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" event={"ID":"08819fe4-b654-44d1-9773-a007a6044ec2","Type":"ContainerStarted","Data":"8aedac4e640627723082161f80f60bfe05dd5e8ed7b546459a698e6f535c68f2"} Jun 14 13:33:12.728568 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:12.728359 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:33:12.728768 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:12.728406 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lhzpp" Jun 14 13:33:12.728768 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:12.728652 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6swkj" podUID="303004c7-a3eb-4fb8-9008-5aef0795ab73" Jun 14 13:33:12.728768 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:12.728436 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:33:12.728768 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:12.728746 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lhzpp" podUID="881168eb-b04c-4047-b61e-38c07200a455" Jun 14 13:33:12.728988 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:12.728801 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq27q" podUID="a5cff939-d984-4037-9dbb-2f4bbf3a6073" Jun 14 13:33:13.057276 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:13.057238 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5dbb" event={"ID":"03d93714-6cee-4e26-baa2-4206ac504233","Type":"ContainerStarted","Data":"ec67d051d2a006cd44d791381e2b5974e0a9c4bdf35bc2c22a62486c25a88bc7"} Jun 14 13:33:13.076340 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:13.076289 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5dbb" podStartSLOduration=3.369768234 podStartE2EDuration="25.076272557s" totalImagesPullingTime="21.706504323s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 13:32:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:33:13.075708546 +0000 UTC m=+25.748976493" watchObservedRunningTime="2026-06-14 13:33:13.076272557 +0000 UTC m=+25.749540524" Jun 14 13:33:14.729358 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:14.729032 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:33:14.729358 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:14.729032 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lhzpp" Jun 14 13:33:14.729358 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:14.729061 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:33:14.729358 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:14.729152 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6swkj" podUID="303004c7-a3eb-4fb8-9008-5aef0795ab73" Jun 14 13:33:14.729358 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:14.729229 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lhzpp" podUID="881168eb-b04c-4047-b61e-38c07200a455" Jun 14 13:33:14.729358 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:14.729340 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq27q" podUID="a5cff939-d984-4037-9dbb-2f4bbf3a6073" Jun 14 13:33:14.775228 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:14.775206 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7x8bl" Jun 14 13:33:14.775774 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:14.775755 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7x8bl" Jun 14 13:33:15.064321 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:15.064154 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqj5p_08819fe4-b654-44d1-9773-a007a6044ec2/ovn-acl-logging/0.log" Jun 14 13:33:15.064712 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:15.064669 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" event={"ID":"08819fe4-b654-44d1-9773-a007a6044ec2","Type":"ContainerStarted","Data":"442f5906b683b31bb879bac9439d0d3741ab19c606dd374c72f5ce4ff4ee13de"} Jun 14 13:33:15.064996 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:15.064966 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:33:15.065176 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:15.065161 2557 scope.go:117] "RemoveContainer" containerID="3b7424b350bfae697a4f88fb6bcd2ef921b39a95c15c4fe1779b2085349dff63" Jun 14 13:33:15.066552 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:15.066521 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9x9kd" event={"ID":"01786353-4e34-48af-90ce-aea4533819b1","Type":"ContainerStarted","Data":"f2e66dc56157ed2cf329a1c8393cc5321683ef3453a5b13960bf565094601171"} Jun 14 13:33:15.082829 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:15.082809 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:33:15.739914 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:15.739879 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7x8bl" Jun 14 13:33:15.740413 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:15.740390 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7x8bl" Jun 14 13:33:16.072571 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:16.072509 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqj5p_08819fe4-b654-44d1-9773-a007a6044ec2/ovn-acl-logging/0.log" Jun 14 13:33:16.072903 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:16.072882 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" event={"ID":"08819fe4-b654-44d1-9773-a007a6044ec2","Type":"ContainerStarted","Data":"89522df2660148dafbfa801951731e921f91f88609713debc26f19b2e51206bd"} Jun 14 13:33:16.073114 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:16.073087 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:33:16.073250 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:16.073205 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:33:16.074750 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:16.074725 2557 generic.go:356] "Generic (PLEG): container finished" podID="01786353-4e34-48af-90ce-aea4533819b1" containerID="f2e66dc56157ed2cf329a1c8393cc5321683ef3453a5b13960bf565094601171" exitCode=0 Jun 14 13:33:16.074844 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:16.074803 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9x9kd" event={"ID":"01786353-4e34-48af-90ce-aea4533819b1","Type":"ContainerDied","Data":"f2e66dc56157ed2cf329a1c8393cc5321683ef3453a5b13960bf565094601171"} Jun 14 13:33:16.088265 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:16.088244 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:33:16.101847 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:16.101807 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" podStartSLOduration=8.252718351 podStartE2EDuration="28.10179561s" totalImagesPullingTime="19.849077259s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 13:32:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:33:16.099970421 +0000 UTC m=+28.773238366" watchObservedRunningTime="2026-06-14 13:33:16.10179561 +0000 UTC m=+28.775063586" Jun 14 13:33:16.729078 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:16.729043 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:33:16.729078 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:16.729070 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lhzpp" Jun 14 13:33:16.729078 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:16.729080 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:33:16.729324 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:16.729164 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6swkj" podUID="303004c7-a3eb-4fb8-9008-5aef0795ab73" Jun 14 13:33:16.729324 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:16.729204 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq27q" podUID="a5cff939-d984-4037-9dbb-2f4bbf3a6073" Jun 14 13:33:16.729324 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:16.729272 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lhzpp" podUID="881168eb-b04c-4047-b61e-38c07200a455" Jun 14 13:33:16.736401 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:16.736376 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6swkj"] Jun 14 13:33:16.742379 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:16.742358 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xq27q"] Jun 14 13:33:16.743089 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:16.743061 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lhzpp"] Jun 14 13:33:17.076481 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:17.076404 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:33:17.076481 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:17.076404 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:33:17.076481 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:17.076412 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lhzpp" Jun 14 13:33:17.076778 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:17.076590 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6swkj" podUID="303004c7-a3eb-4fb8-9008-5aef0795ab73" Jun 14 13:33:17.076778 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:17.076698 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lhzpp" podUID="881168eb-b04c-4047-b61e-38c07200a455" Jun 14 13:33:17.077254 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:17.077234 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq27q" podUID="a5cff939-d984-4037-9dbb-2f4bbf3a6073" Jun 14 13:33:18.080486 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:18.080395 2557 generic.go:356] "Generic (PLEG): container finished" podID="01786353-4e34-48af-90ce-aea4533819b1" containerID="38b3b15e6497c35b9a6b95237b0b6d629659cd3dee3c06b6cc336353490dbec1" exitCode=0 Jun 14 13:33:18.080844 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:18.080478 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9x9kd" event={"ID":"01786353-4e34-48af-90ce-aea4533819b1","Type":"ContainerDied","Data":"38b3b15e6497c35b9a6b95237b0b6d629659cd3dee3c06b6cc336353490dbec1"} Jun 14 13:33:18.729058 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:18.728994 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lhzpp" Jun 14 13:33:18.729058 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:18.729027 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:33:18.729058 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:18.729034 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:33:18.729379 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:18.729118 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lhzpp" podUID="881168eb-b04c-4047-b61e-38c07200a455" Jun 14 13:33:18.729379 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:18.729217 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6swkj" podUID="303004c7-a3eb-4fb8-9008-5aef0795ab73" Jun 14 13:33:18.729379 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:18.729313 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq27q" podUID="a5cff939-d984-4037-9dbb-2f4bbf3a6073" Jun 14 13:33:20.086535 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:20.086343 2557 generic.go:356] "Generic (PLEG): container finished" podID="01786353-4e34-48af-90ce-aea4533819b1" containerID="e5d697f26bf485ae0a17ab22bbfb24b761c00efdf34689fb467e29b8d4f7fb08" exitCode=0 Jun 14 13:33:20.087034 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:20.086423 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9x9kd" event={"ID":"01786353-4e34-48af-90ce-aea4533819b1","Type":"ContainerDied","Data":"e5d697f26bf485ae0a17ab22bbfb24b761c00efdf34689fb467e29b8d4f7fb08"} Jun 14 13:33:20.426921 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:20.426889 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5cff939-d984-4037-9dbb-2f4bbf3a6073-metrics-certs\") pod \"network-metrics-daemon-xq27q\" (UID: \"a5cff939-d984-4037-9dbb-2f4bbf3a6073\") " pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:33:20.427065 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:20.427007 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 13:33:20.427065 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:20.427062 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5cff939-d984-4037-9dbb-2f4bbf3a6073-metrics-certs podName:a5cff939-d984-4037-9dbb-2f4bbf3a6073 nodeName:}" failed. No retries permitted until 2026-06-14 13:33:52.427046388 +0000 UTC m=+65.100314315 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5cff939-d984-4037-9dbb-2f4bbf3a6073-metrics-certs") pod "network-metrics-daemon-xq27q" (UID: "a5cff939-d984-4037-9dbb-2f4bbf3a6073") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 13:33:20.527562 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:20.527523 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/303004c7-a3eb-4fb8-9008-5aef0795ab73-original-pull-secret\") pod \"global-pull-secret-syncer-6swkj\" (UID: \"303004c7-a3eb-4fb8-9008-5aef0795ab73\") " pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:33:20.527562 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:20.527565 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plhkq\" (UniqueName: \"kubernetes.io/projected/881168eb-b04c-4047-b61e-38c07200a455-kube-api-access-plhkq\") pod \"network-check-target-lhzpp\" (UID: \"881168eb-b04c-4047-b61e-38c07200a455\") " pod="openshift-network-diagnostics/network-check-target-lhzpp" Jun 14 13:33:20.527770 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:20.527665 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 13:33:20.527770 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:20.527748 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/303004c7-a3eb-4fb8-9008-5aef0795ab73-original-pull-secret podName:303004c7-a3eb-4fb8-9008-5aef0795ab73 nodeName:}" failed. No retries permitted until 2026-06-14 13:33:52.527731809 +0000 UTC m=+65.200999738 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/303004c7-a3eb-4fb8-9008-5aef0795ab73-original-pull-secret") pod "global-pull-secret-syncer-6swkj" (UID: "303004c7-a3eb-4fb8-9008-5aef0795ab73") : object "kube-system"/"original-pull-secret" not registered Jun 14 13:33:20.527837 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:20.527669 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 13:33:20.527837 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:20.527803 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 13:33:20.527837 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:20.527816 2557 projected.go:196] Error preparing data for projected volume kube-api-access-plhkq for pod openshift-network-diagnostics/network-check-target-lhzpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 13:33:20.527922 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:20.527863 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/881168eb-b04c-4047-b61e-38c07200a455-kube-api-access-plhkq podName:881168eb-b04c-4047-b61e-38c07200a455 nodeName:}" failed. No retries permitted until 2026-06-14 13:33:52.527849508 +0000 UTC m=+65.201117432 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-plhkq" (UniqueName: "kubernetes.io/projected/881168eb-b04c-4047-b61e-38c07200a455-kube-api-access-plhkq") pod "network-check-target-lhzpp" (UID: "881168eb-b04c-4047-b61e-38c07200a455") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 13:33:20.728294 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:20.728213 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:33:20.728449 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:20.728217 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:33:20.728449 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:20.728230 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lhzpp" Jun 14 13:33:20.728449 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:20.728321 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6swkj" podUID="303004c7-a3eb-4fb8-9008-5aef0795ab73" Jun 14 13:33:20.728627 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:20.728461 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq27q" podUID="a5cff939-d984-4037-9dbb-2f4bbf3a6073" Jun 14 13:33:20.728627 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:20.728527 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lhzpp" podUID="881168eb-b04c-4047-b61e-38c07200a455" Jun 14 13:33:21.660533 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.660505 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeReady" Jun 14 13:33:21.660997 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.660644 2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 14 13:33:21.695692 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.695658 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7f7f6b48f-hjbtc"] Jun 14 13:33:21.714836 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.714804 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qhs44"] Jun 14 13:33:21.714982 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.714948 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:33:21.718791 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.718747 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 14 13:33:21.718791 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.718792 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 14 13:33:21.719011 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.718747 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 14 13:33:21.719011 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.718747 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nfbbq\"" Jun 14 13:33:21.724749 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.724571 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 14 13:33:21.742268 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.742235 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qhs44" Jun 14 13:33:21.747368 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.747304 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 14 13:33:21.747368 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.747334 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 14 13:33:21.747565 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.747339 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 14 13:33:21.747565 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.747439 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jcgxh\"" Jun 14 13:33:21.749180 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.749157 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f7f6b48f-hjbtc"] Jun 14 13:33:21.749298 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.749198 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fr9gb"] Jun 14 13:33:21.771747 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.771639 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qhs44"] Jun 14 13:33:21.771747 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.771675 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fr9gb"] Jun 14 13:33:21.771914 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.771789 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fr9gb" Jun 14 13:33:21.774595 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.774574 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 14 13:33:21.774952 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.774928 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 14 13:33:21.775139 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.775120 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8ngwb\"" Jun 14 13:33:21.838024 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.837990 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc9554de-2cf6-4067-aaf8-59003ac80ddf-cert\") pod \"ingress-canary-qhs44\" (UID: \"bc9554de-2cf6-4067-aaf8-59003ac80ddf\") " pod="openshift-ingress-canary/ingress-canary-qhs44" Jun 14 13:33:21.838185 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.838032 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rxkw\" (UniqueName: \"kubernetes.io/projected/bc9554de-2cf6-4067-aaf8-59003ac80ddf-kube-api-access-9rxkw\") pod \"ingress-canary-qhs44\" (UID: \"bc9554de-2cf6-4067-aaf8-59003ac80ddf\") " pod="openshift-ingress-canary/ingress-canary-qhs44" Jun 14 13:33:21.838185 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.838063 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-image-registry-private-configuration\") pod \"image-registry-7f7f6b48f-hjbtc\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:33:21.838185 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.838118 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-installation-pull-secrets\") pod \"image-registry-7f7f6b48f-hjbtc\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:33:21.838346 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.838205 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-trusted-ca\") pod \"image-registry-7f7f6b48f-hjbtc\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:33:21.838346 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.838237 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-certificates\") pod \"image-registry-7f7f6b48f-hjbtc\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:33:21.838346 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.838291 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-ca-trust-extracted\") pod \"image-registry-7f7f6b48f-hjbtc\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:33:21.838455 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.838344 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-bound-sa-token\") pod \"image-registry-7f7f6b48f-hjbtc\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:33:21.838455 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.838370 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-tls\") pod \"image-registry-7f7f6b48f-hjbtc\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:33:21.838455 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.838390 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfpm9\" (UniqueName: \"kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-kube-api-access-gfpm9\") pod \"image-registry-7f7f6b48f-hjbtc\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:33:21.938869 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.938838 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-ca-trust-extracted\") pod \"image-registry-7f7f6b48f-hjbtc\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:33:21.938869 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.938881 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-bound-sa-token\") pod \"image-registry-7f7f6b48f-hjbtc\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:33:21.939106 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.938907 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-tls\") pod \"image-registry-7f7f6b48f-hjbtc\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:33:21.939106 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.938932 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfpm9\" (UniqueName: \"kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-kube-api-access-gfpm9\") pod \"image-registry-7f7f6b48f-hjbtc\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:33:21.939106 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.938969 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a6e5105-b1a2-4429-825b-6c8509d6bf90-metrics-tls\") pod \"dns-default-fr9gb\" (UID: \"5a6e5105-b1a2-4429-825b-6c8509d6bf90\") " pod="openshift-dns/dns-default-fr9gb" Jun 14 13:33:21.939251 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:21.939119 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 13:33:21.939251 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:21.939141 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f7f6b48f-hjbtc: secret "image-registry-tls" not found Jun 14 13:33:21.939251 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:21.939214 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-tls podName:85f3fdc7-5813-4d27-82b6-f9e963f80b4d nodeName:}" failed. No retries permitted until 2026-06-14 13:33:22.439191015 +0000 UTC m=+35.112458960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-tls") pod "image-registry-7f7f6b48f-hjbtc" (UID: "85f3fdc7-5813-4d27-82b6-f9e963f80b4d") : secret "image-registry-tls" not found Jun 14 13:33:21.939392 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.939297 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-ca-trust-extracted\") pod \"image-registry-7f7f6b48f-hjbtc\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:33:21.939450 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.939426 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f8kb\" (UniqueName: \"kubernetes.io/projected/5a6e5105-b1a2-4429-825b-6c8509d6bf90-kube-api-access-6f8kb\") pod \"dns-default-fr9gb\" (UID: \"5a6e5105-b1a2-4429-825b-6c8509d6bf90\") " pod="openshift-dns/dns-default-fr9gb" Jun 14 13:33:21.939537 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.939520 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc9554de-2cf6-4067-aaf8-59003ac80ddf-cert\") pod \"ingress-canary-qhs44\" (UID: \"bc9554de-2cf6-4067-aaf8-59003ac80ddf\") " pod="openshift-ingress-canary/ingress-canary-qhs44" Jun 14 13:33:21.939577 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.939551 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rxkw\" (UniqueName: \"kubernetes.io/projected/bc9554de-2cf6-4067-aaf8-59003ac80ddf-kube-api-access-9rxkw\") pod \"ingress-canary-qhs44\" (UID: \"bc9554de-2cf6-4067-aaf8-59003ac80ddf\") " pod="openshift-ingress-canary/ingress-canary-qhs44" Jun 14 13:33:21.939613 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.939579 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-image-registry-private-configuration\") pod \"image-registry-7f7f6b48f-hjbtc\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:33:21.939658 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.939608 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-installation-pull-secrets\") pod \"image-registry-7f7f6b48f-hjbtc\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:33:21.939658 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.939646 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-trusted-ca\") pod \"image-registry-7f7f6b48f-hjbtc\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:33:21.939774 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.939723 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5a6e5105-b1a2-4429-825b-6c8509d6bf90-config-volume\") pod \"dns-default-fr9gb\" (UID: \"5a6e5105-b1a2-4429-825b-6c8509d6bf90\") " pod="openshift-dns/dns-default-fr9gb" Jun 14 13:33:21.939774 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.939753 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a6e5105-b1a2-4429-825b-6c8509d6bf90-tmp-dir\") pod \"dns-default-fr9gb\" (UID: \"5a6e5105-b1a2-4429-825b-6c8509d6bf90\") " pod="openshift-dns/dns-default-fr9gb" Jun 14 13:33:21.939868 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.939784 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-certificates\") pod \"image-registry-7f7f6b48f-hjbtc\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:33:21.940460 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.940413 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-certificates\") pod \"image-registry-7f7f6b48f-hjbtc\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:33:21.940841 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.940817 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-trusted-ca\") pod \"image-registry-7f7f6b48f-hjbtc\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:33:21.944356 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.944301 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-installation-pull-secrets\") pod \"image-registry-7f7f6b48f-hjbtc\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:33:21.944356 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.944309 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-image-registry-private-configuration\") pod \"image-registry-7f7f6b48f-hjbtc\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:33:21.944513 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.944467 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc9554de-2cf6-4067-aaf8-59003ac80ddf-cert\") pod \"ingress-canary-qhs44\" (UID: \"bc9554de-2cf6-4067-aaf8-59003ac80ddf\") " pod="openshift-ingress-canary/ingress-canary-qhs44" Jun 14 13:33:21.949028 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.949004 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rxkw\" (UniqueName: \"kubernetes.io/projected/bc9554de-2cf6-4067-aaf8-59003ac80ddf-kube-api-access-9rxkw\") pod \"ingress-canary-qhs44\" (UID: \"bc9554de-2cf6-4067-aaf8-59003ac80ddf\") " pod="openshift-ingress-canary/ingress-canary-qhs44" Jun 14 13:33:21.949173 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.949153 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfpm9\" (UniqueName: \"kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-kube-api-access-gfpm9\") pod \"image-registry-7f7f6b48f-hjbtc\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:33:21.949361 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:21.949342 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-bound-sa-token\") pod \"image-registry-7f7f6b48f-hjbtc\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:33:22.040504 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:22.040426 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a6e5105-b1a2-4429-825b-6c8509d6bf90-metrics-tls\") pod \"dns-default-fr9gb\" (UID: \"5a6e5105-b1a2-4429-825b-6c8509d6bf90\") " pod="openshift-dns/dns-default-fr9gb" Jun 14 13:33:22.040504 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:22.040462 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f8kb\" (UniqueName: \"kubernetes.io/projected/5a6e5105-b1a2-4429-825b-6c8509d6bf90-kube-api-access-6f8kb\") pod \"dns-default-fr9gb\" (UID: \"5a6e5105-b1a2-4429-825b-6c8509d6bf90\") " pod="openshift-dns/dns-default-fr9gb" Jun 14 13:33:22.040738 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:22.040508 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5a6e5105-b1a2-4429-825b-6c8509d6bf90-config-volume\") pod \"dns-default-fr9gb\" (UID: \"5a6e5105-b1a2-4429-825b-6c8509d6bf90\") " pod="openshift-dns/dns-default-fr9gb" Jun 14 13:33:22.040738 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:22.040523 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a6e5105-b1a2-4429-825b-6c8509d6bf90-tmp-dir\") pod \"dns-default-fr9gb\" (UID: \"5a6e5105-b1a2-4429-825b-6c8509d6bf90\") " pod="openshift-dns/dns-default-fr9gb" Jun 14 13:33:22.040738 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:22.040567 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 13:33:22.040738 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:22.040670 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a6e5105-b1a2-4429-825b-6c8509d6bf90-metrics-tls podName:5a6e5105-b1a2-4429-825b-6c8509d6bf90 nodeName:}" failed. No retries permitted until 2026-06-14 13:33:22.54064853 +0000 UTC m=+35.213916474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a6e5105-b1a2-4429-825b-6c8509d6bf90-metrics-tls") pod "dns-default-fr9gb" (UID: "5a6e5105-b1a2-4429-825b-6c8509d6bf90") : secret "dns-default-metrics-tls" not found Jun 14 13:33:22.040921 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:22.040901 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a6e5105-b1a2-4429-825b-6c8509d6bf90-tmp-dir\") pod \"dns-default-fr9gb\" (UID: \"5a6e5105-b1a2-4429-825b-6c8509d6bf90\") " pod="openshift-dns/dns-default-fr9gb" Jun 14 13:33:22.041113 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:22.041095 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5a6e5105-b1a2-4429-825b-6c8509d6bf90-config-volume\") pod \"dns-default-fr9gb\" (UID: \"5a6e5105-b1a2-4429-825b-6c8509d6bf90\") " pod="openshift-dns/dns-default-fr9gb" Jun 14 13:33:22.051851 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:22.051823 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f8kb\" (UniqueName: \"kubernetes.io/projected/5a6e5105-b1a2-4429-825b-6c8509d6bf90-kube-api-access-6f8kb\") pod \"dns-default-fr9gb\" (UID: \"5a6e5105-b1a2-4429-825b-6c8509d6bf90\") " pod="openshift-dns/dns-default-fr9gb" Jun 14 13:33:22.055607 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:22.055584 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qhs44" Jun 14 13:33:22.274850 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:22.274801 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qhs44"] Jun 14 13:33:22.280324 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:33:22.280288 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc9554de_2cf6_4067_aaf8_59003ac80ddf.slice/crio-cac19e74812a567feed171efe95c6c7c433003149b1cb90752a12538ef0dbf5d WatchSource:0}: Error finding container cac19e74812a567feed171efe95c6c7c433003149b1cb90752a12538ef0dbf5d: Status 404 returned error can't find the container with id cac19e74812a567feed171efe95c6c7c433003149b1cb90752a12538ef0dbf5d Jun 14 13:33:22.443977 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:22.443785 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-tls\") pod \"image-registry-7f7f6b48f-hjbtc\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:33:22.444153 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:22.443950 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 13:33:22.444153 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:22.444046 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f7f6b48f-hjbtc: secret "image-registry-tls" not found Jun 14 13:33:22.444153 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:22.444108 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-tls podName:85f3fdc7-5813-4d27-82b6-f9e963f80b4d nodeName:}" failed. No retries permitted until 2026-06-14 13:33:23.444091569 +0000 UTC m=+36.117359501 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-tls") pod "image-registry-7f7f6b48f-hjbtc" (UID: "85f3fdc7-5813-4d27-82b6-f9e963f80b4d") : secret "image-registry-tls" not found Jun 14 13:33:22.544911 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:22.544878 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a6e5105-b1a2-4429-825b-6c8509d6bf90-metrics-tls\") pod \"dns-default-fr9gb\" (UID: \"5a6e5105-b1a2-4429-825b-6c8509d6bf90\") " pod="openshift-dns/dns-default-fr9gb" Jun 14 13:33:22.545072 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:22.544984 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 13:33:22.545072 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:22.545034 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a6e5105-b1a2-4429-825b-6c8509d6bf90-metrics-tls podName:5a6e5105-b1a2-4429-825b-6c8509d6bf90 nodeName:}" failed. No retries permitted until 2026-06-14 13:33:23.545021645 +0000 UTC m=+36.218289570 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a6e5105-b1a2-4429-825b-6c8509d6bf90-metrics-tls") pod "dns-default-fr9gb" (UID: "5a6e5105-b1a2-4429-825b-6c8509d6bf90") : secret "dns-default-metrics-tls" not found Jun 14 13:33:22.728657 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:22.728545 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lhzpp" Jun 14 13:33:22.728657 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:22.728569 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:33:22.729444 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:22.729035 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:33:22.731718 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:22.731697 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 13:33:22.731854 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:22.731762 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 13:33:22.731854 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:22.731787 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pw5r2\"" Jun 14 13:33:22.731854 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:22.731824 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4lsq5\"" Jun 14 13:33:22.731854 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:22.731697 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 13:33:22.732104 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:22.732088 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 13:33:22.733472 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:22.733444 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:33:22.815997 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:22.815962 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:33:22.916155 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:22.916121 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:33:23.017553 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:23.017412 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:33:23.096512 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:23.096472 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qhs44" event={"ID":"bc9554de-2cf6-4067-aaf8-59003ac80ddf","Type":"ContainerStarted","Data":"cac19e74812a567feed171efe95c6c7c433003149b1cb90752a12538ef0dbf5d"} Jun 14 13:33:23.451265 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:23.451224 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-tls\") pod \"image-registry-7f7f6b48f-hjbtc\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:33:23.451460 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:23.451376 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 13:33:23.451460 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:23.451395 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f7f6b48f-hjbtc: secret "image-registry-tls" not found Jun 14 13:33:23.451579 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:23.451494 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-tls podName:85f3fdc7-5813-4d27-82b6-f9e963f80b4d nodeName:}" failed. No retries permitted until 2026-06-14 13:33:25.45143904 +0000 UTC m=+38.124706987 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-tls") pod "image-registry-7f7f6b48f-hjbtc" (UID: "85f3fdc7-5813-4d27-82b6-f9e963f80b4d") : secret "image-registry-tls" not found Jun 14 13:33:23.552636 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:23.552605 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a6e5105-b1a2-4429-825b-6c8509d6bf90-metrics-tls\") pod \"dns-default-fr9gb\" (UID: \"5a6e5105-b1a2-4429-825b-6c8509d6bf90\") " pod="openshift-dns/dns-default-fr9gb" Jun 14 13:33:23.552817 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:23.552785 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 13:33:23.552874 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:23.552862 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a6e5105-b1a2-4429-825b-6c8509d6bf90-metrics-tls podName:5a6e5105-b1a2-4429-825b-6c8509d6bf90 nodeName:}" failed. No retries permitted until 2026-06-14 13:33:25.552842925 +0000 UTC m=+38.226110873 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a6e5105-b1a2-4429-825b-6c8509d6bf90-metrics-tls") pod "dns-default-fr9gb" (UID: "5a6e5105-b1a2-4429-825b-6c8509d6bf90") : secret "dns-default-metrics-tls" not found Jun 14 13:33:25.471358 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:25.470741 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-tls\") pod \"image-registry-7f7f6b48f-hjbtc\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:33:25.471358 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:25.470901 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 13:33:25.471358 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:25.470915 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f7f6b48f-hjbtc: secret "image-registry-tls" not found Jun 14 13:33:25.471358 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:25.470973 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-tls podName:85f3fdc7-5813-4d27-82b6-f9e963f80b4d nodeName:}" failed. No retries permitted until 2026-06-14 13:33:29.470954632 +0000 UTC m=+42.144222576 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-tls") pod "image-registry-7f7f6b48f-hjbtc" (UID: "85f3fdc7-5813-4d27-82b6-f9e963f80b4d") : secret "image-registry-tls" not found Jun 14 13:33:25.571798 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:25.571722 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a6e5105-b1a2-4429-825b-6c8509d6bf90-metrics-tls\") pod \"dns-default-fr9gb\" (UID: \"5a6e5105-b1a2-4429-825b-6c8509d6bf90\") " pod="openshift-dns/dns-default-fr9gb" Jun 14 13:33:25.571944 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:25.571869 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 13:33:25.571944 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:25.571932 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a6e5105-b1a2-4429-825b-6c8509d6bf90-metrics-tls podName:5a6e5105-b1a2-4429-825b-6c8509d6bf90 nodeName:}" failed. No retries permitted until 2026-06-14 13:33:29.57191595 +0000 UTC m=+42.245183879 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a6e5105-b1a2-4429-825b-6c8509d6bf90-metrics-tls") pod "dns-default-fr9gb" (UID: "5a6e5105-b1a2-4429-825b-6c8509d6bf90") : secret "dns-default-metrics-tls" not found Jun 14 13:33:26.106190 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:26.106159 2557 generic.go:356] "Generic (PLEG): container finished" podID="01786353-4e34-48af-90ce-aea4533819b1" containerID="ebafd135b6e6d4929d2c034d5d2fff0c0f9e4a3d784f2c27e8feeab1b028289b" exitCode=0 Jun 14 13:33:26.106367 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:26.106201 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9x9kd" event={"ID":"01786353-4e34-48af-90ce-aea4533819b1","Type":"ContainerDied","Data":"ebafd135b6e6d4929d2c034d5d2fff0c0f9e4a3d784f2c27e8feeab1b028289b"} Jun 14 13:33:26.107805 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:26.107779 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qhs44" event={"ID":"bc9554de-2cf6-4067-aaf8-59003ac80ddf","Type":"ContainerStarted","Data":"498f7c613b21d64324986e02be00afd272879d1a3bebfa46367871cb67fbb4ef"} Jun 14 13:33:26.146147 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:26.146094 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qhs44" podStartSLOduration=2.130473627 podStartE2EDuration="5.146074893s" totalImagesPullingTime="3.015601266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:33:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:33:26.145213532 +0000 UTC m=+38.818481490" watchObservedRunningTime="2026-06-14 13:33:26.146074893 +0000 UTC m=+38.819342861" Jun 14 13:33:27.113083 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:27.113042 2557 generic.go:356] "Generic (PLEG): container finished" podID="01786353-4e34-48af-90ce-aea4533819b1" containerID="e2e5bfcfa873721ba3d0276af2df6dc12243c7dec683c7dd13a2fecf32048751" exitCode=0 Jun 14 13:33:27.113447 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:27.113116 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9x9kd" event={"ID":"01786353-4e34-48af-90ce-aea4533819b1","Type":"ContainerDied","Data":"e2e5bfcfa873721ba3d0276af2df6dc12243c7dec683c7dd13a2fecf32048751"} Jun 14 13:33:27.510972 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:27.510722 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:33:27.611372 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:27.611332 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:33:28.118391 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:28.118356 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9x9kd" event={"ID":"01786353-4e34-48af-90ce-aea4533819b1","Type":"ContainerStarted","Data":"64087313674a8c2bea32acc646337228ac95ab56d041aec2bdbb301107d11e33"} Jun 14 13:33:28.140920 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:28.140875 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9x9kd" podStartSLOduration=9.362907717 podStartE2EDuration="41.140857662s" totalImagesPullingTime="31.777949945s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 13:32:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:33:28.140496358 +0000 UTC m=+40.813764303" watchObservedRunningTime="2026-06-14 13:33:28.140857662 +0000 UTC m=+40.814125608" Jun 14 13:33:28.260158 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:28.260128 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:33:28.308154 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:28.308125 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:33:28.966161 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:28.966126 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:33:29.067498 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:29.067463 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:33:29.502794 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:29.502758 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-tls\") pod \"image-registry-7f7f6b48f-hjbtc\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:33:29.503144 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:29.502877 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 13:33:29.503144 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:29.502888 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f7f6b48f-hjbtc: secret "image-registry-tls" not found Jun 14 13:33:29.503144 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:29.502936 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-tls podName:85f3fdc7-5813-4d27-82b6-f9e963f80b4d nodeName:}" failed. No retries permitted until 2026-06-14 13:33:37.502922564 +0000 UTC m=+50.176190488 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-tls") pod "image-registry-7f7f6b48f-hjbtc" (UID: "85f3fdc7-5813-4d27-82b6-f9e963f80b4d") : secret "image-registry-tls" not found Jun 14 13:33:29.603375 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:29.603344 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a6e5105-b1a2-4429-825b-6c8509d6bf90-metrics-tls\") pod \"dns-default-fr9gb\" (UID: \"5a6e5105-b1a2-4429-825b-6c8509d6bf90\") " pod="openshift-dns/dns-default-fr9gb" Jun 14 13:33:29.603479 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:29.603466 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 13:33:29.603527 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:29.603519 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a6e5105-b1a2-4429-825b-6c8509d6bf90-metrics-tls podName:5a6e5105-b1a2-4429-825b-6c8509d6bf90 nodeName:}" failed. No retries permitted until 2026-06-14 13:33:37.603505614 +0000 UTC m=+50.276773539 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a6e5105-b1a2-4429-825b-6c8509d6bf90-metrics-tls") pod "dns-default-fr9gb" (UID: "5a6e5105-b1a2-4429-825b-6c8509d6bf90") : secret "dns-default-metrics-tls" not found Jun 14 13:33:30.177538 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:30.177500 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:33:30.276620 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:30.276576 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:33:33.741937 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:33.741904 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:33:33.804385 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:33.804348 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:33:33.855618 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:33.855582 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:33:35.945302 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:35.945266 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:33:36.014224 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:36.014186 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:33:37.562902 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:37.562862 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-tls\") pod \"image-registry-7f7f6b48f-hjbtc\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:33:37.563276 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:37.563008 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 13:33:37.563276 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:37.563026 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f7f6b48f-hjbtc: secret "image-registry-tls" not found Jun 14 13:33:37.563276 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:37.563079 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-tls podName:85f3fdc7-5813-4d27-82b6-f9e963f80b4d nodeName:}" failed. No retries permitted until 2026-06-14 13:33:53.563064253 +0000 UTC m=+66.236332178 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-tls") pod "image-registry-7f7f6b48f-hjbtc" (UID: "85f3fdc7-5813-4d27-82b6-f9e963f80b4d") : secret "image-registry-tls" not found Jun 14 13:33:37.663613 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:37.663577 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a6e5105-b1a2-4429-825b-6c8509d6bf90-metrics-tls\") pod \"dns-default-fr9gb\" (UID: \"5a6e5105-b1a2-4429-825b-6c8509d6bf90\") " pod="openshift-dns/dns-default-fr9gb" Jun 14 13:33:37.663749 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:37.663735 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 13:33:37.663806 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:37.663796 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a6e5105-b1a2-4429-825b-6c8509d6bf90-metrics-tls podName:5a6e5105-b1a2-4429-825b-6c8509d6bf90 nodeName:}" failed. No retries permitted until 2026-06-14 13:33:53.663778999 +0000 UTC m=+66.337046925 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a6e5105-b1a2-4429-825b-6c8509d6bf90-metrics-tls") pod "dns-default-fr9gb" (UID: "5a6e5105-b1a2-4429-825b-6c8509d6bf90") : secret "dns-default-metrics-tls" not found Jun 14 13:33:48.090916 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:48.090888 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dqj5p" Jun 14 13:33:48.242478 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:48.242438 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:33:48.293431 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:48.293400 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:33:50.949867 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:50.949827 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:33:51.006377 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:51.006345 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:33:52.470767 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:52.470717 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5cff939-d984-4037-9dbb-2f4bbf3a6073-metrics-certs\") pod \"network-metrics-daemon-xq27q\" (UID: \"a5cff939-d984-4037-9dbb-2f4bbf3a6073\") " pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:33:52.473483 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:52.473465 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 13:33:52.481667 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:52.481649 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 13:33:52.481756 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:52.481735 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5cff939-d984-4037-9dbb-2f4bbf3a6073-metrics-certs podName:a5cff939-d984-4037-9dbb-2f4bbf3a6073 nodeName:}" failed. No retries permitted until 2026-06-14 13:34:56.481713722 +0000 UTC m=+129.154981663 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5cff939-d984-4037-9dbb-2f4bbf3a6073-metrics-certs") pod "network-metrics-daemon-xq27q" (UID: "a5cff939-d984-4037-9dbb-2f4bbf3a6073") : secret "metrics-daemon-secret" not found Jun 14 13:33:52.571285 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:52.571237 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plhkq\" (UniqueName: \"kubernetes.io/projected/881168eb-b04c-4047-b61e-38c07200a455-kube-api-access-plhkq\") pod \"network-check-target-lhzpp\" (UID: \"881168eb-b04c-4047-b61e-38c07200a455\") " pod="openshift-network-diagnostics/network-check-target-lhzpp" Jun 14 13:33:52.571403 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:52.571364 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/303004c7-a3eb-4fb8-9008-5aef0795ab73-original-pull-secret\") pod \"global-pull-secret-syncer-6swkj\" (UID: \"303004c7-a3eb-4fb8-9008-5aef0795ab73\") " pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:33:52.574363 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:52.574345 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 13:33:52.574423 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:52.574389 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 13:33:52.583883 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:52.583861 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 13:33:52.585371 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:52.585351 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/303004c7-a3eb-4fb8-9008-5aef0795ab73-original-pull-secret\") pod \"global-pull-secret-syncer-6swkj\" (UID: \"303004c7-a3eb-4fb8-9008-5aef0795ab73\") " pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:33:52.593751 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:52.593728 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plhkq\" (UniqueName: \"kubernetes.io/projected/881168eb-b04c-4047-b61e-38c07200a455-kube-api-access-plhkq\") pod \"network-check-target-lhzpp\" (UID: \"881168eb-b04c-4047-b61e-38c07200a455\") " pod="openshift-network-diagnostics/network-check-target-lhzpp" Jun 14 13:33:52.743755 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:52.743665 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4lsq5\"" Jun 14 13:33:52.748805 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:52.748787 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6swkj" Jun 14 13:33:52.751930 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:52.751906 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lhzpp" Jun 14 13:33:52.876549 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:52.876521 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lhzpp"] Jun 14 13:33:52.879777 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:33:52.879752 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod881168eb_b04c_4047_b61e_38c07200a455.slice/crio-154b7cce681f95c80331fc9ce3d18dfe677e3137590b7ca4e4137ab0b776d3a9 WatchSource:0}: Error finding container 154b7cce681f95c80331fc9ce3d18dfe677e3137590b7ca4e4137ab0b776d3a9: Status 404 returned error can't find the container with id 154b7cce681f95c80331fc9ce3d18dfe677e3137590b7ca4e4137ab0b776d3a9 Jun 14 13:33:52.891131 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:52.891104 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6swkj"] Jun 14 13:33:52.893442 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:33:52.893421 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod303004c7_a3eb_4fb8_9008_5aef0795ab73.slice/crio-c34089e699f5535e6e2bb243308bc4c40ad0a6cad3418aa65851d540fec32488 WatchSource:0}: Error finding container c34089e699f5535e6e2bb243308bc4c40ad0a6cad3418aa65851d540fec32488: Status 404 returned error can't find the container with id c34089e699f5535e6e2bb243308bc4c40ad0a6cad3418aa65851d540fec32488 Jun 14 13:33:53.178733 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:53.178694 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6swkj" event={"ID":"303004c7-a3eb-4fb8-9008-5aef0795ab73","Type":"ContainerStarted","Data":"c34089e699f5535e6e2bb243308bc4c40ad0a6cad3418aa65851d540fec32488"} Jun 14 13:33:53.179825 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:53.179802 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lhzpp" event={"ID":"881168eb-b04c-4047-b61e-38c07200a455","Type":"ContainerStarted","Data":"154b7cce681f95c80331fc9ce3d18dfe677e3137590b7ca4e4137ab0b776d3a9"} Jun 14 13:33:53.579336 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:53.579242 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-tls\") pod \"image-registry-7f7f6b48f-hjbtc\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:33:53.579896 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:53.579411 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 13:33:53.579896 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:53.579433 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f7f6b48f-hjbtc: secret "image-registry-tls" not found Jun 14 13:33:53.579896 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:53.579506 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-tls podName:85f3fdc7-5813-4d27-82b6-f9e963f80b4d nodeName:}" failed. No retries permitted until 2026-06-14 13:34:25.579483867 +0000 UTC m=+98.252751813 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-tls") pod "image-registry-7f7f6b48f-hjbtc" (UID: "85f3fdc7-5813-4d27-82b6-f9e963f80b4d") : secret "image-registry-tls" not found Jun 14 13:33:53.680527 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:53.680464 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a6e5105-b1a2-4429-825b-6c8509d6bf90-metrics-tls\") pod \"dns-default-fr9gb\" (UID: \"5a6e5105-b1a2-4429-825b-6c8509d6bf90\") " pod="openshift-dns/dns-default-fr9gb" Jun 14 13:33:53.680748 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:53.680713 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 13:33:53.680820 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:33:53.680784 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a6e5105-b1a2-4429-825b-6c8509d6bf90-metrics-tls podName:5a6e5105-b1a2-4429-825b-6c8509d6bf90 nodeName:}" failed. No retries permitted until 2026-06-14 13:34:25.680765615 +0000 UTC m=+98.354033556 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a6e5105-b1a2-4429-825b-6c8509d6bf90-metrics-tls") pod "dns-default-fr9gb" (UID: "5a6e5105-b1a2-4429-825b-6c8509d6bf90") : secret "dns-default-metrics-tls" not found Jun 14 13:33:55.728198 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:55.728156 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:33:55.783851 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:55.783819 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:33:55.842535 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:55.842496 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:33:58.194978 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:58.194942 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6swkj" event={"ID":"303004c7-a3eb-4fb8-9008-5aef0795ab73","Type":"ContainerStarted","Data":"d620e89a767ea2a7fb048fe9fd84c9552702a1d0d81e985e4fee7d456b5a4225"} Jun 14 13:33:58.196327 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:58.196301 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lhzpp" event={"ID":"881168eb-b04c-4047-b61e-38c07200a455","Type":"ContainerStarted","Data":"44a0827eb95a5c3b698f8a4dce849127eb8309e24203953e88d7ef942dfec04a"} Jun 14 13:33:58.196471 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:58.196432 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lhzpp" Jun 14 13:33:58.209791 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:58.209727 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6swkj" podStartSLOduration=65.374049655 podStartE2EDuration="1m10.209713145s" totalImagesPullingTime="4.83566349s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 13:32:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:33:58.209222519 +0000 UTC m=+70.882490466" watchObservedRunningTime="2026-06-14 13:33:58.209713145 +0000 UTC m=+70.882981090" Jun 14 13:33:58.223698 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:33:58.223640 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lhzpp" podStartSLOduration=66.386483013 podStartE2EDuration="1m11.223626772s" totalImagesPullingTime="4.837143759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:33:58.22292018 +0000 UTC m=+70.896188116" watchObservedRunningTime="2026-06-14 13:33:58.223626772 +0000 UTC m=+70.896894709" Jun 14 13:34:01.864656 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:34:01.864616 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:34:01.930800 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:34:01.930772 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:34:25.606262 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:34:25.606144 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-tls\") pod \"image-registry-7f7f6b48f-hjbtc\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:34:25.606729 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:34:25.606284 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 13:34:25.606729 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:34:25.606302 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f7f6b48f-hjbtc: secret "image-registry-tls" not found Jun 14 13:34:25.606729 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:34:25.606363 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-tls podName:85f3fdc7-5813-4d27-82b6-f9e963f80b4d nodeName:}" failed. No retries permitted until 2026-06-14 13:35:29.60634985 +0000 UTC m=+162.279617778 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-tls") pod "image-registry-7f7f6b48f-hjbtc" (UID: "85f3fdc7-5813-4d27-82b6-f9e963f80b4d") : secret "image-registry-tls" not found Jun 14 13:34:25.707072 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:34:25.707037 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a6e5105-b1a2-4429-825b-6c8509d6bf90-metrics-tls\") pod \"dns-default-fr9gb\" (UID: \"5a6e5105-b1a2-4429-825b-6c8509d6bf90\") " pod="openshift-dns/dns-default-fr9gb" Jun 14 13:34:25.707207 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:34:25.707183 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 13:34:25.707271 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:34:25.707261 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a6e5105-b1a2-4429-825b-6c8509d6bf90-metrics-tls podName:5a6e5105-b1a2-4429-825b-6c8509d6bf90 nodeName:}" failed. No retries permitted until 2026-06-14 13:35:29.707244427 +0000 UTC m=+162.380512351 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a6e5105-b1a2-4429-825b-6c8509d6bf90-metrics-tls") pod "dns-default-fr9gb" (UID: "5a6e5105-b1a2-4429-825b-6c8509d6bf90") : secret "dns-default-metrics-tls" not found Jun 14 13:34:29.200768 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:34:29.200739 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lhzpp" Jun 14 13:34:56.528639 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:34:56.528587 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5cff939-d984-4037-9dbb-2f4bbf3a6073-metrics-certs\") pod \"network-metrics-daemon-xq27q\" (UID: \"a5cff939-d984-4037-9dbb-2f4bbf3a6073\") " pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:34:56.529137 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:34:56.528750 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 13:34:56.529137 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:34:56.528818 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5cff939-d984-4037-9dbb-2f4bbf3a6073-metrics-certs podName:a5cff939-d984-4037-9dbb-2f4bbf3a6073 nodeName:}" failed. No retries permitted until 2026-06-14 13:36:58.528799922 +0000 UTC m=+251.202067846 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5cff939-d984-4037-9dbb-2f4bbf3a6073-metrics-certs") pod "network-metrics-daemon-xq27q" (UID: "a5cff939-d984-4037-9dbb-2f4bbf3a6073") : secret "metrics-daemon-secret" not found Jun 14 13:35:10.854597 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:35:10.854561 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:35:24.728711 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:35:24.728643 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" podUID="85f3fdc7-5813-4d27-82b6-f9e963f80b4d" Jun 14 13:35:24.781321 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:35:24.781285 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-fr9gb" podUID="5a6e5105-b1a2-4429-825b-6c8509d6bf90" Jun 14 13:35:25.396252 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:35:25.396223 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:35:25.753435 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:35:25.753335 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-xq27q" podUID="a5cff939-d984-4037-9dbb-2f4bbf3a6073" Jun 14 13:35:29.660631 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:35:29.660589 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-tls\") pod \"image-registry-7f7f6b48f-hjbtc\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:35:29.661025 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:35:29.660735 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 13:35:29.661025 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:35:29.660749 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f7f6b48f-hjbtc: secret "image-registry-tls" not found Jun 14 13:35:29.661025 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:35:29.660799 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-tls podName:85f3fdc7-5813-4d27-82b6-f9e963f80b4d nodeName:}" failed. No retries permitted until 2026-06-14 13:37:31.660784632 +0000 UTC m=+284.334052556 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-tls") pod "image-registry-7f7f6b48f-hjbtc" (UID: "85f3fdc7-5813-4d27-82b6-f9e963f80b4d") : secret "image-registry-tls" not found Jun 14 13:35:29.761154 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:35:29.761123 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a6e5105-b1a2-4429-825b-6c8509d6bf90-metrics-tls\") pod \"dns-default-fr9gb\" (UID: \"5a6e5105-b1a2-4429-825b-6c8509d6bf90\") " pod="openshift-dns/dns-default-fr9gb" Jun 14 13:35:29.761319 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:35:29.761266 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 13:35:29.761372 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:35:29.761360 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a6e5105-b1a2-4429-825b-6c8509d6bf90-metrics-tls podName:5a6e5105-b1a2-4429-825b-6c8509d6bf90 nodeName:}" failed. No retries permitted until 2026-06-14 13:37:31.76131938 +0000 UTC m=+284.434587303 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a6e5105-b1a2-4429-825b-6c8509d6bf90-metrics-tls") pod "dns-default-fr9gb" (UID: "5a6e5105-b1a2-4429-825b-6c8509d6bf90") : secret "dns-default-metrics-tls" not found Jun 14 13:35:39.729235 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:35:39.729140 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:35:39.729235 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:35:39.729190 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fr9gb" Jun 14 13:36:30.233170 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.233136 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-kfm5z"] Jun 14 13:36:30.236045 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.236029 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-kfm5z" Jun 14 13:36:30.239211 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.239183 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-5rkgs"] Jun 14 13:36:30.239730 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.239564 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-rsh5r\"" Jun 14 13:36:30.240073 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.240055 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 14 13:36:30.240216 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.240187 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 14 13:36:30.242076 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.242059 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-dwq9q"] Jun 14 13:36:30.242185 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.242168 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-5rkgs" Jun 14 13:36:30.244787 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.244766 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-g5jx2"] Jun 14 13:36:30.244880 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.244841 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-dwq9q" Jun 14 13:36:30.245638 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.245623 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 14 13:36:30.245826 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.245637 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 14 13:36:30.245894 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.245882 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 14 13:36:30.246086 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.246070 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 14 13:36:30.246279 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.246265 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-46vg9\"" Jun 14 13:36:30.247358 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.247342 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-g5jx2" Jun 14 13:36:30.249312 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.249295 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-dgrxx\"" Jun 14 13:36:30.249447 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.249331 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 14 13:36:30.249447 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.249356 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 14 13:36:30.249447 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.249307 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 14 13:36:30.249769 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.249753 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 14 13:36:30.250337 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.250142 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-kfm5z"] Jun 14 13:36:30.250337 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.250229 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 14 13:36:30.250914 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.250731 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 14 13:36:30.250914 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.250779 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-n8zkg\"" Jun 14 13:36:30.251292 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.251158 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 14 13:36:30.251981 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.251949 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 14 13:36:30.253095 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.253075 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 14 13:36:30.256392 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.256372 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 14 13:36:30.259126 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.259091 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-g5jx2"] Jun 14 13:36:30.262966 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.262945 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-dwq9q"] Jun 14 13:36:30.274393 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.274374 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-5rkgs"] Jun 14 13:36:30.278587 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.278565 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ql5c\" (UniqueName: \"kubernetes.io/projected/efba00b2-fae9-4f69-88a9-f4cf7692107f-kube-api-access-8ql5c\") pod \"volume-data-source-validator-bd4ccd799-kfm5z\" (UID: \"efba00b2-fae9-4f69-88a9-f4cf7692107f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-kfm5z" Jun 14 13:36:30.332609 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.332579 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z9xc4"] Jun 14 13:36:30.335370 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.335352 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z9xc4" Jun 14 13:36:30.340995 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.338494 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-fdz7k"] Jun 14 13:36:30.342468 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.342446 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-565d7ffdb8-hjw45"] Jun 14 13:36:30.342563 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.342548 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-fdz7k" Jun 14 13:36:30.345128 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.345109 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 14 13:36:30.345128 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.345116 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 14 13:36:30.345289 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.345116 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 14 13:36:30.345354 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.345336 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-565d7ffdb8-hjw45" Jun 14 13:36:30.345396 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.345383 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 14 13:36:30.345547 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.345528 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-kswtb\"" Jun 14 13:36:30.345919 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.345905 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-k5jcj\"" Jun 14 13:36:30.347504 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.347485 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z9xc4"] Jun 14 13:36:30.348267 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.348247 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 14 13:36:30.348267 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.348263 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 14 13:36:30.348413 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.348385 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 14 13:36:30.350830 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.350435 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 14 13:36:30.351197 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.351160 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 14 13:36:30.351495 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.351475 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 14 13:36:30.351568 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.351517 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-fc7pw\"" Jun 14 13:36:30.351889 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.351871 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-fdz7k"] Jun 14 13:36:30.355762 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.355739 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-565d7ffdb8-hjw45"] Jun 14 13:36:30.379732 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.379709 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ql5c\" (UniqueName: \"kubernetes.io/projected/efba00b2-fae9-4f69-88a9-f4cf7692107f-kube-api-access-8ql5c\") pod \"volume-data-source-validator-bd4ccd799-kfm5z\" (UID: \"efba00b2-fae9-4f69-88a9-f4cf7692107f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-kfm5z" Jun 14 13:36:30.379834 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.379739 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/41e65aca-204a-43b9-89b5-a800f28d1e94-config\") pod \"service-ca-operator-7ccbfd59dc-z9xc4\" (UID: \"41e65aca-204a-43b9-89b5-a800f28d1e94\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z9xc4" Jun 14 13:36:30.379834 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.379756 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa652aa2-ad08-4742-9489-be4b1d474712-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-5rkgs\" (UID: \"fa652aa2-ad08-4742-9489-be4b1d474712\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5rkgs" Jun 14 13:36:30.379834 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.379782 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/41e65aca-204a-43b9-89b5-a800f28d1e94-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-z9xc4\" (UID: \"41e65aca-204a-43b9-89b5-a800f28d1e94\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z9xc4" Jun 14 13:36:30.379834 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.379802 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fa652aa2-ad08-4742-9489-be4b1d474712-snapshots\") pod \"insights-operator-5bbd86d6bd-5rkgs\" (UID: \"fa652aa2-ad08-4742-9489-be4b1d474712\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5rkgs" Jun 14 13:36:30.379974 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.379845 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa652aa2-ad08-4742-9489-be4b1d474712-serving-cert\") pod \"insights-operator-5bbd86d6bd-5rkgs\" (UID: \"fa652aa2-ad08-4742-9489-be4b1d474712\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5rkgs" Jun 14 13:36:30.379974 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.379876 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa652aa2-ad08-4742-9489-be4b1d474712-tmp\") pod \"insights-operator-5bbd86d6bd-5rkgs\" (UID: \"fa652aa2-ad08-4742-9489-be4b1d474712\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5rkgs" Jun 14 13:36:30.379974 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.379910 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bghr4\" (UniqueName: \"kubernetes.io/projected/fa652aa2-ad08-4742-9489-be4b1d474712-kube-api-access-bghr4\") pod \"insights-operator-5bbd86d6bd-5rkgs\" (UID: \"fa652aa2-ad08-4742-9489-be4b1d474712\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5rkgs" Jun 14 13:36:30.379974 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.379934 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n49g4\" (UniqueName: \"kubernetes.io/projected/1fea963c-a8b6-4071-8071-3e7149ef98cd-kube-api-access-n49g4\") pod \"console-operator-5dbbb5d744-dwq9q\" (UID: \"1fea963c-a8b6-4071-8071-3e7149ef98cd\") " pod="openshift-console-operator/console-operator-5dbbb5d744-dwq9q" Jun 14 13:36:30.379974 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.379971 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxvqj\" (UniqueName: \"kubernetes.io/projected/2a66a11c-63e7-477b-a84d-3cf0102368a1-kube-api-access-pxvqj\") pod \"cluster-monitoring-operator-f9d7df769-g5jx2\" (UID: \"2a66a11c-63e7-477b-a84d-3cf0102368a1\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-g5jx2" Jun 14 13:36:30.380135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.379991 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5g8h\" (UniqueName: \"kubernetes.io/projected/41e65aca-204a-43b9-89b5-a800f28d1e94-kube-api-access-b5g8h\") pod \"service-ca-operator-7ccbfd59dc-z9xc4\" (UID: \"41e65aca-204a-43b9-89b5-a800f28d1e94\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z9xc4" Jun 14 13:36:30.380135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.380006 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a66a11c-63e7-477b-a84d-3cf0102368a1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-g5jx2\" (UID: \"2a66a11c-63e7-477b-a84d-3cf0102368a1\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-g5jx2" Jun 14 13:36:30.380135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.380034 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2a66a11c-63e7-477b-a84d-3cf0102368a1-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-g5jx2\" (UID: \"2a66a11c-63e7-477b-a84d-3cf0102368a1\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-g5jx2" Jun 14 13:36:30.380135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.380089 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa652aa2-ad08-4742-9489-be4b1d474712-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-5rkgs\" (UID: \"fa652aa2-ad08-4742-9489-be4b1d474712\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5rkgs" Jun 14 13:36:30.380135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.380110 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1fea963c-a8b6-4071-8071-3e7149ef98cd-config\") pod \"console-operator-5dbbb5d744-dwq9q\" (UID: \"1fea963c-a8b6-4071-8071-3e7149ef98cd\") " pod="openshift-console-operator/console-operator-5dbbb5d744-dwq9q" Jun 14 13:36:30.380305 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.380141 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1fea963c-a8b6-4071-8071-3e7149ef98cd-serving-cert\") pod \"console-operator-5dbbb5d744-dwq9q\" (UID: \"1fea963c-a8b6-4071-8071-3e7149ef98cd\") " pod="openshift-console-operator/console-operator-5dbbb5d744-dwq9q" Jun 14 13:36:30.380305 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.380155 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1fea963c-a8b6-4071-8071-3e7149ef98cd-trusted-ca\") pod \"console-operator-5dbbb5d744-dwq9q\" (UID: \"1fea963c-a8b6-4071-8071-3e7149ef98cd\") " pod="openshift-console-operator/console-operator-5dbbb5d744-dwq9q" Jun 14 13:36:30.395049 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.395027 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ql5c\" (UniqueName: \"kubernetes.io/projected/efba00b2-fae9-4f69-88a9-f4cf7692107f-kube-api-access-8ql5c\") pod \"volume-data-source-validator-bd4ccd799-kfm5z\" (UID: \"efba00b2-fae9-4f69-88a9-f4cf7692107f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-kfm5z" Jun 14 13:36:30.431407 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.431382 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-9d55q"] Jun 14 13:36:30.434388 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.434374 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-9d55q" Jun 14 13:36:30.436868 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.436844 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 14 13:36:30.436972 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.436851 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 14 13:36:30.436972 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.436901 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mgldg\"" Jun 14 13:36:30.443875 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.443854 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-9d55q"] Jun 14 13:36:30.480434 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.480402 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5g8h\" (UniqueName: \"kubernetes.io/projected/41e65aca-204a-43b9-89b5-a800f28d1e94-kube-api-access-b5g8h\") pod \"service-ca-operator-7ccbfd59dc-z9xc4\" (UID: \"41e65aca-204a-43b9-89b5-a800f28d1e94\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z9xc4" Jun 14 13:36:30.480657 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.480449 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a66a11c-63e7-477b-a84d-3cf0102368a1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-g5jx2\" (UID: \"2a66a11c-63e7-477b-a84d-3cf0102368a1\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-g5jx2" Jun 14 13:36:30.480657 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.480413 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:30.480657 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.480482 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2a66a11c-63e7-477b-a84d-3cf0102368a1-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-g5jx2\" (UID: \"2a66a11c-63e7-477b-a84d-3cf0102368a1\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-g5jx2" Jun 14 13:36:30.480657 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.480516 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lppsl\" (UniqueName: \"kubernetes.io/projected/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-kube-api-access-lppsl\") pod \"router-default-565d7ffdb8-hjw45\" (UID: \"341c9198-cdc6-43c8-a9bd-eb0e957f2e19\") " pod="openshift-ingress/router-default-565d7ffdb8-hjw45" Jun 14 13:36:30.480657 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.480542 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa652aa2-ad08-4742-9489-be4b1d474712-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-5rkgs\" (UID: \"fa652aa2-ad08-4742-9489-be4b1d474712\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5rkgs" Jun 14 13:36:30.480657 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:30.480572 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 13:36:30.480657 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.480652 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1fea963c-a8b6-4071-8071-3e7149ef98cd-config\") pod \"console-operator-5dbbb5d744-dwq9q\" (UID: \"1fea963c-a8b6-4071-8071-3e7149ef98cd\") " pod="openshift-console-operator/console-operator-5dbbb5d744-dwq9q" Jun 14 13:36:30.481072 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:30.480735 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a66a11c-63e7-477b-a84d-3cf0102368a1-cluster-monitoring-operator-tls podName:2a66a11c-63e7-477b-a84d-3cf0102368a1 nodeName:}" failed. No retries permitted until 2026-06-14 13:36:30.980701798 +0000 UTC m=+223.653969729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2a66a11c-63e7-477b-a84d-3cf0102368a1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-g5jx2" (UID: "2a66a11c-63e7-477b-a84d-3cf0102368a1") : secret "cluster-monitoring-operator-tls" not found Jun 14 13:36:30.481072 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.480765 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-default-certificate\") pod \"router-default-565d7ffdb8-hjw45\" (UID: \"341c9198-cdc6-43c8-a9bd-eb0e957f2e19\") " pod="openshift-ingress/router-default-565d7ffdb8-hjw45" Jun 14 13:36:30.481072 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.480804 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1fea963c-a8b6-4071-8071-3e7149ef98cd-serving-cert\") pod \"console-operator-5dbbb5d744-dwq9q\" (UID: \"1fea963c-a8b6-4071-8071-3e7149ef98cd\") " pod="openshift-console-operator/console-operator-5dbbb5d744-dwq9q" Jun 14 13:36:30.481072 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.480831 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1fea963c-a8b6-4071-8071-3e7149ef98cd-trusted-ca\") pod \"console-operator-5dbbb5d744-dwq9q\" (UID: \"1fea963c-a8b6-4071-8071-3e7149ef98cd\") " pod="openshift-console-operator/console-operator-5dbbb5d744-dwq9q" Jun 14 13:36:30.481072 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.480882 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ae58844c-88ca-4244-862a-0ceb52ca66f8-nginx-conf\") pod \"networking-console-plugin-867b76cb74-9d55q\" (UID: \"ae58844c-88ca-4244-862a-0ceb52ca66f8\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-9d55q" Jun 14 13:36:30.481072 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.480906 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-service-ca-bundle\") pod \"router-default-565d7ffdb8-hjw45\" (UID: \"341c9198-cdc6-43c8-a9bd-eb0e957f2e19\") " pod="openshift-ingress/router-default-565d7ffdb8-hjw45" Jun 14 13:36:30.481072 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.480936 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/41e65aca-204a-43b9-89b5-a800f28d1e94-config\") pod \"service-ca-operator-7ccbfd59dc-z9xc4\" (UID: \"41e65aca-204a-43b9-89b5-a800f28d1e94\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z9xc4" Jun 14 13:36:30.481072 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.480962 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa652aa2-ad08-4742-9489-be4b1d474712-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-5rkgs\" (UID: \"fa652aa2-ad08-4742-9489-be4b1d474712\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5rkgs" Jun 14 13:36:30.481072 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.481058 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/41e65aca-204a-43b9-89b5-a800f28d1e94-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-z9xc4\" (UID: \"41e65aca-204a-43b9-89b5-a800f28d1e94\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z9xc4" Jun 14 13:36:30.481521 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.481102 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-metrics-certs\") pod \"router-default-565d7ffdb8-hjw45\" (UID: \"341c9198-cdc6-43c8-a9bd-eb0e957f2e19\") " pod="openshift-ingress/router-default-565d7ffdb8-hjw45" Jun 14 13:36:30.481521 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.481147 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fa652aa2-ad08-4742-9489-be4b1d474712-snapshots\") pod \"insights-operator-5bbd86d6bd-5rkgs\" (UID: \"fa652aa2-ad08-4742-9489-be4b1d474712\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5rkgs" Jun 14 13:36:30.481521 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.481172 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa652aa2-ad08-4742-9489-be4b1d474712-serving-cert\") pod \"insights-operator-5bbd86d6bd-5rkgs\" (UID: \"fa652aa2-ad08-4742-9489-be4b1d474712\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5rkgs" Jun 14 13:36:30.481521 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.481214 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm4s4\" (UniqueName: \"kubernetes.io/projected/d7ed995a-f86e-46d9-833d-6c2021201228-kube-api-access-vm4s4\") pod \"network-check-source-6947749cfc-fdz7k\" (UID: \"d7ed995a-f86e-46d9-833d-6c2021201228\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-fdz7k" Jun 14 13:36:30.481521 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.481240 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-stats-auth\") pod \"router-default-565d7ffdb8-hjw45\" (UID: \"341c9198-cdc6-43c8-a9bd-eb0e957f2e19\") " pod="openshift-ingress/router-default-565d7ffdb8-hjw45" Jun 14 13:36:30.481521 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.481268 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa652aa2-ad08-4742-9489-be4b1d474712-tmp\") pod \"insights-operator-5bbd86d6bd-5rkgs\" (UID: \"fa652aa2-ad08-4742-9489-be4b1d474712\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5rkgs" Jun 14 13:36:30.481521 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.481314 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bghr4\" (UniqueName: \"kubernetes.io/projected/fa652aa2-ad08-4742-9489-be4b1d474712-kube-api-access-bghr4\") pod \"insights-operator-5bbd86d6bd-5rkgs\" (UID: \"fa652aa2-ad08-4742-9489-be4b1d474712\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5rkgs" Jun 14 13:36:30.481521 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.481332 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2a66a11c-63e7-477b-a84d-3cf0102368a1-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-g5jx2\" (UID: \"2a66a11c-63e7-477b-a84d-3cf0102368a1\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-g5jx2" Jun 14 13:36:30.481521 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.481348 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n49g4\" (UniqueName: \"kubernetes.io/projected/1fea963c-a8b6-4071-8071-3e7149ef98cd-kube-api-access-n49g4\") pod \"console-operator-5dbbb5d744-dwq9q\" (UID: \"1fea963c-a8b6-4071-8071-3e7149ef98cd\") " pod="openshift-console-operator/console-operator-5dbbb5d744-dwq9q" Jun 14 13:36:30.481521 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.481331 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa652aa2-ad08-4742-9489-be4b1d474712-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-5rkgs\" (UID: \"fa652aa2-ad08-4742-9489-be4b1d474712\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5rkgs" Jun 14 13:36:30.481521 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.481516 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1fea963c-a8b6-4071-8071-3e7149ef98cd-config\") pod \"console-operator-5dbbb5d744-dwq9q\" (UID: \"1fea963c-a8b6-4071-8071-3e7149ef98cd\") " pod="openshift-console-operator/console-operator-5dbbb5d744-dwq9q" Jun 14 13:36:30.482071 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.481515 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/41e65aca-204a-43b9-89b5-a800f28d1e94-config\") pod \"service-ca-operator-7ccbfd59dc-z9xc4\" (UID: \"41e65aca-204a-43b9-89b5-a800f28d1e94\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z9xc4" Jun 14 13:36:30.482071 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.481845 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae58844c-88ca-4244-862a-0ceb52ca66f8-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-9d55q\" (UID: \"ae58844c-88ca-4244-862a-0ceb52ca66f8\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-9d55q" Jun 14 13:36:30.482071 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.481936 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxvqj\" (UniqueName: \"kubernetes.io/projected/2a66a11c-63e7-477b-a84d-3cf0102368a1-kube-api-access-pxvqj\") pod \"cluster-monitoring-operator-f9d7df769-g5jx2\" (UID: \"2a66a11c-63e7-477b-a84d-3cf0102368a1\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-g5jx2" Jun 14 13:36:30.482071 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.482032 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1fea963c-a8b6-4071-8071-3e7149ef98cd-trusted-ca\") pod \"console-operator-5dbbb5d744-dwq9q\" (UID: \"1fea963c-a8b6-4071-8071-3e7149ef98cd\") " pod="openshift-console-operator/console-operator-5dbbb5d744-dwq9q" Jun 14 13:36:30.482261 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.482159 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa652aa2-ad08-4742-9489-be4b1d474712-tmp\") pod \"insights-operator-5bbd86d6bd-5rkgs\" (UID: \"fa652aa2-ad08-4742-9489-be4b1d474712\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5rkgs" Jun 14 13:36:30.482261 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.482194 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa652aa2-ad08-4742-9489-be4b1d474712-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-5rkgs\" (UID: \"fa652aa2-ad08-4742-9489-be4b1d474712\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5rkgs" Jun 14 13:36:30.482261 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.482233 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fa652aa2-ad08-4742-9489-be4b1d474712-snapshots\") pod \"insights-operator-5bbd86d6bd-5rkgs\" (UID: \"fa652aa2-ad08-4742-9489-be4b1d474712\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5rkgs" Jun 14 13:36:30.483768 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.483709 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1fea963c-a8b6-4071-8071-3e7149ef98cd-serving-cert\") pod \"console-operator-5dbbb5d744-dwq9q\" (UID: \"1fea963c-a8b6-4071-8071-3e7149ef98cd\") " pod="openshift-console-operator/console-operator-5dbbb5d744-dwq9q" Jun 14 13:36:30.483873 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.483851 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/41e65aca-204a-43b9-89b5-a800f28d1e94-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-z9xc4\" (UID: \"41e65aca-204a-43b9-89b5-a800f28d1e94\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z9xc4" Jun 14 13:36:30.484203 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.484181 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa652aa2-ad08-4742-9489-be4b1d474712-serving-cert\") pod \"insights-operator-5bbd86d6bd-5rkgs\" (UID: \"fa652aa2-ad08-4742-9489-be4b1d474712\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5rkgs" Jun 14 13:36:30.488396 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.488370 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5g8h\" (UniqueName: \"kubernetes.io/projected/41e65aca-204a-43b9-89b5-a800f28d1e94-kube-api-access-b5g8h\") pod \"service-ca-operator-7ccbfd59dc-z9xc4\" (UID: \"41e65aca-204a-43b9-89b5-a800f28d1e94\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z9xc4" Jun 14 13:36:30.489248 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.489226 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n49g4\" (UniqueName: \"kubernetes.io/projected/1fea963c-a8b6-4071-8071-3e7149ef98cd-kube-api-access-n49g4\") pod \"console-operator-5dbbb5d744-dwq9q\" (UID: \"1fea963c-a8b6-4071-8071-3e7149ef98cd\") " pod="openshift-console-operator/console-operator-5dbbb5d744-dwq9q" Jun 14 13:36:30.489749 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.489725 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxvqj\" (UniqueName: \"kubernetes.io/projected/2a66a11c-63e7-477b-a84d-3cf0102368a1-kube-api-access-pxvqj\") pod \"cluster-monitoring-operator-f9d7df769-g5jx2\" (UID: \"2a66a11c-63e7-477b-a84d-3cf0102368a1\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-g5jx2" Jun 14 13:36:30.490123 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.490099 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bghr4\" (UniqueName: \"kubernetes.io/projected/fa652aa2-ad08-4742-9489-be4b1d474712-kube-api-access-bghr4\") pod \"insights-operator-5bbd86d6bd-5rkgs\" (UID: \"fa652aa2-ad08-4742-9489-be4b1d474712\") " pod="openshift-insights/insights-operator-5bbd86d6bd-5rkgs" Jun 14 13:36:30.545739 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.545701 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-kfm5z" Jun 14 13:36:30.554793 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.554774 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-5rkgs" Jun 14 13:36:30.562487 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.562465 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-dwq9q" Jun 14 13:36:30.582810 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.582781 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lppsl\" (UniqueName: \"kubernetes.io/projected/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-kube-api-access-lppsl\") pod \"router-default-565d7ffdb8-hjw45\" (UID: \"341c9198-cdc6-43c8-a9bd-eb0e957f2e19\") " pod="openshift-ingress/router-default-565d7ffdb8-hjw45" Jun 14 13:36:30.582965 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.582831 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-default-certificate\") pod \"router-default-565d7ffdb8-hjw45\" (UID: \"341c9198-cdc6-43c8-a9bd-eb0e957f2e19\") " pod="openshift-ingress/router-default-565d7ffdb8-hjw45" Jun 14 13:36:30.582965 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.582885 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ae58844c-88ca-4244-862a-0ceb52ca66f8-nginx-conf\") pod \"networking-console-plugin-867b76cb74-9d55q\" (UID: \"ae58844c-88ca-4244-862a-0ceb52ca66f8\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-9d55q" Jun 14 13:36:30.582965 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.582910 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-service-ca-bundle\") pod \"router-default-565d7ffdb8-hjw45\" (UID: \"341c9198-cdc6-43c8-a9bd-eb0e957f2e19\") " pod="openshift-ingress/router-default-565d7ffdb8-hjw45" Jun 14 13:36:30.582965 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.582954 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-metrics-certs\") pod \"router-default-565d7ffdb8-hjw45\" (UID: \"341c9198-cdc6-43c8-a9bd-eb0e957f2e19\") " pod="openshift-ingress/router-default-565d7ffdb8-hjw45" Jun 14 13:36:30.583197 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.582981 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm4s4\" (UniqueName: \"kubernetes.io/projected/d7ed995a-f86e-46d9-833d-6c2021201228-kube-api-access-vm4s4\") pod \"network-check-source-6947749cfc-fdz7k\" (UID: \"d7ed995a-f86e-46d9-833d-6c2021201228\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-fdz7k" Jun 14 13:36:30.583197 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.583009 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-stats-auth\") pod \"router-default-565d7ffdb8-hjw45\" (UID: \"341c9198-cdc6-43c8-a9bd-eb0e957f2e19\") " pod="openshift-ingress/router-default-565d7ffdb8-hjw45" Jun 14 13:36:30.583197 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.583044 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae58844c-88ca-4244-862a-0ceb52ca66f8-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-9d55q\" (UID: \"ae58844c-88ca-4244-862a-0ceb52ca66f8\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-9d55q" Jun 14 13:36:30.583197 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:30.583190 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 13:36:30.583394 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:30.583253 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae58844c-88ca-4244-862a-0ceb52ca66f8-networking-console-plugin-cert podName:ae58844c-88ca-4244-862a-0ceb52ca66f8 nodeName:}" failed. No retries permitted until 2026-06-14 13:36:31.083231921 +0000 UTC m=+223.756499846 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ae58844c-88ca-4244-862a-0ceb52ca66f8-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-9d55q" (UID: "ae58844c-88ca-4244-862a-0ceb52ca66f8") : secret "networking-console-plugin-cert" not found Jun 14 13:36:30.583394 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:30.583261 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 13:36:30.583394 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:30.583318 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-metrics-certs podName:341c9198-cdc6-43c8-a9bd-eb0e957f2e19 nodeName:}" failed. No retries permitted until 2026-06-14 13:36:31.083300736 +0000 UTC m=+223.756568679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-metrics-certs") pod "router-default-565d7ffdb8-hjw45" (UID: "341c9198-cdc6-43c8-a9bd-eb0e957f2e19") : secret "router-metrics-certs-default" not found Jun 14 13:36:30.583573 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:30.583537 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-service-ca-bundle podName:341c9198-cdc6-43c8-a9bd-eb0e957f2e19 nodeName:}" failed. No retries permitted until 2026-06-14 13:36:31.083518159 +0000 UTC m=+223.756786128 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-service-ca-bundle") pod "router-default-565d7ffdb8-hjw45" (UID: "341c9198-cdc6-43c8-a9bd-eb0e957f2e19") : configmap references non-existent config key: service-ca.crt Jun 14 13:36:30.584050 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.584022 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ae58844c-88ca-4244-862a-0ceb52ca66f8-nginx-conf\") pod \"networking-console-plugin-867b76cb74-9d55q\" (UID: \"ae58844c-88ca-4244-862a-0ceb52ca66f8\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-9d55q" Jun 14 13:36:30.586092 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.586046 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-stats-auth\") pod \"router-default-565d7ffdb8-hjw45\" (UID: \"341c9198-cdc6-43c8-a9bd-eb0e957f2e19\") " pod="openshift-ingress/router-default-565d7ffdb8-hjw45" Jun 14 13:36:30.586187 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.586148 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-default-certificate\") pod \"router-default-565d7ffdb8-hjw45\" (UID: \"341c9198-cdc6-43c8-a9bd-eb0e957f2e19\") " pod="openshift-ingress/router-default-565d7ffdb8-hjw45" Jun 14 13:36:30.587755 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.587633 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:30.596446 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.596364 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm4s4\" (UniqueName: \"kubernetes.io/projected/d7ed995a-f86e-46d9-833d-6c2021201228-kube-api-access-vm4s4\") pod \"network-check-source-6947749cfc-fdz7k\" (UID: \"d7ed995a-f86e-46d9-833d-6c2021201228\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-fdz7k" Jun 14 13:36:30.598447 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.597827 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lppsl\" (UniqueName: \"kubernetes.io/projected/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-kube-api-access-lppsl\") pod \"router-default-565d7ffdb8-hjw45\" (UID: \"341c9198-cdc6-43c8-a9bd-eb0e957f2e19\") " pod="openshift-ingress/router-default-565d7ffdb8-hjw45" Jun 14 13:36:30.650011 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.649964 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z9xc4" Jun 14 13:36:30.658389 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.658360 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-fdz7k" Jun 14 13:36:30.699964 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.699935 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-kfm5z"] Jun 14 13:36:30.702035 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:36:30.702008 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefba00b2_fae9_4f69_88a9_f4cf7692107f.slice/crio-0dbe83ad81c497008ae7346c97cb9fb27bebb8515e13326fa76ca413f422ca78 WatchSource:0}: Error finding container 0dbe83ad81c497008ae7346c97cb9fb27bebb8515e13326fa76ca413f422ca78: Status 404 returned error can't find the container with id 0dbe83ad81c497008ae7346c97cb9fb27bebb8515e13326fa76ca413f422ca78 Jun 14 13:36:30.783141 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.783111 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z9xc4"] Jun 14 13:36:30.786386 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:36:30.786357 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41e65aca_204a_43b9_89b5_a800f28d1e94.slice/crio-9ea50e288b369dd6cd00189c580e0c1dbd0d5e6475ad0865f9ca8e5acace978a WatchSource:0}: Error finding container 9ea50e288b369dd6cd00189c580e0c1dbd0d5e6475ad0865f9ca8e5acace978a: Status 404 returned error can't find the container with id 9ea50e288b369dd6cd00189c580e0c1dbd0d5e6475ad0865f9ca8e5acace978a Jun 14 13:36:30.804553 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.804528 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-fdz7k"] Jun 14 13:36:30.806756 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:36:30.806730 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7ed995a_f86e_46d9_833d_6c2021201228.slice/crio-6c40d8436e51ebd75c8fff22a04d84cd958656b06f28d158400ff0f428378009 WatchSource:0}: Error finding container 6c40d8436e51ebd75c8fff22a04d84cd958656b06f28d158400ff0f428378009: Status 404 returned error can't find the container with id 6c40d8436e51ebd75c8fff22a04d84cd958656b06f28d158400ff0f428378009 Jun 14 13:36:30.912527 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.912497 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-dwq9q"] Jun 14 13:36:30.914797 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.914773 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-5rkgs"] Jun 14 13:36:30.915537 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:36:30.915517 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fea963c_a8b6_4071_8071_3e7149ef98cd.slice/crio-12ea0c54385aecb2427dda1978c343003c83802841d88de6fd4c364502a15758 WatchSource:0}: Error finding container 12ea0c54385aecb2427dda1978c343003c83802841d88de6fd4c364502a15758: Status 404 returned error can't find the container with id 12ea0c54385aecb2427dda1978c343003c83802841d88de6fd4c364502a15758 Jun 14 13:36:30.917348 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:36:30.917327 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa652aa2_ad08_4742_9489_be4b1d474712.slice/crio-c8e7e464b7e7e6542914278ce77d92140011e2b29807914bc8bd26117935e893 WatchSource:0}: Error finding container c8e7e464b7e7e6542914278ce77d92140011e2b29807914bc8bd26117935e893: Status 404 returned error can't find the container with id c8e7e464b7e7e6542914278ce77d92140011e2b29807914bc8bd26117935e893 Jun 14 13:36:30.987558 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:30.987519 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a66a11c-63e7-477b-a84d-3cf0102368a1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-g5jx2\" (UID: \"2a66a11c-63e7-477b-a84d-3cf0102368a1\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-g5jx2" Jun 14 13:36:30.987730 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:30.987705 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 13:36:30.987801 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:30.987790 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a66a11c-63e7-477b-a84d-3cf0102368a1-cluster-monitoring-operator-tls podName:2a66a11c-63e7-477b-a84d-3cf0102368a1 nodeName:}" failed. No retries permitted until 2026-06-14 13:36:31.987770795 +0000 UTC m=+224.661038735 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2a66a11c-63e7-477b-a84d-3cf0102368a1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-g5jx2" (UID: "2a66a11c-63e7-477b-a84d-3cf0102368a1") : secret "cluster-monitoring-operator-tls" not found Jun 14 13:36:31.088761 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:31.088666 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-metrics-certs\") pod \"router-default-565d7ffdb8-hjw45\" (UID: \"341c9198-cdc6-43c8-a9bd-eb0e957f2e19\") " pod="openshift-ingress/router-default-565d7ffdb8-hjw45" Jun 14 13:36:31.088761 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:31.088732 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae58844c-88ca-4244-862a-0ceb52ca66f8-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-9d55q\" (UID: \"ae58844c-88ca-4244-862a-0ceb52ca66f8\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-9d55q" Jun 14 13:36:31.088975 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:31.088814 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 13:36:31.088975 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:31.088830 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-service-ca-bundle\") pod \"router-default-565d7ffdb8-hjw45\" (UID: \"341c9198-cdc6-43c8-a9bd-eb0e957f2e19\") " pod="openshift-ingress/router-default-565d7ffdb8-hjw45" Jun 14 13:36:31.088975 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:31.088874 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-metrics-certs podName:341c9198-cdc6-43c8-a9bd-eb0e957f2e19 nodeName:}" failed. No retries permitted until 2026-06-14 13:36:32.088859116 +0000 UTC m=+224.762127060 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-metrics-certs") pod "router-default-565d7ffdb8-hjw45" (UID: "341c9198-cdc6-43c8-a9bd-eb0e957f2e19") : secret "router-metrics-certs-default" not found Jun 14 13:36:31.088975 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:31.088907 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 13:36:31.088975 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:31.088953 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-service-ca-bundle podName:341c9198-cdc6-43c8-a9bd-eb0e957f2e19 nodeName:}" failed. No retries permitted until 2026-06-14 13:36:32.088935861 +0000 UTC m=+224.762203788 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-service-ca-bundle") pod "router-default-565d7ffdb8-hjw45" (UID: "341c9198-cdc6-43c8-a9bd-eb0e957f2e19") : configmap references non-existent config key: service-ca.crt Jun 14 13:36:31.088975 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:31.088973 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae58844c-88ca-4244-862a-0ceb52ca66f8-networking-console-plugin-cert podName:ae58844c-88ca-4244-862a-0ceb52ca66f8 nodeName:}" failed. No retries permitted until 2026-06-14 13:36:32.088963605 +0000 UTC m=+224.762231534 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ae58844c-88ca-4244-862a-0ceb52ca66f8-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-9d55q" (UID: "ae58844c-88ca-4244-862a-0ceb52ca66f8") : secret "networking-console-plugin-cert" not found Jun 14 13:36:31.555861 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:31.555828 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-5rkgs" event={"ID":"fa652aa2-ad08-4742-9489-be4b1d474712","Type":"ContainerStarted","Data":"c8e7e464b7e7e6542914278ce77d92140011e2b29807914bc8bd26117935e893"} Jun 14 13:36:31.558300 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:31.558189 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-fdz7k" event={"ID":"d7ed995a-f86e-46d9-833d-6c2021201228","Type":"ContainerStarted","Data":"2522818778b170267fe0661b0fb81697ef08c22cfa62f25298d0c34460c8beac"} Jun 14 13:36:31.558300 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:31.558238 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-fdz7k" event={"ID":"d7ed995a-f86e-46d9-833d-6c2021201228","Type":"ContainerStarted","Data":"6c40d8436e51ebd75c8fff22a04d84cd958656b06f28d158400ff0f428378009"} Jun 14 13:36:31.561260 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:31.561052 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-kfm5z" event={"ID":"efba00b2-fae9-4f69-88a9-f4cf7692107f","Type":"ContainerStarted","Data":"0dbe83ad81c497008ae7346c97cb9fb27bebb8515e13326fa76ca413f422ca78"} Jun 14 13:36:31.564026 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:31.563997 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z9xc4" event={"ID":"41e65aca-204a-43b9-89b5-a800f28d1e94","Type":"ContainerStarted","Data":"9ea50e288b369dd6cd00189c580e0c1dbd0d5e6475ad0865f9ca8e5acace978a"} Jun 14 13:36:31.566163 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:31.566139 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-dwq9q" event={"ID":"1fea963c-a8b6-4071-8071-3e7149ef98cd","Type":"ContainerStarted","Data":"12ea0c54385aecb2427dda1978c343003c83802841d88de6fd4c364502a15758"} Jun 14 13:36:31.574228 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:31.572904 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-fdz7k" podStartSLOduration=1.572886676 podStartE2EDuration="1.572886676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:36:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:36:31.572462608 +0000 UTC m=+224.245730554" watchObservedRunningTime="2026-06-14 13:36:31.572886676 +0000 UTC m=+224.246154624" Jun 14 13:36:31.996546 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:31.996488 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a66a11c-63e7-477b-a84d-3cf0102368a1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-g5jx2\" (UID: \"2a66a11c-63e7-477b-a84d-3cf0102368a1\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-g5jx2" Jun 14 13:36:31.996705 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:31.996641 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 13:36:31.996779 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:31.996721 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a66a11c-63e7-477b-a84d-3cf0102368a1-cluster-monitoring-operator-tls podName:2a66a11c-63e7-477b-a84d-3cf0102368a1 nodeName:}" failed. No retries permitted until 2026-06-14 13:36:33.996701136 +0000 UTC m=+226.669969073 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2a66a11c-63e7-477b-a84d-3cf0102368a1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-g5jx2" (UID: "2a66a11c-63e7-477b-a84d-3cf0102368a1") : secret "cluster-monitoring-operator-tls" not found Jun 14 13:36:32.097230 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:32.097190 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae58844c-88ca-4244-862a-0ceb52ca66f8-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-9d55q\" (UID: \"ae58844c-88ca-4244-862a-0ceb52ca66f8\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-9d55q" Jun 14 13:36:32.097403 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:32.097349 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-service-ca-bundle\") pod \"router-default-565d7ffdb8-hjw45\" (UID: \"341c9198-cdc6-43c8-a9bd-eb0e957f2e19\") " pod="openshift-ingress/router-default-565d7ffdb8-hjw45" Jun 14 13:36:32.097467 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:32.097406 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-metrics-certs\") pod \"router-default-565d7ffdb8-hjw45\" (UID: \"341c9198-cdc6-43c8-a9bd-eb0e957f2e19\") " pod="openshift-ingress/router-default-565d7ffdb8-hjw45" Jun 14 13:36:32.097558 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:32.097539 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 13:36:32.097617 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:32.097611 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-metrics-certs podName:341c9198-cdc6-43c8-a9bd-eb0e957f2e19 nodeName:}" failed. No retries permitted until 2026-06-14 13:36:34.097592208 +0000 UTC m=+226.770860145 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-metrics-certs") pod "router-default-565d7ffdb8-hjw45" (UID: "341c9198-cdc6-43c8-a9bd-eb0e957f2e19") : secret "router-metrics-certs-default" not found Jun 14 13:36:32.098058 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:32.098037 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 13:36:32.098058 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:32.098055 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-service-ca-bundle podName:341c9198-cdc6-43c8-a9bd-eb0e957f2e19 nodeName:}" failed. No retries permitted until 2026-06-14 13:36:34.09803942 +0000 UTC m=+226.771307352 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-service-ca-bundle") pod "router-default-565d7ffdb8-hjw45" (UID: "341c9198-cdc6-43c8-a9bd-eb0e957f2e19") : configmap references non-existent config key: service-ca.crt Jun 14 13:36:32.098211 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:32.098084 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae58844c-88ca-4244-862a-0ceb52ca66f8-networking-console-plugin-cert podName:ae58844c-88ca-4244-862a-0ceb52ca66f8 nodeName:}" failed. No retries permitted until 2026-06-14 13:36:34.098073601 +0000 UTC m=+226.771341526 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ae58844c-88ca-4244-862a-0ceb52ca66f8-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-9d55q" (UID: "ae58844c-88ca-4244-862a-0ceb52ca66f8") : secret "networking-console-plugin-cert" not found Jun 14 13:36:32.572654 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:32.572609 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-kfm5z" event={"ID":"efba00b2-fae9-4f69-88a9-f4cf7692107f","Type":"ContainerStarted","Data":"19aa7b634fa9879aa49b0af54231b03aebae1ddd9bce85412eb830bdad02f1e0"} Jun 14 13:36:32.588238 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:32.588183 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-kfm5z" podStartSLOduration=1.156479592 podStartE2EDuration="2.58816681s" totalImagesPullingTime="1.431687218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:36:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:36:32.587161765 +0000 UTC m=+225.260429711" watchObservedRunningTime="2026-06-14 13:36:32.58816681 +0000 UTC m=+225.261434792" Jun 14 13:36:32.674498 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:32.674393 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:32.732045 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:32.732012 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:34.015657 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:34.015622 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a66a11c-63e7-477b-a84d-3cf0102368a1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-g5jx2\" (UID: \"2a66a11c-63e7-477b-a84d-3cf0102368a1\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-g5jx2" Jun 14 13:36:34.016017 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:34.015758 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 13:36:34.016017 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:34.015818 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a66a11c-63e7-477b-a84d-3cf0102368a1-cluster-monitoring-operator-tls podName:2a66a11c-63e7-477b-a84d-3cf0102368a1 nodeName:}" failed. No retries permitted until 2026-06-14 13:36:38.015802549 +0000 UTC m=+230.689070477 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2a66a11c-63e7-477b-a84d-3cf0102368a1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-g5jx2" (UID: "2a66a11c-63e7-477b-a84d-3cf0102368a1") : secret "cluster-monitoring-operator-tls" not found Jun 14 13:36:34.116650 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:34.116624 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-service-ca-bundle\") pod \"router-default-565d7ffdb8-hjw45\" (UID: \"341c9198-cdc6-43c8-a9bd-eb0e957f2e19\") " pod="openshift-ingress/router-default-565d7ffdb8-hjw45" Jun 14 13:36:34.116786 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:34.116668 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-metrics-certs\") pod \"router-default-565d7ffdb8-hjw45\" (UID: \"341c9198-cdc6-43c8-a9bd-eb0e957f2e19\") " pod="openshift-ingress/router-default-565d7ffdb8-hjw45" Jun 14 13:36:34.116786 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:34.116710 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae58844c-88ca-4244-862a-0ceb52ca66f8-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-9d55q\" (UID: \"ae58844c-88ca-4244-862a-0ceb52ca66f8\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-9d55q" Jun 14 13:36:34.116897 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:34.116872 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-service-ca-bundle podName:341c9198-cdc6-43c8-a9bd-eb0e957f2e19 nodeName:}" failed. No retries permitted until 2026-06-14 13:36:38.116848803 +0000 UTC m=+230.790116743 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-service-ca-bundle") pod "router-default-565d7ffdb8-hjw45" (UID: "341c9198-cdc6-43c8-a9bd-eb0e957f2e19") : configmap references non-existent config key: service-ca.crt Jun 14 13:36:34.116957 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:34.116915 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 13:36:34.117014 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:34.116967 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 13:36:34.117014 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:34.116988 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae58844c-88ca-4244-862a-0ceb52ca66f8-networking-console-plugin-cert podName:ae58844c-88ca-4244-862a-0ceb52ca66f8 nodeName:}" failed. No retries permitted until 2026-06-14 13:36:38.116961855 +0000 UTC m=+230.790229778 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ae58844c-88ca-4244-862a-0ceb52ca66f8-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-9d55q" (UID: "ae58844c-88ca-4244-862a-0ceb52ca66f8") : secret "networking-console-plugin-cert" not found Jun 14 13:36:34.117014 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:34.117007 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-metrics-certs podName:341c9198-cdc6-43c8-a9bd-eb0e957f2e19 nodeName:}" failed. No retries permitted until 2026-06-14 13:36:38.116996985 +0000 UTC m=+230.790264914 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-metrics-certs") pod "router-default-565d7ffdb8-hjw45" (UID: "341c9198-cdc6-43c8-a9bd-eb0e957f2e19") : secret "router-metrics-certs-default" not found Jun 14 13:36:34.581411 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:34.581379 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z9xc4" event={"ID":"41e65aca-204a-43b9-89b5-a800f28d1e94","Type":"ContainerStarted","Data":"8982cef8fabbb19fe634d89a34d7d4bd3e5a93d6b885501d7c348305a6ed8430"} Jun 14 13:36:34.583064 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:34.583038 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-dwq9q_1fea963c-a8b6-4071-8071-3e7149ef98cd/console-operator/0.log" Jun 14 13:36:34.583211 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:34.583084 2557 generic.go:356] "Generic (PLEG): container finished" podID="1fea963c-a8b6-4071-8071-3e7149ef98cd" containerID="ff9111bc98a4e783dae88372c03e0b955e8b9841add4bda1f9bbfa63f4cbf93b" exitCode=255 Jun 14 13:36:34.583211 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:34.583175 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-dwq9q" event={"ID":"1fea963c-a8b6-4071-8071-3e7149ef98cd","Type":"ContainerDied","Data":"ff9111bc98a4e783dae88372c03e0b955e8b9841add4bda1f9bbfa63f4cbf93b"} Jun 14 13:36:34.583370 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:34.583354 2557 scope.go:117] "RemoveContainer" containerID="ff9111bc98a4e783dae88372c03e0b955e8b9841add4bda1f9bbfa63f4cbf93b" Jun 14 13:36:34.584696 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:34.584660 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-5rkgs" event={"ID":"fa652aa2-ad08-4742-9489-be4b1d474712","Type":"ContainerStarted","Data":"be1806ed4b04fc5c7781f41c1ed0bd4db161a4fb1f0e88e9bfad829b07bb0aa9"} Jun 14 13:36:34.596306 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:34.596260 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z9xc4" podStartSLOduration=1.316499828 podStartE2EDuration="4.596243979s" totalImagesPullingTime="3.279744151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:36:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:36:34.595069865 +0000 UTC m=+227.268337815" watchObservedRunningTime="2026-06-14 13:36:34.596243979 +0000 UTC m=+227.269511926" Jun 14 13:36:34.628574 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:34.628524 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-5rkgs" podStartSLOduration=1.48185941 podStartE2EDuration="4.62850482s" totalImagesPullingTime="3.14664541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:36:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:36:34.62680911 +0000 UTC m=+227.300077068" watchObservedRunningTime="2026-06-14 13:36:34.62850482 +0000 UTC m=+227.301772769" Jun 14 13:36:34.765510 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:34.765482 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:34.861071 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:34.860975 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:34.959477 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:34.959426 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:35.211869 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:35.211828 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:35.271735 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:35.271697 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qfjzz"] Jun 14 13:36:35.277400 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:35.277364 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qfjzz" Jun 14 13:36:35.282498 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:35.282470 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r85mh\"" Jun 14 13:36:35.282847 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:35.282501 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 14 13:36:35.283401 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:35.282582 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 14 13:36:35.283401 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:35.282617 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:35.289129 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:35.289106 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qfjzz"] Jun 14 13:36:35.344059 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:35.344024 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:35.428385 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:35.428345 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41378e80-cec7-4a96-acce-1d65b6e764d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qfjzz\" (UID: \"41378e80-cec7-4a96-acce-1d65b6e764d3\") " pod="openshift-insights/insights-runtime-extractor-qfjzz" Jun 14 13:36:35.428551 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:35.428395 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/41378e80-cec7-4a96-acce-1d65b6e764d3-data-volume\") pod \"insights-runtime-extractor-qfjzz\" (UID: \"41378e80-cec7-4a96-acce-1d65b6e764d3\") " pod="openshift-insights/insights-runtime-extractor-qfjzz" Jun 14 13:36:35.428551 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:35.428485 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/41378e80-cec7-4a96-acce-1d65b6e764d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qfjzz\" (UID: \"41378e80-cec7-4a96-acce-1d65b6e764d3\") " pod="openshift-insights/insights-runtime-extractor-qfjzz" Jun 14 13:36:35.428551 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:35.428538 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/41378e80-cec7-4a96-acce-1d65b6e764d3-crio-socket\") pod \"insights-runtime-extractor-qfjzz\" (UID: \"41378e80-cec7-4a96-acce-1d65b6e764d3\") " pod="openshift-insights/insights-runtime-extractor-qfjzz" Jun 14 13:36:35.428667 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:35.428603 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkqvr\" (UniqueName: \"kubernetes.io/projected/41378e80-cec7-4a96-acce-1d65b6e764d3-kube-api-access-vkqvr\") pod \"insights-runtime-extractor-qfjzz\" (UID: \"41378e80-cec7-4a96-acce-1d65b6e764d3\") " pod="openshift-insights/insights-runtime-extractor-qfjzz" Jun 14 13:36:35.529353 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:35.529245 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41378e80-cec7-4a96-acce-1d65b6e764d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qfjzz\" (UID: \"41378e80-cec7-4a96-acce-1d65b6e764d3\") " pod="openshift-insights/insights-runtime-extractor-qfjzz" Jun 14 13:36:35.529353 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:35.529309 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/41378e80-cec7-4a96-acce-1d65b6e764d3-data-volume\") pod \"insights-runtime-extractor-qfjzz\" (UID: \"41378e80-cec7-4a96-acce-1d65b6e764d3\") " pod="openshift-insights/insights-runtime-extractor-qfjzz" Jun 14 13:36:35.529353 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:35.529359 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/41378e80-cec7-4a96-acce-1d65b6e764d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qfjzz\" (UID: \"41378e80-cec7-4a96-acce-1d65b6e764d3\") " pod="openshift-insights/insights-runtime-extractor-qfjzz" Jun 14 13:36:35.529609 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:35.529399 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 13:36:35.529609 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:35.529464 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/41378e80-cec7-4a96-acce-1d65b6e764d3-crio-socket\") pod \"insights-runtime-extractor-qfjzz\" (UID: \"41378e80-cec7-4a96-acce-1d65b6e764d3\") " pod="openshift-insights/insights-runtime-extractor-qfjzz" Jun 14 13:36:35.529609 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:35.529470 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 13:36:35.529609 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:35.529405 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/41378e80-cec7-4a96-acce-1d65b6e764d3-crio-socket\") pod \"insights-runtime-extractor-qfjzz\" (UID: \"41378e80-cec7-4a96-acce-1d65b6e764d3\") " pod="openshift-insights/insights-runtime-extractor-qfjzz" Jun 14 13:36:35.529609 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:35.529490 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41378e80-cec7-4a96-acce-1d65b6e764d3-insights-runtime-extractor-tls podName:41378e80-cec7-4a96-acce-1d65b6e764d3 nodeName:}" failed. No retries permitted until 2026-06-14 13:36:36.029468962 +0000 UTC m=+228.702736899 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/41378e80-cec7-4a96-acce-1d65b6e764d3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qfjzz" (UID: "41378e80-cec7-4a96-acce-1d65b6e764d3") : secret "insights-runtime-extractor-tls" not found Jun 14 13:36:35.529609 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:35.529551 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41378e80-cec7-4a96-acce-1d65b6e764d3-kube-rbac-proxy-cm podName:41378e80-cec7-4a96-acce-1d65b6e764d3 nodeName:}" failed. No retries permitted until 2026-06-14 13:36:36.029534463 +0000 UTC m=+228.702802403 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/41378e80-cec7-4a96-acce-1d65b6e764d3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qfjzz" (UID: "41378e80-cec7-4a96-acce-1d65b6e764d3") : configmap "kube-rbac-proxy" not found Jun 14 13:36:35.529609 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:35.529606 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkqvr\" (UniqueName: \"kubernetes.io/projected/41378e80-cec7-4a96-acce-1d65b6e764d3-kube-api-access-vkqvr\") pod \"insights-runtime-extractor-qfjzz\" (UID: \"41378e80-cec7-4a96-acce-1d65b6e764d3\") " pod="openshift-insights/insights-runtime-extractor-qfjzz" Jun 14 13:36:35.529944 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:35.529667 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/41378e80-cec7-4a96-acce-1d65b6e764d3-data-volume\") pod \"insights-runtime-extractor-qfjzz\" (UID: \"41378e80-cec7-4a96-acce-1d65b6e764d3\") " pod="openshift-insights/insights-runtime-extractor-qfjzz" Jun 14 13:36:35.537577 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:35.537559 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkqvr\" (UniqueName: \"kubernetes.io/projected/41378e80-cec7-4a96-acce-1d65b6e764d3-kube-api-access-vkqvr\") pod \"insights-runtime-extractor-qfjzz\" (UID: \"41378e80-cec7-4a96-acce-1d65b6e764d3\") " pod="openshift-insights/insights-runtime-extractor-qfjzz" Jun 14 13:36:35.589734 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:35.589713 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-dwq9q_1fea963c-a8b6-4071-8071-3e7149ef98cd/console-operator/1.log" Jun 14 13:36:35.590120 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:35.590103 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-dwq9q_1fea963c-a8b6-4071-8071-3e7149ef98cd/console-operator/0.log" Jun 14 13:36:35.590210 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:35.590141 2557 generic.go:356] "Generic (PLEG): container finished" podID="1fea963c-a8b6-4071-8071-3e7149ef98cd" containerID="18bf79238b82b984c45bc01d3f526cbe8cc9caf973ead35f269dba4a33c22cae" exitCode=255 Jun 14 13:36:35.590415 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:35.590226 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-dwq9q" event={"ID":"1fea963c-a8b6-4071-8071-3e7149ef98cd","Type":"ContainerDied","Data":"18bf79238b82b984c45bc01d3f526cbe8cc9caf973ead35f269dba4a33c22cae"} Jun 14 13:36:35.590415 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:35.590284 2557 scope.go:117] "RemoveContainer" containerID="ff9111bc98a4e783dae88372c03e0b955e8b9841add4bda1f9bbfa63f4cbf93b" Jun 14 13:36:35.590537 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:35.590523 2557 scope.go:117] "RemoveContainer" containerID="18bf79238b82b984c45bc01d3f526cbe8cc9caf973ead35f269dba4a33c22cae" Jun 14 13:36:35.590769 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:35.590741 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-dwq9q_openshift-console-operator(1fea963c-a8b6-4071-8071-3e7149ef98cd)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-dwq9q" podUID="1fea963c-a8b6-4071-8071-3e7149ef98cd" Jun 14 13:36:35.643749 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:35.643712 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:35.744867 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:35.744830 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:35.918136 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:35.918101 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:36.018127 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:36.018093 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:36.034203 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:36.034178 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41378e80-cec7-4a96-acce-1d65b6e764d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qfjzz\" (UID: \"41378e80-cec7-4a96-acce-1d65b6e764d3\") " pod="openshift-insights/insights-runtime-extractor-qfjzz" Jun 14 13:36:36.034339 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:36.034228 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/41378e80-cec7-4a96-acce-1d65b6e764d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qfjzz\" (UID: \"41378e80-cec7-4a96-acce-1d65b6e764d3\") " pod="openshift-insights/insights-runtime-extractor-qfjzz" Jun 14 13:36:36.034339 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:36.034305 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 13:36:36.034339 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:36.034325 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 13:36:36.034441 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:36.034364 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41378e80-cec7-4a96-acce-1d65b6e764d3-kube-rbac-proxy-cm podName:41378e80-cec7-4a96-acce-1d65b6e764d3 nodeName:}" failed. No retries permitted until 2026-06-14 13:36:37.034347158 +0000 UTC m=+229.707615108 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/41378e80-cec7-4a96-acce-1d65b6e764d3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qfjzz" (UID: "41378e80-cec7-4a96-acce-1d65b6e764d3") : configmap "kube-rbac-proxy" not found Jun 14 13:36:36.034441 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:36.034387 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41378e80-cec7-4a96-acce-1d65b6e764d3-insights-runtime-extractor-tls podName:41378e80-cec7-4a96-acce-1d65b6e764d3 nodeName:}" failed. No retries permitted until 2026-06-14 13:36:37.034374174 +0000 UTC m=+229.707642097 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/41378e80-cec7-4a96-acce-1d65b6e764d3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qfjzz" (UID: "41378e80-cec7-4a96-acce-1d65b6e764d3") : secret "insights-runtime-extractor-tls" not found Jun 14 13:36:36.594525 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:36.594498 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-dwq9q_1fea963c-a8b6-4071-8071-3e7149ef98cd/console-operator/1.log" Jun 14 13:36:36.595014 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:36.594930 2557 scope.go:117] "RemoveContainer" containerID="18bf79238b82b984c45bc01d3f526cbe8cc9caf973ead35f269dba4a33c22cae" Jun 14 13:36:36.595137 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:36.595116 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-dwq9q_openshift-console-operator(1fea963c-a8b6-4071-8071-3e7149ef98cd)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-dwq9q" podUID="1fea963c-a8b6-4071-8071-3e7149ef98cd" Jun 14 13:36:37.043631 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:37.043590 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41378e80-cec7-4a96-acce-1d65b6e764d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qfjzz\" (UID: \"41378e80-cec7-4a96-acce-1d65b6e764d3\") " pod="openshift-insights/insights-runtime-extractor-qfjzz" Jun 14 13:36:37.043839 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:37.043649 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/41378e80-cec7-4a96-acce-1d65b6e764d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qfjzz\" (UID: \"41378e80-cec7-4a96-acce-1d65b6e764d3\") " pod="openshift-insights/insights-runtime-extractor-qfjzz" Jun 14 13:36:37.043839 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:37.043754 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 13:36:37.043839 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:37.043822 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41378e80-cec7-4a96-acce-1d65b6e764d3-insights-runtime-extractor-tls podName:41378e80-cec7-4a96-acce-1d65b6e764d3 nodeName:}" failed. No retries permitted until 2026-06-14 13:36:39.043806649 +0000 UTC m=+231.717074574 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/41378e80-cec7-4a96-acce-1d65b6e764d3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qfjzz" (UID: "41378e80-cec7-4a96-acce-1d65b6e764d3") : secret "insights-runtime-extractor-tls" not found Jun 14 13:36:37.043974 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:37.043758 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 13:36:37.043974 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:37.043886 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41378e80-cec7-4a96-acce-1d65b6e764d3-kube-rbac-proxy-cm podName:41378e80-cec7-4a96-acce-1d65b6e764d3 nodeName:}" failed. No retries permitted until 2026-06-14 13:36:39.043875018 +0000 UTC m=+231.717142946 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/41378e80-cec7-4a96-acce-1d65b6e764d3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qfjzz" (UID: "41378e80-cec7-4a96-acce-1d65b6e764d3") : configmap "kube-rbac-proxy" not found Jun 14 13:36:37.236039 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:37.236007 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:37.286154 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:37.286126 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:37.519361 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:37.519324 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-2hn7x"] Jun 14 13:36:37.523791 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:37.523774 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-2hn7x" Jun 14 13:36:37.527187 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:37.527167 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-8l4xk\"" Jun 14 13:36:37.527187 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:37.527180 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 14 13:36:37.527672 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:37.527652 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 14 13:36:37.527770 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:37.527658 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 14 13:36:37.527770 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:37.527661 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 14 13:36:37.529813 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:37.529789 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-2hn7x"] Jun 14 13:36:37.551673 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:37.551642 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:37.604060 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:37.604036 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:37.648777 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:37.648748 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7fgt\" (UniqueName: \"kubernetes.io/projected/f5d25e25-8e60-4643-bbaa-5553906dda8f-kube-api-access-n7fgt\") pod \"service-ca-7b994bc59-2hn7x\" (UID: \"f5d25e25-8e60-4643-bbaa-5553906dda8f\") " pod="openshift-service-ca/service-ca-7b994bc59-2hn7x" Jun 14 13:36:37.648869 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:37.648781 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f5d25e25-8e60-4643-bbaa-5553906dda8f-signing-key\") pod \"service-ca-7b994bc59-2hn7x\" (UID: \"f5d25e25-8e60-4643-bbaa-5553906dda8f\") " pod="openshift-service-ca/service-ca-7b994bc59-2hn7x" Jun 14 13:36:37.648869 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:37.648849 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f5d25e25-8e60-4643-bbaa-5553906dda8f-signing-cabundle\") pod \"service-ca-7b994bc59-2hn7x\" (UID: \"f5d25e25-8e60-4643-bbaa-5553906dda8f\") " pod="openshift-service-ca/service-ca-7b994bc59-2hn7x" Jun 14 13:36:37.750014 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:37.749980 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7fgt\" (UniqueName: \"kubernetes.io/projected/f5d25e25-8e60-4643-bbaa-5553906dda8f-kube-api-access-n7fgt\") pod \"service-ca-7b994bc59-2hn7x\" (UID: \"f5d25e25-8e60-4643-bbaa-5553906dda8f\") " pod="openshift-service-ca/service-ca-7b994bc59-2hn7x" Jun 14 13:36:37.750014 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:37.750010 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f5d25e25-8e60-4643-bbaa-5553906dda8f-signing-key\") pod \"service-ca-7b994bc59-2hn7x\" (UID: \"f5d25e25-8e60-4643-bbaa-5553906dda8f\") " pod="openshift-service-ca/service-ca-7b994bc59-2hn7x" Jun 14 13:36:37.750188 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:37.750041 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f5d25e25-8e60-4643-bbaa-5553906dda8f-signing-cabundle\") pod \"service-ca-7b994bc59-2hn7x\" (UID: \"f5d25e25-8e60-4643-bbaa-5553906dda8f\") " pod="openshift-service-ca/service-ca-7b994bc59-2hn7x" Jun 14 13:36:37.750636 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:37.750618 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f5d25e25-8e60-4643-bbaa-5553906dda8f-signing-cabundle\") pod \"service-ca-7b994bc59-2hn7x\" (UID: \"f5d25e25-8e60-4643-bbaa-5553906dda8f\") " pod="openshift-service-ca/service-ca-7b994bc59-2hn7x" Jun 14 13:36:37.752387 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:37.752366 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f5d25e25-8e60-4643-bbaa-5553906dda8f-signing-key\") pod \"service-ca-7b994bc59-2hn7x\" (UID: \"f5d25e25-8e60-4643-bbaa-5553906dda8f\") " pod="openshift-service-ca/service-ca-7b994bc59-2hn7x" Jun 14 13:36:37.758144 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:37.758125 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7fgt\" (UniqueName: \"kubernetes.io/projected/f5d25e25-8e60-4643-bbaa-5553906dda8f-kube-api-access-n7fgt\") pod \"service-ca-7b994bc59-2hn7x\" (UID: \"f5d25e25-8e60-4643-bbaa-5553906dda8f\") " pod="openshift-service-ca/service-ca-7b994bc59-2hn7x" Jun 14 13:36:37.834058 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:37.833972 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-2hn7x" Jun 14 13:36:37.952419 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:37.952389 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-2hn7x"] Jun 14 13:36:37.954990 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:36:37.954964 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5d25e25_8e60_4643_bbaa_5553906dda8f.slice/crio-68a83210aaab2d7837bb4fb7c1bf00a320b715b944ee957a9b48b74022b2cc05 WatchSource:0}: Error finding container 68a83210aaab2d7837bb4fb7c1bf00a320b715b944ee957a9b48b74022b2cc05: Status 404 returned error can't find the container with id 68a83210aaab2d7837bb4fb7c1bf00a320b715b944ee957a9b48b74022b2cc05 Jun 14 13:36:38.052919 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:38.052880 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a66a11c-63e7-477b-a84d-3cf0102368a1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-g5jx2\" (UID: \"2a66a11c-63e7-477b-a84d-3cf0102368a1\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-g5jx2" Jun 14 13:36:38.053054 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:38.053013 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 13:36:38.053122 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:38.053075 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a66a11c-63e7-477b-a84d-3cf0102368a1-cluster-monitoring-operator-tls podName:2a66a11c-63e7-477b-a84d-3cf0102368a1 nodeName:}" failed. No retries permitted until 2026-06-14 13:36:46.053058227 +0000 UTC m=+238.726326154 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2a66a11c-63e7-477b-a84d-3cf0102368a1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-g5jx2" (UID: "2a66a11c-63e7-477b-a84d-3cf0102368a1") : secret "cluster-monitoring-operator-tls" not found Jun 14 13:36:38.072839 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:38.072817 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hcsvf_31339707-4ec8-4cbb-8014-695a9f156efa/dns-node-resolver/0.log" Jun 14 13:36:38.154230 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:38.154198 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae58844c-88ca-4244-862a-0ceb52ca66f8-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-9d55q\" (UID: \"ae58844c-88ca-4244-862a-0ceb52ca66f8\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-9d55q" Jun 14 13:36:38.154396 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:38.154341 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-service-ca-bundle\") pod \"router-default-565d7ffdb8-hjw45\" (UID: \"341c9198-cdc6-43c8-a9bd-eb0e957f2e19\") " pod="openshift-ingress/router-default-565d7ffdb8-hjw45" Jun 14 13:36:38.154396 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:38.154380 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 13:36:38.154509 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:38.154404 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-metrics-certs\") pod \"router-default-565d7ffdb8-hjw45\" (UID: \"341c9198-cdc6-43c8-a9bd-eb0e957f2e19\") " pod="openshift-ingress/router-default-565d7ffdb8-hjw45" Jun 14 13:36:38.154509 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:38.154454 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae58844c-88ca-4244-862a-0ceb52ca66f8-networking-console-plugin-cert podName:ae58844c-88ca-4244-862a-0ceb52ca66f8 nodeName:}" failed. No retries permitted until 2026-06-14 13:36:46.154432217 +0000 UTC m=+238.827700160 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ae58844c-88ca-4244-862a-0ceb52ca66f8-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-9d55q" (UID: "ae58844c-88ca-4244-862a-0ceb52ca66f8") : secret "networking-console-plugin-cert" not found Jun 14 13:36:38.154594 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:38.154516 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-service-ca-bundle podName:341c9198-cdc6-43c8-a9bd-eb0e957f2e19 nodeName:}" failed. No retries permitted until 2026-06-14 13:36:46.154495425 +0000 UTC m=+238.827763361 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-service-ca-bundle") pod "router-default-565d7ffdb8-hjw45" (UID: "341c9198-cdc6-43c8-a9bd-eb0e957f2e19") : configmap references non-existent config key: service-ca.crt Jun 14 13:36:38.154594 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:38.154525 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 13:36:38.154594 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:38.154567 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-metrics-certs podName:341c9198-cdc6-43c8-a9bd-eb0e957f2e19 nodeName:}" failed. No retries permitted until 2026-06-14 13:36:46.154556019 +0000 UTC m=+238.827823958 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-metrics-certs") pod "router-default-565d7ffdb8-hjw45" (UID: "341c9198-cdc6-43c8-a9bd-eb0e957f2e19") : secret "router-metrics-certs-default" not found Jun 14 13:36:38.432325 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:38.432239 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:38.601286 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:38.601250 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-2hn7x" event={"ID":"f5d25e25-8e60-4643-bbaa-5553906dda8f","Type":"ContainerStarted","Data":"383e0568d54fe52456ccfff6bc16564e0072142e1c2733220a1bfcca94e53a85"} Jun 14 13:36:38.601480 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:38.601319 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-2hn7x" event={"ID":"f5d25e25-8e60-4643-bbaa-5553906dda8f","Type":"ContainerStarted","Data":"68a83210aaab2d7837bb4fb7c1bf00a320b715b944ee957a9b48b74022b2cc05"} Jun 14 13:36:38.618696 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:38.618642 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-2hn7x" podStartSLOduration=1.618628248 podStartE2EDuration="1.618628248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:36:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:36:38.617854267 +0000 UTC m=+231.291122213" watchObservedRunningTime="2026-06-14 13:36:38.618628248 +0000 UTC m=+231.291896225" Jun 14 13:36:39.063593 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:39.063554 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41378e80-cec7-4a96-acce-1d65b6e764d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qfjzz\" (UID: \"41378e80-cec7-4a96-acce-1d65b6e764d3\") " pod="openshift-insights/insights-runtime-extractor-qfjzz" Jun 14 13:36:39.063816 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:39.063617 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/41378e80-cec7-4a96-acce-1d65b6e764d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qfjzz\" (UID: \"41378e80-cec7-4a96-acce-1d65b6e764d3\") " pod="openshift-insights/insights-runtime-extractor-qfjzz" Jun 14 13:36:39.063816 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:39.063724 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 13:36:39.063816 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:39.063759 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 13:36:39.063816 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:39.063785 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41378e80-cec7-4a96-acce-1d65b6e764d3-kube-rbac-proxy-cm podName:41378e80-cec7-4a96-acce-1d65b6e764d3 nodeName:}" failed. No retries permitted until 2026-06-14 13:36:43.063770235 +0000 UTC m=+235.737038180 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/41378e80-cec7-4a96-acce-1d65b6e764d3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qfjzz" (UID: "41378e80-cec7-4a96-acce-1d65b6e764d3") : configmap "kube-rbac-proxy" not found Jun 14 13:36:39.063953 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:39.063851 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41378e80-cec7-4a96-acce-1d65b6e764d3-insights-runtime-extractor-tls podName:41378e80-cec7-4a96-acce-1d65b6e764d3 nodeName:}" failed. No retries permitted until 2026-06-14 13:36:43.06383332 +0000 UTC m=+235.737101248 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/41378e80-cec7-4a96-acce-1d65b6e764d3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qfjzz" (UID: "41378e80-cec7-4a96-acce-1d65b6e764d3") : secret "insights-runtime-extractor-tls" not found Jun 14 13:36:39.071105 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:39.071085 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vhpwp_be7e69d3-6286-4f5c-a895-51baff1834b8/node-ca/0.log" Jun 14 13:36:39.470792 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:39.470765 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:39.656630 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:39.656592 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:39.758907 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:39.758825 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:39.826490 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:39.826449 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:39.967039 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:39.967009 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:40.069306 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:40.069194 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:40.069472 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:40.069358 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qhs44_bc9554de-2cf6-4067-aaf8-59003ac80ddf/serve-healthcheck-canary/0.log" Jun 14 13:36:40.169467 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:40.169432 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:40.562731 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:40.562700 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-dwq9q" Jun 14 13:36:40.562925 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:40.562759 2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-dwq9q" Jun 14 13:36:40.563158 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:40.563142 2557 scope.go:117] "RemoveContainer" containerID="18bf79238b82b984c45bc01d3f526cbe8cc9caf973ead35f269dba4a33c22cae" Jun 14 13:36:40.563337 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:40.563317 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-dwq9q_openshift-console-operator(1fea963c-a8b6-4071-8071-3e7149ef98cd)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-dwq9q" podUID="1fea963c-a8b6-4071-8071-3e7149ef98cd" Jun 14 13:36:40.971140 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:40.971107 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:41.022734 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:41.022696 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:41.566808 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:41.566765 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:41.766659 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:41.766626 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:42.162869 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:42.162834 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:42.376301 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:42.376268 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:42.442597 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:42.442516 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:42.800113 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:42.800028 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:43.101282 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:43.101200 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41378e80-cec7-4a96-acce-1d65b6e764d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qfjzz\" (UID: \"41378e80-cec7-4a96-acce-1d65b6e764d3\") " pod="openshift-insights/insights-runtime-extractor-qfjzz" Jun 14 13:36:43.101282 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:43.101252 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/41378e80-cec7-4a96-acce-1d65b6e764d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qfjzz\" (UID: \"41378e80-cec7-4a96-acce-1d65b6e764d3\") " pod="openshift-insights/insights-runtime-extractor-qfjzz" Jun 14 13:36:43.101461 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:43.101349 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 13:36:43.101461 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:43.101369 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 13:36:43.101461 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:43.101409 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41378e80-cec7-4a96-acce-1d65b6e764d3-insights-runtime-extractor-tls podName:41378e80-cec7-4a96-acce-1d65b6e764d3 nodeName:}" failed. No retries permitted until 2026-06-14 13:36:51.10139451 +0000 UTC m=+243.774662434 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/41378e80-cec7-4a96-acce-1d65b6e764d3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qfjzz" (UID: "41378e80-cec7-4a96-acce-1d65b6e764d3") : secret "insights-runtime-extractor-tls" not found Jun 14 13:36:43.101461 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:43.101442 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41378e80-cec7-4a96-acce-1d65b6e764d3-kube-rbac-proxy-cm podName:41378e80-cec7-4a96-acce-1d65b6e764d3 nodeName:}" failed. No retries permitted until 2026-06-14 13:36:51.101431155 +0000 UTC m=+243.774699079 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/41378e80-cec7-4a96-acce-1d65b6e764d3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qfjzz" (UID: "41378e80-cec7-4a96-acce-1d65b6e764d3") : configmap "kube-rbac-proxy" not found Jun 14 13:36:43.366082 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:43.365986 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:43.416677 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:43.416637 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:43.768132 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:43.768097 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:44.171532 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:44.171500 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:44.222936 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:44.222902 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:44.387876 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:44.387836 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:44.568400 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:44.568305 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:44.766960 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:44.766928 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:45.370413 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:45.366371 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:45.764928 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:45.764894 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:45.874001 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:45.873967 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:46.130318 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:46.130283 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a66a11c-63e7-477b-a84d-3cf0102368a1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-g5jx2\" (UID: \"2a66a11c-63e7-477b-a84d-3cf0102368a1\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-g5jx2" Jun 14 13:36:46.130484 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:46.130419 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 13:36:46.130528 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:46.130488 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a66a11c-63e7-477b-a84d-3cf0102368a1-cluster-monitoring-operator-tls podName:2a66a11c-63e7-477b-a84d-3cf0102368a1 nodeName:}" failed. No retries permitted until 2026-06-14 13:37:02.130470437 +0000 UTC m=+254.803738364 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2a66a11c-63e7-477b-a84d-3cf0102368a1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-g5jx2" (UID: "2a66a11c-63e7-477b-a84d-3cf0102368a1") : secret "cluster-monitoring-operator-tls" not found Jun 14 13:36:46.173695 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:46.173655 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:46.230723 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:46.230661 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae58844c-88ca-4244-862a-0ceb52ca66f8-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-9d55q\" (UID: \"ae58844c-88ca-4244-862a-0ceb52ca66f8\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-9d55q" Jun 14 13:36:46.230894 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:46.230789 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-service-ca-bundle\") pod \"router-default-565d7ffdb8-hjw45\" (UID: \"341c9198-cdc6-43c8-a9bd-eb0e957f2e19\") " pod="openshift-ingress/router-default-565d7ffdb8-hjw45" Jun 14 13:36:46.230894 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:46.230805 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 13:36:46.230894 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:46.230829 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-metrics-certs\") pod \"router-default-565d7ffdb8-hjw45\" (UID: \"341c9198-cdc6-43c8-a9bd-eb0e957f2e19\") " pod="openshift-ingress/router-default-565d7ffdb8-hjw45" Jun 14 13:36:46.230894 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:36:46.230884 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae58844c-88ca-4244-862a-0ceb52ca66f8-networking-console-plugin-cert podName:ae58844c-88ca-4244-862a-0ceb52ca66f8 nodeName:}" failed. No retries permitted until 2026-06-14 13:37:02.230864123 +0000 UTC m=+254.904132078 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ae58844c-88ca-4244-862a-0ceb52ca66f8-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-9d55q" (UID: "ae58844c-88ca-4244-862a-0ceb52ca66f8") : secret "networking-console-plugin-cert" not found Jun 14 13:36:46.231501 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:46.231478 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-service-ca-bundle\") pod \"router-default-565d7ffdb8-hjw45\" (UID: \"341c9198-cdc6-43c8-a9bd-eb0e957f2e19\") " pod="openshift-ingress/router-default-565d7ffdb8-hjw45" Jun 14 13:36:46.233227 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:46.233206 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/341c9198-cdc6-43c8-a9bd-eb0e957f2e19-metrics-certs\") pod \"router-default-565d7ffdb8-hjw45\" (UID: \"341c9198-cdc6-43c8-a9bd-eb0e957f2e19\") " pod="openshift-ingress/router-default-565d7ffdb8-hjw45" Jun 14 13:36:46.263127 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:46.263097 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-565d7ffdb8-hjw45" Jun 14 13:36:46.374987 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:46.374952 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:46.403858 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:46.403836 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-565d7ffdb8-hjw45"] Jun 14 13:36:46.406837 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:36:46.406804 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod341c9198_cdc6_43c8_a9bd_eb0e957f2e19.slice/crio-0abf3728c8f7f677887a06c93f82520f0f45c7253c840f4e2cf3933b2466bee6 WatchSource:0}: Error finding container 0abf3728c8f7f677887a06c93f82520f0f45c7253c840f4e2cf3933b2466bee6: Status 404 returned error can't find the container with id 0abf3728c8f7f677887a06c93f82520f0f45c7253c840f4e2cf3933b2466bee6 Jun 14 13:36:46.627649 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:46.627616 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-565d7ffdb8-hjw45" event={"ID":"341c9198-cdc6-43c8-a9bd-eb0e957f2e19","Type":"ContainerStarted","Data":"4792c7b5c81ead8ec22a8f0a66e465f322544f2221cd4d2724e6b1a5a697a70d"} Jun 14 13:36:46.627800 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:46.627663 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-565d7ffdb8-hjw45" event={"ID":"341c9198-cdc6-43c8-a9bd-eb0e957f2e19","Type":"ContainerStarted","Data":"0abf3728c8f7f677887a06c93f82520f0f45c7253c840f4e2cf3933b2466bee6"} Jun 14 13:36:46.645785 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:46.645736 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-565d7ffdb8-hjw45" podStartSLOduration=16.645720267 podStartE2EDuration="16.645720267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:36:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:36:46.644750887 +0000 UTC m=+239.318018854" watchObservedRunningTime="2026-06-14 13:36:46.645720267 +0000 UTC m=+239.318988207" Jun 14 13:36:46.776927 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:46.776839 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:47.163524 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:47.163470 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:47.263352 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:47.263321 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-565d7ffdb8-hjw45" Jun 14 13:36:47.265979 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:47.265956 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-565d7ffdb8-hjw45" Jun 14 13:36:47.631466 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:47.631444 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-565d7ffdb8-hjw45" Jun 14 13:36:47.632630 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:47.632611 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-565d7ffdb8-hjw45" Jun 14 13:36:47.838573 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:47.838537 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:48.039589 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:48.039494 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:48.180814 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:48.180780 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:48.369928 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:48.369842 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:48.782251 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:48.782218 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:49.386924 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:49.386892 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:49.589649 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:49.589614 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:49.776175 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:49.776098 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:50.170082 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:50.170048 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:50.331965 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:50.331932 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:50.394009 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:50.393981 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:51.178510 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:51.178467 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/41378e80-cec7-4a96-acce-1d65b6e764d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qfjzz\" (UID: \"41378e80-cec7-4a96-acce-1d65b6e764d3\") " pod="openshift-insights/insights-runtime-extractor-qfjzz" Jun 14 13:36:51.178743 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:51.178605 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41378e80-cec7-4a96-acce-1d65b6e764d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qfjzz\" (UID: \"41378e80-cec7-4a96-acce-1d65b6e764d3\") " pod="openshift-insights/insights-runtime-extractor-qfjzz" Jun 14 13:36:51.179041 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:51.179020 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/41378e80-cec7-4a96-acce-1d65b6e764d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qfjzz\" (UID: \"41378e80-cec7-4a96-acce-1d65b6e764d3\") " pod="openshift-insights/insights-runtime-extractor-qfjzz" Jun 14 13:36:51.180856 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:51.180834 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41378e80-cec7-4a96-acce-1d65b6e764d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qfjzz\" (UID: \"41378e80-cec7-4a96-acce-1d65b6e764d3\") " pod="openshift-insights/insights-runtime-extractor-qfjzz" Jun 14 13:36:51.194318 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:51.194293 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r85mh\"" Jun 14 13:36:51.202630 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:51.202606 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qfjzz" Jun 14 13:36:51.338745 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:51.338709 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qfjzz"] Jun 14 13:36:51.341607 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:36:51.341575 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41378e80_cec7_4a96_acce_1d65b6e764d3.slice/crio-b086e199d22e6b548e57e4729db6c74d1359b725111be5ed5130be1cc50c126e WatchSource:0}: Error finding container b086e199d22e6b548e57e4729db6c74d1359b725111be5ed5130be1cc50c126e: Status 404 returned error can't find the container with id b086e199d22e6b548e57e4729db6c74d1359b725111be5ed5130be1cc50c126e Jun 14 13:36:51.644863 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:51.644833 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qfjzz" event={"ID":"41378e80-cec7-4a96-acce-1d65b6e764d3","Type":"ContainerStarted","Data":"b086e199d22e6b548e57e4729db6c74d1359b725111be5ed5130be1cc50c126e"} Jun 14 13:36:54.728722 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:54.728662 2557 scope.go:117] "RemoveContainer" containerID="18bf79238b82b984c45bc01d3f526cbe8cc9caf973ead35f269dba4a33c22cae" Jun 14 13:36:55.662337 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:55.662314 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-dwq9q_1fea963c-a8b6-4071-8071-3e7149ef98cd/console-operator/1.log" Jun 14 13:36:55.662443 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:55.662429 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-dwq9q" event={"ID":"1fea963c-a8b6-4071-8071-3e7149ef98cd","Type":"ContainerStarted","Data":"cb7174e84d484ae28b5797add14959d7c4c844ab37ad606181bf857f8e12a6e6"} Jun 14 13:36:55.662754 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:55.662730 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-dwq9q" Jun 14 13:36:55.664380 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:55.664351 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qfjzz" event={"ID":"41378e80-cec7-4a96-acce-1d65b6e764d3","Type":"ContainerStarted","Data":"c1b9a741b32142abef1511b23262e5f59e4f75abb91712953286abd3d1423fee"} Jun 14 13:36:55.686704 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:55.686642 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5dbbb5d744-dwq9q" podStartSLOduration=22.541379487 podStartE2EDuration="25.686627353s" totalImagesPullingTime="3.145247866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:36:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:36:55.685862117 +0000 UTC m=+248.359130075" watchObservedRunningTime="2026-06-14 13:36:55.686627353 +0000 UTC m=+248.359895354" Jun 14 13:36:55.760173 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:55.760132 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5dbbb5d744-dwq9q" Jun 14 13:36:55.934573 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:55.934485 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:56.035220 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:56.035179 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:56.136056 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:56.136020 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:56.236119 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:56.236043 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:56.639277 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:56.639237 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:56.669892 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:56.669853 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qfjzz" event={"ID":"41378e80-cec7-4a96-acce-1d65b6e764d3","Type":"ContainerStarted","Data":"d2c89e1fc6486c57aae8fdcd8ea84ce75db6721bb6b9253f73e1d0f4a432efca"} Jun 14 13:36:56.735114 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:56.735078 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:56.947949 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:56.947866 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:57.047461 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:57.047414 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:57.148078 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:57.148040 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:57.252574 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:57.252488 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:57.353369 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:57.353317 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:57.455346 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:57.455100 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:57.553484 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:57.553387 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:57.653746 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:57.653710 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:57.675303 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:57.675271 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qfjzz" event={"ID":"41378e80-cec7-4a96-acce-1d65b6e764d3","Type":"ContainerStarted","Data":"dc57c651f336462d4a38eb3c9a9076205b63b6d64bf7c88ab36cd44438cce0a8"} Jun 14 13:36:57.693697 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:57.693626 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qfjzz" podStartSLOduration=16.774554603 podStartE2EDuration="22.693611405s" totalImagesPullingTime="5.919056802s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 13:36:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:36:57.692405592 +0000 UTC m=+250.365673549" watchObservedRunningTime="2026-06-14 13:36:57.693611405 +0000 UTC m=+250.366879351" Jun 14 13:36:58.245053 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:58.245010 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:58.546345 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:58.546254 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5cff939-d984-4037-9dbb-2f4bbf3a6073-metrics-certs\") pod \"network-metrics-daemon-xq27q\" (UID: \"a5cff939-d984-4037-9dbb-2f4bbf3a6073\") " pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:36:58.548534 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:58.548505 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5cff939-d984-4037-9dbb-2f4bbf3a6073-metrics-certs\") pod \"network-metrics-daemon-xq27q\" (UID: \"a5cff939-d984-4037-9dbb-2f4bbf3a6073\") " pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:36:58.632233 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:58.632204 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pw5r2\"" Jun 14 13:36:58.640318 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:58.640296 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq27q" Jun 14 13:36:58.760424 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:58.760393 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xq27q"] Jun 14 13:36:58.763672 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:36:58.763648 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5cff939_d984_4037_9dbb_2f4bbf3a6073.slice/crio-79312f4649826dfcb0dba15755e43d2351eb40e3e202cc3c9932ce860f6c6dcc WatchSource:0}: Error finding container 79312f4649826dfcb0dba15755e43d2351eb40e3e202cc3c9932ce860f6c6dcc: Status 404 returned error can't find the container with id 79312f4649826dfcb0dba15755e43d2351eb40e3e202cc3c9932ce860f6c6dcc Jun 14 13:36:59.640020 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:59.639988 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:59.684483 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:59.684448 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xq27q" event={"ID":"a5cff939-d984-4037-9dbb-2f4bbf3a6073","Type":"ContainerStarted","Data":"79312f4649826dfcb0dba15755e43d2351eb40e3e202cc3c9932ce860f6c6dcc"} Jun 14 13:36:59.696996 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:59.696961 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:36:59.977136 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:36:59.977081 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:00.689305 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:00.689269 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xq27q" event={"ID":"a5cff939-d984-4037-9dbb-2f4bbf3a6073","Type":"ContainerStarted","Data":"cfa2206e9cf9b4934a93c6b2e30845f17527e5cf69cfa6f4e94af2da6573e9df"} Jun 14 13:37:00.689708 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:00.689335 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xq27q" event={"ID":"a5cff939-d984-4037-9dbb-2f4bbf3a6073","Type":"ContainerStarted","Data":"12b8d7b47f20733932aa823aa4efe3de6d3b758ff51b34b9ebe7c7b6c1811057"} Jun 14 13:37:00.712838 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:00.712786 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xq27q" podStartSLOduration=252.604485241 podStartE2EDuration="4m13.712771979s" totalImagesPullingTime="1.108286738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:37:00.711900993 +0000 UTC m=+253.385168939" watchObservedRunningTime="2026-06-14 13:37:00.712771979 +0000 UTC m=+253.386039924" Jun 14 13:37:00.831006 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:00.830968 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:00.892108 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:00.892069 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:02.177724 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:02.177648 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a66a11c-63e7-477b-a84d-3cf0102368a1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-g5jx2\" (UID: \"2a66a11c-63e7-477b-a84d-3cf0102368a1\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-g5jx2" Jun 14 13:37:02.180137 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:02.180107 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a66a11c-63e7-477b-a84d-3cf0102368a1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-g5jx2\" (UID: \"2a66a11c-63e7-477b-a84d-3cf0102368a1\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-g5jx2" Jun 14 13:37:02.278648 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:02.278607 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae58844c-88ca-4244-862a-0ceb52ca66f8-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-9d55q\" (UID: \"ae58844c-88ca-4244-862a-0ceb52ca66f8\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-9d55q" Jun 14 13:37:02.281060 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:02.281031 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae58844c-88ca-4244-862a-0ceb52ca66f8-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-9d55q\" (UID: \"ae58844c-88ca-4244-862a-0ceb52ca66f8\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-9d55q" Jun 14 13:37:02.371013 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:02.370980 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-n8zkg\"" Jun 14 13:37:02.378433 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:02.378415 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-g5jx2" Jun 14 13:37:02.507982 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:02.507959 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-g5jx2"] Jun 14 13:37:02.510296 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:37:02.510268 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a66a11c_63e7_477b_a84d_3cf0102368a1.slice/crio-d5f74d02b0511bf684e8dc5fc0c90af9dae6c798b6d35b7280f962cefea244e1 WatchSource:0}: Error finding container d5f74d02b0511bf684e8dc5fc0c90af9dae6c798b6d35b7280f962cefea244e1: Status 404 returned error can't find the container with id d5f74d02b0511bf684e8dc5fc0c90af9dae6c798b6d35b7280f962cefea244e1 Jun 14 13:37:02.546092 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:02.546067 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mgldg\"" Jun 14 13:37:02.554406 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:02.554385 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-9d55q" Jun 14 13:37:02.674365 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:02.674337 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-9d55q"] Jun 14 13:37:02.677298 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:37:02.677276 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae58844c_88ca_4244_862a_0ceb52ca66f8.slice/crio-46e1da5de08bb33ea3a4575c7a76f315b756647fb1fb9519816d7cc6f80fd074 WatchSource:0}: Error finding container 46e1da5de08bb33ea3a4575c7a76f315b756647fb1fb9519816d7cc6f80fd074: Status 404 returned error can't find the container with id 46e1da5de08bb33ea3a4575c7a76f315b756647fb1fb9519816d7cc6f80fd074 Jun 14 13:37:02.696339 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:02.696314 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-9d55q" event={"ID":"ae58844c-88ca-4244-862a-0ceb52ca66f8","Type":"ContainerStarted","Data":"46e1da5de08bb33ea3a4575c7a76f315b756647fb1fb9519816d7cc6f80fd074"} Jun 14 13:37:02.697329 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:02.697309 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-g5jx2" event={"ID":"2a66a11c-63e7-477b-a84d-3cf0102368a1","Type":"ContainerStarted","Data":"d5f74d02b0511bf684e8dc5fc0c90af9dae6c798b6d35b7280f962cefea244e1"} Jun 14 13:37:04.572364 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:04.572331 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:04.672644 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:04.672605 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:04.706610 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:04.706565 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-g5jx2" event={"ID":"2a66a11c-63e7-477b-a84d-3cf0102368a1","Type":"ContainerStarted","Data":"5aef8b787929936f80ebd75ea0dc0a50d410f9fc1978511d52d5e3460d869086"} Jun 14 13:37:04.708082 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:04.708056 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-9d55q" event={"ID":"ae58844c-88ca-4244-862a-0ceb52ca66f8","Type":"ContainerStarted","Data":"91cfcbaeb5b135f318db301ddc8f3577ec816b7ee5f91b039906d14ce4697d9e"} Jun 14 13:37:04.726891 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:04.726846 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-g5jx2" podStartSLOduration=32.722828364 podStartE2EDuration="34.726834364s" totalImagesPullingTime="2.004006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:36:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:37:04.725654011 +0000 UTC m=+257.398921973" watchObservedRunningTime="2026-06-14 13:37:04.726834364 +0000 UTC m=+257.400102309" Jun 14 13:37:04.742297 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:04.742250 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-9d55q" podStartSLOduration=32.905242699 podStartE2EDuration="34.742235566s" totalImagesPullingTime="1.836992867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:36:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:37:04.741444123 +0000 UTC m=+257.414712068" watchObservedRunningTime="2026-06-14 13:37:04.742235566 +0000 UTC m=+257.415503571" Jun 14 13:37:04.851349 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:04.851240 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:04.951183 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:04.951132 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:05.017142 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:05.017108 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-jcbhd"] Jun 14 13:37:05.017302 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:05.017113 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:05.021419 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:05.021398 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-jcbhd" Jun 14 13:37:05.023994 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:05.023972 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 14 13:37:05.024109 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:05.024069 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-98drp\"" Jun 14 13:37:05.030463 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:05.030444 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-jcbhd"] Jun 14 13:37:05.103558 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:05.103481 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2668b4ae-b476-4d0c-88f1-c83578a8fc03-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-jcbhd\" (UID: \"2668b4ae-b476-4d0c-88f1-c83578a8fc03\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-jcbhd" Jun 14 13:37:05.204126 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:05.204088 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2668b4ae-b476-4d0c-88f1-c83578a8fc03-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-jcbhd\" (UID: \"2668b4ae-b476-4d0c-88f1-c83578a8fc03\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-jcbhd" Jun 14 13:37:05.204295 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:37:05.204230 2557 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 14 13:37:05.204343 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:37:05.204301 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2668b4ae-b476-4d0c-88f1-c83578a8fc03-tls-certificates podName:2668b4ae-b476-4d0c-88f1-c83578a8fc03 nodeName:}" failed. No retries permitted until 2026-06-14 13:37:05.704285884 +0000 UTC m=+258.377553810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/2668b4ae-b476-4d0c-88f1-c83578a8fc03-tls-certificates") pod "prometheus-operator-admission-webhook-5cf667749c-jcbhd" (UID: "2668b4ae-b476-4d0c-88f1-c83578a8fc03") : secret "prometheus-operator-admission-webhook-tls" not found Jun 14 13:37:05.708354 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:05.708309 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2668b4ae-b476-4d0c-88f1-c83578a8fc03-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-jcbhd\" (UID: \"2668b4ae-b476-4d0c-88f1-c83578a8fc03\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-jcbhd" Jun 14 13:37:05.710849 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:05.710826 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2668b4ae-b476-4d0c-88f1-c83578a8fc03-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-jcbhd\" (UID: \"2668b4ae-b476-4d0c-88f1-c83578a8fc03\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-jcbhd" Jun 14 13:37:05.735215 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:05.735192 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:05.932291 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:05.932234 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-jcbhd" Jun 14 13:37:06.054600 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:06.054527 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-jcbhd"] Jun 14 13:37:06.056594 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:37:06.056567 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2668b4ae_b476_4d0c_88f1_c83578a8fc03.slice/crio-d046a3123e6babe5610b11f72e04fbfff32b9266200200aebeb754adc4deb6b5 WatchSource:0}: Error finding container d046a3123e6babe5610b11f72e04fbfff32b9266200200aebeb754adc4deb6b5: Status 404 returned error can't find the container with id d046a3123e6babe5610b11f72e04fbfff32b9266200200aebeb754adc4deb6b5 Jun 14 13:37:06.718763 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:06.718669 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-jcbhd" event={"ID":"2668b4ae-b476-4d0c-88f1-c83578a8fc03","Type":"ContainerStarted","Data":"d046a3123e6babe5610b11f72e04fbfff32b9266200200aebeb754adc4deb6b5"} Jun 14 13:37:07.723248 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:07.723214 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-jcbhd" event={"ID":"2668b4ae-b476-4d0c-88f1-c83578a8fc03","Type":"ContainerStarted","Data":"04dc42d1fb0fbba9420cb55b51a0106f4f547a1e2861bec147c6511a6959a4b3"} Jun 14 13:37:07.723622 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:07.723386 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-jcbhd" Jun 14 13:37:07.732141 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:07.732117 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-jcbhd" Jun 14 13:37:07.739168 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:07.739127 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-jcbhd" podStartSLOduration=1.301029137 podStartE2EDuration="2.73911404s" totalImagesPullingTime="1.438084903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:37:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:37:07.73778417 +0000 UTC m=+260.411052136" watchObservedRunningTime="2026-06-14 13:37:07.73911404 +0000 UTC m=+260.412381986" Jun 14 13:37:08.107557 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.107528 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:08.170838 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.170810 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:08.615053 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.615022 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:08.651251 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.649336 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dcb8dd565-tt7v6"] Jun 14 13:37:08.669761 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.669728 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dcb8dd565-tt7v6"] Jun 14 13:37:08.669915 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.669791 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dcb8dd565-tt7v6" Jun 14 13:37:08.672674 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.672648 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 14 13:37:08.672674 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.672666 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 14 13:37:08.672909 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.672676 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 14 13:37:08.672909 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.672818 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 14 13:37:08.673821 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.673804 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 14 13:37:08.673938 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.673827 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 14 13:37:08.674312 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.674298 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vxsch\"" Jun 14 13:37:08.674394 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.674299 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 14 13:37:08.678185 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.678167 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 14 13:37:08.692151 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.692127 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:08.731972 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.731952 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f40ec0e8-6e28-48dd-a38a-946bc253527c-console-oauth-config\") pod \"console-7dcb8dd565-tt7v6\" (UID: \"f40ec0e8-6e28-48dd-a38a-946bc253527c\") " pod="openshift-console/console-7dcb8dd565-tt7v6" Jun 14 13:37:08.731972 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.731979 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz95w\" (UniqueName: \"kubernetes.io/projected/f40ec0e8-6e28-48dd-a38a-946bc253527c-kube-api-access-gz95w\") pod \"console-7dcb8dd565-tt7v6\" (UID: \"f40ec0e8-6e28-48dd-a38a-946bc253527c\") " pod="openshift-console/console-7dcb8dd565-tt7v6" Jun 14 13:37:08.732360 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.732002 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f40ec0e8-6e28-48dd-a38a-946bc253527c-console-serving-cert\") pod \"console-7dcb8dd565-tt7v6\" (UID: \"f40ec0e8-6e28-48dd-a38a-946bc253527c\") " pod="openshift-console/console-7dcb8dd565-tt7v6" Jun 14 13:37:08.732360 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.732081 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f40ec0e8-6e28-48dd-a38a-946bc253527c-oauth-serving-cert\") pod \"console-7dcb8dd565-tt7v6\" (UID: \"f40ec0e8-6e28-48dd-a38a-946bc253527c\") " pod="openshift-console/console-7dcb8dd565-tt7v6" Jun 14 13:37:08.732360 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.732112 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f40ec0e8-6e28-48dd-a38a-946bc253527c-service-ca\") pod \"console-7dcb8dd565-tt7v6\" (UID: \"f40ec0e8-6e28-48dd-a38a-946bc253527c\") " pod="openshift-console/console-7dcb8dd565-tt7v6" Jun 14 13:37:08.732360 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.732155 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f40ec0e8-6e28-48dd-a38a-946bc253527c-trusted-ca-bundle\") pod \"console-7dcb8dd565-tt7v6\" (UID: \"f40ec0e8-6e28-48dd-a38a-946bc253527c\") " pod="openshift-console/console-7dcb8dd565-tt7v6" Jun 14 13:37:08.732360 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.732175 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f40ec0e8-6e28-48dd-a38a-946bc253527c-console-config\") pod \"console-7dcb8dd565-tt7v6\" (UID: \"f40ec0e8-6e28-48dd-a38a-946bc253527c\") " pod="openshift-console/console-7dcb8dd565-tt7v6" Jun 14 13:37:08.833331 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.833297 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f40ec0e8-6e28-48dd-a38a-946bc253527c-console-config\") pod \"console-7dcb8dd565-tt7v6\" (UID: \"f40ec0e8-6e28-48dd-a38a-946bc253527c\") " pod="openshift-console/console-7dcb8dd565-tt7v6" Jun 14 13:37:08.833499 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.833340 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f40ec0e8-6e28-48dd-a38a-946bc253527c-console-oauth-config\") pod \"console-7dcb8dd565-tt7v6\" (UID: \"f40ec0e8-6e28-48dd-a38a-946bc253527c\") " pod="openshift-console/console-7dcb8dd565-tt7v6" Jun 14 13:37:08.833499 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.833362 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz95w\" (UniqueName: \"kubernetes.io/projected/f40ec0e8-6e28-48dd-a38a-946bc253527c-kube-api-access-gz95w\") pod \"console-7dcb8dd565-tt7v6\" (UID: \"f40ec0e8-6e28-48dd-a38a-946bc253527c\") " pod="openshift-console/console-7dcb8dd565-tt7v6" Jun 14 13:37:08.833499 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.833386 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f40ec0e8-6e28-48dd-a38a-946bc253527c-console-serving-cert\") pod \"console-7dcb8dd565-tt7v6\" (UID: \"f40ec0e8-6e28-48dd-a38a-946bc253527c\") " pod="openshift-console/console-7dcb8dd565-tt7v6" Jun 14 13:37:08.833499 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.833424 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f40ec0e8-6e28-48dd-a38a-946bc253527c-oauth-serving-cert\") pod \"console-7dcb8dd565-tt7v6\" (UID: \"f40ec0e8-6e28-48dd-a38a-946bc253527c\") " pod="openshift-console/console-7dcb8dd565-tt7v6" Jun 14 13:37:08.833499 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.833447 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f40ec0e8-6e28-48dd-a38a-946bc253527c-service-ca\") pod \"console-7dcb8dd565-tt7v6\" (UID: \"f40ec0e8-6e28-48dd-a38a-946bc253527c\") " pod="openshift-console/console-7dcb8dd565-tt7v6" Jun 14 13:37:08.833499 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.833481 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f40ec0e8-6e28-48dd-a38a-946bc253527c-trusted-ca-bundle\") pod \"console-7dcb8dd565-tt7v6\" (UID: \"f40ec0e8-6e28-48dd-a38a-946bc253527c\") " pod="openshift-console/console-7dcb8dd565-tt7v6" Jun 14 13:37:08.834116 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.834090 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f40ec0e8-6e28-48dd-a38a-946bc253527c-console-config\") pod \"console-7dcb8dd565-tt7v6\" (UID: \"f40ec0e8-6e28-48dd-a38a-946bc253527c\") " pod="openshift-console/console-7dcb8dd565-tt7v6" Jun 14 13:37:08.834329 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.834305 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f40ec0e8-6e28-48dd-a38a-946bc253527c-service-ca\") pod \"console-7dcb8dd565-tt7v6\" (UID: \"f40ec0e8-6e28-48dd-a38a-946bc253527c\") " pod="openshift-console/console-7dcb8dd565-tt7v6" Jun 14 13:37:08.834396 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.834327 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f40ec0e8-6e28-48dd-a38a-946bc253527c-trusted-ca-bundle\") pod \"console-7dcb8dd565-tt7v6\" (UID: \"f40ec0e8-6e28-48dd-a38a-946bc253527c\") " pod="openshift-console/console-7dcb8dd565-tt7v6" Jun 14 13:37:08.834396 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.834322 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f40ec0e8-6e28-48dd-a38a-946bc253527c-oauth-serving-cert\") pod \"console-7dcb8dd565-tt7v6\" (UID: \"f40ec0e8-6e28-48dd-a38a-946bc253527c\") " pod="openshift-console/console-7dcb8dd565-tt7v6" Jun 14 13:37:08.836042 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.836021 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f40ec0e8-6e28-48dd-a38a-946bc253527c-console-oauth-config\") pod \"console-7dcb8dd565-tt7v6\" (UID: \"f40ec0e8-6e28-48dd-a38a-946bc253527c\") " pod="openshift-console/console-7dcb8dd565-tt7v6" Jun 14 13:37:08.836042 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.836031 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f40ec0e8-6e28-48dd-a38a-946bc253527c-console-serving-cert\") pod \"console-7dcb8dd565-tt7v6\" (UID: \"f40ec0e8-6e28-48dd-a38a-946bc253527c\") " pod="openshift-console/console-7dcb8dd565-tt7v6" Jun 14 13:37:08.841754 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.841733 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz95w\" (UniqueName: \"kubernetes.io/projected/f40ec0e8-6e28-48dd-a38a-946bc253527c-kube-api-access-gz95w\") pod \"console-7dcb8dd565-tt7v6\" (UID: \"f40ec0e8-6e28-48dd-a38a-946bc253527c\") " pod="openshift-console/console-7dcb8dd565-tt7v6" Jun 14 13:37:08.979559 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:08.979529 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dcb8dd565-tt7v6" Jun 14 13:37:09.105162 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:09.105134 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dcb8dd565-tt7v6"] Jun 14 13:37:09.105964 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:37:09.105939 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf40ec0e8_6e28_48dd_a38a_946bc253527c.slice/crio-2307b89c1263666949c0450bc205768889d250b1c4aca1131fe4c2cdd15902b2 WatchSource:0}: Error finding container 2307b89c1263666949c0450bc205768889d250b1c4aca1131fe4c2cdd15902b2: Status 404 returned error can't find the container with id 2307b89c1263666949c0450bc205768889d250b1c4aca1131fe4c2cdd15902b2 Jun 14 13:37:09.734694 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:09.734645 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dcb8dd565-tt7v6" event={"ID":"f40ec0e8-6e28-48dd-a38a-946bc253527c","Type":"ContainerStarted","Data":"2307b89c1263666949c0450bc205768889d250b1c4aca1131fe4c2cdd15902b2"} Jun 14 13:37:11.741370 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:11.741337 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dcb8dd565-tt7v6" event={"ID":"f40ec0e8-6e28-48dd-a38a-946bc253527c","Type":"ContainerStarted","Data":"bafe4f1c96baa6d601b873ff51839d28cbbb76c82dc988f73bf3c1cb49235c07"} Jun 14 13:37:11.757733 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:11.757595 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7dcb8dd565-tt7v6" podStartSLOduration=1.234201566 podStartE2EDuration="3.75757532s" totalImagesPullingTime="2.523373754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:37:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:37:11.757147081 +0000 UTC m=+264.430415027" watchObservedRunningTime="2026-06-14 13:37:11.75757532 +0000 UTC m=+264.430843266" Jun 14 13:37:12.643865 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:12.643828 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:15.411531 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:15.411493 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:15.513029 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:15.512994 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:16.861399 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:16.861362 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:16.962381 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:16.962339 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:17.137589 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:17.137557 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:17.239642 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:17.239604 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:18.235982 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.235946 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:18.476944 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.476907 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:18.499249 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.499163 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dkgnm"] Jun 14 13:37:18.502709 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.502672 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dkgnm" Jun 14 13:37:18.505928 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.505904 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 14 13:37:18.506295 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.506270 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 14 13:37:18.506570 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.506552 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 14 13:37:18.506885 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.506869 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bc27h\"" Jun 14 13:37:18.507172 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.507156 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 14 13:37:18.557636 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.557577 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:18.617101 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.617066 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/58b2bd4e-cddf-4ac6-a384-fa94a0d02993-node-exporter-accelerators-collector-config\") pod \"node-exporter-dkgnm\" (UID: \"58b2bd4e-cddf-4ac6-a384-fa94a0d02993\") " pod="openshift-monitoring/node-exporter-dkgnm" Jun 14 13:37:18.617248 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.617130 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxnz2\" (UniqueName: \"kubernetes.io/projected/58b2bd4e-cddf-4ac6-a384-fa94a0d02993-kube-api-access-rxnz2\") pod \"node-exporter-dkgnm\" (UID: \"58b2bd4e-cddf-4ac6-a384-fa94a0d02993\") " pod="openshift-monitoring/node-exporter-dkgnm" Jun 14 13:37:18.617248 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.617166 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/58b2bd4e-cddf-4ac6-a384-fa94a0d02993-node-exporter-wtmp\") pod \"node-exporter-dkgnm\" (UID: \"58b2bd4e-cddf-4ac6-a384-fa94a0d02993\") " pod="openshift-monitoring/node-exporter-dkgnm" Jun 14 13:37:18.617248 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.617218 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/58b2bd4e-cddf-4ac6-a384-fa94a0d02993-node-exporter-tls\") pod \"node-exporter-dkgnm\" (UID: \"58b2bd4e-cddf-4ac6-a384-fa94a0d02993\") " pod="openshift-monitoring/node-exporter-dkgnm" Jun 14 13:37:18.617419 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.617246 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58b2bd4e-cddf-4ac6-a384-fa94a0d02993-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dkgnm\" (UID: \"58b2bd4e-cddf-4ac6-a384-fa94a0d02993\") " pod="openshift-monitoring/node-exporter-dkgnm" Jun 14 13:37:18.617419 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.617282 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/58b2bd4e-cddf-4ac6-a384-fa94a0d02993-root\") pod \"node-exporter-dkgnm\" (UID: \"58b2bd4e-cddf-4ac6-a384-fa94a0d02993\") " pod="openshift-monitoring/node-exporter-dkgnm" Jun 14 13:37:18.617419 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.617310 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58b2bd4e-cddf-4ac6-a384-fa94a0d02993-metrics-client-ca\") pod \"node-exporter-dkgnm\" (UID: \"58b2bd4e-cddf-4ac6-a384-fa94a0d02993\") " pod="openshift-monitoring/node-exporter-dkgnm" Jun 14 13:37:18.617419 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.617346 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58b2bd4e-cddf-4ac6-a384-fa94a0d02993-sys\") pod \"node-exporter-dkgnm\" (UID: \"58b2bd4e-cddf-4ac6-a384-fa94a0d02993\") " pod="openshift-monitoring/node-exporter-dkgnm" Jun 14 13:37:18.617419 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.617370 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/58b2bd4e-cddf-4ac6-a384-fa94a0d02993-node-exporter-textfile\") pod \"node-exporter-dkgnm\" (UID: \"58b2bd4e-cddf-4ac6-a384-fa94a0d02993\") " pod="openshift-monitoring/node-exporter-dkgnm" Jun 14 13:37:18.619922 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.619876 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:18.718250 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.718206 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/58b2bd4e-cddf-4ac6-a384-fa94a0d02993-root\") pod \"node-exporter-dkgnm\" (UID: \"58b2bd4e-cddf-4ac6-a384-fa94a0d02993\") " pod="openshift-monitoring/node-exporter-dkgnm" Jun 14 13:37:18.718413 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.718261 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58b2bd4e-cddf-4ac6-a384-fa94a0d02993-metrics-client-ca\") pod \"node-exporter-dkgnm\" (UID: \"58b2bd4e-cddf-4ac6-a384-fa94a0d02993\") " pod="openshift-monitoring/node-exporter-dkgnm" Jun 14 13:37:18.718413 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.718314 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58b2bd4e-cddf-4ac6-a384-fa94a0d02993-sys\") pod \"node-exporter-dkgnm\" (UID: \"58b2bd4e-cddf-4ac6-a384-fa94a0d02993\") " pod="openshift-monitoring/node-exporter-dkgnm" Jun 14 13:37:18.718413 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.718325 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/58b2bd4e-cddf-4ac6-a384-fa94a0d02993-root\") pod \"node-exporter-dkgnm\" (UID: \"58b2bd4e-cddf-4ac6-a384-fa94a0d02993\") " pod="openshift-monitoring/node-exporter-dkgnm" Jun 14 13:37:18.718413 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.718340 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/58b2bd4e-cddf-4ac6-a384-fa94a0d02993-node-exporter-textfile\") pod \"node-exporter-dkgnm\" (UID: \"58b2bd4e-cddf-4ac6-a384-fa94a0d02993\") " pod="openshift-monitoring/node-exporter-dkgnm" Jun 14 13:37:18.718413 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.718383 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58b2bd4e-cddf-4ac6-a384-fa94a0d02993-sys\") pod \"node-exporter-dkgnm\" (UID: \"58b2bd4e-cddf-4ac6-a384-fa94a0d02993\") " pod="openshift-monitoring/node-exporter-dkgnm" Jun 14 13:37:18.718413 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.718385 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/58b2bd4e-cddf-4ac6-a384-fa94a0d02993-node-exporter-accelerators-collector-config\") pod \"node-exporter-dkgnm\" (UID: \"58b2bd4e-cddf-4ac6-a384-fa94a0d02993\") " pod="openshift-monitoring/node-exporter-dkgnm" Jun 14 13:37:18.718754 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.718465 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxnz2\" (UniqueName: \"kubernetes.io/projected/58b2bd4e-cddf-4ac6-a384-fa94a0d02993-kube-api-access-rxnz2\") pod \"node-exporter-dkgnm\" (UID: \"58b2bd4e-cddf-4ac6-a384-fa94a0d02993\") " pod="openshift-monitoring/node-exporter-dkgnm" Jun 14 13:37:18.718754 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.718507 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/58b2bd4e-cddf-4ac6-a384-fa94a0d02993-node-exporter-wtmp\") pod \"node-exporter-dkgnm\" (UID: \"58b2bd4e-cddf-4ac6-a384-fa94a0d02993\") " pod="openshift-monitoring/node-exporter-dkgnm" Jun 14 13:37:18.718754 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.718567 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/58b2bd4e-cddf-4ac6-a384-fa94a0d02993-node-exporter-tls\") pod \"node-exporter-dkgnm\" (UID: \"58b2bd4e-cddf-4ac6-a384-fa94a0d02993\") " pod="openshift-monitoring/node-exporter-dkgnm" Jun 14 13:37:18.718754 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.718600 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58b2bd4e-cddf-4ac6-a384-fa94a0d02993-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dkgnm\" (UID: \"58b2bd4e-cddf-4ac6-a384-fa94a0d02993\") " pod="openshift-monitoring/node-exporter-dkgnm" Jun 14 13:37:18.718950 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.718817 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/58b2bd4e-cddf-4ac6-a384-fa94a0d02993-node-exporter-textfile\") pod \"node-exporter-dkgnm\" (UID: \"58b2bd4e-cddf-4ac6-a384-fa94a0d02993\") " pod="openshift-monitoring/node-exporter-dkgnm" Jun 14 13:37:18.719005 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.718962 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58b2bd4e-cddf-4ac6-a384-fa94a0d02993-metrics-client-ca\") pod \"node-exporter-dkgnm\" (UID: \"58b2bd4e-cddf-4ac6-a384-fa94a0d02993\") " pod="openshift-monitoring/node-exporter-dkgnm" Jun 14 13:37:18.719005 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.718961 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/58b2bd4e-cddf-4ac6-a384-fa94a0d02993-node-exporter-accelerators-collector-config\") pod \"node-exporter-dkgnm\" (UID: \"58b2bd4e-cddf-4ac6-a384-fa94a0d02993\") " pod="openshift-monitoring/node-exporter-dkgnm" Jun 14 13:37:18.719100 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.719000 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/58b2bd4e-cddf-4ac6-a384-fa94a0d02993-node-exporter-wtmp\") pod \"node-exporter-dkgnm\" (UID: \"58b2bd4e-cddf-4ac6-a384-fa94a0d02993\") " pod="openshift-monitoring/node-exporter-dkgnm" Jun 14 13:37:18.721142 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.721119 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58b2bd4e-cddf-4ac6-a384-fa94a0d02993-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dkgnm\" (UID: \"58b2bd4e-cddf-4ac6-a384-fa94a0d02993\") " pod="openshift-monitoring/node-exporter-dkgnm" Jun 14 13:37:18.721868 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.721845 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/58b2bd4e-cddf-4ac6-a384-fa94a0d02993-node-exporter-tls\") pod \"node-exporter-dkgnm\" (UID: \"58b2bd4e-cddf-4ac6-a384-fa94a0d02993\") " pod="openshift-monitoring/node-exporter-dkgnm" Jun 14 13:37:18.722158 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.722131 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:18.726929 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.726902 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxnz2\" (UniqueName: \"kubernetes.io/projected/58b2bd4e-cddf-4ac6-a384-fa94a0d02993-kube-api-access-rxnz2\") pod \"node-exporter-dkgnm\" (UID: \"58b2bd4e-cddf-4ac6-a384-fa94a0d02993\") " pod="openshift-monitoring/node-exporter-dkgnm" Jun 14 13:37:18.813456 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.813373 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dkgnm" Jun 14 13:37:18.821477 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.821446 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:18.827108 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:37:18.827082 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58b2bd4e_cddf_4ac6_a384_fa94a0d02993.slice/crio-2d797a163edaabf2af5cec008f134e73c59c10b693501d254ede1082a5d2f2b6 WatchSource:0}: Error finding container 2d797a163edaabf2af5cec008f134e73c59c10b693501d254ede1082a5d2f2b6: Status 404 returned error can't find the container with id 2d797a163edaabf2af5cec008f134e73c59c10b693501d254ede1082a5d2f2b6 Jun 14 13:37:18.922189 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.922152 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:18.980260 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.980213 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dcb8dd565-tt7v6" Jun 14 13:37:18.980404 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.980280 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dcb8dd565-tt7v6" Jun 14 13:37:18.981694 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.981656 2557 patch_prober.go:28] interesting pod/console-7dcb8dd565-tt7v6 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused" start-of-body= Jun 14 13:37:18.981815 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:18.981725 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7dcb8dd565-tt7v6" podUID="f40ec0e8-6e28-48dd-a38a-946bc253527c" containerName="console" probeResult="failure" output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused" Jun 14 13:37:19.492485 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.492447 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:19.599058 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.599025 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:19.600949 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.600923 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 13:37:19.605241 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.605214 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.608269 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.608240 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 14 13:37:19.608392 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.608300 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 14 13:37:19.608458 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.608249 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 14 13:37:19.609058 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.608784 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 14 13:37:19.609058 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.608838 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 14 13:37:19.609058 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.608858 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-plpnd\"" Jun 14 13:37:19.609058 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.608926 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 14 13:37:19.609058 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.608784 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 14 13:37:19.609058 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.608863 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 14 13:37:19.609391 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.609191 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 14 13:37:19.620635 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.620612 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 13:37:19.726851 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.726817 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/afac4dcf-ccb7-4426-8560-b191b6fce992-config-volume\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.726851 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.726856 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/afac4dcf-ccb7-4426-8560-b191b6fce992-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.727088 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.726877 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/afac4dcf-ccb7-4426-8560-b191b6fce992-tls-assets\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.727088 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.726927 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/afac4dcf-ccb7-4426-8560-b191b6fce992-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.727088 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.726952 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/afac4dcf-ccb7-4426-8560-b191b6fce992-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.727088 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.726989 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afac4dcf-ccb7-4426-8560-b191b6fce992-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.727088 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.727020 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/afac4dcf-ccb7-4426-8560-b191b6fce992-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.727088 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.727041 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afac4dcf-ccb7-4426-8560-b191b6fce992-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.727330 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.727092 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5slv\" (UniqueName: \"kubernetes.io/projected/afac4dcf-ccb7-4426-8560-b191b6fce992-kube-api-access-g5slv\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.727330 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.727155 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/afac4dcf-ccb7-4426-8560-b191b6fce992-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.727330 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.727205 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/afac4dcf-ccb7-4426-8560-b191b6fce992-config-out\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.727330 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.727221 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/afac4dcf-ccb7-4426-8560-b191b6fce992-web-config\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.727330 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.727301 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/afac4dcf-ccb7-4426-8560-b191b6fce992-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.770602 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.770529 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dkgnm" event={"ID":"58b2bd4e-cddf-4ac6-a384-fa94a0d02993","Type":"ContainerStarted","Data":"2d797a163edaabf2af5cec008f134e73c59c10b693501d254ede1082a5d2f2b6"} Jun 14 13:37:19.827800 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.827770 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/afac4dcf-ccb7-4426-8560-b191b6fce992-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.827937 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.827826 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/afac4dcf-ccb7-4426-8560-b191b6fce992-config-volume\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.827937 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.827846 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/afac4dcf-ccb7-4426-8560-b191b6fce992-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.827937 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.827869 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/afac4dcf-ccb7-4426-8560-b191b6fce992-tls-assets\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.827937 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.827893 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/afac4dcf-ccb7-4426-8560-b191b6fce992-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.828251 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.828220 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/afac4dcf-ccb7-4426-8560-b191b6fce992-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.828319 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.828275 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afac4dcf-ccb7-4426-8560-b191b6fce992-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.828319 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.828285 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/afac4dcf-ccb7-4426-8560-b191b6fce992-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.828319 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.828315 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/afac4dcf-ccb7-4426-8560-b191b6fce992-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.828472 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:37:19.828351 2557 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 14 13:37:19.828472 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:37:19.828411 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afac4dcf-ccb7-4426-8560-b191b6fce992-secret-alertmanager-main-tls podName:afac4dcf-ccb7-4426-8560-b191b6fce992 nodeName:}" failed. No retries permitted until 2026-06-14 13:37:20.328391051 +0000 UTC m=+273.001658980 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/afac4dcf-ccb7-4426-8560-b191b6fce992-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "afac4dcf-ccb7-4426-8560-b191b6fce992") : secret "alertmanager-main-tls" not found Jun 14 13:37:19.828472 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.828349 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afac4dcf-ccb7-4426-8560-b191b6fce992-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.828627 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.828505 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5slv\" (UniqueName: \"kubernetes.io/projected/afac4dcf-ccb7-4426-8560-b191b6fce992-kube-api-access-g5slv\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.828627 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.828568 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/afac4dcf-ccb7-4426-8560-b191b6fce992-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.828627 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.828615 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/afac4dcf-ccb7-4426-8560-b191b6fce992-config-out\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.828807 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.828641 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/afac4dcf-ccb7-4426-8560-b191b6fce992-web-config\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.829085 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.829053 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afac4dcf-ccb7-4426-8560-b191b6fce992-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.829199 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.829177 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afac4dcf-ccb7-4426-8560-b191b6fce992-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.831900 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.831874 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/afac4dcf-ccb7-4426-8560-b191b6fce992-tls-assets\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.832009 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.831919 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/afac4dcf-ccb7-4426-8560-b191b6fce992-web-config\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.832633 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.832299 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/afac4dcf-ccb7-4426-8560-b191b6fce992-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.832633 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.832405 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/afac4dcf-ccb7-4426-8560-b191b6fce992-config-volume\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.832633 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.832505 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/afac4dcf-ccb7-4426-8560-b191b6fce992-config-out\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.832633 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.832596 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/afac4dcf-ccb7-4426-8560-b191b6fce992-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.833004 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.832983 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/afac4dcf-ccb7-4426-8560-b191b6fce992-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.833934 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.833916 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/afac4dcf-ccb7-4426-8560-b191b6fce992-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:19.859078 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:19.859051 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5slv\" (UniqueName: \"kubernetes.io/projected/afac4dcf-ccb7-4426-8560-b191b6fce992-kube-api-access-g5slv\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:20.333961 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.333927 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/afac4dcf-ccb7-4426-8560-b191b6fce992-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:20.336521 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.336494 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/afac4dcf-ccb7-4426-8560-b191b6fce992-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"afac4dcf-ccb7-4426-8560-b191b6fce992\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:20.375504 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.375462 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:20.518075 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.518043 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 13:37:20.635021 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.634990 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-75548b57c-bdt42"] Jun 14 13:37:20.639590 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.639570 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" Jun 14 13:37:20.642150 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.642131 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 14 13:37:20.642329 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.642314 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 14 13:37:20.642425 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.642316 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-9rmgj\"" Jun 14 13:37:20.642477 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.642459 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 14 13:37:20.642673 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.642654 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bi2nkj6aluad3\"" Jun 14 13:37:20.642788 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.642744 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 14 13:37:20.643490 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.643473 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 14 13:37:20.655249 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.655230 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-75548b57c-bdt42"] Jun 14 13:37:20.660587 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.660565 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 13:37:20.663946 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:37:20.663920 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafac4dcf_ccb7_4426_8560_b191b6fce992.slice/crio-5c9e98dbfc2f758905613e687cd3002afe8da6ffaa623895cf330bbc06f16ed0 WatchSource:0}: Error finding container 5c9e98dbfc2f758905613e687cd3002afe8da6ffaa623895cf330bbc06f16ed0: Status 404 returned error can't find the container with id 5c9e98dbfc2f758905613e687cd3002afe8da6ffaa623895cf330bbc06f16ed0 Jun 14 13:37:20.737838 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.737804 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75548b57c-bdt42\" (UID: \"6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1\") " pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" Jun 14 13:37:20.738026 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.737853 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1-secret-grpc-tls\") pod \"thanos-querier-75548b57c-bdt42\" (UID: \"6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1\") " pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" Jun 14 13:37:20.738026 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.737890 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1-metrics-client-ca\") pod \"thanos-querier-75548b57c-bdt42\" (UID: \"6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1\") " pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" Jun 14 13:37:20.738026 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.737963 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75548b57c-bdt42\" (UID: \"6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1\") " pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" Jun 14 13:37:20.738026 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.738006 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1-secret-thanos-querier-tls\") pod \"thanos-querier-75548b57c-bdt42\" (UID: \"6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1\") " pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" Jun 14 13:37:20.738178 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.738043 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75548b57c-bdt42\" (UID: \"6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1\") " pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" Jun 14 13:37:20.738178 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.738081 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75548b57c-bdt42\" (UID: \"6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1\") " pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" Jun 14 13:37:20.738178 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.738157 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnllv\" (UniqueName: \"kubernetes.io/projected/6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1-kube-api-access-gnllv\") pod \"thanos-querier-75548b57c-bdt42\" (UID: \"6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1\") " pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" Jun 14 13:37:20.776285 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.776251 2557 generic.go:356] "Generic (PLEG): container finished" podID="58b2bd4e-cddf-4ac6-a384-fa94a0d02993" containerID="dd8b1896ca21f53a566d654eac981b1c41d2c1df86385f5064ca009e881d68e3" exitCode=0 Jun 14 13:37:20.776413 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.776336 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dkgnm" event={"ID":"58b2bd4e-cddf-4ac6-a384-fa94a0d02993","Type":"ContainerDied","Data":"dd8b1896ca21f53a566d654eac981b1c41d2c1df86385f5064ca009e881d68e3"} Jun 14 13:37:20.777565 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.777540 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"afac4dcf-ccb7-4426-8560-b191b6fce992","Type":"ContainerStarted","Data":"5c9e98dbfc2f758905613e687cd3002afe8da6ffaa623895cf330bbc06f16ed0"} Jun 14 13:37:20.838568 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.838545 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1-secret-thanos-querier-tls\") pod \"thanos-querier-75548b57c-bdt42\" (UID: \"6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1\") " pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" Jun 14 13:37:20.838717 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.838579 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75548b57c-bdt42\" (UID: \"6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1\") " pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" Jun 14 13:37:20.838717 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.838597 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75548b57c-bdt42\" (UID: \"6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1\") " pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" Jun 14 13:37:20.838717 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.838668 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnllv\" (UniqueName: \"kubernetes.io/projected/6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1-kube-api-access-gnllv\") pod \"thanos-querier-75548b57c-bdt42\" (UID: \"6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1\") " pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" Jun 14 13:37:20.838886 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.838736 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75548b57c-bdt42\" (UID: \"6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1\") " pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" Jun 14 13:37:20.838886 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.838806 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1-secret-grpc-tls\") pod \"thanos-querier-75548b57c-bdt42\" (UID: \"6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1\") " pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" Jun 14 13:37:20.838886 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.838852 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1-metrics-client-ca\") pod \"thanos-querier-75548b57c-bdt42\" (UID: \"6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1\") " pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" Jun 14 13:37:20.839035 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.838905 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75548b57c-bdt42\" (UID: \"6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1\") " pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" Jun 14 13:37:20.839988 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.839960 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1-metrics-client-ca\") pod \"thanos-querier-75548b57c-bdt42\" (UID: \"6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1\") " pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" Jun 14 13:37:20.841175 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.841149 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75548b57c-bdt42\" (UID: \"6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1\") " pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" Jun 14 13:37:20.841330 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.841303 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1-secret-thanos-querier-tls\") pod \"thanos-querier-75548b57c-bdt42\" (UID: \"6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1\") " pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" Jun 14 13:37:20.841460 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.841435 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75548b57c-bdt42\" (UID: \"6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1\") " pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" Jun 14 13:37:20.841716 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.841606 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75548b57c-bdt42\" (UID: \"6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1\") " pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" Jun 14 13:37:20.841874 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.841859 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1-secret-grpc-tls\") pod \"thanos-querier-75548b57c-bdt42\" (UID: \"6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1\") " pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" Jun 14 13:37:20.841968 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.841944 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75548b57c-bdt42\" (UID: \"6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1\") " pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" Jun 14 13:37:20.848224 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.848168 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnllv\" (UniqueName: \"kubernetes.io/projected/6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1-kube-api-access-gnllv\") pod \"thanos-querier-75548b57c-bdt42\" (UID: \"6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1\") " pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" Jun 14 13:37:20.950257 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:20.950228 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" Jun 14 13:37:21.081004 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:21.080973 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-75548b57c-bdt42"] Jun 14 13:37:21.083547 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:37:21.083516 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e30ee4b_81b2_4755_a7d0_f7c8d1181ce1.slice/crio-d130887190f8ce03974414f690d93ead33ad18227e711fe8ee665afffece38d3 WatchSource:0}: Error finding container d130887190f8ce03974414f690d93ead33ad18227e711fe8ee665afffece38d3: Status 404 returned error can't find the container with id d130887190f8ce03974414f690d93ead33ad18227e711fe8ee665afffece38d3 Jun 14 13:37:21.464661 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:21.464626 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:21.566778 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:21.566735 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:21.667433 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:21.667401 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:21.783576 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:21.783497 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" event={"ID":"6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1","Type":"ContainerStarted","Data":"d130887190f8ce03974414f690d93ead33ad18227e711fe8ee665afffece38d3"} Jun 14 13:37:21.786085 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:21.786046 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dkgnm" event={"ID":"58b2bd4e-cddf-4ac6-a384-fa94a0d02993","Type":"ContainerStarted","Data":"ba5b09d5ef4fbc66611d245d6920d04d3c2ceee579a117360a2f4f68a372a05c"} Jun 14 13:37:21.786231 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:21.786111 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dkgnm" event={"ID":"58b2bd4e-cddf-4ac6-a384-fa94a0d02993","Type":"ContainerStarted","Data":"205e6c6c6b3fd3c3a3dc59b69ea221e8ca36f952ca0c7ebdfaa405a2e9dc5199"} Jun 14 13:37:21.787976 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:21.787947 2557 generic.go:356] "Generic (PLEG): container finished" podID="afac4dcf-ccb7-4426-8560-b191b6fce992" containerID="4defea38e12cd954fc2d767c90203193ce50b4fafea4821fb1c045bd8f557944" exitCode=0 Jun 14 13:37:21.788102 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:21.787988 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"afac4dcf-ccb7-4426-8560-b191b6fce992","Type":"ContainerDied","Data":"4defea38e12cd954fc2d767c90203193ce50b4fafea4821fb1c045bd8f557944"} Jun 14 13:37:21.806145 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:21.806065 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dkgnm" podStartSLOduration=2.789381406 podStartE2EDuration="3.806046013s" totalImagesPullingTime="952.836864ms" totalInitContainerRuntime="63.827743ms" isStatefulPod=true podCreationTimestamp="2026-06-14 13:37:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:37:21.80442212 +0000 UTC m=+274.477690067" watchObservedRunningTime="2026-06-14 13:37:21.806046013 +0000 UTC m=+274.479313964" Jun 14 13:37:21.841865 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:21.841826 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:23.275294 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:23.275235 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:23.345665 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:23.345627 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:23.743632 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:23.743608 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:23.802005 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:23.801960 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" event={"ID":"6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1","Type":"ContainerStarted","Data":"ac00f436284b22bc73cbb25d625ad39d03abd0b45b262cd58d021cbda11a6465"} Jun 14 13:37:23.802125 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:23.802058 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" event={"ID":"6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1","Type":"ContainerStarted","Data":"fc6245a836d8da7cc0ba235fd8e954efbbed2be4e6c75d56a2fa3895656436a2"} Jun 14 13:37:23.802125 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:23.802103 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" event={"ID":"6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1","Type":"ContainerStarted","Data":"e54fe607d8922e16091f46cf14ad34efa014116343783325fbe55b67045af326"} Jun 14 13:37:23.804847 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:23.804805 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"afac4dcf-ccb7-4426-8560-b191b6fce992","Type":"ContainerStarted","Data":"ec0aeea052bef3d7bec801339f307f4df6d48ef6d9e92fc1e082ade3f569d785"} Jun 14 13:37:23.805005 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:23.804881 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"afac4dcf-ccb7-4426-8560-b191b6fce992","Type":"ContainerStarted","Data":"36c8378aa8af0f8bf88b7c4ffbda1be4102a0ab3ccd52b800beddc49f6839b9f"} Jun 14 13:37:23.805005 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:23.804920 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"afac4dcf-ccb7-4426-8560-b191b6fce992","Type":"ContainerStarted","Data":"62d07cccd6816560ea51e0515e622859b8e187a6cde3ca2811518ffe5f2ad620"} Jun 14 13:37:23.805005 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:23.804945 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"afac4dcf-ccb7-4426-8560-b191b6fce992","Type":"ContainerStarted","Data":"d80a686e97475fb1670dc859a1c8e2110cc9668f2491278bdb93e91b6f9a3ff5"} Jun 14 13:37:23.805005 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:23.804969 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"afac4dcf-ccb7-4426-8560-b191b6fce992","Type":"ContainerStarted","Data":"4683909bb94530331c1bdfd68bcf7d59585a03514f04f1c4189c76912dd6635b"} Jun 14 13:37:24.713336 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:24.713299 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:24.812100 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:24.812063 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" event={"ID":"6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1","Type":"ContainerStarted","Data":"a18eca1f65a0037679caa93ac5333a7e77569007b720ed148e575f4a5f943e30"} Jun 14 13:37:24.812286 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:24.812143 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" event={"ID":"6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1","Type":"ContainerStarted","Data":"6b3b8cb13e5111439cb0b37c3e35e7687bde2e4b5894f15649a264d4375819fe"} Jun 14 13:37:24.812286 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:24.812184 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" event={"ID":"6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1","Type":"ContainerStarted","Data":"821513ba51a742ad0e1b1ba28ea7296c872222449af85c5a5c64307782f8b768"} Jun 14 13:37:24.812286 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:24.812225 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" Jun 14 13:37:24.815211 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:24.815184 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"afac4dcf-ccb7-4426-8560-b191b6fce992","Type":"ContainerStarted","Data":"da186811e01a7ad79beb9d6a3a94e1b6eea9ae05a6a727d6e09111b4082be46c"} Jun 14 13:37:24.837557 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:24.837501 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" podStartSLOduration=1.785203225 podStartE2EDuration="4.837485399s" totalImagesPullingTime="3.052282174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:37:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:37:24.835099137 +0000 UTC m=+277.508367122" watchObservedRunningTime="2026-06-14 13:37:24.837485399 +0000 UTC m=+277.510753408" Jun 14 13:37:24.859524 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:24.859470 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.677804247 podStartE2EDuration="5.859453928s" totalImagesPullingTime="3.165776167s" totalInitContainerRuntime="15.873514ms" isStatefulPod=false podCreationTimestamp="2026-06-14 13:37:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:37:24.857307383 +0000 UTC m=+277.530575328" watchObservedRunningTime="2026-06-14 13:37:24.859453928 +0000 UTC m=+277.532721873" Jun 14 13:37:28.397769 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:37:28.397712 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" podUID="85f3fdc7-5813-4d27-82b6-f9e963f80b4d" Jun 14 13:37:28.449202 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:28.449165 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:28.550057 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:28.550025 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:28.830760 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:28.830670 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:37:28.980830 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:28.980796 2557 patch_prober.go:28] interesting pod/console-7dcb8dd565-tt7v6 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused" start-of-body= Jun 14 13:37:28.980979 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:28.980851 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7dcb8dd565-tt7v6" podUID="f40ec0e8-6e28-48dd-a38a-946bc253527c" containerName="console" probeResult="failure" output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused" Jun 14 13:37:30.825929 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:30.825902 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-75548b57c-bdt42" Jun 14 13:37:31.737503 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:31.737474 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-tls\") pod \"image-registry-7f7f6b48f-hjbtc\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:37:31.739825 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:31.739795 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-tls\") pod \"image-registry-7f7f6b48f-hjbtc\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:37:31.834332 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:31.834299 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nfbbq\"" Jun 14 13:37:31.838059 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:31.838033 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a6e5105-b1a2-4429-825b-6c8509d6bf90-metrics-tls\") pod \"dns-default-fr9gb\" (UID: \"5a6e5105-b1a2-4429-825b-6c8509d6bf90\") " pod="openshift-dns/dns-default-fr9gb" Jun 14 13:37:31.840664 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:31.840642 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a6e5105-b1a2-4429-825b-6c8509d6bf90-metrics-tls\") pod \"dns-default-fr9gb\" (UID: \"5a6e5105-b1a2-4429-825b-6c8509d6bf90\") " pod="openshift-dns/dns-default-fr9gb" Jun 14 13:37:31.842566 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:31.842544 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:37:31.933602 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:31.933577 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8ngwb\"" Jun 14 13:37:31.941153 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:31.941126 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fr9gb" Jun 14 13:37:32.001701 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:32.001663 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f7f6b48f-hjbtc"] Jun 14 13:37:32.002827 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:37:32.002801 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85f3fdc7_5813_4d27_82b6_f9e963f80b4d.slice/crio-eddeed66959f66eee3c2095440bfb3e34ca4930e61b50119c4b8f39afa2275e1 WatchSource:0}: Error finding container eddeed66959f66eee3c2095440bfb3e34ca4930e61b50119c4b8f39afa2275e1: Status 404 returned error can't find the container with id eddeed66959f66eee3c2095440bfb3e34ca4930e61b50119c4b8f39afa2275e1 Jun 14 13:37:32.082348 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:32.082314 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fr9gb"] Jun 14 13:37:32.085333 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:37:32.085307 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a6e5105_b1a2_4429_825b_6c8509d6bf90.slice/crio-e80c1d3a1c683f0eecd617b4fc6e5009c3b7e9c671e42ddf6c25351a0b2e9ad6 WatchSource:0}: Error finding container e80c1d3a1c683f0eecd617b4fc6e5009c3b7e9c671e42ddf6c25351a0b2e9ad6: Status 404 returned error can't find the container with id e80c1d3a1c683f0eecd617b4fc6e5009c3b7e9c671e42ddf6c25351a0b2e9ad6 Jun 14 13:37:32.848694 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:32.848628 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" event={"ID":"85f3fdc7-5813-4d27-82b6-f9e963f80b4d","Type":"ContainerStarted","Data":"6ddebf7b05b326fe72a74ebfe22006710d323b24eb89b4e26eae6a7e8d9ba2c1"} Jun 14 13:37:32.849179 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:32.848715 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:37:32.849179 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:32.848751 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" event={"ID":"85f3fdc7-5813-4d27-82b6-f9e963f80b4d","Type":"ContainerStarted","Data":"eddeed66959f66eee3c2095440bfb3e34ca4930e61b50119c4b8f39afa2275e1"} Jun 14 13:37:32.850050 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:32.850022 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fr9gb" event={"ID":"5a6e5105-b1a2-4429-825b-6c8509d6bf90","Type":"ContainerStarted","Data":"e80c1d3a1c683f0eecd617b4fc6e5009c3b7e9c671e42ddf6c25351a0b2e9ad6"} Jun 14 13:37:32.869998 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:32.869948 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" podStartSLOduration=284.869932795 podStartE2EDuration="4m44.869932795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:32:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:37:32.869730842 +0000 UTC m=+285.542998816" watchObservedRunningTime="2026-06-14 13:37:32.869932795 +0000 UTC m=+285.543200767" Jun 14 13:37:33.857272 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:33.857237 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fr9gb" event={"ID":"5a6e5105-b1a2-4429-825b-6c8509d6bf90","Type":"ContainerStarted","Data":"452c335369d78f0b2be060fea9e0bef5c5007d404705e210f38514167f40b6d3"} Jun 14 13:37:34.862402 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:34.862369 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fr9gb" event={"ID":"5a6e5105-b1a2-4429-825b-6c8509d6bf90","Type":"ContainerStarted","Data":"031915321f3d04325ebb70944426ed9cb884fcfb0fd7f1ab3db9da14a7fbb85c"} Jun 14 13:37:34.862779 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:34.862433 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fr9gb" Jun 14 13:37:34.879582 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:34.879536 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fr9gb" podStartSLOduration=252.222915576 podStartE2EDuration="4m13.879519377s" totalImagesPullingTime="1.656603801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:33:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:37:34.878314278 +0000 UTC m=+287.551582227" watchObservedRunningTime="2026-06-14 13:37:34.879519377 +0000 UTC m=+287.552787323" Jun 14 13:37:37.870475 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:37.870432 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:37.934196 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:37.934165 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:38.019407 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:38.019373 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:38.068064 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:38.068033 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:38.980082 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:38.980044 2557 patch_prober.go:28] interesting pod/console-7dcb8dd565-tt7v6 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused" start-of-body= Jun 14 13:37:38.980455 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:38.980098 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7dcb8dd565-tt7v6" podUID="f40ec0e8-6e28-48dd-a38a-946bc253527c" containerName="console" probeResult="failure" output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused" Jun 14 13:37:44.868191 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:44.868160 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fr9gb" Jun 14 13:37:47.699745 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:47.699709 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-dwq9q_1fea963c-a8b6-4071-8071-3e7149ef98cd/console-operator/1.log" Jun 14 13:37:47.700170 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:47.699723 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-dwq9q_1fea963c-a8b6-4071-8071-3e7149ef98cd/console-operator/1.log" Jun 14 13:37:47.704987 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:47.704969 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqj5p_08819fe4-b654-44d1-9773-a007a6044ec2/ovn-acl-logging/0.log" Jun 14 13:37:47.705105 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:47.704969 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqj5p_08819fe4-b654-44d1-9773-a007a6044ec2/ovn-acl-logging/0.log" Jun 14 13:37:47.712809 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:47.712790 2557 kubelet.go:1648] "Image garbage collection succeeded" Jun 14 13:37:47.735341 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:47.735207 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:47.837485 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:47.837450 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:48.984017 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:48.983985 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dcb8dd565-tt7v6" Jun 14 13:37:48.987796 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:48.987771 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dcb8dd565-tt7v6" Jun 14 13:37:49.124905 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:49.124870 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:50.111616 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:50.111579 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:51.136493 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:51.136455 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:51.184836 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:51.184806 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:51.847226 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:51.847193 2557 patch_prober.go:28] interesting pod/image-registry-7f7f6b48f-hjbtc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 13:37:51.847405 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:51.847248 2557 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" podUID="85f3fdc7-5813-4d27-82b6-f9e963f80b4d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 13:37:53.576778 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:53.576745 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:53.695781 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:53.695747 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dcb8dd565-tt7v6"] Jun 14 13:37:53.799551 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:53.799522 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:53.854217 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:53.854139 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:53.861920 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:53.861899 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:37:53.922501 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:53.922471 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:54.115925 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:54.115837 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:54.216519 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:54.216488 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:57.237834 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:57.237799 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f7f6b48f-hjbtc"] Jun 14 13:37:57.313095 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:57.313066 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:57.453904 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:57.453864 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:57.554927 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:57.554840 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:37:59.960978 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:59.960945 2557 generic.go:356] "Generic (PLEG): container finished" podID="fa652aa2-ad08-4742-9489-be4b1d474712" containerID="be1806ed4b04fc5c7781f41c1ed0bd4db161a4fb1f0e88e9bfad829b07bb0aa9" exitCode=0 Jun 14 13:37:59.961338 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:59.961007 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-5rkgs" event={"ID":"fa652aa2-ad08-4742-9489-be4b1d474712","Type":"ContainerDied","Data":"be1806ed4b04fc5c7781f41c1ed0bd4db161a4fb1f0e88e9bfad829b07bb0aa9"} Jun 14 13:37:59.961379 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:37:59.961337 2557 scope.go:117] "RemoveContainer" containerID="be1806ed4b04fc5c7781f41c1ed0bd4db161a4fb1f0e88e9bfad829b07bb0aa9" Jun 14 13:38:00.203809 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:00.203775 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:38:00.255422 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:00.255329 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:38:00.967152 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:00.967119 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-5rkgs" event={"ID":"fa652aa2-ad08-4742-9489-be4b1d474712","Type":"ContainerStarted","Data":"6fb626313740100f8a1965a5e95bc1a796a87ef14e255f2ffad3a46b342c57c6"} Jun 14 13:38:01.793825 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:01.793800 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fr9gb_5a6e5105-b1a2-4429-825b-6c8509d6bf90/dns/0.log" Jun 14 13:38:01.993957 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:01.993926 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fr9gb_5a6e5105-b1a2-4429-825b-6c8509d6bf90/kube-rbac-proxy/0.log" Jun 14 13:38:02.394530 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:02.394502 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hcsvf_31339707-4ec8-4cbb-8014-695a9f156efa/dns-node-resolver/0.log" Jun 14 13:38:02.794388 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:02.794311 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-565d7ffdb8-hjw45_341c9198-cdc6-43c8-a9bd-eb0e957f2e19/router/0.log" Jun 14 13:38:02.997942 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:02.997907 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:38:03.093012 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:03.092926 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:38:03.394174 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:03.394146 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qhs44_bc9554de-2cf6-4067-aaf8-59003ac80ddf/serve-healthcheck-canary/0.log" Jun 14 13:38:03.762066 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:03.761987 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:38:03.862792 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:03.862761 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:38:04.986508 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:04.986415 2557 generic.go:356] "Generic (PLEG): container finished" podID="41e65aca-204a-43b9-89b5-a800f28d1e94" containerID="8982cef8fabbb19fe634d89a34d7d4bd3e5a93d6b885501d7c348305a6ed8430" exitCode=0 Jun 14 13:38:04.986508 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:04.986490 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z9xc4" event={"ID":"41e65aca-204a-43b9-89b5-a800f28d1e94","Type":"ContainerDied","Data":"8982cef8fabbb19fe634d89a34d7d4bd3e5a93d6b885501d7c348305a6ed8430"} Jun 14 13:38:04.987034 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:04.986924 2557 scope.go:117] "RemoveContainer" containerID="8982cef8fabbb19fe634d89a34d7d4bd3e5a93d6b885501d7c348305a6ed8430" Jun 14 13:38:05.991872 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:05.991835 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z9xc4" event={"ID":"41e65aca-204a-43b9-89b5-a800f28d1e94","Type":"ContainerStarted","Data":"4ab63ca810c2a63f660ba79da9fee2607c5b0dcf4e7b6f865036b18bf6a0fcd2"} Jun 14 13:38:07.870754 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:07.870717 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:38:07.938039 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:07.937998 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:38:12.865751 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:12.865647 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:38:12.967378 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:12.967343 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:38:13.017997 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:13.017951 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:38:18.717342 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:18.717278 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7dcb8dd565-tt7v6" podUID="f40ec0e8-6e28-48dd-a38a-946bc253527c" containerName="console" containerID="cri-o://bafe4f1c96baa6d601b873ff51839d28cbbb76c82dc988f73bf3c1cb49235c07" gracePeriod=15 Jun 14 13:38:18.960486 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:18.960454 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dcb8dd565-tt7v6" Jun 14 13:38:19.031152 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:19.031076 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f40ec0e8-6e28-48dd-a38a-946bc253527c-trusted-ca-bundle\") pod \"f40ec0e8-6e28-48dd-a38a-946bc253527c\" (UID: \"f40ec0e8-6e28-48dd-a38a-946bc253527c\") " Jun 14 13:38:19.031152 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:19.031120 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f40ec0e8-6e28-48dd-a38a-946bc253527c-oauth-serving-cert\") pod \"f40ec0e8-6e28-48dd-a38a-946bc253527c\" (UID: \"f40ec0e8-6e28-48dd-a38a-946bc253527c\") " Jun 14 13:38:19.031363 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:19.031178 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f40ec0e8-6e28-48dd-a38a-946bc253527c-console-serving-cert\") pod \"f40ec0e8-6e28-48dd-a38a-946bc253527c\" (UID: \"f40ec0e8-6e28-48dd-a38a-946bc253527c\") " Jun 14 13:38:19.031363 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:19.031211 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f40ec0e8-6e28-48dd-a38a-946bc253527c-console-oauth-config\") pod \"f40ec0e8-6e28-48dd-a38a-946bc253527c\" (UID: \"f40ec0e8-6e28-48dd-a38a-946bc253527c\") " Jun 14 13:38:19.031363 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:19.031238 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gz95w\" (UniqueName: \"kubernetes.io/projected/f40ec0e8-6e28-48dd-a38a-946bc253527c-kube-api-access-gz95w\") pod \"f40ec0e8-6e28-48dd-a38a-946bc253527c\" (UID: \"f40ec0e8-6e28-48dd-a38a-946bc253527c\") " Jun 14 13:38:19.031363 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:19.031308 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f40ec0e8-6e28-48dd-a38a-946bc253527c-service-ca\") pod \"f40ec0e8-6e28-48dd-a38a-946bc253527c\" (UID: \"f40ec0e8-6e28-48dd-a38a-946bc253527c\") " Jun 14 13:38:19.031541 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:19.031368 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f40ec0e8-6e28-48dd-a38a-946bc253527c-console-config\") pod \"f40ec0e8-6e28-48dd-a38a-946bc253527c\" (UID: \"f40ec0e8-6e28-48dd-a38a-946bc253527c\") " Jun 14 13:38:19.031594 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:19.031566 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f40ec0e8-6e28-48dd-a38a-946bc253527c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f40ec0e8-6e28-48dd-a38a-946bc253527c" (UID: "f40ec0e8-6e28-48dd-a38a-946bc253527c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 13:38:19.031649 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:19.031624 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f40ec0e8-6e28-48dd-a38a-946bc253527c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f40ec0e8-6e28-48dd-a38a-946bc253527c" (UID: "f40ec0e8-6e28-48dd-a38a-946bc253527c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 13:38:19.031781 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:19.031764 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f40ec0e8-6e28-48dd-a38a-946bc253527c-trusted-ca-bundle\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:38:19.031840 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:19.031783 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f40ec0e8-6e28-48dd-a38a-946bc253527c-oauth-serving-cert\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:38:19.031840 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:19.031818 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f40ec0e8-6e28-48dd-a38a-946bc253527c-service-ca" (OuterVolumeSpecName: "service-ca") pod "f40ec0e8-6e28-48dd-a38a-946bc253527c" (UID: "f40ec0e8-6e28-48dd-a38a-946bc253527c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 13:38:19.031947 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:19.031896 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f40ec0e8-6e28-48dd-a38a-946bc253527c-console-config" (OuterVolumeSpecName: "console-config") pod "f40ec0e8-6e28-48dd-a38a-946bc253527c" (UID: "f40ec0e8-6e28-48dd-a38a-946bc253527c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 13:38:19.033511 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:19.033483 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f40ec0e8-6e28-48dd-a38a-946bc253527c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f40ec0e8-6e28-48dd-a38a-946bc253527c" (UID: "f40ec0e8-6e28-48dd-a38a-946bc253527c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 13:38:19.033621 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:19.033522 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f40ec0e8-6e28-48dd-a38a-946bc253527c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f40ec0e8-6e28-48dd-a38a-946bc253527c" (UID: "f40ec0e8-6e28-48dd-a38a-946bc253527c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 13:38:19.033621 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:19.033533 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f40ec0e8-6e28-48dd-a38a-946bc253527c-kube-api-access-gz95w" (OuterVolumeSpecName: "kube-api-access-gz95w") pod "f40ec0e8-6e28-48dd-a38a-946bc253527c" (UID: "f40ec0e8-6e28-48dd-a38a-946bc253527c"). InnerVolumeSpecName "kube-api-access-gz95w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 13:38:19.052849 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:19.052820 2557 generic.go:356] "Generic (PLEG): container finished" podID="f40ec0e8-6e28-48dd-a38a-946bc253527c" containerID="bafe4f1c96baa6d601b873ff51839d28cbbb76c82dc988f73bf3c1cb49235c07" exitCode=0 Jun 14 13:38:19.052935 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:19.052863 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dcb8dd565-tt7v6" Jun 14 13:38:19.052935 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:19.052906 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dcb8dd565-tt7v6" event={"ID":"f40ec0e8-6e28-48dd-a38a-946bc253527c","Type":"ContainerDied","Data":"bafe4f1c96baa6d601b873ff51839d28cbbb76c82dc988f73bf3c1cb49235c07"} Jun 14 13:38:19.053015 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:19.052956 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dcb8dd565-tt7v6" event={"ID":"f40ec0e8-6e28-48dd-a38a-946bc253527c","Type":"ContainerDied","Data":"2307b89c1263666949c0450bc205768889d250b1c4aca1131fe4c2cdd15902b2"} Jun 14 13:38:19.053015 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:19.052976 2557 scope.go:117] "RemoveContainer" containerID="bafe4f1c96baa6d601b873ff51839d28cbbb76c82dc988f73bf3c1cb49235c07" Jun 14 13:38:19.067274 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:19.067257 2557 scope.go:117] "RemoveContainer" containerID="bafe4f1c96baa6d601b873ff51839d28cbbb76c82dc988f73bf3c1cb49235c07" Jun 14 13:38:19.067533 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:38:19.067512 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bafe4f1c96baa6d601b873ff51839d28cbbb76c82dc988f73bf3c1cb49235c07\": container with ID starting with bafe4f1c96baa6d601b873ff51839d28cbbb76c82dc988f73bf3c1cb49235c07 not found: ID does not exist" containerID="bafe4f1c96baa6d601b873ff51839d28cbbb76c82dc988f73bf3c1cb49235c07" Jun 14 13:38:19.067606 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:19.067540 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bafe4f1c96baa6d601b873ff51839d28cbbb76c82dc988f73bf3c1cb49235c07"} err="failed to get container status \"bafe4f1c96baa6d601b873ff51839d28cbbb76c82dc988f73bf3c1cb49235c07\": rpc error: code = NotFound desc = could not find container \"bafe4f1c96baa6d601b873ff51839d28cbbb76c82dc988f73bf3c1cb49235c07\": container with ID starting with bafe4f1c96baa6d601b873ff51839d28cbbb76c82dc988f73bf3c1cb49235c07 not found: ID does not exist" Jun 14 13:38:19.077215 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:19.077193 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dcb8dd565-tt7v6"] Jun 14 13:38:19.080241 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:19.080220 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7dcb8dd565-tt7v6"] Jun 14 13:38:19.132783 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:19.132752 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f40ec0e8-6e28-48dd-a38a-946bc253527c-console-serving-cert\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:38:19.132783 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:19.132775 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f40ec0e8-6e28-48dd-a38a-946bc253527c-console-oauth-config\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:38:19.132783 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:19.132786 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gz95w\" (UniqueName: \"kubernetes.io/projected/f40ec0e8-6e28-48dd-a38a-946bc253527c-kube-api-access-gz95w\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:38:19.132967 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:19.132797 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f40ec0e8-6e28-48dd-a38a-946bc253527c-service-ca\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:38:19.132967 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:19.132806 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f40ec0e8-6e28-48dd-a38a-946bc253527c-console-config\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:38:19.733732 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:19.733675 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f40ec0e8-6e28-48dd-a38a-946bc253527c" path="/var/lib/kubelet/pods/f40ec0e8-6e28-48dd-a38a-946bc253527c/volumes" Jun 14 13:38:22.257665 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:22.257604 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" podUID="85f3fdc7-5813-4d27-82b6-f9e963f80b4d" containerName="registry" containerID="cri-o://6ddebf7b05b326fe72a74ebfe22006710d323b24eb89b4e26eae6a7e8d9ba2c1" gracePeriod=30 Jun 14 13:38:22.505160 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:22.505135 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:38:22.561729 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:22.561623 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-trusted-ca\") pod \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " Jun 14 13:38:22.561729 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:22.561660 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-bound-sa-token\") pod \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " Jun 14 13:38:22.561729 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:22.561701 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-installation-pull-secrets\") pod \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " Jun 14 13:38:22.561729 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:22.561723 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-certificates\") pod \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " Jun 14 13:38:22.562167 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:22.561756 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfpm9\" (UniqueName: \"kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-kube-api-access-gfpm9\") pod \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " Jun 14 13:38:22.562167 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:22.561785 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-image-registry-private-configuration\") pod \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " Jun 14 13:38:22.562167 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:22.561829 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-ca-trust-extracted\") pod \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " Jun 14 13:38:22.562167 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:22.561877 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-tls\") pod \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\" (UID: \"85f3fdc7-5813-4d27-82b6-f9e963f80b4d\") " Jun 14 13:38:22.562167 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:22.562083 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "85f3fdc7-5813-4d27-82b6-f9e963f80b4d" (UID: "85f3fdc7-5813-4d27-82b6-f9e963f80b4d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 13:38:22.562669 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:22.562590 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "85f3fdc7-5813-4d27-82b6-f9e963f80b4d" (UID: "85f3fdc7-5813-4d27-82b6-f9e963f80b4d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 13:38:22.564568 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:22.564535 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "85f3fdc7-5813-4d27-82b6-f9e963f80b4d" (UID: "85f3fdc7-5813-4d27-82b6-f9e963f80b4d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 13:38:22.564568 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:22.564556 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "85f3fdc7-5813-4d27-82b6-f9e963f80b4d" (UID: "85f3fdc7-5813-4d27-82b6-f9e963f80b4d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 13:38:22.564783 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:22.564700 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "85f3fdc7-5813-4d27-82b6-f9e963f80b4d" (UID: "85f3fdc7-5813-4d27-82b6-f9e963f80b4d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 13:38:22.564840 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:22.564796 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-kube-api-access-gfpm9" (OuterVolumeSpecName: "kube-api-access-gfpm9") pod "85f3fdc7-5813-4d27-82b6-f9e963f80b4d" (UID: "85f3fdc7-5813-4d27-82b6-f9e963f80b4d"). InnerVolumeSpecName "kube-api-access-gfpm9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 13:38:22.564892 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:22.564873 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "85f3fdc7-5813-4d27-82b6-f9e963f80b4d" (UID: "85f3fdc7-5813-4d27-82b6-f9e963f80b4d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 13:38:22.571082 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:22.571045 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "85f3fdc7-5813-4d27-82b6-f9e963f80b4d" (UID: "85f3fdc7-5813-4d27-82b6-f9e963f80b4d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 13:38:22.663468 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:22.663432 2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-installation-pull-secrets\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:38:22.663468 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:22.663460 2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-certificates\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:38:22.663468 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:22.663469 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfpm9\" (UniqueName: \"kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-kube-api-access-gfpm9\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:38:22.663468 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:22.663479 2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-image-registry-private-configuration\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:38:22.663744 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:22.663488 2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-ca-trust-extracted\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:38:22.663744 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:22.663497 2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-registry-tls\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:38:22.663744 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:22.663505 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-trusted-ca\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:38:22.663744 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:22.663512 2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85f3fdc7-5813-4d27-82b6-f9e963f80b4d-bound-sa-token\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:38:22.874103 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:22.874071 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:38:22.972496 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:22.972459 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:38:23.071364 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:23.071332 2557 generic.go:356] "Generic (PLEG): container finished" podID="85f3fdc7-5813-4d27-82b6-f9e963f80b4d" containerID="6ddebf7b05b326fe72a74ebfe22006710d323b24eb89b4e26eae6a7e8d9ba2c1" exitCode=0 Jun 14 13:38:23.071548 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:23.071373 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" Jun 14 13:38:23.071548 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:23.071423 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" event={"ID":"85f3fdc7-5813-4d27-82b6-f9e963f80b4d","Type":"ContainerDied","Data":"6ddebf7b05b326fe72a74ebfe22006710d323b24eb89b4e26eae6a7e8d9ba2c1"} Jun 14 13:38:23.071548 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:23.071478 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f7f6b48f-hjbtc" event={"ID":"85f3fdc7-5813-4d27-82b6-f9e963f80b4d","Type":"ContainerDied","Data":"eddeed66959f66eee3c2095440bfb3e34ca4930e61b50119c4b8f39afa2275e1"} Jun 14 13:38:23.071548 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:23.071507 2557 scope.go:117] "RemoveContainer" containerID="6ddebf7b05b326fe72a74ebfe22006710d323b24eb89b4e26eae6a7e8d9ba2c1" Jun 14 13:38:23.080000 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:23.079985 2557 scope.go:117] "RemoveContainer" containerID="6ddebf7b05b326fe72a74ebfe22006710d323b24eb89b4e26eae6a7e8d9ba2c1" Jun 14 13:38:23.080262 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:38:23.080245 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ddebf7b05b326fe72a74ebfe22006710d323b24eb89b4e26eae6a7e8d9ba2c1\": container with ID starting with 6ddebf7b05b326fe72a74ebfe22006710d323b24eb89b4e26eae6a7e8d9ba2c1 not found: ID does not exist" containerID="6ddebf7b05b326fe72a74ebfe22006710d323b24eb89b4e26eae6a7e8d9ba2c1" Jun 14 13:38:23.080311 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:23.080269 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ddebf7b05b326fe72a74ebfe22006710d323b24eb89b4e26eae6a7e8d9ba2c1"} err="failed to get container status \"6ddebf7b05b326fe72a74ebfe22006710d323b24eb89b4e26eae6a7e8d9ba2c1\": rpc error: code = NotFound desc = could not find container \"6ddebf7b05b326fe72a74ebfe22006710d323b24eb89b4e26eae6a7e8d9ba2c1\": container with ID starting with 6ddebf7b05b326fe72a74ebfe22006710d323b24eb89b4e26eae6a7e8d9ba2c1 not found: ID does not exist" Jun 14 13:38:23.091781 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:23.091757 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f7f6b48f-hjbtc"] Jun 14 13:38:23.095312 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:23.095291 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7f7f6b48f-hjbtc"] Jun 14 13:38:23.733127 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:23.733094 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85f3fdc7-5813-4d27-82b6-f9e963f80b4d" path="/var/lib/kubelet/pods/85f3fdc7-5813-4d27-82b6-f9e963f80b4d/volumes" Jun 14 13:38:24.759037 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:24.759002 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:38:24.814596 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:24.814561 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:38:37.747917 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:37.747821 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:38:37.881210 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:37.881173 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:38:37.948701 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:37.948646 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:38:38.008437 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:38.008352 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:38:42.835399 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:42.835366 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-76765544d8-vznw9"] Jun 14 13:38:42.835799 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:42.835709 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85f3fdc7-5813-4d27-82b6-f9e963f80b4d" containerName="registry" Jun 14 13:38:42.835799 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:42.835720 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="85f3fdc7-5813-4d27-82b6-f9e963f80b4d" containerName="registry" Jun 14 13:38:42.835799 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:42.835731 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f40ec0e8-6e28-48dd-a38a-946bc253527c" containerName="console" Jun 14 13:38:42.835799 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:42.835736 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f40ec0e8-6e28-48dd-a38a-946bc253527c" containerName="console" Jun 14 13:38:42.835799 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:42.835795 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="85f3fdc7-5813-4d27-82b6-f9e963f80b4d" containerName="registry" Jun 14 13:38:42.835799 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:42.835803 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f40ec0e8-6e28-48dd-a38a-946bc253527c" containerName="console" Jun 14 13:38:42.839014 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:42.838993 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-76765544d8-vznw9" Jun 14 13:38:42.841706 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:42.841662 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 14 13:38:42.841840 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:42.841758 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 14 13:38:42.841840 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:42.841736 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 14 13:38:42.841955 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:42.841717 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 14 13:38:42.841955 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:42.841770 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 14 13:38:42.842150 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:42.842132 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-4lhwb\"" Jun 14 13:38:42.846650 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:42.846614 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 14 13:38:42.852252 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:42.852229 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-76765544d8-vznw9"] Jun 14 13:38:43.034895 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:43.034849 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbaf557b-e49d-4783-99a7-20698b22658d-metrics-client-ca\") pod \"telemeter-client-76765544d8-vznw9\" (UID: \"dbaf557b-e49d-4783-99a7-20698b22658d\") " pod="openshift-monitoring/telemeter-client-76765544d8-vznw9" Jun 14 13:38:43.035109 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:43.034907 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbaf557b-e49d-4783-99a7-20698b22658d-serving-certs-ca-bundle\") pod \"telemeter-client-76765544d8-vznw9\" (UID: \"dbaf557b-e49d-4783-99a7-20698b22658d\") " pod="openshift-monitoring/telemeter-client-76765544d8-vznw9" Jun 14 13:38:43.035109 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:43.035020 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x55l6\" (UniqueName: \"kubernetes.io/projected/dbaf557b-e49d-4783-99a7-20698b22658d-kube-api-access-x55l6\") pod \"telemeter-client-76765544d8-vznw9\" (UID: \"dbaf557b-e49d-4783-99a7-20698b22658d\") " pod="openshift-monitoring/telemeter-client-76765544d8-vznw9" Jun 14 13:38:43.035109 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:43.035062 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/dbaf557b-e49d-4783-99a7-20698b22658d-secret-telemeter-client\") pod \"telemeter-client-76765544d8-vznw9\" (UID: \"dbaf557b-e49d-4783-99a7-20698b22658d\") " pod="openshift-monitoring/telemeter-client-76765544d8-vznw9" Jun 14 13:38:43.035238 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:43.035117 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbaf557b-e49d-4783-99a7-20698b22658d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-76765544d8-vznw9\" (UID: \"dbaf557b-e49d-4783-99a7-20698b22658d\") " pod="openshift-monitoring/telemeter-client-76765544d8-vznw9" Jun 14 13:38:43.035238 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:43.035151 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/dbaf557b-e49d-4783-99a7-20698b22658d-federate-client-tls\") pod \"telemeter-client-76765544d8-vznw9\" (UID: \"dbaf557b-e49d-4783-99a7-20698b22658d\") " pod="openshift-monitoring/telemeter-client-76765544d8-vznw9" Jun 14 13:38:43.035238 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:43.035184 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/dbaf557b-e49d-4783-99a7-20698b22658d-telemeter-client-tls\") pod \"telemeter-client-76765544d8-vznw9\" (UID: \"dbaf557b-e49d-4783-99a7-20698b22658d\") " pod="openshift-monitoring/telemeter-client-76765544d8-vznw9" Jun 14 13:38:43.035238 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:43.035217 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbaf557b-e49d-4783-99a7-20698b22658d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-76765544d8-vznw9\" (UID: \"dbaf557b-e49d-4783-99a7-20698b22658d\") " pod="openshift-monitoring/telemeter-client-76765544d8-vznw9" Jun 14 13:38:43.136438 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:43.136400 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbaf557b-e49d-4783-99a7-20698b22658d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-76765544d8-vznw9\" (UID: \"dbaf557b-e49d-4783-99a7-20698b22658d\") " pod="openshift-monitoring/telemeter-client-76765544d8-vznw9" Jun 14 13:38:43.136632 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:43.136448 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/dbaf557b-e49d-4783-99a7-20698b22658d-federate-client-tls\") pod \"telemeter-client-76765544d8-vznw9\" (UID: \"dbaf557b-e49d-4783-99a7-20698b22658d\") " pod="openshift-monitoring/telemeter-client-76765544d8-vznw9" Jun 14 13:38:43.136632 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:43.136477 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/dbaf557b-e49d-4783-99a7-20698b22658d-telemeter-client-tls\") pod \"telemeter-client-76765544d8-vznw9\" (UID: \"dbaf557b-e49d-4783-99a7-20698b22658d\") " pod="openshift-monitoring/telemeter-client-76765544d8-vznw9" Jun 14 13:38:43.136632 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:43.136512 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbaf557b-e49d-4783-99a7-20698b22658d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-76765544d8-vznw9\" (UID: \"dbaf557b-e49d-4783-99a7-20698b22658d\") " pod="openshift-monitoring/telemeter-client-76765544d8-vznw9" Jun 14 13:38:43.136632 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:43.136539 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbaf557b-e49d-4783-99a7-20698b22658d-metrics-client-ca\") pod \"telemeter-client-76765544d8-vznw9\" (UID: \"dbaf557b-e49d-4783-99a7-20698b22658d\") " pod="openshift-monitoring/telemeter-client-76765544d8-vznw9" Jun 14 13:38:43.136632 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:43.136587 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbaf557b-e49d-4783-99a7-20698b22658d-serving-certs-ca-bundle\") pod \"telemeter-client-76765544d8-vznw9\" (UID: \"dbaf557b-e49d-4783-99a7-20698b22658d\") " pod="openshift-monitoring/telemeter-client-76765544d8-vznw9" Jun 14 13:38:43.136926 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:43.136652 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x55l6\" (UniqueName: \"kubernetes.io/projected/dbaf557b-e49d-4783-99a7-20698b22658d-kube-api-access-x55l6\") pod \"telemeter-client-76765544d8-vznw9\" (UID: \"dbaf557b-e49d-4783-99a7-20698b22658d\") " pod="openshift-monitoring/telemeter-client-76765544d8-vznw9" Jun 14 13:38:43.136926 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:43.136713 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/dbaf557b-e49d-4783-99a7-20698b22658d-secret-telemeter-client\") pod \"telemeter-client-76765544d8-vznw9\" (UID: \"dbaf557b-e49d-4783-99a7-20698b22658d\") " pod="openshift-monitoring/telemeter-client-76765544d8-vznw9" Jun 14 13:38:43.137419 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:43.137389 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbaf557b-e49d-4783-99a7-20698b22658d-metrics-client-ca\") pod \"telemeter-client-76765544d8-vznw9\" (UID: \"dbaf557b-e49d-4783-99a7-20698b22658d\") " pod="openshift-monitoring/telemeter-client-76765544d8-vznw9" Jun 14 13:38:43.137534 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:43.137423 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbaf557b-e49d-4783-99a7-20698b22658d-serving-certs-ca-bundle\") pod \"telemeter-client-76765544d8-vznw9\" (UID: \"dbaf557b-e49d-4783-99a7-20698b22658d\") " pod="openshift-monitoring/telemeter-client-76765544d8-vznw9" Jun 14 13:38:43.138007 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:43.137982 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbaf557b-e49d-4783-99a7-20698b22658d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-76765544d8-vznw9\" (UID: \"dbaf557b-e49d-4783-99a7-20698b22658d\") " pod="openshift-monitoring/telemeter-client-76765544d8-vznw9" Jun 14 13:38:43.139289 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:43.139263 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbaf557b-e49d-4783-99a7-20698b22658d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-76765544d8-vznw9\" (UID: \"dbaf557b-e49d-4783-99a7-20698b22658d\") " pod="openshift-monitoring/telemeter-client-76765544d8-vznw9" Jun 14 13:38:43.139418 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:43.139397 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/dbaf557b-e49d-4783-99a7-20698b22658d-secret-telemeter-client\") pod \"telemeter-client-76765544d8-vznw9\" (UID: \"dbaf557b-e49d-4783-99a7-20698b22658d\") " pod="openshift-monitoring/telemeter-client-76765544d8-vznw9" Jun 14 13:38:43.139461 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:43.139443 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/dbaf557b-e49d-4783-99a7-20698b22658d-telemeter-client-tls\") pod \"telemeter-client-76765544d8-vznw9\" (UID: \"dbaf557b-e49d-4783-99a7-20698b22658d\") " pod="openshift-monitoring/telemeter-client-76765544d8-vznw9" Jun 14 13:38:43.139536 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:43.139521 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/dbaf557b-e49d-4783-99a7-20698b22658d-federate-client-tls\") pod \"telemeter-client-76765544d8-vznw9\" (UID: \"dbaf557b-e49d-4783-99a7-20698b22658d\") " pod="openshift-monitoring/telemeter-client-76765544d8-vznw9" Jun 14 13:38:43.144289 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:43.144267 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x55l6\" (UniqueName: \"kubernetes.io/projected/dbaf557b-e49d-4783-99a7-20698b22658d-kube-api-access-x55l6\") pod \"telemeter-client-76765544d8-vznw9\" (UID: \"dbaf557b-e49d-4783-99a7-20698b22658d\") " pod="openshift-monitoring/telemeter-client-76765544d8-vznw9" Jun 14 13:38:43.149218 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:43.149201 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-76765544d8-vznw9" Jun 14 13:38:43.281193 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:43.281160 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-76765544d8-vznw9"] Jun 14 13:38:43.284440 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:38:43.284416 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbaf557b_e49d_4783_99a7_20698b22658d.slice/crio-a515de8248e29be71966f19272e9edcaf64e6fbbd398f2f07790eca4dd496a43 WatchSource:0}: Error finding container a515de8248e29be71966f19272e9edcaf64e6fbbd398f2f07790eca4dd496a43: Status 404 returned error can't find the container with id a515de8248e29be71966f19272e9edcaf64e6fbbd398f2f07790eca4dd496a43 Jun 14 13:38:43.286391 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:43.286373 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 13:38:44.161034 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:44.161001 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-76765544d8-vznw9" event={"ID":"dbaf557b-e49d-4783-99a7-20698b22658d","Type":"ContainerStarted","Data":"a515de8248e29be71966f19272e9edcaf64e6fbbd398f2f07790eca4dd496a43"} Jun 14 13:38:46.171934 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:46.171895 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-76765544d8-vznw9" event={"ID":"dbaf557b-e49d-4783-99a7-20698b22658d","Type":"ContainerStarted","Data":"068cbe39606fe0f70355dcf10b33bc68de60e72fe128cc5f725c6ae779c616f4"} Jun 14 13:38:46.172404 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:46.171966 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-76765544d8-vznw9" event={"ID":"dbaf557b-e49d-4783-99a7-20698b22658d","Type":"ContainerStarted","Data":"d97713a244ba896f0cbf00215aff278da7d875ce575dcd84fb1ae0eb2c3217a8"} Jun 14 13:38:46.172404 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:46.171991 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-76765544d8-vznw9" event={"ID":"dbaf557b-e49d-4783-99a7-20698b22658d","Type":"ContainerStarted","Data":"6ccc34c0487ab918b54173d3f8a3e462eb81dd26274a21b03df29d92003dd3a9"} Jun 14 13:38:46.193650 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:46.193596 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-76765544d8-vznw9" podStartSLOduration=2.236313098 podStartE2EDuration="4.193576173s" totalImagesPullingTime="1.957263075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:38:46.191609301 +0000 UTC m=+358.864877246" watchObservedRunningTime="2026-06-14 13:38:46.193576173 +0000 UTC m=+358.866844120" Jun 14 13:38:46.879456 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:46.879405 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6768b7496f-vw5j6"] Jun 14 13:38:46.882923 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:46.882900 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6768b7496f-vw5j6" Jun 14 13:38:46.886560 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:46.886535 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vxsch\"" Jun 14 13:38:46.887308 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:46.886561 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 14 13:38:46.887308 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:46.886583 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 14 13:38:46.887308 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:46.886590 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 14 13:38:46.887308 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:46.886626 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 14 13:38:46.887308 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:46.886637 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 14 13:38:46.887661 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:46.887445 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 14 13:38:46.888367 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:46.888023 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 14 13:38:46.890950 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:46.890929 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6768b7496f-vw5j6"] Jun 14 13:38:46.892994 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:46.892717 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 14 13:38:46.933215 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:46.933180 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:38:46.968813 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:46.968783 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4be302ec-2148-4350-8b22-f2f9efd25d37-console-config\") pod \"console-6768b7496f-vw5j6\" (UID: \"4be302ec-2148-4350-8b22-f2f9efd25d37\") " pod="openshift-console/console-6768b7496f-vw5j6" Jun 14 13:38:46.968968 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:46.968821 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4be302ec-2148-4350-8b22-f2f9efd25d37-console-oauth-config\") pod \"console-6768b7496f-vw5j6\" (UID: \"4be302ec-2148-4350-8b22-f2f9efd25d37\") " pod="openshift-console/console-6768b7496f-vw5j6" Jun 14 13:38:46.968968 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:46.968845 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4be302ec-2148-4350-8b22-f2f9efd25d37-service-ca\") pod \"console-6768b7496f-vw5j6\" (UID: \"4be302ec-2148-4350-8b22-f2f9efd25d37\") " pod="openshift-console/console-6768b7496f-vw5j6" Jun 14 13:38:46.968968 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:46.968900 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4be302ec-2148-4350-8b22-f2f9efd25d37-console-serving-cert\") pod \"console-6768b7496f-vw5j6\" (UID: \"4be302ec-2148-4350-8b22-f2f9efd25d37\") " pod="openshift-console/console-6768b7496f-vw5j6" Jun 14 13:38:46.968968 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:46.968918 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4be302ec-2148-4350-8b22-f2f9efd25d37-trusted-ca-bundle\") pod \"console-6768b7496f-vw5j6\" (UID: \"4be302ec-2148-4350-8b22-f2f9efd25d37\") " pod="openshift-console/console-6768b7496f-vw5j6" Jun 14 13:38:46.968968 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:46.968947 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4be302ec-2148-4350-8b22-f2f9efd25d37-oauth-serving-cert\") pod \"console-6768b7496f-vw5j6\" (UID: \"4be302ec-2148-4350-8b22-f2f9efd25d37\") " pod="openshift-console/console-6768b7496f-vw5j6" Jun 14 13:38:46.969124 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:46.969000 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsvhx\" (UniqueName: \"kubernetes.io/projected/4be302ec-2148-4350-8b22-f2f9efd25d37-kube-api-access-nsvhx\") pod \"console-6768b7496f-vw5j6\" (UID: \"4be302ec-2148-4350-8b22-f2f9efd25d37\") " pod="openshift-console/console-6768b7496f-vw5j6" Jun 14 13:38:47.070275 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:47.070240 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4be302ec-2148-4350-8b22-f2f9efd25d37-console-config\") pod \"console-6768b7496f-vw5j6\" (UID: \"4be302ec-2148-4350-8b22-f2f9efd25d37\") " pod="openshift-console/console-6768b7496f-vw5j6" Jun 14 13:38:47.070275 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:47.070280 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4be302ec-2148-4350-8b22-f2f9efd25d37-console-oauth-config\") pod \"console-6768b7496f-vw5j6\" (UID: \"4be302ec-2148-4350-8b22-f2f9efd25d37\") " pod="openshift-console/console-6768b7496f-vw5j6" Jun 14 13:38:47.070513 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:47.070298 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4be302ec-2148-4350-8b22-f2f9efd25d37-service-ca\") pod \"console-6768b7496f-vw5j6\" (UID: \"4be302ec-2148-4350-8b22-f2f9efd25d37\") " pod="openshift-console/console-6768b7496f-vw5j6" Jun 14 13:38:47.070513 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:47.070333 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4be302ec-2148-4350-8b22-f2f9efd25d37-console-serving-cert\") pod \"console-6768b7496f-vw5j6\" (UID: \"4be302ec-2148-4350-8b22-f2f9efd25d37\") " pod="openshift-console/console-6768b7496f-vw5j6" Jun 14 13:38:47.070513 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:47.070438 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4be302ec-2148-4350-8b22-f2f9efd25d37-trusted-ca-bundle\") pod \"console-6768b7496f-vw5j6\" (UID: \"4be302ec-2148-4350-8b22-f2f9efd25d37\") " pod="openshift-console/console-6768b7496f-vw5j6" Jun 14 13:38:47.070513 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:47.070497 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4be302ec-2148-4350-8b22-f2f9efd25d37-oauth-serving-cert\") pod \"console-6768b7496f-vw5j6\" (UID: \"4be302ec-2148-4350-8b22-f2f9efd25d37\") " pod="openshift-console/console-6768b7496f-vw5j6" Jun 14 13:38:47.070724 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:47.070550 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsvhx\" (UniqueName: \"kubernetes.io/projected/4be302ec-2148-4350-8b22-f2f9efd25d37-kube-api-access-nsvhx\") pod \"console-6768b7496f-vw5j6\" (UID: \"4be302ec-2148-4350-8b22-f2f9efd25d37\") " pod="openshift-console/console-6768b7496f-vw5j6" Jun 14 13:38:47.071166 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:47.071140 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4be302ec-2148-4350-8b22-f2f9efd25d37-service-ca\") pod \"console-6768b7496f-vw5j6\" (UID: \"4be302ec-2148-4350-8b22-f2f9efd25d37\") " pod="openshift-console/console-6768b7496f-vw5j6" Jun 14 13:38:47.071249 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:47.071152 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4be302ec-2148-4350-8b22-f2f9efd25d37-console-config\") pod \"console-6768b7496f-vw5j6\" (UID: \"4be302ec-2148-4350-8b22-f2f9efd25d37\") " pod="openshift-console/console-6768b7496f-vw5j6" Jun 14 13:38:47.071290 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:47.071253 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4be302ec-2148-4350-8b22-f2f9efd25d37-oauth-serving-cert\") pod \"console-6768b7496f-vw5j6\" (UID: \"4be302ec-2148-4350-8b22-f2f9efd25d37\") " pod="openshift-console/console-6768b7496f-vw5j6" Jun 14 13:38:47.071290 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:47.071272 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4be302ec-2148-4350-8b22-f2f9efd25d37-trusted-ca-bundle\") pod \"console-6768b7496f-vw5j6\" (UID: \"4be302ec-2148-4350-8b22-f2f9efd25d37\") " pod="openshift-console/console-6768b7496f-vw5j6" Jun 14 13:38:47.073286 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:47.073267 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4be302ec-2148-4350-8b22-f2f9efd25d37-console-oauth-config\") pod \"console-6768b7496f-vw5j6\" (UID: \"4be302ec-2148-4350-8b22-f2f9efd25d37\") " pod="openshift-console/console-6768b7496f-vw5j6" Jun 14 13:38:47.073488 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:47.073468 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4be302ec-2148-4350-8b22-f2f9efd25d37-console-serving-cert\") pod \"console-6768b7496f-vw5j6\" (UID: \"4be302ec-2148-4350-8b22-f2f9efd25d37\") " pod="openshift-console/console-6768b7496f-vw5j6" Jun 14 13:38:47.078646 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:47.078621 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsvhx\" (UniqueName: \"kubernetes.io/projected/4be302ec-2148-4350-8b22-f2f9efd25d37-kube-api-access-nsvhx\") pod \"console-6768b7496f-vw5j6\" (UID: \"4be302ec-2148-4350-8b22-f2f9efd25d37\") " pod="openshift-console/console-6768b7496f-vw5j6" Jun 14 13:38:47.134208 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:47.134113 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:38:47.188211 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:47.188154 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:38:47.196121 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:47.196088 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6768b7496f-vw5j6" Jun 14 13:38:47.332744 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:47.332718 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6768b7496f-vw5j6"] Jun 14 13:38:47.335127 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:38:47.335103 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4be302ec_2148_4350_8b22_f2f9efd25d37.slice/crio-d0b8e51ef159cfb4bdb66285aa90c8b4eb24b8c437b52892341763da7775ab86 WatchSource:0}: Error finding container d0b8e51ef159cfb4bdb66285aa90c8b4eb24b8c437b52892341763da7775ab86: Status 404 returned error can't find the container with id d0b8e51ef159cfb4bdb66285aa90c8b4eb24b8c437b52892341763da7775ab86 Jun 14 13:38:47.670793 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:47.670702 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:38:47.771665 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:47.771629 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:38:48.181128 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:48.181096 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6768b7496f-vw5j6" event={"ID":"4be302ec-2148-4350-8b22-f2f9efd25d37","Type":"ContainerStarted","Data":"ee4b8a5417750eb2b9c862b343fa6903b041cfa0ca65078d28f70393db052cf6"} Jun 14 13:38:48.181290 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:48.181144 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6768b7496f-vw5j6" event={"ID":"4be302ec-2148-4350-8b22-f2f9efd25d37","Type":"ContainerStarted","Data":"d0b8e51ef159cfb4bdb66285aa90c8b4eb24b8c437b52892341763da7775ab86"} Jun 14 13:38:48.198365 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:48.198323 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6768b7496f-vw5j6" podStartSLOduration=2.198308393 podStartE2EDuration="2.198308393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:38:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:38:48.196995173 +0000 UTC m=+360.870263119" watchObservedRunningTime="2026-06-14 13:38:48.198308393 +0000 UTC m=+360.871576338" Jun 14 13:38:52.953909 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:52.953876 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:38:53.006181 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:53.006147 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:38:54.110589 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:54.110554 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6768b7496f-vw5j6"] Jun 14 13:38:54.142371 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:54.142332 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-558c7f9cd6-cpxfj"] Jun 14 13:38:54.146946 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:54.146929 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-558c7f9cd6-cpxfj" Jun 14 13:38:54.157722 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:54.157675 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-558c7f9cd6-cpxfj"] Jun 14 13:38:54.230598 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:54.230562 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b58a27be-912a-4a91-8211-3401380a6eb7-service-ca\") pod \"console-558c7f9cd6-cpxfj\" (UID: \"b58a27be-912a-4a91-8211-3401380a6eb7\") " pod="openshift-console/console-558c7f9cd6-cpxfj" Jun 14 13:38:54.230794 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:54.230608 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b58a27be-912a-4a91-8211-3401380a6eb7-console-config\") pod \"console-558c7f9cd6-cpxfj\" (UID: \"b58a27be-912a-4a91-8211-3401380a6eb7\") " pod="openshift-console/console-558c7f9cd6-cpxfj" Jun 14 13:38:54.230794 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:54.230641 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b58a27be-912a-4a91-8211-3401380a6eb7-console-oauth-config\") pod \"console-558c7f9cd6-cpxfj\" (UID: \"b58a27be-912a-4a91-8211-3401380a6eb7\") " pod="openshift-console/console-558c7f9cd6-cpxfj" Jun 14 13:38:54.230794 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:54.230667 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5jzx\" (UniqueName: \"kubernetes.io/projected/b58a27be-912a-4a91-8211-3401380a6eb7-kube-api-access-j5jzx\") pod \"console-558c7f9cd6-cpxfj\" (UID: \"b58a27be-912a-4a91-8211-3401380a6eb7\") " pod="openshift-console/console-558c7f9cd6-cpxfj" Jun 14 13:38:54.230794 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:54.230713 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b58a27be-912a-4a91-8211-3401380a6eb7-oauth-serving-cert\") pod \"console-558c7f9cd6-cpxfj\" (UID: \"b58a27be-912a-4a91-8211-3401380a6eb7\") " pod="openshift-console/console-558c7f9cd6-cpxfj" Jun 14 13:38:54.230794 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:54.230740 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b58a27be-912a-4a91-8211-3401380a6eb7-console-serving-cert\") pod \"console-558c7f9cd6-cpxfj\" (UID: \"b58a27be-912a-4a91-8211-3401380a6eb7\") " pod="openshift-console/console-558c7f9cd6-cpxfj" Jun 14 13:38:54.230794 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:54.230758 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b58a27be-912a-4a91-8211-3401380a6eb7-trusted-ca-bundle\") pod \"console-558c7f9cd6-cpxfj\" (UID: \"b58a27be-912a-4a91-8211-3401380a6eb7\") " pod="openshift-console/console-558c7f9cd6-cpxfj" Jun 14 13:38:54.331567 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:54.331531 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b58a27be-912a-4a91-8211-3401380a6eb7-console-serving-cert\") pod \"console-558c7f9cd6-cpxfj\" (UID: \"b58a27be-912a-4a91-8211-3401380a6eb7\") " pod="openshift-console/console-558c7f9cd6-cpxfj" Jun 14 13:38:54.331567 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:54.331564 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b58a27be-912a-4a91-8211-3401380a6eb7-trusted-ca-bundle\") pod \"console-558c7f9cd6-cpxfj\" (UID: \"b58a27be-912a-4a91-8211-3401380a6eb7\") " pod="openshift-console/console-558c7f9cd6-cpxfj" Jun 14 13:38:54.331794 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:54.331717 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b58a27be-912a-4a91-8211-3401380a6eb7-service-ca\") pod \"console-558c7f9cd6-cpxfj\" (UID: \"b58a27be-912a-4a91-8211-3401380a6eb7\") " pod="openshift-console/console-558c7f9cd6-cpxfj" Jun 14 13:38:54.331794 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:54.331773 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b58a27be-912a-4a91-8211-3401380a6eb7-console-config\") pod \"console-558c7f9cd6-cpxfj\" (UID: \"b58a27be-912a-4a91-8211-3401380a6eb7\") " pod="openshift-console/console-558c7f9cd6-cpxfj" Jun 14 13:38:54.331868 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:54.331808 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b58a27be-912a-4a91-8211-3401380a6eb7-console-oauth-config\") pod \"console-558c7f9cd6-cpxfj\" (UID: \"b58a27be-912a-4a91-8211-3401380a6eb7\") " pod="openshift-console/console-558c7f9cd6-cpxfj" Jun 14 13:38:54.331868 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:54.331838 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5jzx\" (UniqueName: \"kubernetes.io/projected/b58a27be-912a-4a91-8211-3401380a6eb7-kube-api-access-j5jzx\") pod \"console-558c7f9cd6-cpxfj\" (UID: \"b58a27be-912a-4a91-8211-3401380a6eb7\") " pod="openshift-console/console-558c7f9cd6-cpxfj" Jun 14 13:38:54.331868 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:54.331858 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b58a27be-912a-4a91-8211-3401380a6eb7-oauth-serving-cert\") pod \"console-558c7f9cd6-cpxfj\" (UID: \"b58a27be-912a-4a91-8211-3401380a6eb7\") " pod="openshift-console/console-558c7f9cd6-cpxfj" Jun 14 13:38:54.332457 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:54.332431 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b58a27be-912a-4a91-8211-3401380a6eb7-service-ca\") pod \"console-558c7f9cd6-cpxfj\" (UID: \"b58a27be-912a-4a91-8211-3401380a6eb7\") " pod="openshift-console/console-558c7f9cd6-cpxfj" Jun 14 13:38:54.332591 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:54.332459 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b58a27be-912a-4a91-8211-3401380a6eb7-console-config\") pod \"console-558c7f9cd6-cpxfj\" (UID: \"b58a27be-912a-4a91-8211-3401380a6eb7\") " pod="openshift-console/console-558c7f9cd6-cpxfj" Jun 14 13:38:54.332591 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:54.332507 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b58a27be-912a-4a91-8211-3401380a6eb7-oauth-serving-cert\") pod \"console-558c7f9cd6-cpxfj\" (UID: \"b58a27be-912a-4a91-8211-3401380a6eb7\") " pod="openshift-console/console-558c7f9cd6-cpxfj" Jun 14 13:38:54.332591 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:54.332516 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b58a27be-912a-4a91-8211-3401380a6eb7-trusted-ca-bundle\") pod \"console-558c7f9cd6-cpxfj\" (UID: \"b58a27be-912a-4a91-8211-3401380a6eb7\") " pod="openshift-console/console-558c7f9cd6-cpxfj" Jun 14 13:38:54.334105 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:54.334081 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b58a27be-912a-4a91-8211-3401380a6eb7-console-serving-cert\") pod \"console-558c7f9cd6-cpxfj\" (UID: \"b58a27be-912a-4a91-8211-3401380a6eb7\") " pod="openshift-console/console-558c7f9cd6-cpxfj" Jun 14 13:38:54.334254 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:54.334236 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b58a27be-912a-4a91-8211-3401380a6eb7-console-oauth-config\") pod \"console-558c7f9cd6-cpxfj\" (UID: \"b58a27be-912a-4a91-8211-3401380a6eb7\") " pod="openshift-console/console-558c7f9cd6-cpxfj" Jun 14 13:38:54.340176 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:54.340155 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5jzx\" (UniqueName: \"kubernetes.io/projected/b58a27be-912a-4a91-8211-3401380a6eb7-kube-api-access-j5jzx\") pod \"console-558c7f9cd6-cpxfj\" (UID: \"b58a27be-912a-4a91-8211-3401380a6eb7\") " pod="openshift-console/console-558c7f9cd6-cpxfj" Jun 14 13:38:54.459783 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:54.459749 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-558c7f9cd6-cpxfj" Jun 14 13:38:54.500849 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:54.500815 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:38:54.599134 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:54.599099 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-558c7f9cd6-cpxfj"] Jun 14 13:38:54.602854 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:38:54.602824 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb58a27be_912a_4a91_8211_3401380a6eb7.slice/crio-8fc113fddf6b83c8a8c4263029a347821fbd353e9a961b5477eb46ba58dec99b WatchSource:0}: Error finding container 8fc113fddf6b83c8a8c4263029a347821fbd353e9a961b5477eb46ba58dec99b: Status 404 returned error can't find the container with id 8fc113fddf6b83c8a8c4263029a347821fbd353e9a961b5477eb46ba58dec99b Jun 14 13:38:55.103006 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:55.102968 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:38:55.153086 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:55.153052 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:38:55.210730 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:55.210675 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-558c7f9cd6-cpxfj" event={"ID":"b58a27be-912a-4a91-8211-3401380a6eb7","Type":"ContainerStarted","Data":"8e221129427bfc6d8cc789e634e0b4a8f7c716fc0b669208ef3b58a4d7f856e0"} Jun 14 13:38:55.210884 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:55.210751 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-558c7f9cd6-cpxfj" event={"ID":"b58a27be-912a-4a91-8211-3401380a6eb7","Type":"ContainerStarted","Data":"8fc113fddf6b83c8a8c4263029a347821fbd353e9a961b5477eb46ba58dec99b"} Jun 14 13:38:55.228351 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:55.228302 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-558c7f9cd6-cpxfj" podStartSLOduration=1.228287799 podStartE2EDuration="1.228287799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:38:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:38:55.226848619 +0000 UTC m=+367.900132473" watchObservedRunningTime="2026-06-14 13:38:55.228287799 +0000 UTC m=+367.901555809" Jun 14 13:38:57.196814 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:38:57.196761 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6768b7496f-vw5j6" Jun 14 13:39:04.460833 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:04.460792 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-558c7f9cd6-cpxfj" Jun 14 13:39:04.461314 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:04.460889 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-558c7f9cd6-cpxfj" Jun 14 13:39:04.466037 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:04.466010 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-558c7f9cd6-cpxfj" Jun 14 13:39:05.259217 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:05.259181 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-558c7f9cd6-cpxfj" Jun 14 13:39:05.412484 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:05.412447 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:39:05.463850 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:05.463806 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:39:05.518848 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:05.518741 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:39:07.930626 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:07.930585 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:39:08.000078 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:08.000048 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:39:19.131151 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:19.131093 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6768b7496f-vw5j6" podUID="4be302ec-2148-4350-8b22-f2f9efd25d37" containerName="console" containerID="cri-o://ee4b8a5417750eb2b9c862b343fa6903b041cfa0ca65078d28f70393db052cf6" gracePeriod=15 Jun 14 13:39:19.313549 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:19.313517 2557 generic.go:356] "Generic (PLEG): container finished" podID="4be302ec-2148-4350-8b22-f2f9efd25d37" containerID="ee4b8a5417750eb2b9c862b343fa6903b041cfa0ca65078d28f70393db052cf6" exitCode=0 Jun 14 13:39:19.313755 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:19.313559 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6768b7496f-vw5j6" event={"ID":"4be302ec-2148-4350-8b22-f2f9efd25d37","Type":"ContainerDied","Data":"ee4b8a5417750eb2b9c862b343fa6903b041cfa0ca65078d28f70393db052cf6"} Jun 14 13:39:19.377887 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:19.377863 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6768b7496f-vw5j6" Jun 14 13:39:19.461576 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:19.461489 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4be302ec-2148-4350-8b22-f2f9efd25d37-console-serving-cert\") pod \"4be302ec-2148-4350-8b22-f2f9efd25d37\" (UID: \"4be302ec-2148-4350-8b22-f2f9efd25d37\") " Jun 14 13:39:19.461576 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:19.461536 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4be302ec-2148-4350-8b22-f2f9efd25d37-console-oauth-config\") pod \"4be302ec-2148-4350-8b22-f2f9efd25d37\" (UID: \"4be302ec-2148-4350-8b22-f2f9efd25d37\") " Jun 14 13:39:19.461576 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:19.461565 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4be302ec-2148-4350-8b22-f2f9efd25d37-oauth-serving-cert\") pod \"4be302ec-2148-4350-8b22-f2f9efd25d37\" (UID: \"4be302ec-2148-4350-8b22-f2f9efd25d37\") " Jun 14 13:39:19.461878 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:19.461612 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4be302ec-2148-4350-8b22-f2f9efd25d37-trusted-ca-bundle\") pod \"4be302ec-2148-4350-8b22-f2f9efd25d37\" (UID: \"4be302ec-2148-4350-8b22-f2f9efd25d37\") " Jun 14 13:39:19.461878 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:19.461759 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4be302ec-2148-4350-8b22-f2f9efd25d37-console-config\") pod \"4be302ec-2148-4350-8b22-f2f9efd25d37\" (UID: \"4be302ec-2148-4350-8b22-f2f9efd25d37\") " Jun 14 13:39:19.461878 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:19.461807 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4be302ec-2148-4350-8b22-f2f9efd25d37-service-ca\") pod \"4be302ec-2148-4350-8b22-f2f9efd25d37\" (UID: \"4be302ec-2148-4350-8b22-f2f9efd25d37\") " Jun 14 13:39:19.461878 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:19.461839 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsvhx\" (UniqueName: \"kubernetes.io/projected/4be302ec-2148-4350-8b22-f2f9efd25d37-kube-api-access-nsvhx\") pod \"4be302ec-2148-4350-8b22-f2f9efd25d37\" (UID: \"4be302ec-2148-4350-8b22-f2f9efd25d37\") " Jun 14 13:39:19.462083 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:19.462035 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4be302ec-2148-4350-8b22-f2f9efd25d37-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4be302ec-2148-4350-8b22-f2f9efd25d37" (UID: "4be302ec-2148-4350-8b22-f2f9efd25d37"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 13:39:19.462083 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:19.462042 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4be302ec-2148-4350-8b22-f2f9efd25d37-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4be302ec-2148-4350-8b22-f2f9efd25d37" (UID: "4be302ec-2148-4350-8b22-f2f9efd25d37"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 13:39:19.462245 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:19.462223 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4be302ec-2148-4350-8b22-f2f9efd25d37-trusted-ca-bundle\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:39:19.462328 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:19.462247 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4be302ec-2148-4350-8b22-f2f9efd25d37-oauth-serving-cert\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:39:19.462328 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:19.462261 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4be302ec-2148-4350-8b22-f2f9efd25d37-console-config" (OuterVolumeSpecName: "console-config") pod "4be302ec-2148-4350-8b22-f2f9efd25d37" (UID: "4be302ec-2148-4350-8b22-f2f9efd25d37"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 13:39:19.462328 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:19.462273 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4be302ec-2148-4350-8b22-f2f9efd25d37-service-ca" (OuterVolumeSpecName: "service-ca") pod "4be302ec-2148-4350-8b22-f2f9efd25d37" (UID: "4be302ec-2148-4350-8b22-f2f9efd25d37"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 13:39:19.463776 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:19.463748 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4be302ec-2148-4350-8b22-f2f9efd25d37-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4be302ec-2148-4350-8b22-f2f9efd25d37" (UID: "4be302ec-2148-4350-8b22-f2f9efd25d37"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 13:39:19.463884 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:19.463844 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4be302ec-2148-4350-8b22-f2f9efd25d37-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4be302ec-2148-4350-8b22-f2f9efd25d37" (UID: "4be302ec-2148-4350-8b22-f2f9efd25d37"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 13:39:19.463884 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:19.463846 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4be302ec-2148-4350-8b22-f2f9efd25d37-kube-api-access-nsvhx" (OuterVolumeSpecName: "kube-api-access-nsvhx") pod "4be302ec-2148-4350-8b22-f2f9efd25d37" (UID: "4be302ec-2148-4350-8b22-f2f9efd25d37"). InnerVolumeSpecName "kube-api-access-nsvhx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 13:39:19.563461 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:19.563426 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4be302ec-2148-4350-8b22-f2f9efd25d37-service-ca\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:39:19.563461 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:19.563456 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsvhx\" (UniqueName: \"kubernetes.io/projected/4be302ec-2148-4350-8b22-f2f9efd25d37-kube-api-access-nsvhx\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:39:19.563461 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:19.563466 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4be302ec-2148-4350-8b22-f2f9efd25d37-console-serving-cert\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:39:19.563704 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:19.563475 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4be302ec-2148-4350-8b22-f2f9efd25d37-console-oauth-config\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:39:19.563704 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:19.563484 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4be302ec-2148-4350-8b22-f2f9efd25d37-console-config\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:39:20.319393 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:20.319365 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6768b7496f-vw5j6" Jun 14 13:39:20.319831 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:20.319406 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6768b7496f-vw5j6" event={"ID":"4be302ec-2148-4350-8b22-f2f9efd25d37","Type":"ContainerDied","Data":"d0b8e51ef159cfb4bdb66285aa90c8b4eb24b8c437b52892341763da7775ab86"} Jun 14 13:39:20.319831 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:20.319467 2557 scope.go:117] "RemoveContainer" containerID="ee4b8a5417750eb2b9c862b343fa6903b041cfa0ca65078d28f70393db052cf6" Jun 14 13:39:20.335184 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:20.335158 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6768b7496f-vw5j6"] Jun 14 13:39:20.339318 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:20.339296 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6768b7496f-vw5j6"] Jun 14 13:39:21.733411 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:21.733375 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4be302ec-2148-4350-8b22-f2f9efd25d37" path="/var/lib/kubelet/pods/4be302ec-2148-4350-8b22-f2f9efd25d37/volumes" Jun 14 13:39:22.885441 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:22.885413 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:39:22.985408 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:22.985376 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:39:30.933602 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:39:30.933567 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:40:27.525892 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:27.525786 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:40:27.611465 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:27.611402 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:40:28.074824 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:28.074785 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzj5z"] Jun 14 13:40:28.075117 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:28.075105 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4be302ec-2148-4350-8b22-f2f9efd25d37" containerName="console" Jun 14 13:40:28.075171 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:28.075118 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4be302ec-2148-4350-8b22-f2f9efd25d37" containerName="console" Jun 14 13:40:28.075205 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:28.075179 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4be302ec-2148-4350-8b22-f2f9efd25d37" containerName="console" Jun 14 13:40:28.078240 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:28.078225 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzj5z" Jun 14 13:40:28.081025 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:28.081001 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 13:40:28.081166 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:28.081009 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 13:40:28.081973 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:28.081958 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-whkbn\"" Jun 14 13:40:28.086957 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:28.086935 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzj5z"] Jun 14 13:40:28.131559 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:28.131532 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69s2w\" (UniqueName: \"kubernetes.io/projected/e76d864c-98ea-4610-b145-221fe7a7d5f2-kube-api-access-69s2w\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzj5z\" (UID: \"e76d864c-98ea-4610-b145-221fe7a7d5f2\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzj5z" Jun 14 13:40:28.131728 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:28.131575 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e76d864c-98ea-4610-b145-221fe7a7d5f2-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzj5z\" (UID: \"e76d864c-98ea-4610-b145-221fe7a7d5f2\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzj5z" Jun 14 13:40:28.131728 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:28.131592 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e76d864c-98ea-4610-b145-221fe7a7d5f2-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzj5z\" (UID: \"e76d864c-98ea-4610-b145-221fe7a7d5f2\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzj5z" Jun 14 13:40:28.232890 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:28.232836 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69s2w\" (UniqueName: \"kubernetes.io/projected/e76d864c-98ea-4610-b145-221fe7a7d5f2-kube-api-access-69s2w\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzj5z\" (UID: \"e76d864c-98ea-4610-b145-221fe7a7d5f2\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzj5z" Jun 14 13:40:28.233082 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:28.232927 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e76d864c-98ea-4610-b145-221fe7a7d5f2-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzj5z\" (UID: \"e76d864c-98ea-4610-b145-221fe7a7d5f2\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzj5z" Jun 14 13:40:28.233082 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:28.232952 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e76d864c-98ea-4610-b145-221fe7a7d5f2-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzj5z\" (UID: \"e76d864c-98ea-4610-b145-221fe7a7d5f2\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzj5z" Jun 14 13:40:28.233321 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:28.233299 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e76d864c-98ea-4610-b145-221fe7a7d5f2-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzj5z\" (UID: \"e76d864c-98ea-4610-b145-221fe7a7d5f2\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzj5z" Jun 14 13:40:28.233397 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:28.233354 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e76d864c-98ea-4610-b145-221fe7a7d5f2-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzj5z\" (UID: \"e76d864c-98ea-4610-b145-221fe7a7d5f2\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzj5z" Jun 14 13:40:28.241203 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:28.241178 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69s2w\" (UniqueName: \"kubernetes.io/projected/e76d864c-98ea-4610-b145-221fe7a7d5f2-kube-api-access-69s2w\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzj5z\" (UID: \"e76d864c-98ea-4610-b145-221fe7a7d5f2\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzj5z" Jun 14 13:40:28.387904 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:28.387859 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzj5z" Jun 14 13:40:28.522151 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:28.522093 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzj5z"] Jun 14 13:40:28.524334 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:40:28.524307 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode76d864c_98ea_4610_b145_221fe7a7d5f2.slice/crio-2aaee621b258cb41ee3a7dd64beec2470869ae9bf0c557a81e3cda43f7844402 WatchSource:0}: Error finding container 2aaee621b258cb41ee3a7dd64beec2470869ae9bf0c557a81e3cda43f7844402: Status 404 returned error can't find the container with id 2aaee621b258cb41ee3a7dd64beec2470869ae9bf0c557a81e3cda43f7844402 Jun 14 13:40:28.593142 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:28.593110 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzj5z" event={"ID":"e76d864c-98ea-4610-b145-221fe7a7d5f2","Type":"ContainerStarted","Data":"2aaee621b258cb41ee3a7dd64beec2470869ae9bf0c557a81e3cda43f7844402"} Jun 14 13:40:35.631521 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:35.631482 2557 generic.go:356] "Generic (PLEG): container finished" podID="e76d864c-98ea-4610-b145-221fe7a7d5f2" containerID="42bc5ad6b5a8a9a5487bb2c5cb56a848a499ace9b8965f580bb715682e0ab4fb" exitCode=0 Jun 14 13:40:35.632027 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:35.631571 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzj5z" event={"ID":"e76d864c-98ea-4610-b145-221fe7a7d5f2","Type":"ContainerDied","Data":"42bc5ad6b5a8a9a5487bb2c5cb56a848a499ace9b8965f580bb715682e0ab4fb"} Jun 14 13:40:38.644861 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:38.644823 2557 generic.go:356] "Generic (PLEG): container finished" podID="e76d864c-98ea-4610-b145-221fe7a7d5f2" containerID="ed5aefcf30978d5af81760fd1adfed4f512c988fca1c25765a2d699b482ef28d" exitCode=0 Jun 14 13:40:38.645239 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:38.644868 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzj5z" event={"ID":"e76d864c-98ea-4610-b145-221fe7a7d5f2","Type":"ContainerDied","Data":"ed5aefcf30978d5af81760fd1adfed4f512c988fca1c25765a2d699b482ef28d"} Jun 14 13:40:46.688082 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:46.688049 2557 generic.go:356] "Generic (PLEG): container finished" podID="e76d864c-98ea-4610-b145-221fe7a7d5f2" containerID="6f01cc82e8f92818d453964a45ab59431d157dcc510609869d8fa7084f39cfab" exitCode=0 Jun 14 13:40:46.688423 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:46.688118 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzj5z" event={"ID":"e76d864c-98ea-4610-b145-221fe7a7d5f2","Type":"ContainerDied","Data":"6f01cc82e8f92818d453964a45ab59431d157dcc510609869d8fa7084f39cfab"} Jun 14 13:40:47.825350 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:47.825328 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzj5z" Jun 14 13:40:47.896893 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:47.896863 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69s2w\" (UniqueName: \"kubernetes.io/projected/e76d864c-98ea-4610-b145-221fe7a7d5f2-kube-api-access-69s2w\") pod \"e76d864c-98ea-4610-b145-221fe7a7d5f2\" (UID: \"e76d864c-98ea-4610-b145-221fe7a7d5f2\") " Jun 14 13:40:47.896893 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:47.896901 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e76d864c-98ea-4610-b145-221fe7a7d5f2-util\") pod \"e76d864c-98ea-4610-b145-221fe7a7d5f2\" (UID: \"e76d864c-98ea-4610-b145-221fe7a7d5f2\") " Jun 14 13:40:47.897104 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:47.896958 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e76d864c-98ea-4610-b145-221fe7a7d5f2-bundle\") pod \"e76d864c-98ea-4610-b145-221fe7a7d5f2\" (UID: \"e76d864c-98ea-4610-b145-221fe7a7d5f2\") " Jun 14 13:40:47.897625 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:47.897596 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e76d864c-98ea-4610-b145-221fe7a7d5f2-bundle" (OuterVolumeSpecName: "bundle") pod "e76d864c-98ea-4610-b145-221fe7a7d5f2" (UID: "e76d864c-98ea-4610-b145-221fe7a7d5f2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 13:40:47.899092 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:47.899070 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e76d864c-98ea-4610-b145-221fe7a7d5f2-kube-api-access-69s2w" (OuterVolumeSpecName: "kube-api-access-69s2w") pod "e76d864c-98ea-4610-b145-221fe7a7d5f2" (UID: "e76d864c-98ea-4610-b145-221fe7a7d5f2"). InnerVolumeSpecName "kube-api-access-69s2w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 13:40:47.900918 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:47.900897 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e76d864c-98ea-4610-b145-221fe7a7d5f2-util" (OuterVolumeSpecName: "util") pod "e76d864c-98ea-4610-b145-221fe7a7d5f2" (UID: "e76d864c-98ea-4610-b145-221fe7a7d5f2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 13:40:47.997779 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:47.997698 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69s2w\" (UniqueName: \"kubernetes.io/projected/e76d864c-98ea-4610-b145-221fe7a7d5f2-kube-api-access-69s2w\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:40:47.997779 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:47.997725 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e76d864c-98ea-4610-b145-221fe7a7d5f2-util\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:40:47.997779 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:47.997739 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e76d864c-98ea-4610-b145-221fe7a7d5f2-bundle\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:40:48.700416 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:48.700384 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzj5z" Jun 14 13:40:48.700416 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:48.700416 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwzj5z" event={"ID":"e76d864c-98ea-4610-b145-221fe7a7d5f2","Type":"ContainerDied","Data":"2aaee621b258cb41ee3a7dd64beec2470869ae9bf0c557a81e3cda43f7844402"} Jun 14 13:40:48.700668 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:48.700459 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2aaee621b258cb41ee3a7dd64beec2470869ae9bf0c557a81e3cda43f7844402" Jun 14 13:40:53.850167 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:53.850127 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:40:55.228449 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:55.228415 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:40:55.790602 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:55.790568 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-sjn4b"] Jun 14 13:40:55.790950 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:55.790936 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e76d864c-98ea-4610-b145-221fe7a7d5f2" containerName="util" Jun 14 13:40:55.790996 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:55.790953 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e76d864c-98ea-4610-b145-221fe7a7d5f2" containerName="util" Jun 14 13:40:55.790996 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:55.790967 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e76d864c-98ea-4610-b145-221fe7a7d5f2" containerName="extract" Jun 14 13:40:55.790996 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:55.790973 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e76d864c-98ea-4610-b145-221fe7a7d5f2" containerName="extract" Jun 14 13:40:55.790996 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:55.790982 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e76d864c-98ea-4610-b145-221fe7a7d5f2" containerName="pull" Jun 14 13:40:55.790996 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:55.790987 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e76d864c-98ea-4610-b145-221fe7a7d5f2" containerName="pull" Jun 14 13:40:55.791144 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:55.791052 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e76d864c-98ea-4610-b145-221fe7a7d5f2" containerName="extract" Jun 14 13:40:55.795065 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:55.795050 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-sjn4b" Jun 14 13:40:55.797793 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:55.797771 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-j4wrz\"" Jun 14 13:40:55.797932 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:55.797790 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 14 13:40:55.797932 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:55.797848 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 14 13:40:55.807491 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:55.807468 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-sjn4b"] Jun 14 13:40:55.862071 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:55.862037 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg8tt\" (UniqueName: \"kubernetes.io/projected/01121ca2-2c53-44da-8c79-7a07435c406d-kube-api-access-mg8tt\") pod \"cert-manager-operator-controller-manager-57757f7cfc-sjn4b\" (UID: \"01121ca2-2c53-44da-8c79-7a07435c406d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-sjn4b" Jun 14 13:40:55.862224 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:55.862080 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01121ca2-2c53-44da-8c79-7a07435c406d-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-sjn4b\" (UID: \"01121ca2-2c53-44da-8c79-7a07435c406d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-sjn4b" Jun 14 13:40:55.962720 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:55.962669 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg8tt\" (UniqueName: \"kubernetes.io/projected/01121ca2-2c53-44da-8c79-7a07435c406d-kube-api-access-mg8tt\") pod \"cert-manager-operator-controller-manager-57757f7cfc-sjn4b\" (UID: \"01121ca2-2c53-44da-8c79-7a07435c406d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-sjn4b" Jun 14 13:40:55.962898 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:55.962745 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01121ca2-2c53-44da-8c79-7a07435c406d-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-sjn4b\" (UID: \"01121ca2-2c53-44da-8c79-7a07435c406d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-sjn4b" Jun 14 13:40:55.963097 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:55.963077 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01121ca2-2c53-44da-8c79-7a07435c406d-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-sjn4b\" (UID: \"01121ca2-2c53-44da-8c79-7a07435c406d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-sjn4b" Jun 14 13:40:55.972323 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:55.972299 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg8tt\" (UniqueName: \"kubernetes.io/projected/01121ca2-2c53-44da-8c79-7a07435c406d-kube-api-access-mg8tt\") pod \"cert-manager-operator-controller-manager-57757f7cfc-sjn4b\" (UID: \"01121ca2-2c53-44da-8c79-7a07435c406d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-sjn4b" Jun 14 13:40:56.104516 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:56.104437 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-sjn4b" Jun 14 13:40:56.240222 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:56.240194 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-sjn4b"] Jun 14 13:40:56.243078 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:40:56.243052 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01121ca2_2c53_44da_8c79_7a07435c406d.slice/crio-1abb981fbcb5246f32922e27a59aa3dcd45ec3060cb351d3cb8b1fd43fd67b48 WatchSource:0}: Error finding container 1abb981fbcb5246f32922e27a59aa3dcd45ec3060cb351d3cb8b1fd43fd67b48: Status 404 returned error can't find the container with id 1abb981fbcb5246f32922e27a59aa3dcd45ec3060cb351d3cb8b1fd43fd67b48 Jun 14 13:40:56.734662 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:56.734626 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-sjn4b" event={"ID":"01121ca2-2c53-44da-8c79-7a07435c406d","Type":"ContainerStarted","Data":"1abb981fbcb5246f32922e27a59aa3dcd45ec3060cb351d3cb8b1fd43fd67b48"} Jun 14 13:40:57.470089 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:57.470051 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:40:57.568695 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:57.568632 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:40:58.705547 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:58.705504 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:40:58.745145 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:58.745113 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-sjn4b" event={"ID":"01121ca2-2c53-44da-8c79-7a07435c406d","Type":"ContainerStarted","Data":"2b589d234b455ef346041ba2659e6e8f44ecf6d8ec55c45813678d11d143b8c4"} Jun 14 13:40:58.780793 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:58.780733 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-sjn4b" podStartSLOduration=2.151622285 podStartE2EDuration="3.780707998s" totalImagesPullingTime="1.629085713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:40:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:40:58.778139651 +0000 UTC m=+491.451407598" watchObservedRunningTime="2026-06-14 13:40:58.780707998 +0000 UTC m=+491.453975941" Jun 14 13:40:58.801129 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:58.801092 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:40:59.226570 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:59.226539 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:40:59.351088 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:40:59.351055 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:00.497804 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:00.497769 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnth6t"] Jun 14 13:41:00.501218 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:00.501201 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnth6t" Jun 14 13:41:00.503902 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:00.503881 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 13:41:00.504003 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:00.503927 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-whkbn\"" Jun 14 13:41:00.504923 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:00.504904 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 13:41:00.509777 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:00.509746 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnth6t"] Jun 14 13:41:00.603656 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:00.603619 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8998e4eb-1231-42dc-aa17-364c6b34608b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnth6t\" (UID: \"8998e4eb-1231-42dc-aa17-364c6b34608b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnth6t" Jun 14 13:41:00.603852 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:00.603716 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8998e4eb-1231-42dc-aa17-364c6b34608b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnth6t\" (UID: \"8998e4eb-1231-42dc-aa17-364c6b34608b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnth6t" Jun 14 13:41:00.603852 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:00.603744 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlbh6\" (UniqueName: \"kubernetes.io/projected/8998e4eb-1231-42dc-aa17-364c6b34608b-kube-api-access-hlbh6\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnth6t\" (UID: \"8998e4eb-1231-42dc-aa17-364c6b34608b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnth6t" Jun 14 13:41:00.704750 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:00.704710 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8998e4eb-1231-42dc-aa17-364c6b34608b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnth6t\" (UID: \"8998e4eb-1231-42dc-aa17-364c6b34608b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnth6t" Jun 14 13:41:00.704909 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:00.704775 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8998e4eb-1231-42dc-aa17-364c6b34608b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnth6t\" (UID: \"8998e4eb-1231-42dc-aa17-364c6b34608b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnth6t" Jun 14 13:41:00.704909 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:00.704802 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlbh6\" (UniqueName: \"kubernetes.io/projected/8998e4eb-1231-42dc-aa17-364c6b34608b-kube-api-access-hlbh6\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnth6t\" (UID: \"8998e4eb-1231-42dc-aa17-364c6b34608b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnth6t" Jun 14 13:41:00.705175 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:00.705151 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8998e4eb-1231-42dc-aa17-364c6b34608b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnth6t\" (UID: \"8998e4eb-1231-42dc-aa17-364c6b34608b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnth6t" Jun 14 13:41:00.705215 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:00.705157 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8998e4eb-1231-42dc-aa17-364c6b34608b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnth6t\" (UID: \"8998e4eb-1231-42dc-aa17-364c6b34608b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnth6t" Jun 14 13:41:00.718024 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:00.717999 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlbh6\" (UniqueName: \"kubernetes.io/projected/8998e4eb-1231-42dc-aa17-364c6b34608b-kube-api-access-hlbh6\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnth6t\" (UID: \"8998e4eb-1231-42dc-aa17-364c6b34608b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnth6t" Jun 14 13:41:00.811748 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:00.811629 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnth6t" Jun 14 13:41:00.947882 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:00.945054 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnth6t"] Jun 14 13:41:00.948325 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:41:00.948299 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8998e4eb_1231_42dc_aa17_364c6b34608b.slice/crio-eba211a47f7bab984942c8c015615aa57e6f4c274d0ba58771f84a5fb792329c WatchSource:0}: Error finding container eba211a47f7bab984942c8c015615aa57e6f4c274d0ba58771f84a5fb792329c: Status 404 returned error can't find the container with id eba211a47f7bab984942c8c015615aa57e6f4c274d0ba58771f84a5fb792329c Jun 14 13:41:01.388271 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:01.388237 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-m6bm6"] Jun 14 13:41:01.391505 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:01.391489 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-m6bm6" Jun 14 13:41:01.394242 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:01.394215 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-6s5m4\"" Jun 14 13:41:01.394373 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:01.394215 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 14 13:41:01.394373 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:01.394272 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 14 13:41:01.399051 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:01.399023 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-m6bm6"] Jun 14 13:41:01.510751 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:01.510719 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbz6f\" (UniqueName: \"kubernetes.io/projected/964fac1c-3fa9-4dab-8102-a2b24534d99b-kube-api-access-tbz6f\") pod \"cert-manager-webhook-7dc76cbb94-m6bm6\" (UID: \"964fac1c-3fa9-4dab-8102-a2b24534d99b\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-m6bm6" Jun 14 13:41:01.510751 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:01.510762 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/964fac1c-3fa9-4dab-8102-a2b24534d99b-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-m6bm6\" (UID: \"964fac1c-3fa9-4dab-8102-a2b24534d99b\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-m6bm6" Jun 14 13:41:01.612054 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:01.612016 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbz6f\" (UniqueName: \"kubernetes.io/projected/964fac1c-3fa9-4dab-8102-a2b24534d99b-kube-api-access-tbz6f\") pod \"cert-manager-webhook-7dc76cbb94-m6bm6\" (UID: \"964fac1c-3fa9-4dab-8102-a2b24534d99b\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-m6bm6" Jun 14 13:41:01.612054 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:01.612059 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/964fac1c-3fa9-4dab-8102-a2b24534d99b-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-m6bm6\" (UID: \"964fac1c-3fa9-4dab-8102-a2b24534d99b\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-m6bm6" Jun 14 13:41:01.620951 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:01.620923 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/964fac1c-3fa9-4dab-8102-a2b24534d99b-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-m6bm6\" (UID: \"964fac1c-3fa9-4dab-8102-a2b24534d99b\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-m6bm6" Jun 14 13:41:01.621075 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:01.621019 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbz6f\" (UniqueName: \"kubernetes.io/projected/964fac1c-3fa9-4dab-8102-a2b24534d99b-kube-api-access-tbz6f\") pod \"cert-manager-webhook-7dc76cbb94-m6bm6\" (UID: \"964fac1c-3fa9-4dab-8102-a2b24534d99b\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-m6bm6" Jun 14 13:41:01.712938 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:01.712858 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-m6bm6" Jun 14 13:41:01.763715 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:01.763663 2557 generic.go:356] "Generic (PLEG): container finished" podID="8998e4eb-1231-42dc-aa17-364c6b34608b" containerID="a8098f556f281c2a519d285ea2181ad216c9b963fb711eaee73567922b678fd2" exitCode=0 Jun 14 13:41:01.763845 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:01.763727 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnth6t" event={"ID":"8998e4eb-1231-42dc-aa17-364c6b34608b","Type":"ContainerDied","Data":"a8098f556f281c2a519d285ea2181ad216c9b963fb711eaee73567922b678fd2"} Jun 14 13:41:01.763845 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:01.763828 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnth6t" event={"ID":"8998e4eb-1231-42dc-aa17-364c6b34608b","Type":"ContainerStarted","Data":"eba211a47f7bab984942c8c015615aa57e6f4c274d0ba58771f84a5fb792329c"} Jun 14 13:41:01.843438 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:01.843412 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-m6bm6"] Jun 14 13:41:01.846137 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:41:01.846110 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod964fac1c_3fa9_4dab_8102_a2b24534d99b.slice/crio-91093e0f4fc6b130c4381bb43265cd53791ac862812757fb759c0d6d8e8871ca WatchSource:0}: Error finding container 91093e0f4fc6b130c4381bb43265cd53791ac862812757fb759c0d6d8e8871ca: Status 404 returned error can't find the container with id 91093e0f4fc6b130c4381bb43265cd53791ac862812757fb759c0d6d8e8871ca Jun 14 13:41:01.985616 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:01.985523 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:02.575884 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:02.575851 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:02.771766 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:02.771719 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-m6bm6" event={"ID":"964fac1c-3fa9-4dab-8102-a2b24534d99b","Type":"ContainerStarted","Data":"91093e0f4fc6b130c4381bb43265cd53791ac862812757fb759c0d6d8e8871ca"} Jun 14 13:41:04.249182 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:04.249120 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:04.305449 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:04.305357 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:04.783276 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:04.783243 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-m6bm6" event={"ID":"964fac1c-3fa9-4dab-8102-a2b24534d99b","Type":"ContainerStarted","Data":"08da8efe6280336b33c7238f536106a76c54437489f30fb52b4bfc585a63959f"} Jun 14 13:41:04.783442 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:04.783372 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-m6bm6" Jun 14 13:41:04.785014 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:04.784992 2557 generic.go:356] "Generic (PLEG): container finished" podID="8998e4eb-1231-42dc-aa17-364c6b34608b" containerID="674aa0a62473e508c30b009aa5c4bdba48baf9b0b57609ed5a0e13f0d804f984" exitCode=0 Jun 14 13:41:04.785119 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:04.785020 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnth6t" event={"ID":"8998e4eb-1231-42dc-aa17-364c6b34608b","Type":"ContainerDied","Data":"674aa0a62473e508c30b009aa5c4bdba48baf9b0b57609ed5a0e13f0d804f984"} Jun 14 13:41:04.799492 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:04.799446 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-m6bm6" podStartSLOduration=1.0235877310000001 podStartE2EDuration="3.799432214s" totalImagesPullingTime="2.775844483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:41:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:41:04.798762445 +0000 UTC m=+497.472030392" watchObservedRunningTime="2026-06-14 13:41:04.799432214 +0000 UTC m=+497.472700160" Jun 14 13:41:05.791444 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:05.791405 2557 generic.go:356] "Generic (PLEG): container finished" podID="8998e4eb-1231-42dc-aa17-364c6b34608b" containerID="c7fb6d88475b270908d3679bd389bbdc21402efe177928f33170b64d0e0cb864" exitCode=0 Jun 14 13:41:05.791833 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:05.791480 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnth6t" event={"ID":"8998e4eb-1231-42dc-aa17-364c6b34608b","Type":"ContainerDied","Data":"c7fb6d88475b270908d3679bd389bbdc21402efe177928f33170b64d0e0cb864"} Jun 14 13:41:06.933668 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:06.933641 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnth6t" Jun 14 13:41:07.064943 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:07.064856 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8998e4eb-1231-42dc-aa17-364c6b34608b-bundle\") pod \"8998e4eb-1231-42dc-aa17-364c6b34608b\" (UID: \"8998e4eb-1231-42dc-aa17-364c6b34608b\") " Jun 14 13:41:07.064943 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:07.064938 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlbh6\" (UniqueName: \"kubernetes.io/projected/8998e4eb-1231-42dc-aa17-364c6b34608b-kube-api-access-hlbh6\") pod \"8998e4eb-1231-42dc-aa17-364c6b34608b\" (UID: \"8998e4eb-1231-42dc-aa17-364c6b34608b\") " Jun 14 13:41:07.065125 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:07.065000 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8998e4eb-1231-42dc-aa17-364c6b34608b-util\") pod \"8998e4eb-1231-42dc-aa17-364c6b34608b\" (UID: \"8998e4eb-1231-42dc-aa17-364c6b34608b\") " Jun 14 13:41:07.065339 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:07.065313 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8998e4eb-1231-42dc-aa17-364c6b34608b-bundle" (OuterVolumeSpecName: "bundle") pod "8998e4eb-1231-42dc-aa17-364c6b34608b" (UID: "8998e4eb-1231-42dc-aa17-364c6b34608b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 13:41:07.067044 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:07.067019 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8998e4eb-1231-42dc-aa17-364c6b34608b-kube-api-access-hlbh6" (OuterVolumeSpecName: "kube-api-access-hlbh6") pod "8998e4eb-1231-42dc-aa17-364c6b34608b" (UID: "8998e4eb-1231-42dc-aa17-364c6b34608b"). InnerVolumeSpecName "kube-api-access-hlbh6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 13:41:07.070343 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:07.070315 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8998e4eb-1231-42dc-aa17-364c6b34608b-util" (OuterVolumeSpecName: "util") pod "8998e4eb-1231-42dc-aa17-364c6b34608b" (UID: "8998e4eb-1231-42dc-aa17-364c6b34608b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 13:41:07.165920 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:07.165884 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlbh6\" (UniqueName: \"kubernetes.io/projected/8998e4eb-1231-42dc-aa17-364c6b34608b-kube-api-access-hlbh6\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:41:07.165920 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:07.165913 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8998e4eb-1231-42dc-aa17-364c6b34608b-util\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:41:07.165920 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:07.165926 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8998e4eb-1231-42dc-aa17-364c6b34608b-bundle\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:41:07.802826 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:07.802789 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnth6t" event={"ID":"8998e4eb-1231-42dc-aa17-364c6b34608b","Type":"ContainerDied","Data":"eba211a47f7bab984942c8c015615aa57e6f4c274d0ba58771f84a5fb792329c"} Jun 14 13:41:07.802826 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:07.802814 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnth6t" Jun 14 13:41:07.803025 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:07.802846 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eba211a47f7bab984942c8c015615aa57e6f4c274d0ba58771f84a5fb792329c" Jun 14 13:41:10.383607 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:10.383570 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:10.681072 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:10.680993 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:10.785494 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:10.785457 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:10.794033 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:10.794011 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-m6bm6" Jun 14 13:41:13.869885 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:13.869845 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:13.974215 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:13.974177 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:15.883093 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:15.883061 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z4slj"] Jun 14 13:41:15.883531 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:15.883511 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8998e4eb-1231-42dc-aa17-364c6b34608b" containerName="util" Jun 14 13:41:15.883574 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:15.883535 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8998e4eb-1231-42dc-aa17-364c6b34608b" containerName="util" Jun 14 13:41:15.883574 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:15.883547 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8998e4eb-1231-42dc-aa17-364c6b34608b" containerName="pull" Jun 14 13:41:15.883574 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:15.883555 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8998e4eb-1231-42dc-aa17-364c6b34608b" containerName="pull" Jun 14 13:41:15.883574 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:15.883572 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8998e4eb-1231-42dc-aa17-364c6b34608b" containerName="extract" Jun 14 13:41:15.883756 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:15.883581 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8998e4eb-1231-42dc-aa17-364c6b34608b" containerName="extract" Jun 14 13:41:15.883756 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:15.883664 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="8998e4eb-1231-42dc-aa17-364c6b34608b" containerName="extract" Jun 14 13:41:15.903147 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:15.903121 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z4slj"] Jun 14 13:41:15.903289 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:15.903211 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z4slj" Jun 14 13:41:15.905838 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:15.905813 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 14 13:41:15.906891 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:15.906871 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 14 13:41:15.906977 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:15.906933 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-m6hg6\"" Jun 14 13:41:16.041866 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:16.041835 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czdgb\" (UniqueName: \"kubernetes.io/projected/1da755b9-22a7-48b6-acaa-b1e96276ab99-kube-api-access-czdgb\") pod \"openshift-lws-operator-fd8ccff4c-z4slj\" (UID: \"1da755b9-22a7-48b6-acaa-b1e96276ab99\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z4slj" Jun 14 13:41:16.042045 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:16.041915 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1da755b9-22a7-48b6-acaa-b1e96276ab99-tmp\") pod \"openshift-lws-operator-fd8ccff4c-z4slj\" (UID: \"1da755b9-22a7-48b6-acaa-b1e96276ab99\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z4slj" Jun 14 13:41:16.143003 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:16.142920 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1da755b9-22a7-48b6-acaa-b1e96276ab99-tmp\") pod \"openshift-lws-operator-fd8ccff4c-z4slj\" (UID: \"1da755b9-22a7-48b6-acaa-b1e96276ab99\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z4slj" Jun 14 13:41:16.143003 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:16.142975 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czdgb\" (UniqueName: \"kubernetes.io/projected/1da755b9-22a7-48b6-acaa-b1e96276ab99-kube-api-access-czdgb\") pod \"openshift-lws-operator-fd8ccff4c-z4slj\" (UID: \"1da755b9-22a7-48b6-acaa-b1e96276ab99\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z4slj" Jun 14 13:41:16.143299 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:16.143279 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1da755b9-22a7-48b6-acaa-b1e96276ab99-tmp\") pod \"openshift-lws-operator-fd8ccff4c-z4slj\" (UID: \"1da755b9-22a7-48b6-acaa-b1e96276ab99\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z4slj" Jun 14 13:41:16.151253 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:16.151228 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czdgb\" (UniqueName: \"kubernetes.io/projected/1da755b9-22a7-48b6-acaa-b1e96276ab99-kube-api-access-czdgb\") pod \"openshift-lws-operator-fd8ccff4c-z4slj\" (UID: \"1da755b9-22a7-48b6-acaa-b1e96276ab99\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z4slj" Jun 14 13:41:16.212975 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:16.212937 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z4slj" Jun 14 13:41:16.361675 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:16.361649 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z4slj"] Jun 14 13:41:16.363864 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:41:16.363835 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1da755b9_22a7_48b6_acaa_b1e96276ab99.slice/crio-9d1ca3d397a17caa2f784dc0d419f052b558358ca0187877c2e545a835879b13 WatchSource:0}: Error finding container 9d1ca3d397a17caa2f784dc0d419f052b558358ca0187877c2e545a835879b13: Status 404 returned error can't find the container with id 9d1ca3d397a17caa2f784dc0d419f052b558358ca0187877c2e545a835879b13 Jun 14 13:41:16.849563 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:16.849524 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z4slj" event={"ID":"1da755b9-22a7-48b6-acaa-b1e96276ab99","Type":"ContainerStarted","Data":"9d1ca3d397a17caa2f784dc0d419f052b558358ca0187877c2e545a835879b13"} Jun 14 13:41:18.860505 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:18.860420 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z4slj" event={"ID":"1da755b9-22a7-48b6-acaa-b1e96276ab99","Type":"ContainerStarted","Data":"d721b4422454107074889bbe9ad65879015e827133bc5272065939f04e86e0c2"} Jun 14 13:41:18.876825 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:18.876769 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z4slj" podStartSLOduration=1.80645618 podStartE2EDuration="3.876749814s" totalImagesPullingTime="2.070293634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:41:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:41:18.875209175 +0000 UTC m=+511.548477134" watchObservedRunningTime="2026-06-14 13:41:18.876749814 +0000 UTC m=+511.550017753" Jun 14 13:41:19.566395 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:19.566354 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:19.669772 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:19.669727 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:20.309894 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:20.309858 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-mngcs"] Jun 14 13:41:20.313155 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:20.313133 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-mngcs" Jun 14 13:41:20.315517 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:20.315487 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-7smhf\"" Jun 14 13:41:20.319864 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:20.319844 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-mngcs"] Jun 14 13:41:20.482931 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:20.482896 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dc6n\" (UniqueName: \"kubernetes.io/projected/33ac2392-53bc-41f5-a886-72759c85be3e-kube-api-access-4dc6n\") pod \"cert-manager-59c77684cc-mngcs\" (UID: \"33ac2392-53bc-41f5-a886-72759c85be3e\") " pod="cert-manager/cert-manager-59c77684cc-mngcs" Jun 14 13:41:20.483109 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:20.482972 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/33ac2392-53bc-41f5-a886-72759c85be3e-bound-sa-token\") pod \"cert-manager-59c77684cc-mngcs\" (UID: \"33ac2392-53bc-41f5-a886-72759c85be3e\") " pod="cert-manager/cert-manager-59c77684cc-mngcs" Jun 14 13:41:20.583667 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:20.583581 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/33ac2392-53bc-41f5-a886-72759c85be3e-bound-sa-token\") pod \"cert-manager-59c77684cc-mngcs\" (UID: \"33ac2392-53bc-41f5-a886-72759c85be3e\") " pod="cert-manager/cert-manager-59c77684cc-mngcs" Jun 14 13:41:20.583667 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:20.583644 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dc6n\" (UniqueName: \"kubernetes.io/projected/33ac2392-53bc-41f5-a886-72759c85be3e-kube-api-access-4dc6n\") pod \"cert-manager-59c77684cc-mngcs\" (UID: \"33ac2392-53bc-41f5-a886-72759c85be3e\") " pod="cert-manager/cert-manager-59c77684cc-mngcs" Jun 14 13:41:20.591827 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:20.591797 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/33ac2392-53bc-41f5-a886-72759c85be3e-bound-sa-token\") pod \"cert-manager-59c77684cc-mngcs\" (UID: \"33ac2392-53bc-41f5-a886-72759c85be3e\") " pod="cert-manager/cert-manager-59c77684cc-mngcs" Jun 14 13:41:20.591943 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:20.591797 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dc6n\" (UniqueName: \"kubernetes.io/projected/33ac2392-53bc-41f5-a886-72759c85be3e-kube-api-access-4dc6n\") pod \"cert-manager-59c77684cc-mngcs\" (UID: \"33ac2392-53bc-41f5-a886-72759c85be3e\") " pod="cert-manager/cert-manager-59c77684cc-mngcs" Jun 14 13:41:20.623438 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:20.623410 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-mngcs" Jun 14 13:41:20.750115 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:20.750094 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-mngcs"] Jun 14 13:41:20.751969 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:41:20.751934 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33ac2392_53bc_41f5_a886_72759c85be3e.slice/crio-55b5a1da6bdfa56cb739033ea6fd05abc4457d62ad6784ee9c530aefd445fa04 WatchSource:0}: Error finding container 55b5a1da6bdfa56cb739033ea6fd05abc4457d62ad6784ee9c530aefd445fa04: Status 404 returned error can't find the container with id 55b5a1da6bdfa56cb739033ea6fd05abc4457d62ad6784ee9c530aefd445fa04 Jun 14 13:41:20.871242 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:20.871167 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-mngcs" event={"ID":"33ac2392-53bc-41f5-a886-72759c85be3e","Type":"ContainerStarted","Data":"812dc9ad1beb53dcc327fa9892fe0139e21f5d93765df591d667876a6ebe0fed"} Jun 14 13:41:20.871242 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:20.871206 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-mngcs" event={"ID":"33ac2392-53bc-41f5-a886-72759c85be3e","Type":"ContainerStarted","Data":"55b5a1da6bdfa56cb739033ea6fd05abc4457d62ad6784ee9c530aefd445fa04"} Jun 14 13:41:20.886443 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:20.886400 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-mngcs" podStartSLOduration=0.886386686 podStartE2EDuration="886.386686ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:41:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:41:20.885819381 +0000 UTC m=+513.559087329" watchObservedRunningTime="2026-06-14 13:41:20.886386686 +0000 UTC m=+513.559654632" Jun 14 13:41:21.256609 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:21.256578 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:23.721296 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:23.721262 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7rvp8"] Jun 14 13:41:23.724823 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:23.724799 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7rvp8" Jun 14 13:41:23.727407 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:23.727374 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 13:41:23.727525 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:23.727452 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-whkbn\"" Jun 14 13:41:23.728541 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:23.728521 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 13:41:23.735242 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:23.735221 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7rvp8"] Jun 14 13:41:23.808358 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:23.808322 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7rvp8\" (UID: \"3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7rvp8" Jun 14 13:41:23.808577 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:23.808371 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7rvp8\" (UID: \"3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7rvp8" Jun 14 13:41:23.808577 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:23.808412 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9zzr\" (UniqueName: \"kubernetes.io/projected/3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce-kube-api-access-j9zzr\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7rvp8\" (UID: \"3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7rvp8" Jun 14 13:41:23.909062 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:23.909031 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7rvp8\" (UID: \"3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7rvp8" Jun 14 13:41:23.909221 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:23.909072 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7rvp8\" (UID: \"3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7rvp8" Jun 14 13:41:23.909221 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:23.909189 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9zzr\" (UniqueName: \"kubernetes.io/projected/3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce-kube-api-access-j9zzr\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7rvp8\" (UID: \"3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7rvp8" Jun 14 13:41:23.909463 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:23.909443 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7rvp8\" (UID: \"3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7rvp8" Jun 14 13:41:23.909499 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:23.909446 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7rvp8\" (UID: \"3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7rvp8" Jun 14 13:41:23.917232 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:23.917205 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9zzr\" (UniqueName: \"kubernetes.io/projected/3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce-kube-api-access-j9zzr\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7rvp8\" (UID: \"3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7rvp8" Jun 14 13:41:24.037188 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:24.037098 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7rvp8" Jun 14 13:41:24.164561 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:24.164535 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7rvp8"] Jun 14 13:41:24.165884 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:41:24.165851 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a4cd7af_d7ce_41f1_96cd_b24cbb84c3ce.slice/crio-2f4f53253b933c3f6c24295a4eeed0cd516338676c99746bf624e9de4b891b4d WatchSource:0}: Error finding container 2f4f53253b933c3f6c24295a4eeed0cd516338676c99746bf624e9de4b891b4d: Status 404 returned error can't find the container with id 2f4f53253b933c3f6c24295a4eeed0cd516338676c99746bf624e9de4b891b4d Jun 14 13:41:24.198088 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:24.198063 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:24.888912 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:24.888881 2557 generic.go:356] "Generic (PLEG): container finished" podID="3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce" containerID="f09f3e9804d8e6763aba6feb911ef5b75dee3dff4b95b042d9b2e2a0f6bc2b23" exitCode=0 Jun 14 13:41:24.889250 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:24.888944 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7rvp8" event={"ID":"3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce","Type":"ContainerDied","Data":"f09f3e9804d8e6763aba6feb911ef5b75dee3dff4b95b042d9b2e2a0f6bc2b23"} Jun 14 13:41:24.889250 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:24.888980 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7rvp8" event={"ID":"3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce","Type":"ContainerStarted","Data":"2f4f53253b933c3f6c24295a4eeed0cd516338676c99746bf624e9de4b891b4d"} Jun 14 13:41:25.895772 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:25.895734 2557 generic.go:356] "Generic (PLEG): container finished" podID="3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce" containerID="686f7799c5055cdd04a44042685d2ed49542eb4d9dbc33e695492ddb3c6ae48f" exitCode=0 Jun 14 13:41:25.896197 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:25.895797 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7rvp8" event={"ID":"3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce","Type":"ContainerDied","Data":"686f7799c5055cdd04a44042685d2ed49542eb4d9dbc33e695492ddb3c6ae48f"} Jun 14 13:41:26.902800 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:26.902767 2557 generic.go:356] "Generic (PLEG): container finished" podID="3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce" containerID="59b11e8c4e99b7c2e60ba57e1ee38e2e945d1a399d4482ad2f75258e7b3d5b23" exitCode=0 Jun 14 13:41:26.903169 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:26.902822 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7rvp8" event={"ID":"3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce","Type":"ContainerDied","Data":"59b11e8c4e99b7c2e60ba57e1ee38e2e945d1a399d4482ad2f75258e7b3d5b23"} Jun 14 13:41:28.029887 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:28.029860 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7rvp8" Jun 14 13:41:28.042825 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:28.042797 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9zzr\" (UniqueName: \"kubernetes.io/projected/3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce-kube-api-access-j9zzr\") pod \"3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce\" (UID: \"3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce\") " Jun 14 13:41:28.042939 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:28.042843 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce-util\") pod \"3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce\" (UID: \"3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce\") " Jun 14 13:41:28.042939 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:28.042861 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce-bundle\") pod \"3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce\" (UID: \"3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce\") " Jun 14 13:41:28.043702 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:28.043646 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce-bundle" (OuterVolumeSpecName: "bundle") pod "3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce" (UID: "3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 13:41:28.044982 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:28.044953 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce-kube-api-access-j9zzr" (OuterVolumeSpecName: "kube-api-access-j9zzr") pod "3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce" (UID: "3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce"). InnerVolumeSpecName "kube-api-access-j9zzr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 13:41:28.048844 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:28.048818 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce-util" (OuterVolumeSpecName: "util") pod "3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce" (UID: "3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 13:41:28.144067 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:28.144032 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9zzr\" (UniqueName: \"kubernetes.io/projected/3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce-kube-api-access-j9zzr\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:41:28.144067 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:28.144060 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce-util\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:41:28.144067 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:28.144069 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce-bundle\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:41:28.916940 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:28.916914 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7rvp8" Jun 14 13:41:28.917101 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:28.916919 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7rvp8" event={"ID":"3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce","Type":"ContainerDied","Data":"2f4f53253b933c3f6c24295a4eeed0cd516338676c99746bf624e9de4b891b4d"} Jun 14 13:41:28.917101 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:28.917029 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f4f53253b933c3f6c24295a4eeed0cd516338676c99746bf624e9de4b891b4d" Jun 14 13:41:34.375480 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:34.375442 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:36.062112 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:36.062073 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:36.163598 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:36.163560 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:36.736541 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:36.736456 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:36.982121 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:36.982093 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:37.086990 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.086897 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:37.119164 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.119137 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b7b4955f8-dpchh"] Jun 14 13:41:37.119470 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.119459 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce" containerName="util" Jun 14 13:41:37.119513 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.119472 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce" containerName="util" Jun 14 13:41:37.119513 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.119496 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce" containerName="pull" Jun 14 13:41:37.119513 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.119501 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce" containerName="pull" Jun 14 13:41:37.119513 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.119507 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce" containerName="extract" Jun 14 13:41:37.119513 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.119513 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce" containerName="extract" Jun 14 13:41:37.119665 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.119569 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a4cd7af-d7ce-41f1-96cd-b24cbb84c3ce" containerName="extract" Jun 14 13:41:37.124073 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.124047 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b7b4955f8-dpchh" Jun 14 13:41:37.126751 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.126730 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 14 13:41:37.126949 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.126930 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 14 13:41:37.127054 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.126934 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 14 13:41:37.127206 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.127193 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gbt6f\"" Jun 14 13:41:37.127459 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.127444 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 14 13:41:37.139223 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.139202 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b7b4955f8-dpchh"] Jun 14 13:41:37.222266 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.222230 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4hsw\" (UniqueName: \"kubernetes.io/projected/b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7-kube-api-access-q4hsw\") pod \"opendatahub-operator-controller-manager-5b7b4955f8-dpchh\" (UID: \"b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7\") " pod="opendatahub/opendatahub-operator-controller-manager-5b7b4955f8-dpchh" Jun 14 13:41:37.222266 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.222266 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7-tmp\") pod \"opendatahub-operator-controller-manager-5b7b4955f8-dpchh\" (UID: \"b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7\") " pod="opendatahub/opendatahub-operator-controller-manager-5b7b4955f8-dpchh" Jun 14 13:41:37.222482 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.222297 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7-manifests\") pod \"opendatahub-operator-controller-manager-5b7b4955f8-dpchh\" (UID: \"b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7\") " pod="opendatahub/opendatahub-operator-controller-manager-5b7b4955f8-dpchh" Jun 14 13:41:37.222482 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.222312 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b7b4955f8-dpchh\" (UID: \"b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7\") " pod="opendatahub/opendatahub-operator-controller-manager-5b7b4955f8-dpchh" Jun 14 13:41:37.222482 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.222372 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b7b4955f8-dpchh\" (UID: \"b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7\") " pod="opendatahub/opendatahub-operator-controller-manager-5b7b4955f8-dpchh" Jun 14 13:41:37.234545 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.234500 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:37.323005 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.322967 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7-manifests\") pod \"opendatahub-operator-controller-manager-5b7b4955f8-dpchh\" (UID: \"b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7\") " pod="opendatahub/opendatahub-operator-controller-manager-5b7b4955f8-dpchh" Jun 14 13:41:37.323005 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.323002 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b7b4955f8-dpchh\" (UID: \"b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7\") " pod="opendatahub/opendatahub-operator-controller-manager-5b7b4955f8-dpchh" Jun 14 13:41:37.323246 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.323032 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b7b4955f8-dpchh\" (UID: \"b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7\") " pod="opendatahub/opendatahub-operator-controller-manager-5b7b4955f8-dpchh" Jun 14 13:41:37.323246 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.323106 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4hsw\" (UniqueName: \"kubernetes.io/projected/b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7-kube-api-access-q4hsw\") pod \"opendatahub-operator-controller-manager-5b7b4955f8-dpchh\" (UID: \"b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7\") " pod="opendatahub/opendatahub-operator-controller-manager-5b7b4955f8-dpchh" Jun 14 13:41:37.323246 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.323126 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7-tmp\") pod \"opendatahub-operator-controller-manager-5b7b4955f8-dpchh\" (UID: \"b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7\") " pod="opendatahub/opendatahub-operator-controller-manager-5b7b4955f8-dpchh" Jun 14 13:41:37.323411 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.323372 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7-manifests\") pod \"opendatahub-operator-controller-manager-5b7b4955f8-dpchh\" (UID: \"b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7\") " pod="opendatahub/opendatahub-operator-controller-manager-5b7b4955f8-dpchh" Jun 14 13:41:37.325413 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.325383 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7-tmp\") pod \"opendatahub-operator-controller-manager-5b7b4955f8-dpchh\" (UID: \"b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7\") " pod="opendatahub/opendatahub-operator-controller-manager-5b7b4955f8-dpchh" Jun 14 13:41:37.325539 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.325521 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b7b4955f8-dpchh\" (UID: \"b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7\") " pod="opendatahub/opendatahub-operator-controller-manager-5b7b4955f8-dpchh" Jun 14 13:41:37.325622 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.325607 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b7b4955f8-dpchh\" (UID: \"b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7\") " pod="opendatahub/opendatahub-operator-controller-manager-5b7b4955f8-dpchh" Jun 14 13:41:37.332074 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.332052 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4hsw\" (UniqueName: \"kubernetes.io/projected/b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7-kube-api-access-q4hsw\") pod \"opendatahub-operator-controller-manager-5b7b4955f8-dpchh\" (UID: \"b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7\") " pod="opendatahub/opendatahub-operator-controller-manager-5b7b4955f8-dpchh" Jun 14 13:41:37.332589 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.332562 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:37.434653 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.434622 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b7b4955f8-dpchh" Jun 14 13:41:37.448591 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.448556 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:37.533292 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.533258 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:37.571299 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.571277 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b7b4955f8-dpchh"] Jun 14 13:41:37.573365 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:41:37.573333 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7adc24e_f5ad_4fbd_8a8f_e3060c5977a7.slice/crio-a0a6fea63fb189da4ebad75d335ad5f705e0261ec5cca04d42d36fa8e400b70f WatchSource:0}: Error finding container a0a6fea63fb189da4ebad75d335ad5f705e0261ec5cca04d42d36fa8e400b70f: Status 404 returned error can't find the container with id a0a6fea63fb189da4ebad75d335ad5f705e0261ec5cca04d42d36fa8e400b70f Jun 14 13:41:37.635535 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.635497 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:37.734123 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.734046 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:37.960867 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:37.960832 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b7b4955f8-dpchh" event={"ID":"b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7","Type":"ContainerStarted","Data":"a0a6fea63fb189da4ebad75d335ad5f705e0261ec5cca04d42d36fa8e400b70f"} Jun 14 13:41:40.983589 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:40.983552 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b7b4955f8-dpchh" event={"ID":"b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7","Type":"ContainerStarted","Data":"3697504699c1f6659144fc68caf7a150e8e886fc25574a1041388fa49d3cd4ad"} Jun 14 13:41:41.990353 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:41.990314 2557 generic.go:356] "Generic (PLEG): container finished" podID="b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7" containerID="3697504699c1f6659144fc68caf7a150e8e886fc25574a1041388fa49d3cd4ad" exitCode=0 Jun 14 13:41:41.990844 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:41.990380 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b7b4955f8-dpchh" event={"ID":"b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7","Type":"ContainerDied","Data":"3697504699c1f6659144fc68caf7a150e8e886fc25574a1041388fa49d3cd4ad"} Jun 14 13:41:42.996867 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:42.996825 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b7b4955f8-dpchh" event={"ID":"b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7","Type":"ContainerStarted","Data":"e7168979b28e2b81204267d6fcb0fb53349854bcb4ca02ea7bf1c0c439c6b2af"} Jun 14 13:41:42.997262 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:42.996982 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5b7b4955f8-dpchh" Jun 14 13:41:43.018597 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:43.018548 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5b7b4955f8-dpchh" podStartSLOduration=1.796784084 podStartE2EDuration="6.018532231s" totalImagesPullingTime="3.284772438s" totalInitContainerRuntime="936.975709ms" isStatefulPod=false podCreationTimestamp="2026-06-14 13:41:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:41:43.016386945 +0000 UTC m=+535.689654890" watchObservedRunningTime="2026-06-14 13:41:43.018532231 +0000 UTC m=+535.691800176" Jun 14 13:41:45.516075 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:45.516042 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:45.569737 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:45.569708 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:54.003981 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:54.003950 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5b7b4955f8-dpchh" Jun 14 13:41:55.744097 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:55.744064 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:55.862649 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:55.862613 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:56.183303 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:56.183269 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:56.299053 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:56.299020 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:56.387206 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:56.387172 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:56.477054 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:56.476967 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7f7b87855f-xfnvr"] Jun 14 13:41:56.485808 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:56.485784 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f7b87855f-xfnvr" Jun 14 13:41:56.488442 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:56.488413 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-6t9wp\"" Jun 14 13:41:56.488660 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:56.488642 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 14 13:41:56.489475 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:56.489459 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 14 13:41:56.495150 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:56.495123 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f7b87855f-xfnvr"] Jun 14 13:41:56.568207 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:56.568169 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-t6l8h"] Jun 14 13:41:56.571733 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:56.571703 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-t6l8h" Jun 14 13:41:56.574367 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:56.574341 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 14 13:41:56.574473 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:56.574346 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-cqldm\"" Jun 14 13:41:56.584299 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:56.584270 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-t6l8h"] Jun 14 13:41:56.588481 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:56.588455 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6259\" (UniqueName: \"kubernetes.io/projected/14125b39-a31f-40ce-be74-40bf60e697b4-kube-api-access-s6259\") pod \"kube-auth-proxy-7f7b87855f-xfnvr\" (UID: \"14125b39-a31f-40ce-be74-40bf60e697b4\") " pod="openshift-ingress/kube-auth-proxy-7f7b87855f-xfnvr" Jun 14 13:41:56.588717 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:56.588667 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14125b39-a31f-40ce-be74-40bf60e697b4-tmp\") pod \"kube-auth-proxy-7f7b87855f-xfnvr\" (UID: \"14125b39-a31f-40ce-be74-40bf60e697b4\") " pod="openshift-ingress/kube-auth-proxy-7f7b87855f-xfnvr" Jun 14 13:41:56.588904 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:56.588879 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14125b39-a31f-40ce-be74-40bf60e697b4-tls-certs\") pod \"kube-auth-proxy-7f7b87855f-xfnvr\" (UID: \"14125b39-a31f-40ce-be74-40bf60e697b4\") " pod="openshift-ingress/kube-auth-proxy-7f7b87855f-xfnvr" Jun 14 13:41:56.616400 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:56.616369 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:56.690289 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:56.690257 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14125b39-a31f-40ce-be74-40bf60e697b4-tls-certs\") pod \"kube-auth-proxy-7f7b87855f-xfnvr\" (UID: \"14125b39-a31f-40ce-be74-40bf60e697b4\") " pod="openshift-ingress/kube-auth-proxy-7f7b87855f-xfnvr" Jun 14 13:41:56.690462 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:56.690332 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5kzf\" (UniqueName: \"kubernetes.io/projected/5b8c3d54-d4b9-4d03-b44d-9961b5cc38d8-kube-api-access-z5kzf\") pod \"odh-model-controller-6dc94f689f-t6l8h\" (UID: \"5b8c3d54-d4b9-4d03-b44d-9961b5cc38d8\") " pod="opendatahub/odh-model-controller-6dc94f689f-t6l8h" Jun 14 13:41:56.690462 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:56.690411 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6259\" (UniqueName: \"kubernetes.io/projected/14125b39-a31f-40ce-be74-40bf60e697b4-kube-api-access-s6259\") pod \"kube-auth-proxy-7f7b87855f-xfnvr\" (UID: \"14125b39-a31f-40ce-be74-40bf60e697b4\") " pod="openshift-ingress/kube-auth-proxy-7f7b87855f-xfnvr" Jun 14 13:41:56.690462 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:41:56.690422 2557 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 14 13:41:56.690462 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:56.690449 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14125b39-a31f-40ce-be74-40bf60e697b4-tmp\") pod \"kube-auth-proxy-7f7b87855f-xfnvr\" (UID: \"14125b39-a31f-40ce-be74-40bf60e697b4\") " pod="openshift-ingress/kube-auth-proxy-7f7b87855f-xfnvr" Jun 14 13:41:56.690707 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:56.690474 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b8c3d54-d4b9-4d03-b44d-9961b5cc38d8-cert\") pod \"odh-model-controller-6dc94f689f-t6l8h\" (UID: \"5b8c3d54-d4b9-4d03-b44d-9961b5cc38d8\") " pod="opendatahub/odh-model-controller-6dc94f689f-t6l8h" Jun 14 13:41:56.690707 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:41:56.690493 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14125b39-a31f-40ce-be74-40bf60e697b4-tls-certs podName:14125b39-a31f-40ce-be74-40bf60e697b4 nodeName:}" failed. No retries permitted until 2026-06-14 13:41:57.190473954 +0000 UTC m=+549.863741881 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/14125b39-a31f-40ce-be74-40bf60e697b4-tls-certs") pod "kube-auth-proxy-7f7b87855f-xfnvr" (UID: "14125b39-a31f-40ce-be74-40bf60e697b4") : secret "kube-auth-proxy-tls" not found Jun 14 13:41:56.692727 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:56.692698 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14125b39-a31f-40ce-be74-40bf60e697b4-tmp\") pod \"kube-auth-proxy-7f7b87855f-xfnvr\" (UID: \"14125b39-a31f-40ce-be74-40bf60e697b4\") " pod="openshift-ingress/kube-auth-proxy-7f7b87855f-xfnvr" Jun 14 13:41:56.704480 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:56.704453 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6259\" (UniqueName: \"kubernetes.io/projected/14125b39-a31f-40ce-be74-40bf60e697b4-kube-api-access-s6259\") pod \"kube-auth-proxy-7f7b87855f-xfnvr\" (UID: \"14125b39-a31f-40ce-be74-40bf60e697b4\") " pod="openshift-ingress/kube-auth-proxy-7f7b87855f-xfnvr" Jun 14 13:41:56.720846 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:56.720791 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:56.791475 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:56.791395 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5kzf\" (UniqueName: \"kubernetes.io/projected/5b8c3d54-d4b9-4d03-b44d-9961b5cc38d8-kube-api-access-z5kzf\") pod \"odh-model-controller-6dc94f689f-t6l8h\" (UID: \"5b8c3d54-d4b9-4d03-b44d-9961b5cc38d8\") " pod="opendatahub/odh-model-controller-6dc94f689f-t6l8h" Jun 14 13:41:56.791843 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:56.791502 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b8c3d54-d4b9-4d03-b44d-9961b5cc38d8-cert\") pod \"odh-model-controller-6dc94f689f-t6l8h\" (UID: \"5b8c3d54-d4b9-4d03-b44d-9961b5cc38d8\") " pod="opendatahub/odh-model-controller-6dc94f689f-t6l8h" Jun 14 13:41:56.791843 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:41:56.791647 2557 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 14 13:41:56.791843 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:41:56.791742 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b8c3d54-d4b9-4d03-b44d-9961b5cc38d8-cert podName:5b8c3d54-d4b9-4d03-b44d-9961b5cc38d8 nodeName:}" failed. No retries permitted until 2026-06-14 13:41:57.291725574 +0000 UTC m=+549.964993508 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5b8c3d54-d4b9-4d03-b44d-9961b5cc38d8-cert") pod "odh-model-controller-6dc94f689f-t6l8h" (UID: "5b8c3d54-d4b9-4d03-b44d-9961b5cc38d8") : secret "odh-model-controller-webhook-cert" not found Jun 14 13:41:56.801424 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:56.801404 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5kzf\" (UniqueName: \"kubernetes.io/projected/5b8c3d54-d4b9-4d03-b44d-9961b5cc38d8-kube-api-access-z5kzf\") pod \"odh-model-controller-6dc94f689f-t6l8h\" (UID: \"5b8c3d54-d4b9-4d03-b44d-9961b5cc38d8\") " pod="opendatahub/odh-model-controller-6dc94f689f-t6l8h" Jun 14 13:41:56.817284 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:56.817256 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:56.918899 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:56.918862 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:57.019096 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:57.019055 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:57.194777 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:57.194747 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14125b39-a31f-40ce-be74-40bf60e697b4-tls-certs\") pod \"kube-auth-proxy-7f7b87855f-xfnvr\" (UID: \"14125b39-a31f-40ce-be74-40bf60e697b4\") " pod="openshift-ingress/kube-auth-proxy-7f7b87855f-xfnvr" Jun 14 13:41:57.197046 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:57.197026 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14125b39-a31f-40ce-be74-40bf60e697b4-tls-certs\") pod \"kube-auth-proxy-7f7b87855f-xfnvr\" (UID: \"14125b39-a31f-40ce-be74-40bf60e697b4\") " pod="openshift-ingress/kube-auth-proxy-7f7b87855f-xfnvr" Jun 14 13:41:57.245828 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:57.245797 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-b9q9g"] Jun 14 13:41:57.249480 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:57.249461 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-b9q9g" Jun 14 13:41:57.252041 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:57.252021 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 14 13:41:57.252244 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:57.252229 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-zzrm4\"" Jun 14 13:41:57.253977 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:57.253950 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:57.258773 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:57.258731 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-b9q9g"] Jun 14 13:41:57.295959 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:57.295928 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b8c3d54-d4b9-4d03-b44d-9961b5cc38d8-cert\") pod \"odh-model-controller-6dc94f689f-t6l8h\" (UID: \"5b8c3d54-d4b9-4d03-b44d-9961b5cc38d8\") " pod="opendatahub/odh-model-controller-6dc94f689f-t6l8h" Jun 14 13:41:57.298885 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:57.298863 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b8c3d54-d4b9-4d03-b44d-9961b5cc38d8-cert\") pod \"odh-model-controller-6dc94f689f-t6l8h\" (UID: \"5b8c3d54-d4b9-4d03-b44d-9961b5cc38d8\") " pod="opendatahub/odh-model-controller-6dc94f689f-t6l8h" Jun 14 13:41:57.330017 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:57.329986 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:41:57.397316 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:57.397277 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fftgm\" (UniqueName: \"kubernetes.io/projected/82a5a742-6e87-4232-ab75-fbb447d181ae-kube-api-access-fftgm\") pod \"model-serving-api-5dd488fc48-b9q9g\" (UID: \"82a5a742-6e87-4232-ab75-fbb447d181ae\") " pod="opendatahub/model-serving-api-5dd488fc48-b9q9g" Jun 14 13:41:57.397487 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:57.397331 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82a5a742-6e87-4232-ab75-fbb447d181ae-tls-certs\") pod \"model-serving-api-5dd488fc48-b9q9g\" (UID: \"82a5a742-6e87-4232-ab75-fbb447d181ae\") " pod="opendatahub/model-serving-api-5dd488fc48-b9q9g" Jun 14 13:41:57.400118 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:57.400094 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f7b87855f-xfnvr" Jun 14 13:41:57.488608 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:57.488579 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-t6l8h" Jun 14 13:41:57.498171 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:57.498141 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fftgm\" (UniqueName: \"kubernetes.io/projected/82a5a742-6e87-4232-ab75-fbb447d181ae-kube-api-access-fftgm\") pod \"model-serving-api-5dd488fc48-b9q9g\" (UID: \"82a5a742-6e87-4232-ab75-fbb447d181ae\") " pod="opendatahub/model-serving-api-5dd488fc48-b9q9g" Jun 14 13:41:57.498291 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:57.498199 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82a5a742-6e87-4232-ab75-fbb447d181ae-tls-certs\") pod \"model-serving-api-5dd488fc48-b9q9g\" (UID: \"82a5a742-6e87-4232-ab75-fbb447d181ae\") " pod="opendatahub/model-serving-api-5dd488fc48-b9q9g" Jun 14 13:41:57.501207 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:57.501183 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82a5a742-6e87-4232-ab75-fbb447d181ae-tls-certs\") pod \"model-serving-api-5dd488fc48-b9q9g\" (UID: \"82a5a742-6e87-4232-ab75-fbb447d181ae\") " pod="opendatahub/model-serving-api-5dd488fc48-b9q9g" Jun 14 13:41:57.508173 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:57.508147 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fftgm\" (UniqueName: \"kubernetes.io/projected/82a5a742-6e87-4232-ab75-fbb447d181ae-kube-api-access-fftgm\") pod \"model-serving-api-5dd488fc48-b9q9g\" (UID: \"82a5a742-6e87-4232-ab75-fbb447d181ae\") " pod="opendatahub/model-serving-api-5dd488fc48-b9q9g" Jun 14 13:41:57.539456 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:57.538546 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f7b87855f-xfnvr"] Jun 14 13:41:57.541481 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:41:57.541452 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14125b39_a31f_40ce_be74_40bf60e697b4.slice/crio-e7c35422e233842a5b86201d1830fc187fac8b884c2508b3bd2cead9a9865337 WatchSource:0}: Error finding container e7c35422e233842a5b86201d1830fc187fac8b884c2508b3bd2cead9a9865337: Status 404 returned error can't find the container with id e7c35422e233842a5b86201d1830fc187fac8b884c2508b3bd2cead9a9865337 Jun 14 13:41:57.561885 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:57.561863 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-b9q9g" Jun 14 13:41:57.711285 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:57.711251 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-b9q9g"] Jun 14 13:41:57.713852 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:41:57.713820 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82a5a742_6e87_4232_ab75_fbb447d181ae.slice/crio-be802bf59d985de09fdfbf31aea4e3f31c33a4944639069eb55c49ce087ecee4 WatchSource:0}: Error finding container be802bf59d985de09fdfbf31aea4e3f31c33a4944639069eb55c49ce087ecee4: Status 404 returned error can't find the container with id be802bf59d985de09fdfbf31aea4e3f31c33a4944639069eb55c49ce087ecee4 Jun 14 13:41:57.840216 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:57.840184 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-t6l8h"] Jun 14 13:41:57.843476 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:41:57.843450 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b8c3d54_d4b9_4d03_b44d_9961b5cc38d8.slice/crio-00eb680985e354dd98e966dce0be6f9a4cd67c88e2aa1832d1014b472491b54e WatchSource:0}: Error finding container 00eb680985e354dd98e966dce0be6f9a4cd67c88e2aa1832d1014b472491b54e: Status 404 returned error can't find the container with id 00eb680985e354dd98e966dce0be6f9a4cd67c88e2aa1832d1014b472491b54e Jun 14 13:41:58.069435 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:58.069354 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sk8wj"] Jun 14 13:41:58.073652 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:58.073626 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-t6l8h" event={"ID":"5b8c3d54-d4b9-4d03-b44d-9961b5cc38d8","Type":"ContainerStarted","Data":"00eb680985e354dd98e966dce0be6f9a4cd67c88e2aa1832d1014b472491b54e"} Jun 14 13:41:58.073807 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:58.073757 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sk8wj" Jun 14 13:41:58.073871 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:58.073792 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-b9q9g" event={"ID":"82a5a742-6e87-4232-ab75-fbb447d181ae","Type":"ContainerStarted","Data":"be802bf59d985de09fdfbf31aea4e3f31c33a4944639069eb55c49ce087ecee4"} Jun 14 13:41:58.075370 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:58.075340 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f7b87855f-xfnvr" event={"ID":"14125b39-a31f-40ce-be74-40bf60e697b4","Type":"ContainerStarted","Data":"e7c35422e233842a5b86201d1830fc187fac8b884c2508b3bd2cead9a9865337"} Jun 14 13:41:58.076455 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:58.076434 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 13:41:58.076544 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:58.076434 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-whkbn\"" Jun 14 13:41:58.076544 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:58.076437 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 13:41:58.082018 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:58.081963 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sk8wj"] Jun 14 13:41:58.204607 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:58.204568 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c96e7414-901e-43a9-85ca-c7c842c1de6a-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sk8wj\" (UID: \"c96e7414-901e-43a9-85ca-c7c842c1de6a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sk8wj" Jun 14 13:41:58.204804 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:58.204746 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c96e7414-901e-43a9-85ca-c7c842c1de6a-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sk8wj\" (UID: \"c96e7414-901e-43a9-85ca-c7c842c1de6a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sk8wj" Jun 14 13:41:58.204878 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:58.204812 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9g44\" (UniqueName: \"kubernetes.io/projected/c96e7414-901e-43a9-85ca-c7c842c1de6a-kube-api-access-z9g44\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sk8wj\" (UID: \"c96e7414-901e-43a9-85ca-c7c842c1de6a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sk8wj" Jun 14 13:41:58.306087 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:58.306054 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c96e7414-901e-43a9-85ca-c7c842c1de6a-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sk8wj\" (UID: \"c96e7414-901e-43a9-85ca-c7c842c1de6a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sk8wj" Jun 14 13:41:58.306289 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:58.306116 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9g44\" (UniqueName: \"kubernetes.io/projected/c96e7414-901e-43a9-85ca-c7c842c1de6a-kube-api-access-z9g44\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sk8wj\" (UID: \"c96e7414-901e-43a9-85ca-c7c842c1de6a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sk8wj" Jun 14 13:41:58.306289 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:58.306156 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c96e7414-901e-43a9-85ca-c7c842c1de6a-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sk8wj\" (UID: \"c96e7414-901e-43a9-85ca-c7c842c1de6a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sk8wj" Jun 14 13:41:58.306597 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:58.306573 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c96e7414-901e-43a9-85ca-c7c842c1de6a-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sk8wj\" (UID: \"c96e7414-901e-43a9-85ca-c7c842c1de6a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sk8wj" Jun 14 13:41:58.306661 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:58.306597 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c96e7414-901e-43a9-85ca-c7c842c1de6a-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sk8wj\" (UID: \"c96e7414-901e-43a9-85ca-c7c842c1de6a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sk8wj" Jun 14 13:41:58.317765 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:58.317735 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9g44\" (UniqueName: \"kubernetes.io/projected/c96e7414-901e-43a9-85ca-c7c842c1de6a-kube-api-access-z9g44\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sk8wj\" (UID: \"c96e7414-901e-43a9-85ca-c7c842c1de6a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sk8wj" Jun 14 13:41:58.386613 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:58.386576 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sk8wj" Jun 14 13:41:58.839912 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:58.839829 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sk8wj"] Jun 14 13:41:59.088186 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:59.087178 2557 generic.go:356] "Generic (PLEG): container finished" podID="c96e7414-901e-43a9-85ca-c7c842c1de6a" containerID="f6936c71fa80b1e97e3c9d6277bd563c191d0690a545010b12b1a71e8600e337" exitCode=0 Jun 14 13:41:59.088186 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:59.087335 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sk8wj" event={"ID":"c96e7414-901e-43a9-85ca-c7c842c1de6a","Type":"ContainerDied","Data":"f6936c71fa80b1e97e3c9d6277bd563c191d0690a545010b12b1a71e8600e337"} Jun 14 13:41:59.088186 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:41:59.087382 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sk8wj" event={"ID":"c96e7414-901e-43a9-85ca-c7c842c1de6a","Type":"ContainerStarted","Data":"7e3b973de13ee6edb6bda3f0e49f250db9f9b2f3dc949593d66e97fe20bab60e"} Jun 14 13:42:03.114272 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:03.114238 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f7b87855f-xfnvr" event={"ID":"14125b39-a31f-40ce-be74-40bf60e697b4","Type":"ContainerStarted","Data":"21787ff202e36e11699ede077fd55a4e5f4ceccf6373a5f00ac79b4e62e8b4e6"} Jun 14 13:42:03.115957 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:03.115926 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-t6l8h" event={"ID":"5b8c3d54-d4b9-4d03-b44d-9961b5cc38d8","Type":"ContainerStarted","Data":"39d6cabe18e54c92660d543358e8db306cab494443db60f6a5041c8831e058cf"} Jun 14 13:42:03.116112 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:03.116070 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-t6l8h" Jun 14 13:42:03.117475 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:03.117443 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-b9q9g" event={"ID":"82a5a742-6e87-4232-ab75-fbb447d181ae","Type":"ContainerStarted","Data":"9f1be5f80a34db50b65145a21b87eae8c9192d85de514de848456c25b0e9a22f"} Jun 14 13:42:03.117600 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:03.117509 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-b9q9g" Jun 14 13:42:03.119407 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:03.119383 2557 generic.go:356] "Generic (PLEG): container finished" podID="c96e7414-901e-43a9-85ca-c7c842c1de6a" containerID="3770e00f6d3abdce2f55e0631613b70245535bcf686484010b33859836a72d81" exitCode=0 Jun 14 13:42:03.119497 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:03.119423 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sk8wj" event={"ID":"c96e7414-901e-43a9-85ca-c7c842c1de6a","Type":"ContainerDied","Data":"3770e00f6d3abdce2f55e0631613b70245535bcf686484010b33859836a72d81"} Jun 14 13:42:03.132867 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:03.132785 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7f7b87855f-xfnvr" podStartSLOduration=2.214525361 podStartE2EDuration="7.132767978s" totalImagesPullingTime="4.918242617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:41:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:42:03.132256928 +0000 UTC m=+555.805524912" watchObservedRunningTime="2026-06-14 13:42:03.132767978 +0000 UTC m=+555.806035926" Jun 14 13:42:03.153350 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:03.153095 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-t6l8h" podStartSLOduration=2.4901905060000002 podStartE2EDuration="7.1530742s" totalImagesPullingTime="4.662883694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:41:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:42:03.15041188 +0000 UTC m=+555.823679825" watchObservedRunningTime="2026-06-14 13:42:03.1530742 +0000 UTC m=+555.826342146" Jun 14 13:42:03.224408 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:03.224350 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-b9q9g" podStartSLOduration=1.475306986 podStartE2EDuration="6.224328s" totalImagesPullingTime="4.749021014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:41:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:42:03.223560857 +0000 UTC m=+555.896828802" watchObservedRunningTime="2026-06-14 13:42:03.224328 +0000 UTC m=+555.897595947" Jun 14 13:42:04.126307 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:04.126274 2557 generic.go:356] "Generic (PLEG): container finished" podID="c96e7414-901e-43a9-85ca-c7c842c1de6a" containerID="e2b74e6c6ed4f59e5926a7f46bf7e503edf2557d30d0bf067609745172068acd" exitCode=0 Jun 14 13:42:04.126742 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:04.126366 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sk8wj" event={"ID":"c96e7414-901e-43a9-85ca-c7c842c1de6a","Type":"ContainerDied","Data":"e2b74e6c6ed4f59e5926a7f46bf7e503edf2557d30d0bf067609745172068acd"} Jun 14 13:42:05.268761 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:05.268733 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sk8wj" Jun 14 13:42:05.378628 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:05.378592 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c96e7414-901e-43a9-85ca-c7c842c1de6a-util\") pod \"c96e7414-901e-43a9-85ca-c7c842c1de6a\" (UID: \"c96e7414-901e-43a9-85ca-c7c842c1de6a\") " Jun 14 13:42:05.378628 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:05.378629 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9g44\" (UniqueName: \"kubernetes.io/projected/c96e7414-901e-43a9-85ca-c7c842c1de6a-kube-api-access-z9g44\") pod \"c96e7414-901e-43a9-85ca-c7c842c1de6a\" (UID: \"c96e7414-901e-43a9-85ca-c7c842c1de6a\") " Jun 14 13:42:05.378870 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:05.378673 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c96e7414-901e-43a9-85ca-c7c842c1de6a-bundle\") pod \"c96e7414-901e-43a9-85ca-c7c842c1de6a\" (UID: \"c96e7414-901e-43a9-85ca-c7c842c1de6a\") " Jun 14 13:42:05.379553 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:05.379520 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c96e7414-901e-43a9-85ca-c7c842c1de6a-bundle" (OuterVolumeSpecName: "bundle") pod "c96e7414-901e-43a9-85ca-c7c842c1de6a" (UID: "c96e7414-901e-43a9-85ca-c7c842c1de6a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 13:42:05.380806 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:05.380783 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c96e7414-901e-43a9-85ca-c7c842c1de6a-kube-api-access-z9g44" (OuterVolumeSpecName: "kube-api-access-z9g44") pod "c96e7414-901e-43a9-85ca-c7c842c1de6a" (UID: "c96e7414-901e-43a9-85ca-c7c842c1de6a"). InnerVolumeSpecName "kube-api-access-z9g44". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 13:42:05.382721 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:05.382664 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c96e7414-901e-43a9-85ca-c7c842c1de6a-util" (OuterVolumeSpecName: "util") pod "c96e7414-901e-43a9-85ca-c7c842c1de6a" (UID: "c96e7414-901e-43a9-85ca-c7c842c1de6a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 13:42:05.480408 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:05.480372 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c96e7414-901e-43a9-85ca-c7c842c1de6a-util\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:42:05.480408 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:05.480402 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9g44\" (UniqueName: \"kubernetes.io/projected/c96e7414-901e-43a9-85ca-c7c842c1de6a-kube-api-access-z9g44\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:42:05.480408 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:05.480413 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c96e7414-901e-43a9-85ca-c7c842c1de6a-bundle\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:42:06.141570 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:06.141537 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sk8wj" event={"ID":"c96e7414-901e-43a9-85ca-c7c842c1de6a","Type":"ContainerDied","Data":"7e3b973de13ee6edb6bda3f0e49f250db9f9b2f3dc949593d66e97fe20bab60e"} Jun 14 13:42:06.141727 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:06.141584 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e3b973de13ee6edb6bda3f0e49f250db9f9b2f3dc949593d66e97fe20bab60e" Jun 14 13:42:06.141727 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:06.141551 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sk8wj" Jun 14 13:42:06.888569 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:06.888502 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:42:06.933309 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:06.933269 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-pvvpc"] Jun 14 13:42:06.933856 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:06.933831 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c96e7414-901e-43a9-85ca-c7c842c1de6a" containerName="pull" Jun 14 13:42:06.934023 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:06.934009 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c96e7414-901e-43a9-85ca-c7c842c1de6a" containerName="pull" Jun 14 13:42:06.934099 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:06.934084 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c96e7414-901e-43a9-85ca-c7c842c1de6a" containerName="extract" Jun 14 13:42:06.934099 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:06.934097 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c96e7414-901e-43a9-85ca-c7c842c1de6a" containerName="extract" Jun 14 13:42:06.934189 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:06.934111 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c96e7414-901e-43a9-85ca-c7c842c1de6a" containerName="util" Jun 14 13:42:06.934189 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:06.934120 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c96e7414-901e-43a9-85ca-c7c842c1de6a" containerName="util" Jun 14 13:42:06.934272 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:06.934245 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c96e7414-901e-43a9-85ca-c7c842c1de6a" containerName="extract" Jun 14 13:42:06.940904 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:06.940885 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-pvvpc" Jun 14 13:42:06.943652 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:06.943631 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 14 13:42:06.944728 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:06.944511 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-72lhq\"" Jun 14 13:42:06.946517 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:06.946496 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-gjkfc"] Jun 14 13:42:06.951134 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:06.951112 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-pvvpc"] Jun 14 13:42:06.951261 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:06.951221 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gjkfc" Jun 14 13:42:06.953705 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:06.953662 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 14 13:42:06.953813 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:06.953797 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-9p4zk\"" Jun 14 13:42:06.959834 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:06.959811 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-gjkfc"] Jun 14 13:42:06.966270 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:06.966179 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:42:07.096169 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:07.096132 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e50efa17-b71b-4dd7-b400-2987b066484c-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-gjkfc\" (UID: \"e50efa17-b71b-4dd7-b400-2987b066484c\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gjkfc" Jun 14 13:42:07.096169 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:07.096169 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq9q5\" (UniqueName: \"kubernetes.io/projected/e50efa17-b71b-4dd7-b400-2987b066484c-kube-api-access-pq9q5\") pod \"llmisvc-controller-manager-864bfd7bc9-gjkfc\" (UID: \"e50efa17-b71b-4dd7-b400-2987b066484c\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gjkfc" Jun 14 13:42:07.096425 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:07.096241 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pmfs\" (UniqueName: \"kubernetes.io/projected/5dcb78f0-4d50-48c5-9eaf-666f497af019-kube-api-access-8pmfs\") pod \"kserve-controller-manager-69fc866d76-pvvpc\" (UID: \"5dcb78f0-4d50-48c5-9eaf-666f497af019\") " pod="opendatahub/kserve-controller-manager-69fc866d76-pvvpc" Jun 14 13:42:07.096425 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:07.096281 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5dcb78f0-4d50-48c5-9eaf-666f497af019-cert\") pod \"kserve-controller-manager-69fc866d76-pvvpc\" (UID: \"5dcb78f0-4d50-48c5-9eaf-666f497af019\") " pod="opendatahub/kserve-controller-manager-69fc866d76-pvvpc" Jun 14 13:42:07.197558 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:07.197464 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5dcb78f0-4d50-48c5-9eaf-666f497af019-cert\") pod \"kserve-controller-manager-69fc866d76-pvvpc\" (UID: \"5dcb78f0-4d50-48c5-9eaf-666f497af019\") " pod="opendatahub/kserve-controller-manager-69fc866d76-pvvpc" Jun 14 13:42:07.197741 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:07.197587 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e50efa17-b71b-4dd7-b400-2987b066484c-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-gjkfc\" (UID: \"e50efa17-b71b-4dd7-b400-2987b066484c\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gjkfc" Jun 14 13:42:07.197741 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:07.197614 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq9q5\" (UniqueName: \"kubernetes.io/projected/e50efa17-b71b-4dd7-b400-2987b066484c-kube-api-access-pq9q5\") pod \"llmisvc-controller-manager-864bfd7bc9-gjkfc\" (UID: \"e50efa17-b71b-4dd7-b400-2987b066484c\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gjkfc" Jun 14 13:42:07.197741 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:42:07.197618 2557 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 14 13:42:07.197907 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:07.197661 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pmfs\" (UniqueName: \"kubernetes.io/projected/5dcb78f0-4d50-48c5-9eaf-666f497af019-kube-api-access-8pmfs\") pod \"kserve-controller-manager-69fc866d76-pvvpc\" (UID: \"5dcb78f0-4d50-48c5-9eaf-666f497af019\") " pod="opendatahub/kserve-controller-manager-69fc866d76-pvvpc" Jun 14 13:42:07.197907 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:42:07.197742 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dcb78f0-4d50-48c5-9eaf-666f497af019-cert podName:5dcb78f0-4d50-48c5-9eaf-666f497af019 nodeName:}" failed. No retries permitted until 2026-06-14 13:42:07.697724497 +0000 UTC m=+560.370992421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5dcb78f0-4d50-48c5-9eaf-666f497af019-cert") pod "kserve-controller-manager-69fc866d76-pvvpc" (UID: "5dcb78f0-4d50-48c5-9eaf-666f497af019") : secret "kserve-webhook-server-cert" not found Jun 14 13:42:07.197907 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:42:07.197658 2557 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 14 13:42:07.197907 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:42:07.197834 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e50efa17-b71b-4dd7-b400-2987b066484c-cert podName:e50efa17-b71b-4dd7-b400-2987b066484c nodeName:}" failed. No retries permitted until 2026-06-14 13:42:07.697812867 +0000 UTC m=+560.371080805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e50efa17-b71b-4dd7-b400-2987b066484c-cert") pod "llmisvc-controller-manager-864bfd7bc9-gjkfc" (UID: "e50efa17-b71b-4dd7-b400-2987b066484c") : secret "llmisvc-webhook-server-cert" not found Jun 14 13:42:07.208263 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:07.208240 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pmfs\" (UniqueName: \"kubernetes.io/projected/5dcb78f0-4d50-48c5-9eaf-666f497af019-kube-api-access-8pmfs\") pod \"kserve-controller-manager-69fc866d76-pvvpc\" (UID: \"5dcb78f0-4d50-48c5-9eaf-666f497af019\") " pod="opendatahub/kserve-controller-manager-69fc866d76-pvvpc" Jun 14 13:42:07.208762 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:07.208740 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq9q5\" (UniqueName: \"kubernetes.io/projected/e50efa17-b71b-4dd7-b400-2987b066484c-kube-api-access-pq9q5\") pod \"llmisvc-controller-manager-864bfd7bc9-gjkfc\" (UID: \"e50efa17-b71b-4dd7-b400-2987b066484c\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gjkfc" Jun 14 13:42:07.249819 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:07.249787 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:42:07.551256 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:07.551161 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:42:07.702046 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:07.702013 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e50efa17-b71b-4dd7-b400-2987b066484c-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-gjkfc\" (UID: \"e50efa17-b71b-4dd7-b400-2987b066484c\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gjkfc" Jun 14 13:42:07.702246 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:07.702063 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5dcb78f0-4d50-48c5-9eaf-666f497af019-cert\") pod \"kserve-controller-manager-69fc866d76-pvvpc\" (UID: \"5dcb78f0-4d50-48c5-9eaf-666f497af019\") " pod="opendatahub/kserve-controller-manager-69fc866d76-pvvpc" Jun 14 13:42:07.704503 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:07.704476 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5dcb78f0-4d50-48c5-9eaf-666f497af019-cert\") pod \"kserve-controller-manager-69fc866d76-pvvpc\" (UID: \"5dcb78f0-4d50-48c5-9eaf-666f497af019\") " pod="opendatahub/kserve-controller-manager-69fc866d76-pvvpc" Jun 14 13:42:07.704621 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:07.704515 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e50efa17-b71b-4dd7-b400-2987b066484c-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-gjkfc\" (UID: \"e50efa17-b71b-4dd7-b400-2987b066484c\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gjkfc" Jun 14 13:42:07.857335 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:07.857245 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-pvvpc" Jun 14 13:42:07.869306 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:07.869148 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gjkfc" Jun 14 13:42:08.022218 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:08.022177 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-pvvpc"] Jun 14 13:42:08.023558 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:42:08.023504 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dcb78f0_4d50_48c5_9eaf_666f497af019.slice/crio-875c0339cabc798f56a442e8d5ba2f8be46304fd85212e463e22f0a2ea85f6f5 WatchSource:0}: Error finding container 875c0339cabc798f56a442e8d5ba2f8be46304fd85212e463e22f0a2ea85f6f5: Status 404 returned error can't find the container with id 875c0339cabc798f56a442e8d5ba2f8be46304fd85212e463e22f0a2ea85f6f5 Jun 14 13:42:08.035413 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:08.035382 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-gjkfc"] Jun 14 13:42:08.036956 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:42:08.036936 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode50efa17_b71b_4dd7_b400_2987b066484c.slice/crio-1537f8b80022bda4dc2b046f2f20c42ccd1e972eb8c3146650058ff5265e274d WatchSource:0}: Error finding container 1537f8b80022bda4dc2b046f2f20c42ccd1e972eb8c3146650058ff5265e274d: Status 404 returned error can't find the container with id 1537f8b80022bda4dc2b046f2f20c42ccd1e972eb8c3146650058ff5265e274d Jun 14 13:42:08.147883 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:08.147846 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:42:08.155036 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:08.155008 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-pvvpc" event={"ID":"5dcb78f0-4d50-48c5-9eaf-666f497af019","Type":"ContainerStarted","Data":"875c0339cabc798f56a442e8d5ba2f8be46304fd85212e463e22f0a2ea85f6f5"} Jun 14 13:42:08.156354 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:08.156326 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gjkfc" event={"ID":"e50efa17-b71b-4dd7-b400-2987b066484c","Type":"ContainerStarted","Data":"1537f8b80022bda4dc2b046f2f20c42ccd1e972eb8c3146650058ff5265e274d"} Jun 14 13:42:08.259466 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:08.259435 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:42:11.690317 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:11.690293 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:42:11.784625 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:11.784592 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:42:12.181048 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:12.181008 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-pvvpc" event={"ID":"5dcb78f0-4d50-48c5-9eaf-666f497af019","Type":"ContainerStarted","Data":"b17f50c97d5d8d67e8babc11697e3a3a1ac5632543c49c89be3e1173faa263ab"} Jun 14 13:42:12.181229 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:12.181080 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-pvvpc" Jun 14 13:42:12.182514 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:12.182488 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gjkfc" event={"ID":"e50efa17-b71b-4dd7-b400-2987b066484c","Type":"ContainerStarted","Data":"f91ade2f32f1a368344bad56c6cd5e3d013027895d4f68c424c675e83121f781"} Jun 14 13:42:12.182649 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:12.182543 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gjkfc" Jun 14 13:42:12.338748 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:12.338669 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-pvvpc" podStartSLOduration=2.78575399 podStartE2EDuration="6.33865339s" totalImagesPullingTime="3.5528994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:42:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:42:12.279608326 +0000 UTC m=+564.952876272" watchObservedRunningTime="2026-06-14 13:42:12.33865339 +0000 UTC m=+565.011921335" Jun 14 13:42:12.339809 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:12.339775 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gjkfc" podStartSLOduration=2.794379762 podStartE2EDuration="6.339762695s" totalImagesPullingTime="3.545382933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:42:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:42:12.337788956 +0000 UTC m=+565.011056923" watchObservedRunningTime="2026-06-14 13:42:12.339762695 +0000 UTC m=+565.013030640" Jun 14 13:42:12.852073 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:12.852041 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:42:12.898301 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:12.898269 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2xvt4"] Jun 14 13:42:12.942908 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:12.942879 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2xvt4"] Jun 14 13:42:12.943061 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:12.942981 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2xvt4" Jun 14 13:42:12.945971 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:12.945946 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-whkbn\"" Jun 14 13:42:12.946102 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:12.945977 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 13:42:12.946902 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:12.946880 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 13:42:13.052275 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:13.052240 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjprc\" (UniqueName: \"kubernetes.io/projected/8f834626-c0e6-45a2-bf70-09ebe4b99e9d-kube-api-access-xjprc\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2xvt4\" (UID: \"8f834626-c0e6-45a2-bf70-09ebe4b99e9d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2xvt4" Jun 14 13:42:13.052455 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:13.052286 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f834626-c0e6-45a2-bf70-09ebe4b99e9d-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2xvt4\" (UID: \"8f834626-c0e6-45a2-bf70-09ebe4b99e9d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2xvt4" Jun 14 13:42:13.052455 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:13.052346 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f834626-c0e6-45a2-bf70-09ebe4b99e9d-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2xvt4\" (UID: \"8f834626-c0e6-45a2-bf70-09ebe4b99e9d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2xvt4" Jun 14 13:42:13.153581 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:13.153547 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f834626-c0e6-45a2-bf70-09ebe4b99e9d-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2xvt4\" (UID: \"8f834626-c0e6-45a2-bf70-09ebe4b99e9d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2xvt4" Jun 14 13:42:13.153780 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:13.153606 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f834626-c0e6-45a2-bf70-09ebe4b99e9d-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2xvt4\" (UID: \"8f834626-c0e6-45a2-bf70-09ebe4b99e9d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2xvt4" Jun 14 13:42:13.153780 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:13.153712 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjprc\" (UniqueName: \"kubernetes.io/projected/8f834626-c0e6-45a2-bf70-09ebe4b99e9d-kube-api-access-xjprc\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2xvt4\" (UID: \"8f834626-c0e6-45a2-bf70-09ebe4b99e9d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2xvt4" Jun 14 13:42:13.154037 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:13.154015 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f834626-c0e6-45a2-bf70-09ebe4b99e9d-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2xvt4\" (UID: \"8f834626-c0e6-45a2-bf70-09ebe4b99e9d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2xvt4" Jun 14 13:42:13.154087 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:13.154067 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f834626-c0e6-45a2-bf70-09ebe4b99e9d-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2xvt4\" (UID: \"8f834626-c0e6-45a2-bf70-09ebe4b99e9d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2xvt4" Jun 14 13:42:13.166377 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:13.166348 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjprc\" (UniqueName: \"kubernetes.io/projected/8f834626-c0e6-45a2-bf70-09ebe4b99e9d-kube-api-access-xjprc\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2xvt4\" (UID: \"8f834626-c0e6-45a2-bf70-09ebe4b99e9d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2xvt4" Jun 14 13:42:13.254543 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:13.254503 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2xvt4" Jun 14 13:42:13.429820 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:13.429788 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2xvt4"] Jun 14 13:42:13.431254 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:42:13.431227 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f834626_c0e6_45a2_bf70_09ebe4b99e9d.slice/crio-256b13673d47df7be66c1903042f3d53f007cd93a243c3b191b14753e214a6a9 WatchSource:0}: Error finding container 256b13673d47df7be66c1903042f3d53f007cd93a243c3b191b14753e214a6a9: Status 404 returned error can't find the container with id 256b13673d47df7be66c1903042f3d53f007cd93a243c3b191b14753e214a6a9 Jun 14 13:42:13.544282 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:13.544244 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:42:13.644183 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:13.644149 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:42:14.129222 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:14.129194 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-t6l8h" Jun 14 13:42:14.131160 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:14.131134 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-b9q9g" Jun 14 13:42:14.194138 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:14.194098 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:42:14.195642 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:14.195612 2557 generic.go:356] "Generic (PLEG): container finished" podID="8f834626-c0e6-45a2-bf70-09ebe4b99e9d" containerID="0fea38e1b1eb5638c3998f4f5f6b23408914e10481416ed7e9515fc99d3d05a9" exitCode=0 Jun 14 13:42:14.196077 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:14.195651 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2xvt4" event={"ID":"8f834626-c0e6-45a2-bf70-09ebe4b99e9d","Type":"ContainerDied","Data":"0fea38e1b1eb5638c3998f4f5f6b23408914e10481416ed7e9515fc99d3d05a9"} Jun 14 13:42:14.196077 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:14.195732 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2xvt4" event={"ID":"8f834626-c0e6-45a2-bf70-09ebe4b99e9d","Type":"ContainerStarted","Data":"256b13673d47df7be66c1903042f3d53f007cd93a243c3b191b14753e214a6a9"} Jun 14 13:42:14.343586 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:14.343552 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-qz494"] Jun 14 13:42:14.374097 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:14.374069 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-qz494"] Jun 14 13:42:14.374243 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:14.374190 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-qz494" Jun 14 13:42:14.377025 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:14.376993 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 14 13:42:14.377179 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:14.377062 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 14 13:42:14.377179 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:14.377167 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-rpl8c\"" Jun 14 13:42:14.467960 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:14.467921 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2w7p\" (UniqueName: \"kubernetes.io/projected/8a3b3513-efbc-4410-afe5-279b435e75ff-kube-api-access-k2w7p\") pod \"servicemesh-operator3-57f65f65fb-qz494\" (UID: \"8a3b3513-efbc-4410-afe5-279b435e75ff\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-qz494" Jun 14 13:42:14.468115 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:14.468061 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/8a3b3513-efbc-4410-afe5-279b435e75ff-operator-config\") pod \"servicemesh-operator3-57f65f65fb-qz494\" (UID: \"8a3b3513-efbc-4410-afe5-279b435e75ff\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-qz494" Jun 14 13:42:14.569103 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:14.569068 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/8a3b3513-efbc-4410-afe5-279b435e75ff-operator-config\") pod \"servicemesh-operator3-57f65f65fb-qz494\" (UID: \"8a3b3513-efbc-4410-afe5-279b435e75ff\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-qz494" Jun 14 13:42:14.569273 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:14.569115 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2w7p\" (UniqueName: \"kubernetes.io/projected/8a3b3513-efbc-4410-afe5-279b435e75ff-kube-api-access-k2w7p\") pod \"servicemesh-operator3-57f65f65fb-qz494\" (UID: \"8a3b3513-efbc-4410-afe5-279b435e75ff\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-qz494" Jun 14 13:42:14.571560 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:14.571529 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/8a3b3513-efbc-4410-afe5-279b435e75ff-operator-config\") pod \"servicemesh-operator3-57f65f65fb-qz494\" (UID: \"8a3b3513-efbc-4410-afe5-279b435e75ff\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-qz494" Jun 14 13:42:14.578232 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:14.578196 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2w7p\" (UniqueName: \"kubernetes.io/projected/8a3b3513-efbc-4410-afe5-279b435e75ff-kube-api-access-k2w7p\") pod \"servicemesh-operator3-57f65f65fb-qz494\" (UID: \"8a3b3513-efbc-4410-afe5-279b435e75ff\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-qz494" Jun 14 13:42:14.683768 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:14.683674 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-qz494" Jun 14 13:42:14.833105 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:14.833083 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-qz494"] Jun 14 13:42:14.836234 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:42:14.836207 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a3b3513_efbc_4410_afe5_279b435e75ff.slice/crio-8ebf14aab3680270f24d4b8e6598ba0570a3e9676ad4bddb8e7a3bc281990895 WatchSource:0}: Error finding container 8ebf14aab3680270f24d4b8e6598ba0570a3e9676ad4bddb8e7a3bc281990895: Status 404 returned error can't find the container with id 8ebf14aab3680270f24d4b8e6598ba0570a3e9676ad4bddb8e7a3bc281990895 Jun 14 13:42:15.206452 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:15.206418 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-qz494" event={"ID":"8a3b3513-efbc-4410-afe5-279b435e75ff","Type":"ContainerStarted","Data":"8ebf14aab3680270f24d4b8e6598ba0570a3e9676ad4bddb8e7a3bc281990895"} Jun 14 13:42:16.216128 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:16.216087 2557 generic.go:356] "Generic (PLEG): container finished" podID="8f834626-c0e6-45a2-bf70-09ebe4b99e9d" containerID="efe193aa1579bbc6d8bea98c9201f01a4a9c639f4a8cbe4e6e2ca75bcfd27130" exitCode=0 Jun 14 13:42:16.216586 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:16.216133 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2xvt4" event={"ID":"8f834626-c0e6-45a2-bf70-09ebe4b99e9d","Type":"ContainerDied","Data":"efe193aa1579bbc6d8bea98c9201f01a4a9c639f4a8cbe4e6e2ca75bcfd27130"} Jun 14 13:42:17.225318 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:17.225282 2557 generic.go:356] "Generic (PLEG): container finished" podID="8f834626-c0e6-45a2-bf70-09ebe4b99e9d" containerID="5ecbcb33988ab3cff720edb773b722fd2c7572899b769e9f03c8ee9347396316" exitCode=0 Jun 14 13:42:17.225778 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:17.225369 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2xvt4" event={"ID":"8f834626-c0e6-45a2-bf70-09ebe4b99e9d","Type":"ContainerDied","Data":"5ecbcb33988ab3cff720edb773b722fd2c7572899b769e9f03c8ee9347396316"} Jun 14 13:42:18.232634 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:18.232585 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-qz494" event={"ID":"8a3b3513-efbc-4410-afe5-279b435e75ff","Type":"ContainerStarted","Data":"1f74d8da3c254af8783e4d9b4e634e1a61115ad5ea4d32885dcf414868487288"} Jun 14 13:42:18.233130 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:18.232656 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-qz494" Jun 14 13:42:18.258662 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:18.258610 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-qz494" podStartSLOduration=1.641218883 podStartE2EDuration="4.258591991s" totalImagesPullingTime="2.617373108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:42:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:42:18.256123559 +0000 UTC m=+570.929391506" watchObservedRunningTime="2026-06-14 13:42:18.258591991 +0000 UTC m=+570.931859928" Jun 14 13:42:18.370344 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:18.370317 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2xvt4" Jun 14 13:42:18.406987 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:18.406953 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f834626-c0e6-45a2-bf70-09ebe4b99e9d-util\") pod \"8f834626-c0e6-45a2-bf70-09ebe4b99e9d\" (UID: \"8f834626-c0e6-45a2-bf70-09ebe4b99e9d\") " Jun 14 13:42:18.407155 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:18.407040 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjprc\" (UniqueName: \"kubernetes.io/projected/8f834626-c0e6-45a2-bf70-09ebe4b99e9d-kube-api-access-xjprc\") pod \"8f834626-c0e6-45a2-bf70-09ebe4b99e9d\" (UID: \"8f834626-c0e6-45a2-bf70-09ebe4b99e9d\") " Jun 14 13:42:18.407155 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:18.407100 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f834626-c0e6-45a2-bf70-09ebe4b99e9d-bundle\") pod \"8f834626-c0e6-45a2-bf70-09ebe4b99e9d\" (UID: \"8f834626-c0e6-45a2-bf70-09ebe4b99e9d\") " Jun 14 13:42:18.408276 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:18.408226 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f834626-c0e6-45a2-bf70-09ebe4b99e9d-bundle" (OuterVolumeSpecName: "bundle") pod "8f834626-c0e6-45a2-bf70-09ebe4b99e9d" (UID: "8f834626-c0e6-45a2-bf70-09ebe4b99e9d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 13:42:18.409238 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:18.409215 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f834626-c0e6-45a2-bf70-09ebe4b99e9d-kube-api-access-xjprc" (OuterVolumeSpecName: "kube-api-access-xjprc") pod "8f834626-c0e6-45a2-bf70-09ebe4b99e9d" (UID: "8f834626-c0e6-45a2-bf70-09ebe4b99e9d"). InnerVolumeSpecName "kube-api-access-xjprc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 13:42:18.412292 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:18.412268 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f834626-c0e6-45a2-bf70-09ebe4b99e9d-util" (OuterVolumeSpecName: "util") pod "8f834626-c0e6-45a2-bf70-09ebe4b99e9d" (UID: "8f834626-c0e6-45a2-bf70-09ebe4b99e9d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 13:42:18.507935 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:18.507862 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjprc\" (UniqueName: \"kubernetes.io/projected/8f834626-c0e6-45a2-bf70-09ebe4b99e9d-kube-api-access-xjprc\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:42:18.507935 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:18.507888 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f834626-c0e6-45a2-bf70-09ebe4b99e9d-bundle\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:42:18.507935 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:18.507897 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f834626-c0e6-45a2-bf70-09ebe4b99e9d-util\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:42:19.239191 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:19.239158 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2xvt4" Jun 14 13:42:19.239547 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:19.239193 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2xvt4" event={"ID":"8f834626-c0e6-45a2-bf70-09ebe4b99e9d","Type":"ContainerDied","Data":"256b13673d47df7be66c1903042f3d53f007cd93a243c3b191b14753e214a6a9"} Jun 14 13:42:19.239547 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:19.239239 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="256b13673d47df7be66c1903042f3d53f007cd93a243c3b191b14753e214a6a9" Jun 14 13:42:24.461931 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:24.461889 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:42:24.559450 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:24.559419 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:42:26.754093 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:26.754061 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-765bd5bf78-fdxg4"] Jun 14 13:42:26.754674 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:26.754655 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f834626-c0e6-45a2-bf70-09ebe4b99e9d" containerName="pull" Jun 14 13:42:26.754674 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:26.754695 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f834626-c0e6-45a2-bf70-09ebe4b99e9d" containerName="pull" Jun 14 13:42:26.754793 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:26.754718 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f834626-c0e6-45a2-bf70-09ebe4b99e9d" containerName="util" Jun 14 13:42:26.754793 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:26.754727 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f834626-c0e6-45a2-bf70-09ebe4b99e9d" containerName="util" Jun 14 13:42:26.754793 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:26.754738 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f834626-c0e6-45a2-bf70-09ebe4b99e9d" containerName="extract" Jun 14 13:42:26.754793 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:26.754750 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f834626-c0e6-45a2-bf70-09ebe4b99e9d" containerName="extract" Jun 14 13:42:26.754924 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:26.754892 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f834626-c0e6-45a2-bf70-09ebe4b99e9d" containerName="extract" Jun 14 13:42:26.759858 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:26.759836 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-765bd5bf78-fdxg4" Jun 14 13:42:26.764799 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:26.764778 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jw2qz\"" Jun 14 13:42:26.765410 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:26.765388 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 14 13:42:26.768973 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:26.768947 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-765bd5bf78-fdxg4"] Jun 14 13:42:26.803867 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:26.803842 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:42:26.878912 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:26.878875 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls457\" (UniqueName: \"kubernetes.io/projected/3f9d0f1a-4449-4aa0-b525-1751a0045b89-kube-api-access-ls457\") pod \"dashboard-redirect-765bd5bf78-fdxg4\" (UID: \"3f9d0f1a-4449-4aa0-b525-1751a0045b89\") " pod="opendatahub/dashboard-redirect-765bd5bf78-fdxg4" Jun 14 13:42:26.879091 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:26.878959 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3f9d0f1a-4449-4aa0-b525-1751a0045b89-redirect-config\") pod \"dashboard-redirect-765bd5bf78-fdxg4\" (UID: \"3f9d0f1a-4449-4aa0-b525-1751a0045b89\") " pod="opendatahub/dashboard-redirect-765bd5bf78-fdxg4" Jun 14 13:42:26.979723 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:26.979667 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3f9d0f1a-4449-4aa0-b525-1751a0045b89-redirect-config\") pod \"dashboard-redirect-765bd5bf78-fdxg4\" (UID: \"3f9d0f1a-4449-4aa0-b525-1751a0045b89\") " pod="opendatahub/dashboard-redirect-765bd5bf78-fdxg4" Jun 14 13:42:26.979896 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:26.979784 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls457\" (UniqueName: \"kubernetes.io/projected/3f9d0f1a-4449-4aa0-b525-1751a0045b89-kube-api-access-ls457\") pod \"dashboard-redirect-765bd5bf78-fdxg4\" (UID: \"3f9d0f1a-4449-4aa0-b525-1751a0045b89\") " pod="opendatahub/dashboard-redirect-765bd5bf78-fdxg4" Jun 14 13:42:26.980414 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:26.980395 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3f9d0f1a-4449-4aa0-b525-1751a0045b89-redirect-config\") pod \"dashboard-redirect-765bd5bf78-fdxg4\" (UID: \"3f9d0f1a-4449-4aa0-b525-1751a0045b89\") " pod="opendatahub/dashboard-redirect-765bd5bf78-fdxg4" Jun 14 13:42:26.989136 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:26.989102 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls457\" (UniqueName: \"kubernetes.io/projected/3f9d0f1a-4449-4aa0-b525-1751a0045b89-kube-api-access-ls457\") pod \"dashboard-redirect-765bd5bf78-fdxg4\" (UID: \"3f9d0f1a-4449-4aa0-b525-1751a0045b89\") " pod="opendatahub/dashboard-redirect-765bd5bf78-fdxg4" Jun 14 13:42:27.072071 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:27.071986 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-765bd5bf78-fdxg4" Jun 14 13:42:27.203207 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:27.203183 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-765bd5bf78-fdxg4"] Jun 14 13:42:27.205765 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:42:27.205737 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f9d0f1a_4449_4aa0_b525_1751a0045b89.slice/crio-24016829fdd278b515c85db061b116772518525a935e9b355770a48051c6fd9f WatchSource:0}: Error finding container 24016829fdd278b515c85db061b116772518525a935e9b355770a48051c6fd9f: Status 404 returned error can't find the container with id 24016829fdd278b515c85db061b116772518525a935e9b355770a48051c6fd9f Jun 14 13:42:27.284901 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:27.284860 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-765bd5bf78-fdxg4" event={"ID":"3f9d0f1a-4449-4aa0-b525-1751a0045b89","Type":"ContainerStarted","Data":"24016829fdd278b515c85db061b116772518525a935e9b355770a48051c6fd9f"} Jun 14 13:42:29.241188 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:29.241153 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-qz494" Jun 14 13:42:30.304739 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:30.304667 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-765bd5bf78-fdxg4" event={"ID":"3f9d0f1a-4449-4aa0-b525-1751a0045b89","Type":"ContainerStarted","Data":"561b0d874cf588eb2e7c79728eaad01b68d3290214ccf06e6ac37ee8b8535176"} Jun 14 13:42:30.330774 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:30.330725 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-765bd5bf78-fdxg4" podStartSLOduration=2.287551877 podStartE2EDuration="4.330710027s" totalImagesPullingTime="2.04315815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:42:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:42:30.32922794 +0000 UTC m=+583.002495883" watchObservedRunningTime="2026-06-14 13:42:30.330710027 +0000 UTC m=+583.003977973" Jun 14 13:42:43.189914 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:43.189885 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gjkfc" Jun 14 13:42:43.193253 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:43.193231 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-pvvpc" Jun 14 13:42:44.193115 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.193080 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:42:44.194326 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.194304 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-b5k8z"] Jun 14 13:42:44.198944 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.198927 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5k8z" Jun 14 13:42:44.201342 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.201318 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 14 13:42:44.201460 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.201353 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 14 13:42:44.201610 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.201591 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 14 13:42:44.201668 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.201657 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-sh8t5\"" Jun 14 13:42:44.201869 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.201859 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 14 13:42:44.206257 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.206235 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-b5k8z"] Jun 14 13:42:44.252120 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.252084 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:42:44.337000 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.336965 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d45a6ea3-3615-4cce-8f85-6c15bf98fc5e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-b5k8z\" (UID: \"d45a6ea3-3615-4cce-8f85-6c15bf98fc5e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5k8z" Jun 14 13:42:44.337168 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.337030 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d45a6ea3-3615-4cce-8f85-6c15bf98fc5e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-b5k8z\" (UID: \"d45a6ea3-3615-4cce-8f85-6c15bf98fc5e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5k8z" Jun 14 13:42:44.337168 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.337053 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6mv5\" (UniqueName: \"kubernetes.io/projected/d45a6ea3-3615-4cce-8f85-6c15bf98fc5e-kube-api-access-r6mv5\") pod \"istiod-openshift-gateway-75c67f8887-b5k8z\" (UID: \"d45a6ea3-3615-4cce-8f85-6c15bf98fc5e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5k8z" Jun 14 13:42:44.337168 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.337096 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d45a6ea3-3615-4cce-8f85-6c15bf98fc5e-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-b5k8z\" (UID: \"d45a6ea3-3615-4cce-8f85-6c15bf98fc5e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5k8z" Jun 14 13:42:44.337168 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.337113 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d45a6ea3-3615-4cce-8f85-6c15bf98fc5e-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-b5k8z\" (UID: \"d45a6ea3-3615-4cce-8f85-6c15bf98fc5e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5k8z" Jun 14 13:42:44.337168 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.337128 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d45a6ea3-3615-4cce-8f85-6c15bf98fc5e-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-b5k8z\" (UID: \"d45a6ea3-3615-4cce-8f85-6c15bf98fc5e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5k8z" Jun 14 13:42:44.337336 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.337191 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d45a6ea3-3615-4cce-8f85-6c15bf98fc5e-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-b5k8z\" (UID: \"d45a6ea3-3615-4cce-8f85-6c15bf98fc5e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5k8z" Jun 14 13:42:44.438119 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.438076 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d45a6ea3-3615-4cce-8f85-6c15bf98fc5e-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-b5k8z\" (UID: \"d45a6ea3-3615-4cce-8f85-6c15bf98fc5e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5k8z" Jun 14 13:42:44.438315 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.438133 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d45a6ea3-3615-4cce-8f85-6c15bf98fc5e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-b5k8z\" (UID: \"d45a6ea3-3615-4cce-8f85-6c15bf98fc5e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5k8z" Jun 14 13:42:44.438315 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.438186 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d45a6ea3-3615-4cce-8f85-6c15bf98fc5e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-b5k8z\" (UID: \"d45a6ea3-3615-4cce-8f85-6c15bf98fc5e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5k8z" Jun 14 13:42:44.438315 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.438204 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6mv5\" (UniqueName: \"kubernetes.io/projected/d45a6ea3-3615-4cce-8f85-6c15bf98fc5e-kube-api-access-r6mv5\") pod \"istiod-openshift-gateway-75c67f8887-b5k8z\" (UID: \"d45a6ea3-3615-4cce-8f85-6c15bf98fc5e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5k8z" Jun 14 13:42:44.438315 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.438246 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d45a6ea3-3615-4cce-8f85-6c15bf98fc5e-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-b5k8z\" (UID: \"d45a6ea3-3615-4cce-8f85-6c15bf98fc5e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5k8z" Jun 14 13:42:44.438315 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.438270 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d45a6ea3-3615-4cce-8f85-6c15bf98fc5e-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-b5k8z\" (UID: \"d45a6ea3-3615-4cce-8f85-6c15bf98fc5e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5k8z" Jun 14 13:42:44.438315 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.438286 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d45a6ea3-3615-4cce-8f85-6c15bf98fc5e-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-b5k8z\" (UID: \"d45a6ea3-3615-4cce-8f85-6c15bf98fc5e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5k8z" Jun 14 13:42:44.439151 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.439113 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d45a6ea3-3615-4cce-8f85-6c15bf98fc5e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-b5k8z\" (UID: \"d45a6ea3-3615-4cce-8f85-6c15bf98fc5e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5k8z" Jun 14 13:42:44.440604 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.440574 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d45a6ea3-3615-4cce-8f85-6c15bf98fc5e-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-b5k8z\" (UID: \"d45a6ea3-3615-4cce-8f85-6c15bf98fc5e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5k8z" Jun 14 13:42:44.440755 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.440626 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d45a6ea3-3615-4cce-8f85-6c15bf98fc5e-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-b5k8z\" (UID: \"d45a6ea3-3615-4cce-8f85-6c15bf98fc5e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5k8z" Jun 14 13:42:44.440914 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.440896 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d45a6ea3-3615-4cce-8f85-6c15bf98fc5e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-b5k8z\" (UID: \"d45a6ea3-3615-4cce-8f85-6c15bf98fc5e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5k8z" Jun 14 13:42:44.440974 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.440951 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d45a6ea3-3615-4cce-8f85-6c15bf98fc5e-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-b5k8z\" (UID: \"d45a6ea3-3615-4cce-8f85-6c15bf98fc5e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5k8z" Jun 14 13:42:44.447429 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.447376 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d45a6ea3-3615-4cce-8f85-6c15bf98fc5e-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-b5k8z\" (UID: \"d45a6ea3-3615-4cce-8f85-6c15bf98fc5e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5k8z" Jun 14 13:42:44.447814 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.447797 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6mv5\" (UniqueName: \"kubernetes.io/projected/d45a6ea3-3615-4cce-8f85-6c15bf98fc5e-kube-api-access-r6mv5\") pod \"istiod-openshift-gateway-75c67f8887-b5k8z\" (UID: \"d45a6ea3-3615-4cce-8f85-6c15bf98fc5e\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5k8z" Jun 14 13:42:44.509891 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.509857 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5k8z" Jun 14 13:42:44.657114 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.657083 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-b5k8z"] Jun 14 13:42:44.658497 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:42:44.658465 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd45a6ea3_3615_4cce_8f85_6c15bf98fc5e.slice/crio-f3e9801b0e6a08a53ccda0ce4fa446a031b1b0e54ad6adba605d88c0df729d72 WatchSource:0}: Error finding container f3e9801b0e6a08a53ccda0ce4fa446a031b1b0e54ad6adba605d88c0df729d72: Status 404 returned error can't find the container with id f3e9801b0e6a08a53ccda0ce4fa446a031b1b0e54ad6adba605d88c0df729d72 Jun 14 13:42:44.731421 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:44.731309 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:42:45.385332 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:45.385296 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5k8z" event={"ID":"d45a6ea3-3615-4cce-8f85-6c15bf98fc5e","Type":"ContainerStarted","Data":"f3e9801b0e6a08a53ccda0ce4fa446a031b1b0e54ad6adba605d88c0df729d72"} Jun 14 13:42:47.004162 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:47.004129 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 14 13:42:47.004409 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:47.004200 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 14 13:42:47.211955 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:47.211916 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:42:47.399473 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:47.399417 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5k8z" event={"ID":"d45a6ea3-3615-4cce-8f85-6c15bf98fc5e","Type":"ContainerStarted","Data":"77ec1645a2165a73637d3e663425add0b1b1234b0463915540a3def3ddec6629"} Jun 14 13:42:47.399701 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:47.399579 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5k8z" Jun 14 13:42:47.421985 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:47.421934 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5k8z" podStartSLOduration=1.079239855 podStartE2EDuration="3.421915587s" totalImagesPullingTime="2.342675732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:42:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:42:47.418820138 +0000 UTC m=+600.092088086" watchObservedRunningTime="2026-06-14 13:42:47.421915587 +0000 UTC m=+600.095183532" Jun 14 13:42:47.742075 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:47.741918 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-dwq9q_1fea963c-a8b6-4071-8071-3e7149ef98cd/console-operator/1.log" Jun 14 13:42:47.756753 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:47.742557 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-dwq9q_1fea963c-a8b6-4071-8071-3e7149ef98cd/console-operator/1.log" Jun 14 13:42:47.756753 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:47.746165 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqj5p_08819fe4-b654-44d1-9773-a007a6044ec2/ovn-acl-logging/0.log" Jun 14 13:42:47.756753 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:47.746837 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqj5p_08819fe4-b654-44d1-9773-a007a6044ec2/ovn-acl-logging/0.log" Jun 14 13:42:47.892089 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:47.891874 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:42:47.992584 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:47.992497 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:42:48.196073 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:48.196037 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:42:48.388906 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:48.388869 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:42:48.407882 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:48.407858 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-b5k8z" Jun 14 13:42:48.661950 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:48.661860 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:42:48.763452 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:48.763408 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:42:55.947223 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:55.947165 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:42:56.900292 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:56.900248 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:42:56.956559 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:56.956524 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:42:57.715120 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:57.715092 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:42:57.922894 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:42:57.922858 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:43:12.932096 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:12.932012 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr"] Jun 14 13:43:12.936527 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:12.936510 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr" Jun 14 13:43:12.940632 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:12.940597 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 14 13:43:12.940800 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:12.940633 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 14 13:43:12.940921 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:12.940899 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8cfvj\"" Jun 14 13:43:12.942560 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:12.942530 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr"] Jun 14 13:43:12.991910 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:12.991878 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07b7c58c-e6d1-48c8-b09d-76cb3edd79ca-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr\" (UID: \"07b7c58c-e6d1-48c8-b09d-76cb3edd79ca\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr" Jun 14 13:43:12.991910 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:12.991911 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s52df\" (UniqueName: \"kubernetes.io/projected/07b7c58c-e6d1-48c8-b09d-76cb3edd79ca-kube-api-access-s52df\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr\" (UID: \"07b7c58c-e6d1-48c8-b09d-76cb3edd79ca\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr" Jun 14 13:43:12.992128 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:12.991947 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07b7c58c-e6d1-48c8-b09d-76cb3edd79ca-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr\" (UID: \"07b7c58c-e6d1-48c8-b09d-76cb3edd79ca\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr" Jun 14 13:43:13.092466 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:13.092436 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07b7c58c-e6d1-48c8-b09d-76cb3edd79ca-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr\" (UID: \"07b7c58c-e6d1-48c8-b09d-76cb3edd79ca\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr" Jun 14 13:43:13.092648 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:13.092473 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s52df\" (UniqueName: \"kubernetes.io/projected/07b7c58c-e6d1-48c8-b09d-76cb3edd79ca-kube-api-access-s52df\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr\" (UID: \"07b7c58c-e6d1-48c8-b09d-76cb3edd79ca\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr" Jun 14 13:43:13.092648 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:13.092600 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07b7c58c-e6d1-48c8-b09d-76cb3edd79ca-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr\" (UID: \"07b7c58c-e6d1-48c8-b09d-76cb3edd79ca\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr" Jun 14 13:43:13.092868 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:13.092853 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07b7c58c-e6d1-48c8-b09d-76cb3edd79ca-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr\" (UID: \"07b7c58c-e6d1-48c8-b09d-76cb3edd79ca\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr" Jun 14 13:43:13.092958 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:13.092941 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07b7c58c-e6d1-48c8-b09d-76cb3edd79ca-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr\" (UID: \"07b7c58c-e6d1-48c8-b09d-76cb3edd79ca\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr" Jun 14 13:43:13.100333 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:13.100311 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s52df\" (UniqueName: \"kubernetes.io/projected/07b7c58c-e6d1-48c8-b09d-76cb3edd79ca-kube-api-access-s52df\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr\" (UID: \"07b7c58c-e6d1-48c8-b09d-76cb3edd79ca\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr" Jun 14 13:43:13.248760 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:13.248644 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr" Jun 14 13:43:13.383919 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:13.383891 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr"] Jun 14 13:43:13.385663 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:43:13.385639 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07b7c58c_e6d1_48c8_b09d_76cb3edd79ca.slice/crio-0ab7a1ab63e35e276ed24bd3d88d57dbd94bc7d311a0ae4d01b3f4ab7a39f17f WatchSource:0}: Error finding container 0ab7a1ab63e35e276ed24bd3d88d57dbd94bc7d311a0ae4d01b3f4ab7a39f17f: Status 404 returned error can't find the container with id 0ab7a1ab63e35e276ed24bd3d88d57dbd94bc7d311a0ae4d01b3f4ab7a39f17f Jun 14 13:43:13.524653 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:13.524579 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq"] Jun 14 13:43:13.528246 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:13.528230 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq" Jun 14 13:43:13.536109 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:13.536086 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq"] Jun 14 13:43:13.549611 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:13.549580 2557 generic.go:356] "Generic (PLEG): container finished" podID="07b7c58c-e6d1-48c8-b09d-76cb3edd79ca" containerID="92ddccf4a8d473aadf182d3c78e525618eb1f782e95e5c92b0c12a61157ec6b4" exitCode=0 Jun 14 13:43:13.549763 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:13.549624 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr" event={"ID":"07b7c58c-e6d1-48c8-b09d-76cb3edd79ca","Type":"ContainerDied","Data":"92ddccf4a8d473aadf182d3c78e525618eb1f782e95e5c92b0c12a61157ec6b4"} Jun 14 13:43:13.549763 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:13.549661 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr" event={"ID":"07b7c58c-e6d1-48c8-b09d-76cb3edd79ca","Type":"ContainerStarted","Data":"0ab7a1ab63e35e276ed24bd3d88d57dbd94bc7d311a0ae4d01b3f4ab7a39f17f"} Jun 14 13:43:13.597100 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:13.597062 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f93def8-28bf-46a9-b56e-c83fa29d56f2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq\" (UID: \"5f93def8-28bf-46a9-b56e-c83fa29d56f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq" Jun 14 13:43:13.597254 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:13.597106 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqp46\" (UniqueName: \"kubernetes.io/projected/5f93def8-28bf-46a9-b56e-c83fa29d56f2-kube-api-access-gqp46\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq\" (UID: \"5f93def8-28bf-46a9-b56e-c83fa29d56f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq" Jun 14 13:43:13.597254 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:13.597215 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f93def8-28bf-46a9-b56e-c83fa29d56f2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq\" (UID: \"5f93def8-28bf-46a9-b56e-c83fa29d56f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq" Jun 14 13:43:13.698051 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:13.698016 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f93def8-28bf-46a9-b56e-c83fa29d56f2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq\" (UID: \"5f93def8-28bf-46a9-b56e-c83fa29d56f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq" Jun 14 13:43:13.698229 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:13.698079 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f93def8-28bf-46a9-b56e-c83fa29d56f2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq\" (UID: \"5f93def8-28bf-46a9-b56e-c83fa29d56f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq" Jun 14 13:43:13.698229 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:13.698111 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqp46\" (UniqueName: \"kubernetes.io/projected/5f93def8-28bf-46a9-b56e-c83fa29d56f2-kube-api-access-gqp46\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq\" (UID: \"5f93def8-28bf-46a9-b56e-c83fa29d56f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq" Jun 14 13:43:13.698374 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:13.698355 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f93def8-28bf-46a9-b56e-c83fa29d56f2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq\" (UID: \"5f93def8-28bf-46a9-b56e-c83fa29d56f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq" Jun 14 13:43:13.698457 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:13.698439 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f93def8-28bf-46a9-b56e-c83fa29d56f2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq\" (UID: \"5f93def8-28bf-46a9-b56e-c83fa29d56f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq" Jun 14 13:43:13.706163 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:13.706142 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqp46\" (UniqueName: \"kubernetes.io/projected/5f93def8-28bf-46a9-b56e-c83fa29d56f2-kube-api-access-gqp46\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq\" (UID: \"5f93def8-28bf-46a9-b56e-c83fa29d56f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq" Jun 14 13:43:13.866029 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:13.865939 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq" Jun 14 13:43:13.928572 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:13.928540 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr"] Jun 14 13:43:13.933569 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:13.933547 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr" Jun 14 13:43:13.938268 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:13.938244 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr"] Jun 14 13:43:14.001308 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.001274 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6602eea-9856-483b-9eed-9627f36440a1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr\" (UID: \"b6602eea-9856-483b-9eed-9627f36440a1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr" Jun 14 13:43:14.001465 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.001403 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65mb8\" (UniqueName: \"kubernetes.io/projected/b6602eea-9856-483b-9eed-9627f36440a1-kube-api-access-65mb8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr\" (UID: \"b6602eea-9856-483b-9eed-9627f36440a1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr" Jun 14 13:43:14.001465 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.001451 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6602eea-9856-483b-9eed-9627f36440a1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr\" (UID: \"b6602eea-9856-483b-9eed-9627f36440a1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr" Jun 14 13:43:14.010142 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.010117 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq"] Jun 14 13:43:14.011496 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:43:14.011473 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f93def8_28bf_46a9_b56e_c83fa29d56f2.slice/crio-965618fad3f75b46bd5f800430b6a256e69c8f75aff7a8b288546000a9694bd4 WatchSource:0}: Error finding container 965618fad3f75b46bd5f800430b6a256e69c8f75aff7a8b288546000a9694bd4: Status 404 returned error can't find the container with id 965618fad3f75b46bd5f800430b6a256e69c8f75aff7a8b288546000a9694bd4 Jun 14 13:43:14.102796 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.102767 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65mb8\" (UniqueName: \"kubernetes.io/projected/b6602eea-9856-483b-9eed-9627f36440a1-kube-api-access-65mb8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr\" (UID: \"b6602eea-9856-483b-9eed-9627f36440a1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr" Jun 14 13:43:14.102972 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.102807 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6602eea-9856-483b-9eed-9627f36440a1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr\" (UID: \"b6602eea-9856-483b-9eed-9627f36440a1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr" Jun 14 13:43:14.102972 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.102868 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6602eea-9856-483b-9eed-9627f36440a1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr\" (UID: \"b6602eea-9856-483b-9eed-9627f36440a1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr" Jun 14 13:43:14.103278 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.103259 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6602eea-9856-483b-9eed-9627f36440a1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr\" (UID: \"b6602eea-9856-483b-9eed-9627f36440a1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr" Jun 14 13:43:14.103381 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.103334 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6602eea-9856-483b-9eed-9627f36440a1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr\" (UID: \"b6602eea-9856-483b-9eed-9627f36440a1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr" Jun 14 13:43:14.110662 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.110560 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65mb8\" (UniqueName: \"kubernetes.io/projected/b6602eea-9856-483b-9eed-9627f36440a1-kube-api-access-65mb8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr\" (UID: \"b6602eea-9856-483b-9eed-9627f36440a1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr" Jun 14 13:43:14.244984 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.244958 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr" Jun 14 13:43:14.331083 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.331052 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r"] Jun 14 13:43:14.344545 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.344516 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r"] Jun 14 13:43:14.344857 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.344784 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r" Jun 14 13:43:14.414280 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.413998 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6tq9\" (UniqueName: \"kubernetes.io/projected/524c838e-80d0-4f67-9ade-042a8a96bc21-kube-api-access-q6tq9\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r\" (UID: \"524c838e-80d0-4f67-9ade-042a8a96bc21\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r" Jun 14 13:43:14.414280 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.414074 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/524c838e-80d0-4f67-9ade-042a8a96bc21-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r\" (UID: \"524c838e-80d0-4f67-9ade-042a8a96bc21\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r" Jun 14 13:43:14.414280 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.414190 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/524c838e-80d0-4f67-9ade-042a8a96bc21-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r\" (UID: \"524c838e-80d0-4f67-9ade-042a8a96bc21\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r" Jun 14 13:43:14.416917 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.416802 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr"] Jun 14 13:43:14.422591 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:43:14.422565 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6602eea_9856_483b_9eed_9627f36440a1.slice/crio-b10943b986858f45692460b8f985fdaed485e873814b2257147dfeeac4d83f09 WatchSource:0}: Error finding container b10943b986858f45692460b8f985fdaed485e873814b2257147dfeeac4d83f09: Status 404 returned error can't find the container with id b10943b986858f45692460b8f985fdaed485e873814b2257147dfeeac4d83f09 Jun 14 13:43:14.515068 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.515021 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6tq9\" (UniqueName: \"kubernetes.io/projected/524c838e-80d0-4f67-9ade-042a8a96bc21-kube-api-access-q6tq9\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r\" (UID: \"524c838e-80d0-4f67-9ade-042a8a96bc21\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r" Jun 14 13:43:14.515241 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.515120 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/524c838e-80d0-4f67-9ade-042a8a96bc21-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r\" (UID: \"524c838e-80d0-4f67-9ade-042a8a96bc21\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r" Jun 14 13:43:14.515321 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.515258 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/524c838e-80d0-4f67-9ade-042a8a96bc21-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r\" (UID: \"524c838e-80d0-4f67-9ade-042a8a96bc21\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r" Jun 14 13:43:14.515542 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.515521 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/524c838e-80d0-4f67-9ade-042a8a96bc21-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r\" (UID: \"524c838e-80d0-4f67-9ade-042a8a96bc21\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r" Jun 14 13:43:14.515589 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.515554 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/524c838e-80d0-4f67-9ade-042a8a96bc21-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r\" (UID: \"524c838e-80d0-4f67-9ade-042a8a96bc21\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r" Jun 14 13:43:14.523422 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.523392 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6tq9\" (UniqueName: \"kubernetes.io/projected/524c838e-80d0-4f67-9ade-042a8a96bc21-kube-api-access-q6tq9\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r\" (UID: \"524c838e-80d0-4f67-9ade-042a8a96bc21\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r" Jun 14 13:43:14.557135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.557106 2557 generic.go:356] "Generic (PLEG): container finished" podID="b6602eea-9856-483b-9eed-9627f36440a1" containerID="c3d46af5b85b8baa77945fcad6f2b7f787958b28eaa40b34c864e37ef30be66d" exitCode=0 Jun 14 13:43:14.557268 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.557192 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr" event={"ID":"b6602eea-9856-483b-9eed-9627f36440a1","Type":"ContainerDied","Data":"c3d46af5b85b8baa77945fcad6f2b7f787958b28eaa40b34c864e37ef30be66d"} Jun 14 13:43:14.557268 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.557246 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr" event={"ID":"b6602eea-9856-483b-9eed-9627f36440a1","Type":"ContainerStarted","Data":"b10943b986858f45692460b8f985fdaed485e873814b2257147dfeeac4d83f09"} Jun 14 13:43:14.558725 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.558702 2557 generic.go:356] "Generic (PLEG): container finished" podID="5f93def8-28bf-46a9-b56e-c83fa29d56f2" containerID="7fb4b539c5eb1b70a07e2c3f1d565b4897e851b1e61de537f0ffc8f607655206" exitCode=0 Jun 14 13:43:14.558839 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.558791 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq" event={"ID":"5f93def8-28bf-46a9-b56e-c83fa29d56f2","Type":"ContainerDied","Data":"7fb4b539c5eb1b70a07e2c3f1d565b4897e851b1e61de537f0ffc8f607655206"} Jun 14 13:43:14.558894 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.558851 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq" event={"ID":"5f93def8-28bf-46a9-b56e-c83fa29d56f2","Type":"ContainerStarted","Data":"965618fad3f75b46bd5f800430b6a256e69c8f75aff7a8b288546000a9694bd4"} Jun 14 13:43:14.561052 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.560964 2557 generic.go:356] "Generic (PLEG): container finished" podID="07b7c58c-e6d1-48c8-b09d-76cb3edd79ca" containerID="e30aca431700b65e1067b2f6d21012883140f3395c420d9beb2dbe80f389c996" exitCode=0 Jun 14 13:43:14.561052 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.561015 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr" event={"ID":"07b7c58c-e6d1-48c8-b09d-76cb3edd79ca","Type":"ContainerDied","Data":"e30aca431700b65e1067b2f6d21012883140f3395c420d9beb2dbe80f389c996"} Jun 14 13:43:14.658739 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.658660 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r" Jun 14 13:43:14.792213 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:14.792184 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r"] Jun 14 13:43:14.793424 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:43:14.793395 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod524c838e_80d0_4f67_9ade_042a8a96bc21.slice/crio-b17f6a575494429936a3c715a86d93f69e3190fd3d5d94629ec6d718751696f5 WatchSource:0}: Error finding container b17f6a575494429936a3c715a86d93f69e3190fd3d5d94629ec6d718751696f5: Status 404 returned error can't find the container with id b17f6a575494429936a3c715a86d93f69e3190fd3d5d94629ec6d718751696f5 Jun 14 13:43:15.568699 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:15.568594 2557 generic.go:356] "Generic (PLEG): container finished" podID="07b7c58c-e6d1-48c8-b09d-76cb3edd79ca" containerID="9a15c7c48a891fbcf861abf087e9fac7f23a5863867b8a296cb58b6f56fccaa2" exitCode=0 Jun 14 13:43:15.568699 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:15.568660 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr" event={"ID":"07b7c58c-e6d1-48c8-b09d-76cb3edd79ca","Type":"ContainerDied","Data":"9a15c7c48a891fbcf861abf087e9fac7f23a5863867b8a296cb58b6f56fccaa2"} Jun 14 13:43:15.570129 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:15.570100 2557 generic.go:356] "Generic (PLEG): container finished" podID="524c838e-80d0-4f67-9ade-042a8a96bc21" containerID="8623ff06f3790843f1693ffd3aa467c1fe954da508365bd29177d2b9e155bed2" exitCode=0 Jun 14 13:43:15.570257 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:15.570180 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r" event={"ID":"524c838e-80d0-4f67-9ade-042a8a96bc21","Type":"ContainerDied","Data":"8623ff06f3790843f1693ffd3aa467c1fe954da508365bd29177d2b9e155bed2"} Jun 14 13:43:15.570257 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:15.570227 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r" event={"ID":"524c838e-80d0-4f67-9ade-042a8a96bc21","Type":"ContainerStarted","Data":"b17f6a575494429936a3c715a86d93f69e3190fd3d5d94629ec6d718751696f5"} Jun 14 13:43:15.571941 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:15.571919 2557 generic.go:356] "Generic (PLEG): container finished" podID="b6602eea-9856-483b-9eed-9627f36440a1" containerID="669d3cea5a7cafd53514eadadca68d6c8008d8ea8408fdffc349a9b85d338ce3" exitCode=0 Jun 14 13:43:15.572051 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:15.572000 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr" event={"ID":"b6602eea-9856-483b-9eed-9627f36440a1","Type":"ContainerDied","Data":"669d3cea5a7cafd53514eadadca68d6c8008d8ea8408fdffc349a9b85d338ce3"} Jun 14 13:43:15.574074 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:15.573920 2557 generic.go:356] "Generic (PLEG): container finished" podID="5f93def8-28bf-46a9-b56e-c83fa29d56f2" containerID="2f8826825dc674cf3e584875003bc2f8c58ae83714f9a71bc0c571b9f7032124" exitCode=0 Jun 14 13:43:15.574074 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:15.573944 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq" event={"ID":"5f93def8-28bf-46a9-b56e-c83fa29d56f2","Type":"ContainerDied","Data":"2f8826825dc674cf3e584875003bc2f8c58ae83714f9a71bc0c571b9f7032124"} Jun 14 13:43:16.513010 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:16.512915 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:43:16.566417 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:16.566378 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:43:16.582020 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:16.581989 2557 generic.go:356] "Generic (PLEG): container finished" podID="b6602eea-9856-483b-9eed-9627f36440a1" containerID="8c34157bde9b08bc5081d26a10f8a1664a599cd6dc7d9243ce2b51a43d28dbe3" exitCode=0 Jun 14 13:43:16.582447 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:16.582068 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr" event={"ID":"b6602eea-9856-483b-9eed-9627f36440a1","Type":"ContainerDied","Data":"8c34157bde9b08bc5081d26a10f8a1664a599cd6dc7d9243ce2b51a43d28dbe3"} Jun 14 13:43:16.584177 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:16.584153 2557 generic.go:356] "Generic (PLEG): container finished" podID="5f93def8-28bf-46a9-b56e-c83fa29d56f2" containerID="4aa3949db6b18046c9d9a0343c7a18114a740c749d20f48026d067d0869b2870" exitCode=0 Jun 14 13:43:16.584279 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:16.584234 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq" event={"ID":"5f93def8-28bf-46a9-b56e-c83fa29d56f2","Type":"ContainerDied","Data":"4aa3949db6b18046c9d9a0343c7a18114a740c749d20f48026d067d0869b2870"} Jun 14 13:43:16.586075 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:16.586054 2557 generic.go:356] "Generic (PLEG): container finished" podID="524c838e-80d0-4f67-9ade-042a8a96bc21" containerID="ad88c6c23bd14793652a81b613963cf5b57ba6c709108de50d47e068189a48b0" exitCode=0 Jun 14 13:43:16.586159 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:16.586109 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r" event={"ID":"524c838e-80d0-4f67-9ade-042a8a96bc21","Type":"ContainerDied","Data":"ad88c6c23bd14793652a81b613963cf5b57ba6c709108de50d47e068189a48b0"} Jun 14 13:43:16.723261 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:16.723238 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr" Jun 14 13:43:16.835460 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:16.835371 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07b7c58c-e6d1-48c8-b09d-76cb3edd79ca-bundle\") pod \"07b7c58c-e6d1-48c8-b09d-76cb3edd79ca\" (UID: \"07b7c58c-e6d1-48c8-b09d-76cb3edd79ca\") " Jun 14 13:43:16.835460 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:16.835440 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s52df\" (UniqueName: \"kubernetes.io/projected/07b7c58c-e6d1-48c8-b09d-76cb3edd79ca-kube-api-access-s52df\") pod \"07b7c58c-e6d1-48c8-b09d-76cb3edd79ca\" (UID: \"07b7c58c-e6d1-48c8-b09d-76cb3edd79ca\") " Jun 14 13:43:16.835670 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:16.835476 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07b7c58c-e6d1-48c8-b09d-76cb3edd79ca-util\") pod \"07b7c58c-e6d1-48c8-b09d-76cb3edd79ca\" (UID: \"07b7c58c-e6d1-48c8-b09d-76cb3edd79ca\") " Jun 14 13:43:16.835998 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:16.835968 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07b7c58c-e6d1-48c8-b09d-76cb3edd79ca-bundle" (OuterVolumeSpecName: "bundle") pod "07b7c58c-e6d1-48c8-b09d-76cb3edd79ca" (UID: "07b7c58c-e6d1-48c8-b09d-76cb3edd79ca"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 13:43:16.837812 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:16.837788 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07b7c58c-e6d1-48c8-b09d-76cb3edd79ca-kube-api-access-s52df" (OuterVolumeSpecName: "kube-api-access-s52df") pod "07b7c58c-e6d1-48c8-b09d-76cb3edd79ca" (UID: "07b7c58c-e6d1-48c8-b09d-76cb3edd79ca"). InnerVolumeSpecName "kube-api-access-s52df". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 13:43:16.841136 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:16.841096 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07b7c58c-e6d1-48c8-b09d-76cb3edd79ca-util" (OuterVolumeSpecName: "util") pod "07b7c58c-e6d1-48c8-b09d-76cb3edd79ca" (UID: "07b7c58c-e6d1-48c8-b09d-76cb3edd79ca"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 13:43:16.936940 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:16.936905 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s52df\" (UniqueName: \"kubernetes.io/projected/07b7c58c-e6d1-48c8-b09d-76cb3edd79ca-kube-api-access-s52df\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:43:16.936940 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:16.936936 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07b7c58c-e6d1-48c8-b09d-76cb3edd79ca-util\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:43:16.936940 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:16.936949 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07b7c58c-e6d1-48c8-b09d-76cb3edd79ca-bundle\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:43:16.955926 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:16.955901 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:43:17.009159 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:17.009113 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:43:17.593866 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:17.593833 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr" event={"ID":"07b7c58c-e6d1-48c8-b09d-76cb3edd79ca","Type":"ContainerDied","Data":"0ab7a1ab63e35e276ed24bd3d88d57dbd94bc7d311a0ae4d01b3f4ab7a39f17f"} Jun 14 13:43:17.594303 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:17.593907 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ab7a1ab63e35e276ed24bd3d88d57dbd94bc7d311a0ae4d01b3f4ab7a39f17f" Jun 14 13:43:17.594303 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:17.593841 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr" Jun 14 13:43:17.596040 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:17.596015 2557 generic.go:356] "Generic (PLEG): container finished" podID="524c838e-80d0-4f67-9ade-042a8a96bc21" containerID="89a24d79545dd89042df792f2354e895f7eb929117a86e1067925a2b52e67d3d" exitCode=0 Jun 14 13:43:17.596181 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:17.596101 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r" event={"ID":"524c838e-80d0-4f67-9ade-042a8a96bc21","Type":"ContainerDied","Data":"89a24d79545dd89042df792f2354e895f7eb929117a86e1067925a2b52e67d3d"} Jun 14 13:43:17.738929 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:17.738901 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq" Jun 14 13:43:17.773246 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:17.773182 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr" Jun 14 13:43:17.847164 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:17.847078 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6602eea-9856-483b-9eed-9627f36440a1-util\") pod \"b6602eea-9856-483b-9eed-9627f36440a1\" (UID: \"b6602eea-9856-483b-9eed-9627f36440a1\") " Jun 14 13:43:17.847315 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:17.847171 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f93def8-28bf-46a9-b56e-c83fa29d56f2-util\") pod \"5f93def8-28bf-46a9-b56e-c83fa29d56f2\" (UID: \"5f93def8-28bf-46a9-b56e-c83fa29d56f2\") " Jun 14 13:43:17.847315 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:17.847198 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6602eea-9856-483b-9eed-9627f36440a1-bundle\") pod \"b6602eea-9856-483b-9eed-9627f36440a1\" (UID: \"b6602eea-9856-483b-9eed-9627f36440a1\") " Jun 14 13:43:17.847315 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:17.847232 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f93def8-28bf-46a9-b56e-c83fa29d56f2-bundle\") pod \"5f93def8-28bf-46a9-b56e-c83fa29d56f2\" (UID: \"5f93def8-28bf-46a9-b56e-c83fa29d56f2\") " Jun 14 13:43:17.847315 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:17.847277 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqp46\" (UniqueName: \"kubernetes.io/projected/5f93def8-28bf-46a9-b56e-c83fa29d56f2-kube-api-access-gqp46\") pod \"5f93def8-28bf-46a9-b56e-c83fa29d56f2\" (UID: \"5f93def8-28bf-46a9-b56e-c83fa29d56f2\") " Jun 14 13:43:17.847315 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:17.847300 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65mb8\" (UniqueName: \"kubernetes.io/projected/b6602eea-9856-483b-9eed-9627f36440a1-kube-api-access-65mb8\") pod \"b6602eea-9856-483b-9eed-9627f36440a1\" (UID: \"b6602eea-9856-483b-9eed-9627f36440a1\") " Jun 14 13:43:17.847828 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:17.847767 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f93def8-28bf-46a9-b56e-c83fa29d56f2-bundle" (OuterVolumeSpecName: "bundle") pod "5f93def8-28bf-46a9-b56e-c83fa29d56f2" (UID: "5f93def8-28bf-46a9-b56e-c83fa29d56f2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 13:43:17.848181 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:17.848148 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f93def8-28bf-46a9-b56e-c83fa29d56f2-bundle\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:43:17.848700 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:17.848657 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6602eea-9856-483b-9eed-9627f36440a1-bundle" (OuterVolumeSpecName: "bundle") pod "b6602eea-9856-483b-9eed-9627f36440a1" (UID: "b6602eea-9856-483b-9eed-9627f36440a1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 13:43:17.849605 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:17.849583 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6602eea-9856-483b-9eed-9627f36440a1-kube-api-access-65mb8" (OuterVolumeSpecName: "kube-api-access-65mb8") pod "b6602eea-9856-483b-9eed-9627f36440a1" (UID: "b6602eea-9856-483b-9eed-9627f36440a1"). InnerVolumeSpecName "kube-api-access-65mb8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 13:43:17.850204 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:17.850188 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f93def8-28bf-46a9-b56e-c83fa29d56f2-kube-api-access-gqp46" (OuterVolumeSpecName: "kube-api-access-gqp46") pod "5f93def8-28bf-46a9-b56e-c83fa29d56f2" (UID: "5f93def8-28bf-46a9-b56e-c83fa29d56f2"). InnerVolumeSpecName "kube-api-access-gqp46". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 13:43:17.852731 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:17.852692 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6602eea-9856-483b-9eed-9627f36440a1-util" (OuterVolumeSpecName: "util") pod "b6602eea-9856-483b-9eed-9627f36440a1" (UID: "b6602eea-9856-483b-9eed-9627f36440a1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 13:43:17.853843 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:17.853823 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f93def8-28bf-46a9-b56e-c83fa29d56f2-util" (OuterVolumeSpecName: "util") pod "5f93def8-28bf-46a9-b56e-c83fa29d56f2" (UID: "5f93def8-28bf-46a9-b56e-c83fa29d56f2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 13:43:17.949236 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:17.949202 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6602eea-9856-483b-9eed-9627f36440a1-util\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:43:17.949236 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:17.949227 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f93def8-28bf-46a9-b56e-c83fa29d56f2-util\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:43:17.949236 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:17.949239 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6602eea-9856-483b-9eed-9627f36440a1-bundle\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:43:17.949455 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:17.949253 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqp46\" (UniqueName: \"kubernetes.io/projected/5f93def8-28bf-46a9-b56e-c83fa29d56f2-kube-api-access-gqp46\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:43:17.949455 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:17.949263 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65mb8\" (UniqueName: \"kubernetes.io/projected/b6602eea-9856-483b-9eed-9627f36440a1-kube-api-access-65mb8\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:43:18.603881 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:18.603849 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr" Jun 14 13:43:18.604289 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:18.603847 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr" event={"ID":"b6602eea-9856-483b-9eed-9627f36440a1","Type":"ContainerDied","Data":"b10943b986858f45692460b8f985fdaed485e873814b2257147dfeeac4d83f09"} Jun 14 13:43:18.604289 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:18.603980 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b10943b986858f45692460b8f985fdaed485e873814b2257147dfeeac4d83f09" Jun 14 13:43:18.605577 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:18.605553 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq" Jun 14 13:43:18.605737 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:18.605586 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq" event={"ID":"5f93def8-28bf-46a9-b56e-c83fa29d56f2","Type":"ContainerDied","Data":"965618fad3f75b46bd5f800430b6a256e69c8f75aff7a8b288546000a9694bd4"} Jun 14 13:43:18.605737 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:18.605635 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="965618fad3f75b46bd5f800430b6a256e69c8f75aff7a8b288546000a9694bd4" Jun 14 13:43:18.656512 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:18.656480 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:43:18.709764 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:18.709690 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:43:18.737155 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:18.737133 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r" Jun 14 13:43:18.858113 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:18.858033 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6tq9\" (UniqueName: \"kubernetes.io/projected/524c838e-80d0-4f67-9ade-042a8a96bc21-kube-api-access-q6tq9\") pod \"524c838e-80d0-4f67-9ade-042a8a96bc21\" (UID: \"524c838e-80d0-4f67-9ade-042a8a96bc21\") " Jun 14 13:43:18.858113 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:18.858097 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/524c838e-80d0-4f67-9ade-042a8a96bc21-util\") pod \"524c838e-80d0-4f67-9ade-042a8a96bc21\" (UID: \"524c838e-80d0-4f67-9ade-042a8a96bc21\") " Jun 14 13:43:18.858354 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:18.858121 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/524c838e-80d0-4f67-9ade-042a8a96bc21-bundle\") pod \"524c838e-80d0-4f67-9ade-042a8a96bc21\" (UID: \"524c838e-80d0-4f67-9ade-042a8a96bc21\") " Jun 14 13:43:18.858734 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:18.858706 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/524c838e-80d0-4f67-9ade-042a8a96bc21-bundle" (OuterVolumeSpecName: "bundle") pod "524c838e-80d0-4f67-9ade-042a8a96bc21" (UID: "524c838e-80d0-4f67-9ade-042a8a96bc21"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 13:43:18.860565 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:18.860535 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/524c838e-80d0-4f67-9ade-042a8a96bc21-kube-api-access-q6tq9" (OuterVolumeSpecName: "kube-api-access-q6tq9") pod "524c838e-80d0-4f67-9ade-042a8a96bc21" (UID: "524c838e-80d0-4f67-9ade-042a8a96bc21"). InnerVolumeSpecName "kube-api-access-q6tq9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 13:43:18.864213 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:18.864189 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/524c838e-80d0-4f67-9ade-042a8a96bc21-util" (OuterVolumeSpecName: "util") pod "524c838e-80d0-4f67-9ade-042a8a96bc21" (UID: "524c838e-80d0-4f67-9ade-042a8a96bc21"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 13:43:18.959651 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:18.959604 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/524c838e-80d0-4f67-9ade-042a8a96bc21-util\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:43:18.959651 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:18.959647 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/524c838e-80d0-4f67-9ade-042a8a96bc21-bundle\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:43:18.959651 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:18.959656 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6tq9\" (UniqueName: \"kubernetes.io/projected/524c838e-80d0-4f67-9ade-042a8a96bc21-kube-api-access-q6tq9\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:43:19.613294 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:19.613257 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r" event={"ID":"524c838e-80d0-4f67-9ade-042a8a96bc21","Type":"ContainerDied","Data":"b17f6a575494429936a3c715a86d93f69e3190fd3d5d94629ec6d718751696f5"} Jun 14 13:43:19.613644 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:19.613299 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r" Jun 14 13:43:19.613644 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:19.613328 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b17f6a575494429936a3c715a86d93f69e3190fd3d5d94629ec6d718751696f5" Jun 14 13:43:28.131508 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:28.131468 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:43:32.174332 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:32.174297 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:43:38.505455 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:38.505419 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:43:42.107589 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:42.107551 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:43:42.703818 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:42.703781 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:43:44.330026 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:44.329989 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:43:44.396388 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:44.396345 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:43:45.567029 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.566992 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5kkmg"] Jun 14 13:43:45.567632 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.567609 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07b7c58c-e6d1-48c8-b09d-76cb3edd79ca" containerName="util" Jun 14 13:43:45.567778 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.567636 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="07b7c58c-e6d1-48c8-b09d-76cb3edd79ca" containerName="util" Jun 14 13:43:45.567778 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.567650 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f93def8-28bf-46a9-b56e-c83fa29d56f2" containerName="extract" Jun 14 13:43:45.567778 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.567657 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f93def8-28bf-46a9-b56e-c83fa29d56f2" containerName="extract" Jun 14 13:43:45.567778 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.567671 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07b7c58c-e6d1-48c8-b09d-76cb3edd79ca" containerName="extract" Jun 14 13:43:45.567778 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.567694 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="07b7c58c-e6d1-48c8-b09d-76cb3edd79ca" containerName="extract" Jun 14 13:43:45.567778 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.567714 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="524c838e-80d0-4f67-9ade-042a8a96bc21" containerName="pull" Jun 14 13:43:45.567778 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.567722 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="524c838e-80d0-4f67-9ade-042a8a96bc21" containerName="pull" Jun 14 13:43:45.567778 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.567734 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="524c838e-80d0-4f67-9ade-042a8a96bc21" containerName="extract" Jun 14 13:43:45.567778 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.567741 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="524c838e-80d0-4f67-9ade-042a8a96bc21" containerName="extract" Jun 14 13:43:45.567778 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.567755 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="524c838e-80d0-4f67-9ade-042a8a96bc21" containerName="util" Jun 14 13:43:45.567778 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.567763 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="524c838e-80d0-4f67-9ade-042a8a96bc21" containerName="util" Jun 14 13:43:45.567778 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.567771 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6602eea-9856-483b-9eed-9627f36440a1" containerName="pull" Jun 14 13:43:45.567778 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.567779 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6602eea-9856-483b-9eed-9627f36440a1" containerName="pull" Jun 14 13:43:45.568397 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.567791 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6602eea-9856-483b-9eed-9627f36440a1" containerName="util" Jun 14 13:43:45.568397 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.567798 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6602eea-9856-483b-9eed-9627f36440a1" containerName="util" Jun 14 13:43:45.568397 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.567808 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f93def8-28bf-46a9-b56e-c83fa29d56f2" containerName="pull" Jun 14 13:43:45.568397 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.567815 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f93def8-28bf-46a9-b56e-c83fa29d56f2" containerName="pull" Jun 14 13:43:45.568397 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.567843 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f93def8-28bf-46a9-b56e-c83fa29d56f2" containerName="util" Jun 14 13:43:45.568397 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.567850 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f93def8-28bf-46a9-b56e-c83fa29d56f2" containerName="util" Jun 14 13:43:45.568397 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.567858 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07b7c58c-e6d1-48c8-b09d-76cb3edd79ca" containerName="pull" Jun 14 13:43:45.568397 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.567867 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="07b7c58c-e6d1-48c8-b09d-76cb3edd79ca" containerName="pull" Jun 14 13:43:45.568397 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.567886 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6602eea-9856-483b-9eed-9627f36440a1" containerName="extract" Jun 14 13:43:45.568397 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.567893 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6602eea-9856-483b-9eed-9627f36440a1" containerName="extract" Jun 14 13:43:45.568397 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.567998 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="07b7c58c-e6d1-48c8-b09d-76cb3edd79ca" containerName="extract" Jun 14 13:43:45.568397 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.568012 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6602eea-9856-483b-9eed-9627f36440a1" containerName="extract" Jun 14 13:43:45.568397 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.568022 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="524c838e-80d0-4f67-9ade-042a8a96bc21" containerName="extract" Jun 14 13:43:45.568397 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.568030 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f93def8-28bf-46a9-b56e-c83fa29d56f2" containerName="extract" Jun 14 13:43:45.571595 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.571575 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5kkmg" Jun 14 13:43:45.574466 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.574443 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 14 13:43:45.575503 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.575471 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 14 13:43:45.575610 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.575473 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-w7rkr\"" Jun 14 13:43:45.581074 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.581051 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm4sc\" (UniqueName: \"kubernetes.io/projected/a07c9b25-51cc-4d4d-ae55-631be3dcea14-kube-api-access-xm4sc\") pod \"authorino-operator-75cc8d5cb7-5kkmg\" (UID: \"a07c9b25-51cc-4d4d-ae55-631be3dcea14\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5kkmg" Jun 14 13:43:45.583842 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.583820 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5kkmg"] Jun 14 13:43:45.681756 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.681723 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm4sc\" (UniqueName: \"kubernetes.io/projected/a07c9b25-51cc-4d4d-ae55-631be3dcea14-kube-api-access-xm4sc\") pod \"authorino-operator-75cc8d5cb7-5kkmg\" (UID: \"a07c9b25-51cc-4d4d-ae55-631be3dcea14\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5kkmg" Jun 14 13:43:45.692699 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.692660 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm4sc\" (UniqueName: \"kubernetes.io/projected/a07c9b25-51cc-4d4d-ae55-631be3dcea14-kube-api-access-xm4sc\") pod \"authorino-operator-75cc8d5cb7-5kkmg\" (UID: \"a07c9b25-51cc-4d4d-ae55-631be3dcea14\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5kkmg" Jun 14 13:43:45.882944 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:45.882911 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5kkmg" Jun 14 13:43:46.025343 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:46.025316 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5kkmg"] Jun 14 13:43:46.026267 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:43:46.026242 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda07c9b25_51cc_4d4d_ae55_631be3dcea14.slice/crio-d9a0b77a7219b62f3a43329dc1867626d7a17d45c5b46209910383828285ea09 WatchSource:0}: Error finding container d9a0b77a7219b62f3a43329dc1867626d7a17d45c5b46209910383828285ea09: Status 404 returned error can't find the container with id d9a0b77a7219b62f3a43329dc1867626d7a17d45c5b46209910383828285ea09 Jun 14 13:43:46.028320 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:46.028302 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 13:43:46.413542 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:46.413514 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:43:46.770476 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:46.770385 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5kkmg" event={"ID":"a07c9b25-51cc-4d4d-ae55-631be3dcea14","Type":"ContainerStarted","Data":"d9a0b77a7219b62f3a43329dc1867626d7a17d45c5b46209910383828285ea09"} Jun 14 13:43:46.971895 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:46.971860 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:43:47.314939 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:47.314895 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:43:47.409354 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:47.409310 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:43:47.518839 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:47.518801 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:43:47.605696 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:47.605596 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:43:47.732625 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:47.732534 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:43:47.834452 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:47.834414 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:43:47.931632 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:47.931601 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:43:48.005339 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:48.005298 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:43:48.787632 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:48.787593 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5kkmg" event={"ID":"a07c9b25-51cc-4d4d-ae55-631be3dcea14","Type":"ContainerStarted","Data":"5a56c77b3243c31e0f521f17ca937eece7e9f60eb48829384946575581182c09"} Jun 14 13:43:48.787834 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:48.787664 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5kkmg" Jun 14 13:43:48.808874 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:48.808821 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5kkmg" podStartSLOduration=1.5660836759999999 podStartE2EDuration="3.808805841s" totalImagesPullingTime="2.242722165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:43:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:43:48.807352348 +0000 UTC m=+661.480620295" watchObservedRunningTime="2026-06-14 13:43:48.808805841 +0000 UTC m=+661.482073787" Jun 14 13:43:49.564887 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:49.564848 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:43:51.308247 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:51.308211 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:43:51.379327 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:51.379271 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:43:58.327507 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:58.327463 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-558c7f9cd6-cpxfj"] Jun 14 13:43:58.449495 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:58.449456 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:43:58.548933 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:58.548903 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:43:58.648834 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:58.648799 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:43:58.940772 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:58.940665 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:43:59.053506 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:59.053468 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:43:59.795260 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:43:59.795229 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5kkmg" Jun 14 13:44:03.737021 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:03.736979 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:44:03.834651 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:03.834613 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:44:03.894415 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:03.894385 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:44:06.284337 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:06.284293 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:44:06.390809 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:06.390772 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:44:09.731724 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:09.731663 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:44:09.831965 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:09.831933 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:44:16.670418 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:16.670382 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:44:16.774090 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:16.774055 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:44:21.474876 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:21.474838 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:44:21.578488 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:21.578450 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:44:23.348995 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:23.348933 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-558c7f9cd6-cpxfj" podUID="b58a27be-912a-4a91-8211-3401380a6eb7" containerName="console" containerID="cri-o://8e221129427bfc6d8cc789e634e0b4a8f7c716fc0b669208ef3b58a4d7f856e0" gracePeriod=15 Jun 14 13:44:23.611440 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:23.611381 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-558c7f9cd6-cpxfj" Jun 14 13:44:23.735267 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:23.735234 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b58a27be-912a-4a91-8211-3401380a6eb7-oauth-serving-cert\") pod \"b58a27be-912a-4a91-8211-3401380a6eb7\" (UID: \"b58a27be-912a-4a91-8211-3401380a6eb7\") " Jun 14 13:44:23.735267 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:23.735270 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b58a27be-912a-4a91-8211-3401380a6eb7-console-serving-cert\") pod \"b58a27be-912a-4a91-8211-3401380a6eb7\" (UID: \"b58a27be-912a-4a91-8211-3401380a6eb7\") " Jun 14 13:44:23.735504 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:23.735329 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b58a27be-912a-4a91-8211-3401380a6eb7-service-ca\") pod \"b58a27be-912a-4a91-8211-3401380a6eb7\" (UID: \"b58a27be-912a-4a91-8211-3401380a6eb7\") " Jun 14 13:44:23.735504 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:23.735391 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b58a27be-912a-4a91-8211-3401380a6eb7-console-config\") pod \"b58a27be-912a-4a91-8211-3401380a6eb7\" (UID: \"b58a27be-912a-4a91-8211-3401380a6eb7\") " Jun 14 13:44:23.735504 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:23.735416 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b58a27be-912a-4a91-8211-3401380a6eb7-trusted-ca-bundle\") pod \"b58a27be-912a-4a91-8211-3401380a6eb7\" (UID: \"b58a27be-912a-4a91-8211-3401380a6eb7\") " Jun 14 13:44:23.735504 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:23.735461 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b58a27be-912a-4a91-8211-3401380a6eb7-console-oauth-config\") pod \"b58a27be-912a-4a91-8211-3401380a6eb7\" (UID: \"b58a27be-912a-4a91-8211-3401380a6eb7\") " Jun 14 13:44:23.735774 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:23.735621 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b58a27be-912a-4a91-8211-3401380a6eb7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b58a27be-912a-4a91-8211-3401380a6eb7" (UID: "b58a27be-912a-4a91-8211-3401380a6eb7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 13:44:23.735950 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:23.735769 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b58a27be-912a-4a91-8211-3401380a6eb7-service-ca" (OuterVolumeSpecName: "service-ca") pod "b58a27be-912a-4a91-8211-3401380a6eb7" (UID: "b58a27be-912a-4a91-8211-3401380a6eb7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 13:44:23.736108 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:23.735843 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5jzx\" (UniqueName: \"kubernetes.io/projected/b58a27be-912a-4a91-8211-3401380a6eb7-kube-api-access-j5jzx\") pod \"b58a27be-912a-4a91-8211-3401380a6eb7\" (UID: \"b58a27be-912a-4a91-8211-3401380a6eb7\") " Jun 14 13:44:23.736242 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:23.735804 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b58a27be-912a-4a91-8211-3401380a6eb7-console-config" (OuterVolumeSpecName: "console-config") pod "b58a27be-912a-4a91-8211-3401380a6eb7" (UID: "b58a27be-912a-4a91-8211-3401380a6eb7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 13:44:23.736242 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:23.736008 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b58a27be-912a-4a91-8211-3401380a6eb7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b58a27be-912a-4a91-8211-3401380a6eb7" (UID: "b58a27be-912a-4a91-8211-3401380a6eb7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 13:44:23.736365 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:23.736347 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b58a27be-912a-4a91-8211-3401380a6eb7-oauth-serving-cert\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:44:23.736424 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:23.736374 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b58a27be-912a-4a91-8211-3401380a6eb7-service-ca\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:44:23.736424 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:23.736389 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b58a27be-912a-4a91-8211-3401380a6eb7-console-config\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:44:23.736424 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:23.736403 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b58a27be-912a-4a91-8211-3401380a6eb7-trusted-ca-bundle\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:44:23.737725 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:23.737699 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b58a27be-912a-4a91-8211-3401380a6eb7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b58a27be-912a-4a91-8211-3401380a6eb7" (UID: "b58a27be-912a-4a91-8211-3401380a6eb7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 13:44:23.737871 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:23.737724 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b58a27be-912a-4a91-8211-3401380a6eb7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b58a27be-912a-4a91-8211-3401380a6eb7" (UID: "b58a27be-912a-4a91-8211-3401380a6eb7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 13:44:23.738122 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:23.738104 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b58a27be-912a-4a91-8211-3401380a6eb7-kube-api-access-j5jzx" (OuterVolumeSpecName: "kube-api-access-j5jzx") pod "b58a27be-912a-4a91-8211-3401380a6eb7" (UID: "b58a27be-912a-4a91-8211-3401380a6eb7"). InnerVolumeSpecName "kube-api-access-j5jzx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 13:44:23.837785 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:23.837750 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b58a27be-912a-4a91-8211-3401380a6eb7-console-oauth-config\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:44:23.837785 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:23.837780 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5jzx\" (UniqueName: \"kubernetes.io/projected/b58a27be-912a-4a91-8211-3401380a6eb7-kube-api-access-j5jzx\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:44:23.837985 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:23.837794 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b58a27be-912a-4a91-8211-3401380a6eb7-console-serving-cert\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:44:23.997850 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:23.997810 2557 generic.go:356] "Generic (PLEG): container finished" podID="b58a27be-912a-4a91-8211-3401380a6eb7" containerID="8e221129427bfc6d8cc789e634e0b4a8f7c716fc0b669208ef3b58a4d7f856e0" exitCode=0 Jun 14 13:44:23.998023 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:23.997860 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-558c7f9cd6-cpxfj" Jun 14 13:44:23.998023 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:23.997869 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-558c7f9cd6-cpxfj" event={"ID":"b58a27be-912a-4a91-8211-3401380a6eb7","Type":"ContainerDied","Data":"8e221129427bfc6d8cc789e634e0b4a8f7c716fc0b669208ef3b58a4d7f856e0"} Jun 14 13:44:23.998023 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:23.997914 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-558c7f9cd6-cpxfj" event={"ID":"b58a27be-912a-4a91-8211-3401380a6eb7","Type":"ContainerDied","Data":"8fc113fddf6b83c8a8c4263029a347821fbd353e9a961b5477eb46ba58dec99b"} Jun 14 13:44:23.998023 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:23.997934 2557 scope.go:117] "RemoveContainer" containerID="8e221129427bfc6d8cc789e634e0b4a8f7c716fc0b669208ef3b58a4d7f856e0" Jun 14 13:44:24.008110 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:24.008092 2557 scope.go:117] "RemoveContainer" containerID="8e221129427bfc6d8cc789e634e0b4a8f7c716fc0b669208ef3b58a4d7f856e0" Jun 14 13:44:24.008357 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:44:24.008335 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e221129427bfc6d8cc789e634e0b4a8f7c716fc0b669208ef3b58a4d7f856e0\": container with ID starting with 8e221129427bfc6d8cc789e634e0b4a8f7c716fc0b669208ef3b58a4d7f856e0 not found: ID does not exist" containerID="8e221129427bfc6d8cc789e634e0b4a8f7c716fc0b669208ef3b58a4d7f856e0" Jun 14 13:44:24.008463 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:24.008361 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e221129427bfc6d8cc789e634e0b4a8f7c716fc0b669208ef3b58a4d7f856e0"} err="failed to get container status \"8e221129427bfc6d8cc789e634e0b4a8f7c716fc0b669208ef3b58a4d7f856e0\": rpc error: code = NotFound desc = could not find container \"8e221129427bfc6d8cc789e634e0b4a8f7c716fc0b669208ef3b58a4d7f856e0\": container with ID starting with 8e221129427bfc6d8cc789e634e0b4a8f7c716fc0b669208ef3b58a4d7f856e0 not found: ID does not exist" Jun 14 13:44:24.021272 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:24.021235 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-558c7f9cd6-cpxfj"] Jun 14 13:44:24.023723 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:24.023698 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-558c7f9cd6-cpxfj"] Jun 14 13:44:24.075712 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:24.075666 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:44:24.176442 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:24.176403 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:44:25.267315 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:25.267284 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:44:25.734697 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:25.734655 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b58a27be-912a-4a91-8211-3401380a6eb7" path="/var/lib/kubelet/pods/b58a27be-912a-4a91-8211-3401380a6eb7/volumes" Jun 14 13:44:27.681119 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:27.681078 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:44:27.781592 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:27.781558 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:44:35.477924 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:35.477884 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:44:35.577984 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:35.577947 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:44:38.310637 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:38.310543 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:44:38.365849 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:38.365811 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:44:38.769090 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:38.769053 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:44:39.936160 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:39.936107 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:44:39.952287 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:39.952252 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h9ctg"] Jun 14 13:44:39.952734 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:39.952710 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b58a27be-912a-4a91-8211-3401380a6eb7" containerName="console" Jun 14 13:44:39.952847 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:39.952737 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b58a27be-912a-4a91-8211-3401380a6eb7" containerName="console" Jun 14 13:44:39.952904 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:39.952880 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b58a27be-912a-4a91-8211-3401380a6eb7" containerName="console" Jun 14 13:44:39.955928 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:39.955910 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-h9ctg" Jun 14 13:44:39.958618 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:39.958595 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 14 13:44:39.958747 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:39.958647 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8cfvj\"" Jun 14 13:44:39.965001 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:39.964979 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h9ctg"] Jun 14 13:44:39.982071 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:39.982045 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ghvm\" (UniqueName: \"kubernetes.io/projected/7ca52091-738e-41b2-b955-8b25784df27c-kube-api-access-6ghvm\") pod \"limitador-limitador-64c94fd64f-h9ctg\" (UID: \"7ca52091-738e-41b2-b955-8b25784df27c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h9ctg" Jun 14 13:44:39.982185 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:39.982114 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7ca52091-738e-41b2-b955-8b25784df27c-config-file\") pod \"limitador-limitador-64c94fd64f-h9ctg\" (UID: \"7ca52091-738e-41b2-b955-8b25784df27c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h9ctg" Jun 14 13:44:40.048653 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:40.048619 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h9ctg"] Jun 14 13:44:40.051745 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:40.051711 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:44:40.082674 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:40.082648 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ghvm\" (UniqueName: \"kubernetes.io/projected/7ca52091-738e-41b2-b955-8b25784df27c-kube-api-access-6ghvm\") pod \"limitador-limitador-64c94fd64f-h9ctg\" (UID: \"7ca52091-738e-41b2-b955-8b25784df27c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h9ctg" Jun 14 13:44:40.082854 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:40.082742 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7ca52091-738e-41b2-b955-8b25784df27c-config-file\") pod \"limitador-limitador-64c94fd64f-h9ctg\" (UID: \"7ca52091-738e-41b2-b955-8b25784df27c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h9ctg" Jun 14 13:44:40.083407 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:40.083383 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7ca52091-738e-41b2-b955-8b25784df27c-config-file\") pod \"limitador-limitador-64c94fd64f-h9ctg\" (UID: \"7ca52091-738e-41b2-b955-8b25784df27c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h9ctg" Jun 14 13:44:40.090811 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:40.090783 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ghvm\" (UniqueName: \"kubernetes.io/projected/7ca52091-738e-41b2-b955-8b25784df27c-kube-api-access-6ghvm\") pod \"limitador-limitador-64c94fd64f-h9ctg\" (UID: \"7ca52091-738e-41b2-b955-8b25784df27c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h9ctg" Jun 14 13:44:40.105258 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:40.105232 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:44:40.267726 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:40.267672 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-h9ctg" Jun 14 13:44:40.411425 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:40.411392 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h9ctg"] Jun 14 13:44:40.780827 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:40.780787 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:44:40.880753 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:40.880710 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:44:41.004955 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:41.004923 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:44:41.107266 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:41.107181 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-h9ctg" event={"ID":"7ca52091-738e-41b2-b955-8b25784df27c","Type":"ContainerStarted","Data":"01b93ec4b4a35d4e7b2766c57a13aa1147150dbef11cee4ca9437702abc13bc7"} Jun 14 13:44:41.276631 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:41.276597 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:44:41.363974 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:41.363876 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:44:43.120984 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:43.120951 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-h9ctg" event={"ID":"7ca52091-738e-41b2-b955-8b25784df27c","Type":"ContainerStarted","Data":"79d07904308b2ccd1f51255cdb9b03db5138b7ba08f9091a04894e066a97e780"} Jun 14 13:44:43.121394 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:43.121012 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-h9ctg" Jun 14 13:44:43.138699 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:43.138631 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-h9ctg" podStartSLOduration=1.5254401340000001 podStartE2EDuration="4.138615558s" totalImagesPullingTime="2.613175424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:44:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:44:43.136113305 +0000 UTC m=+715.809381270" watchObservedRunningTime="2026-06-14 13:44:43.138615558 +0000 UTC m=+715.811883505" Jun 14 13:44:54.127758 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:54.127728 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-h9ctg" Jun 14 13:44:55.040913 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:55.040875 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h9ctg"] Jun 14 13:44:55.041154 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:55.041062 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-h9ctg" podUID="7ca52091-738e-41b2-b955-8b25784df27c" containerName="limitador" containerID="cri-o://79d07904308b2ccd1f51255cdb9b03db5138b7ba08f9091a04894e066a97e780" gracePeriod=30 Jun 14 13:44:55.604109 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:55.604046 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-h9ctg" Jun 14 13:44:55.730305 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:55.730268 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7ca52091-738e-41b2-b955-8b25784df27c-config-file\") pod \"7ca52091-738e-41b2-b955-8b25784df27c\" (UID: \"7ca52091-738e-41b2-b955-8b25784df27c\") " Jun 14 13:44:55.730502 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:55.730315 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ghvm\" (UniqueName: \"kubernetes.io/projected/7ca52091-738e-41b2-b955-8b25784df27c-kube-api-access-6ghvm\") pod \"7ca52091-738e-41b2-b955-8b25784df27c\" (UID: \"7ca52091-738e-41b2-b955-8b25784df27c\") " Jun 14 13:44:55.730673 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:55.730649 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ca52091-738e-41b2-b955-8b25784df27c-config-file" (OuterVolumeSpecName: "config-file") pod "7ca52091-738e-41b2-b955-8b25784df27c" (UID: "7ca52091-738e-41b2-b955-8b25784df27c"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 13:44:55.732944 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:55.732903 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ca52091-738e-41b2-b955-8b25784df27c-kube-api-access-6ghvm" (OuterVolumeSpecName: "kube-api-access-6ghvm") pod "7ca52091-738e-41b2-b955-8b25784df27c" (UID: "7ca52091-738e-41b2-b955-8b25784df27c"). InnerVolumeSpecName "kube-api-access-6ghvm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 13:44:55.830978 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:55.830943 2557 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7ca52091-738e-41b2-b955-8b25784df27c-config-file\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:44:55.830978 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:55.830971 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ghvm\" (UniqueName: \"kubernetes.io/projected/7ca52091-738e-41b2-b955-8b25784df27c-kube-api-access-6ghvm\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:44:56.198459 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:56.198429 2557 generic.go:356] "Generic (PLEG): container finished" podID="7ca52091-738e-41b2-b955-8b25784df27c" containerID="79d07904308b2ccd1f51255cdb9b03db5138b7ba08f9091a04894e066a97e780" exitCode=0 Jun 14 13:44:56.198636 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:56.198476 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-h9ctg" Jun 14 13:44:56.198636 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:56.198495 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-h9ctg" event={"ID":"7ca52091-738e-41b2-b955-8b25784df27c","Type":"ContainerDied","Data":"79d07904308b2ccd1f51255cdb9b03db5138b7ba08f9091a04894e066a97e780"} Jun 14 13:44:56.198636 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:56.198535 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-h9ctg" event={"ID":"7ca52091-738e-41b2-b955-8b25784df27c","Type":"ContainerDied","Data":"01b93ec4b4a35d4e7b2766c57a13aa1147150dbef11cee4ca9437702abc13bc7"} Jun 14 13:44:56.198636 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:56.198557 2557 scope.go:117] "RemoveContainer" containerID="79d07904308b2ccd1f51255cdb9b03db5138b7ba08f9091a04894e066a97e780" Jun 14 13:44:56.227826 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:56.227784 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h9ctg"] Jun 14 13:44:56.227982 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:56.227850 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h9ctg"] Jun 14 13:44:56.229784 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:56.229757 2557 scope.go:117] "RemoveContainer" containerID="79d07904308b2ccd1f51255cdb9b03db5138b7ba08f9091a04894e066a97e780" Jun 14 13:44:56.230144 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:44:56.230125 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79d07904308b2ccd1f51255cdb9b03db5138b7ba08f9091a04894e066a97e780\": container with ID starting with 79d07904308b2ccd1f51255cdb9b03db5138b7ba08f9091a04894e066a97e780 not found: ID does not exist" containerID="79d07904308b2ccd1f51255cdb9b03db5138b7ba08f9091a04894e066a97e780" Jun 14 13:44:56.230217 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:56.230151 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79d07904308b2ccd1f51255cdb9b03db5138b7ba08f9091a04894e066a97e780"} err="failed to get container status \"79d07904308b2ccd1f51255cdb9b03db5138b7ba08f9091a04894e066a97e780\": rpc error: code = NotFound desc = could not find container \"79d07904308b2ccd1f51255cdb9b03db5138b7ba08f9091a04894e066a97e780\": container with ID starting with 79d07904308b2ccd1f51255cdb9b03db5138b7ba08f9091a04894e066a97e780 not found: ID does not exist" Jun 14 13:44:56.486163 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:56.481749 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-lzgh6"] Jun 14 13:44:56.486163 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:56.482740 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ca52091-738e-41b2-b955-8b25784df27c" containerName="limitador" Jun 14 13:44:56.486163 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:56.482764 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ca52091-738e-41b2-b955-8b25784df27c" containerName="limitador" Jun 14 13:44:56.486163 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:56.482997 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ca52091-738e-41b2-b955-8b25784df27c" containerName="limitador" Jun 14 13:44:56.495147 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:56.495109 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-lzgh6"] Jun 14 13:44:56.495311 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:56.495233 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-lzgh6" Jun 14 13:44:56.497867 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:56.497841 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 14 13:44:56.512624 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:56.512589 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:44:56.638553 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:56.638520 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtnwt\" (UniqueName: \"kubernetes.io/projected/9010b236-55e0-4c02-97ea-5d7227dee236-kube-api-access-xtnwt\") pod \"postgres-69fb4594cf-lzgh6\" (UID: \"9010b236-55e0-4c02-97ea-5d7227dee236\") " pod="opendatahub/postgres-69fb4594cf-lzgh6" Jun 14 13:44:56.638553 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:56.638563 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9010b236-55e0-4c02-97ea-5d7227dee236-data\") pod \"postgres-69fb4594cf-lzgh6\" (UID: \"9010b236-55e0-4c02-97ea-5d7227dee236\") " pod="opendatahub/postgres-69fb4594cf-lzgh6" Jun 14 13:44:56.739772 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:56.739660 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtnwt\" (UniqueName: \"kubernetes.io/projected/9010b236-55e0-4c02-97ea-5d7227dee236-kube-api-access-xtnwt\") pod \"postgres-69fb4594cf-lzgh6\" (UID: \"9010b236-55e0-4c02-97ea-5d7227dee236\") " pod="opendatahub/postgres-69fb4594cf-lzgh6" Jun 14 13:44:56.739772 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:56.739747 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9010b236-55e0-4c02-97ea-5d7227dee236-data\") pod \"postgres-69fb4594cf-lzgh6\" (UID: \"9010b236-55e0-4c02-97ea-5d7227dee236\") " pod="opendatahub/postgres-69fb4594cf-lzgh6" Jun 14 13:44:56.740140 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:56.740121 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9010b236-55e0-4c02-97ea-5d7227dee236-data\") pod \"postgres-69fb4594cf-lzgh6\" (UID: \"9010b236-55e0-4c02-97ea-5d7227dee236\") " pod="opendatahub/postgres-69fb4594cf-lzgh6" Jun 14 13:44:56.749186 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:56.749159 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtnwt\" (UniqueName: \"kubernetes.io/projected/9010b236-55e0-4c02-97ea-5d7227dee236-kube-api-access-xtnwt\") pod \"postgres-69fb4594cf-lzgh6\" (UID: \"9010b236-55e0-4c02-97ea-5d7227dee236\") " pod="opendatahub/postgres-69fb4594cf-lzgh6" Jun 14 13:44:56.809066 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:56.809027 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-lzgh6" Jun 14 13:44:56.942218 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:56.942193 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-lzgh6"] Jun 14 13:44:56.944405 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:44:56.944372 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9010b236_55e0_4c02_97ea_5d7227dee236.slice/crio-12d126bb49323bd9338130f83080d649f5bfcab202ac17a51746959d791fff8d WatchSource:0}: Error finding container 12d126bb49323bd9338130f83080d649f5bfcab202ac17a51746959d791fff8d: Status 404 returned error can't find the container with id 12d126bb49323bd9338130f83080d649f5bfcab202ac17a51746959d791fff8d Jun 14 13:44:57.205976 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:57.205941 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-lzgh6" event={"ID":"9010b236-55e0-4c02-97ea-5d7227dee236","Type":"ContainerStarted","Data":"12d126bb49323bd9338130f83080d649f5bfcab202ac17a51746959d791fff8d"} Jun 14 13:44:57.735361 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:44:57.735320 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ca52091-738e-41b2-b955-8b25784df27c" path="/var/lib/kubelet/pods/7ca52091-738e-41b2-b955-8b25784df27c/volumes" Jun 14 13:45:00.227982 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:00.227941 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-lzgh6" event={"ID":"9010b236-55e0-4c02-97ea-5d7227dee236","Type":"ContainerStarted","Data":"d7e830282f1997f558e9a9628a560ea1e6692e6bdbd8d02d51aadc5d4baa87d2"} Jun 14 13:45:00.228378 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:00.228018 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-lzgh6" Jun 14 13:45:00.245881 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:00.245826 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-lzgh6" podStartSLOduration=1.7412187810000002 podStartE2EDuration="4.245811296s" totalImagesPullingTime="2.504592515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:45:00.242554535 +0000 UTC m=+732.915822488" watchObservedRunningTime="2026-06-14 13:45:00.245811296 +0000 UTC m=+732.919079271" Jun 14 13:45:06.269202 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:06.269152 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-lzgh6" Jun 14 13:45:06.597428 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:06.597325 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:45:06.700666 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:06.700613 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:45:06.908469 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:06.908431 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:45:07.799880 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:07.799849 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hstgm"] Jun 14 13:45:07.806730 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:07.806709 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hstgm" Jun 14 13:45:07.809372 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:07.809344 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 13:45:07.809591 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:07.809501 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-whkbn\"" Jun 14 13:45:07.810380 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:07.810359 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 13:45:07.814386 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:07.814361 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hstgm"] Jun 14 13:45:07.943168 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:07.943119 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0cb5341-4616-4669-8b3b-38599b628e86-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hstgm\" (UID: \"e0cb5341-4616-4669-8b3b-38599b628e86\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hstgm" Jun 14 13:45:07.943350 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:07.943218 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjsxk\" (UniqueName: \"kubernetes.io/projected/e0cb5341-4616-4669-8b3b-38599b628e86-kube-api-access-fjsxk\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hstgm\" (UID: \"e0cb5341-4616-4669-8b3b-38599b628e86\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hstgm" Jun 14 13:45:07.943350 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:07.943328 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0cb5341-4616-4669-8b3b-38599b628e86-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hstgm\" (UID: \"e0cb5341-4616-4669-8b3b-38599b628e86\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hstgm" Jun 14 13:45:08.044546 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:08.044512 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0cb5341-4616-4669-8b3b-38599b628e86-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hstgm\" (UID: \"e0cb5341-4616-4669-8b3b-38599b628e86\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hstgm" Jun 14 13:45:08.044747 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:08.044564 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0cb5341-4616-4669-8b3b-38599b628e86-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hstgm\" (UID: \"e0cb5341-4616-4669-8b3b-38599b628e86\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hstgm" Jun 14 13:45:08.044747 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:08.044598 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjsxk\" (UniqueName: \"kubernetes.io/projected/e0cb5341-4616-4669-8b3b-38599b628e86-kube-api-access-fjsxk\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hstgm\" (UID: \"e0cb5341-4616-4669-8b3b-38599b628e86\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hstgm" Jun 14 13:45:08.045014 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:08.044989 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0cb5341-4616-4669-8b3b-38599b628e86-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hstgm\" (UID: \"e0cb5341-4616-4669-8b3b-38599b628e86\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hstgm" Jun 14 13:45:08.045054 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:08.045000 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0cb5341-4616-4669-8b3b-38599b628e86-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hstgm\" (UID: \"e0cb5341-4616-4669-8b3b-38599b628e86\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hstgm" Jun 14 13:45:08.053393 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:08.053331 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjsxk\" (UniqueName: \"kubernetes.io/projected/e0cb5341-4616-4669-8b3b-38599b628e86-kube-api-access-fjsxk\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hstgm\" (UID: \"e0cb5341-4616-4669-8b3b-38599b628e86\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hstgm" Jun 14 13:45:08.118491 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:08.118460 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hstgm" Jun 14 13:45:08.260658 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:08.260632 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hstgm"] Jun 14 13:45:08.263180 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:45:08.263148 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0cb5341_4616_4669_8b3b_38599b628e86.slice/crio-a7fde1d7d10566f5d7b08be4d0fb5ad5b568a3b32da2f527265b5b1654d875c8 WatchSource:0}: Error finding container a7fde1d7d10566f5d7b08be4d0fb5ad5b568a3b32da2f527265b5b1654d875c8: Status 404 returned error can't find the container with id a7fde1d7d10566f5d7b08be4d0fb5ad5b568a3b32da2f527265b5b1654d875c8 Jun 14 13:45:08.293966 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:08.293930 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hstgm" event={"ID":"e0cb5341-4616-4669-8b3b-38599b628e86","Type":"ContainerStarted","Data":"a7fde1d7d10566f5d7b08be4d0fb5ad5b568a3b32da2f527265b5b1654d875c8"} Jun 14 13:45:09.301563 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:09.301522 2557 generic.go:356] "Generic (PLEG): container finished" podID="e0cb5341-4616-4669-8b3b-38599b628e86" containerID="24040e09fd8e2d8946ef1fcb7a0f35eda4a12d70225a806cb31e97274bd7e16e" exitCode=0 Jun 14 13:45:09.302039 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:09.301582 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hstgm" event={"ID":"e0cb5341-4616-4669-8b3b-38599b628e86","Type":"ContainerDied","Data":"24040e09fd8e2d8946ef1fcb7a0f35eda4a12d70225a806cb31e97274bd7e16e"} Jun 14 13:45:10.308727 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:10.308665 2557 generic.go:356] "Generic (PLEG): container finished" podID="e0cb5341-4616-4669-8b3b-38599b628e86" containerID="55256487ad6beabe25aae33f6e809aff16173e0e6abfd42e67910d77f027250e" exitCode=0 Jun 14 13:45:10.309197 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:10.308757 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hstgm" event={"ID":"e0cb5341-4616-4669-8b3b-38599b628e86","Type":"ContainerDied","Data":"55256487ad6beabe25aae33f6e809aff16173e0e6abfd42e67910d77f027250e"} Jun 14 13:45:11.319155 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:11.319115 2557 generic.go:356] "Generic (PLEG): container finished" podID="e0cb5341-4616-4669-8b3b-38599b628e86" containerID="27daddb17105f99806f538e66da74647fd5cc09ca1e78ba4e3cce1ed1b503e42" exitCode=0 Jun 14 13:45:11.319549 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:11.319160 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hstgm" event={"ID":"e0cb5341-4616-4669-8b3b-38599b628e86","Type":"ContainerDied","Data":"27daddb17105f99806f538e66da74647fd5cc09ca1e78ba4e3cce1ed1b503e42"} Jun 14 13:45:12.467900 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:12.467875 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hstgm" Jun 14 13:45:12.584545 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:12.584460 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0cb5341-4616-4669-8b3b-38599b628e86-util\") pod \"e0cb5341-4616-4669-8b3b-38599b628e86\" (UID: \"e0cb5341-4616-4669-8b3b-38599b628e86\") " Jun 14 13:45:12.584545 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:12.584534 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0cb5341-4616-4669-8b3b-38599b628e86-bundle\") pod \"e0cb5341-4616-4669-8b3b-38599b628e86\" (UID: \"e0cb5341-4616-4669-8b3b-38599b628e86\") " Jun 14 13:45:12.584827 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:12.584555 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjsxk\" (UniqueName: \"kubernetes.io/projected/e0cb5341-4616-4669-8b3b-38599b628e86-kube-api-access-fjsxk\") pod \"e0cb5341-4616-4669-8b3b-38599b628e86\" (UID: \"e0cb5341-4616-4669-8b3b-38599b628e86\") " Jun 14 13:45:12.585038 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:12.585010 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0cb5341-4616-4669-8b3b-38599b628e86-bundle" (OuterVolumeSpecName: "bundle") pod "e0cb5341-4616-4669-8b3b-38599b628e86" (UID: "e0cb5341-4616-4669-8b3b-38599b628e86"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 13:45:12.586621 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:12.586598 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0cb5341-4616-4669-8b3b-38599b628e86-kube-api-access-fjsxk" (OuterVolumeSpecName: "kube-api-access-fjsxk") pod "e0cb5341-4616-4669-8b3b-38599b628e86" (UID: "e0cb5341-4616-4669-8b3b-38599b628e86"). InnerVolumeSpecName "kube-api-access-fjsxk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 13:45:12.590552 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:12.590526 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0cb5341-4616-4669-8b3b-38599b628e86-util" (OuterVolumeSpecName: "util") pod "e0cb5341-4616-4669-8b3b-38599b628e86" (UID: "e0cb5341-4616-4669-8b3b-38599b628e86"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 13:45:12.685936 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:12.685897 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0cb5341-4616-4669-8b3b-38599b628e86-util\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:45:12.685936 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:12.685927 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0cb5341-4616-4669-8b3b-38599b628e86-bundle\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:45:12.685936 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:12.685935 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjsxk\" (UniqueName: \"kubernetes.io/projected/e0cb5341-4616-4669-8b3b-38599b628e86-kube-api-access-fjsxk\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:45:13.333261 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:13.333232 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hstgm" Jun 14 13:45:13.333446 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:13.333238 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hstgm" event={"ID":"e0cb5341-4616-4669-8b3b-38599b628e86","Type":"ContainerDied","Data":"a7fde1d7d10566f5d7b08be4d0fb5ad5b568a3b32da2f527265b5b1654d875c8"} Jun 14 13:45:13.333446 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:13.333355 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7fde1d7d10566f5d7b08be4d0fb5ad5b568a3b32da2f527265b5b1654d875c8" Jun 14 13:45:35.915235 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:35.915201 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:45:36.013628 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:45:36.013591 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:46:05.379493 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:05.379454 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:46:05.477287 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:05.477249 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:46:11.402643 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:11.402553 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:46:11.418911 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:11.418882 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6b787498dd-ghr5r"] Jun 14 13:46:11.419445 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:11.419423 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0cb5341-4616-4669-8b3b-38599b628e86" containerName="pull" Jun 14 13:46:11.419445 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:11.419446 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0cb5341-4616-4669-8b3b-38599b628e86" containerName="pull" Jun 14 13:46:11.419589 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:11.419462 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0cb5341-4616-4669-8b3b-38599b628e86" containerName="util" Jun 14 13:46:11.419589 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:11.419467 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0cb5341-4616-4669-8b3b-38599b628e86" containerName="util" Jun 14 13:46:11.419589 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:11.419483 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0cb5341-4616-4669-8b3b-38599b628e86" containerName="extract" Jun 14 13:46:11.419589 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:11.419491 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0cb5341-4616-4669-8b3b-38599b628e86" containerName="extract" Jun 14 13:46:11.419589 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:11.419567 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0cb5341-4616-4669-8b3b-38599b628e86" containerName="extract" Jun 14 13:46:11.422562 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:11.422547 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b787498dd-ghr5r" Jun 14 13:46:11.425296 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:11.425271 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 14 13:46:11.425410 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:11.425276 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 14 13:46:11.425410 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:11.425319 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-h5vsg\"" Jun 14 13:46:11.432184 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:11.432164 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b787498dd-ghr5r"] Jun 14 13:46:11.508141 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:11.508104 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:46:11.516202 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:11.516179 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpph9\" (UniqueName: \"kubernetes.io/projected/7e0d577d-3325-4cfa-8803-a1085fb35f32-kube-api-access-rpph9\") pod \"maas-controller-6b787498dd-ghr5r\" (UID: \"7e0d577d-3325-4cfa-8803-a1085fb35f32\") " pod="opendatahub/maas-controller-6b787498dd-ghr5r" Jun 14 13:46:11.516314 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:11.516224 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7e0d577d-3325-4cfa-8803-a1085fb35f32-webhook-cert\") pod \"maas-controller-6b787498dd-ghr5r\" (UID: \"7e0d577d-3325-4cfa-8803-a1085fb35f32\") " pod="opendatahub/maas-controller-6b787498dd-ghr5r" Jun 14 13:46:11.596391 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:11.596354 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:46:11.601817 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:11.601794 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5cc6889694-dcsvv"] Jun 14 13:46:11.609369 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:11.608105 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cc6889694-dcsvv" Jun 14 13:46:11.617322 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:11.617296 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7e0d577d-3325-4cfa-8803-a1085fb35f32-webhook-cert\") pod \"maas-controller-6b787498dd-ghr5r\" (UID: \"7e0d577d-3325-4cfa-8803-a1085fb35f32\") " pod="opendatahub/maas-controller-6b787498dd-ghr5r" Jun 14 13:46:11.617473 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:11.617410 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c0609b9e-c443-4ca7-b6e6-758e84429a57-webhook-cert\") pod \"maas-controller-5cc6889694-dcsvv\" (UID: \"c0609b9e-c443-4ca7-b6e6-758e84429a57\") " pod="opendatahub/maas-controller-5cc6889694-dcsvv" Jun 14 13:46:11.617473 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:11.617455 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-755dv\" (UniqueName: \"kubernetes.io/projected/c0609b9e-c443-4ca7-b6e6-758e84429a57-kube-api-access-755dv\") pod \"maas-controller-5cc6889694-dcsvv\" (UID: \"c0609b9e-c443-4ca7-b6e6-758e84429a57\") " pod="opendatahub/maas-controller-5cc6889694-dcsvv" Jun 14 13:46:11.617586 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:11.617489 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpph9\" (UniqueName: \"kubernetes.io/projected/7e0d577d-3325-4cfa-8803-a1085fb35f32-kube-api-access-rpph9\") pod \"maas-controller-6b787498dd-ghr5r\" (UID: \"7e0d577d-3325-4cfa-8803-a1085fb35f32\") " pod="opendatahub/maas-controller-6b787498dd-ghr5r" Jun 14 13:46:11.617586 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:11.617556 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cc6889694-dcsvv"] Jun 14 13:46:11.617825 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:46:11.617710 2557 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 14 13:46:11.617825 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:46:11.617773 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e0d577d-3325-4cfa-8803-a1085fb35f32-webhook-cert podName:7e0d577d-3325-4cfa-8803-a1085fb35f32 nodeName:}" failed. No retries permitted until 2026-06-14 13:46:12.117756251 +0000 UTC m=+804.791024190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/7e0d577d-3325-4cfa-8803-a1085fb35f32-webhook-cert") pod "maas-controller-6b787498dd-ghr5r" (UID: "7e0d577d-3325-4cfa-8803-a1085fb35f32") : secret "maas-controller-webhook-cert" not found Jun 14 13:46:11.626834 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:11.626805 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpph9\" (UniqueName: \"kubernetes.io/projected/7e0d577d-3325-4cfa-8803-a1085fb35f32-kube-api-access-rpph9\") pod \"maas-controller-6b787498dd-ghr5r\" (UID: \"7e0d577d-3325-4cfa-8803-a1085fb35f32\") " pod="opendatahub/maas-controller-6b787498dd-ghr5r" Jun 14 13:46:11.718070 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:11.717980 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c0609b9e-c443-4ca7-b6e6-758e84429a57-webhook-cert\") pod \"maas-controller-5cc6889694-dcsvv\" (UID: \"c0609b9e-c443-4ca7-b6e6-758e84429a57\") " pod="opendatahub/maas-controller-5cc6889694-dcsvv" Jun 14 13:46:11.718070 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:11.718029 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-755dv\" (UniqueName: \"kubernetes.io/projected/c0609b9e-c443-4ca7-b6e6-758e84429a57-kube-api-access-755dv\") pod \"maas-controller-5cc6889694-dcsvv\" (UID: \"c0609b9e-c443-4ca7-b6e6-758e84429a57\") " pod="opendatahub/maas-controller-5cc6889694-dcsvv" Jun 14 13:46:11.718306 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:46:11.718133 2557 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 14 13:46:11.718306 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:46:11.718210 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0609b9e-c443-4ca7-b6e6-758e84429a57-webhook-cert podName:c0609b9e-c443-4ca7-b6e6-758e84429a57 nodeName:}" failed. No retries permitted until 2026-06-14 13:46:12.218192098 +0000 UTC m=+804.891460027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/c0609b9e-c443-4ca7-b6e6-758e84429a57-webhook-cert") pod "maas-controller-5cc6889694-dcsvv" (UID: "c0609b9e-c443-4ca7-b6e6-758e84429a57") : secret "maas-controller-webhook-cert" not found Jun 14 13:46:11.726420 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:11.726390 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-755dv\" (UniqueName: \"kubernetes.io/projected/c0609b9e-c443-4ca7-b6e6-758e84429a57-kube-api-access-755dv\") pod \"maas-controller-5cc6889694-dcsvv\" (UID: \"c0609b9e-c443-4ca7-b6e6-758e84429a57\") " pod="opendatahub/maas-controller-5cc6889694-dcsvv" Jun 14 13:46:12.121969 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:12.121883 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7e0d577d-3325-4cfa-8803-a1085fb35f32-webhook-cert\") pod \"maas-controller-6b787498dd-ghr5r\" (UID: \"7e0d577d-3325-4cfa-8803-a1085fb35f32\") " pod="opendatahub/maas-controller-6b787498dd-ghr5r" Jun 14 13:46:12.124397 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:12.124374 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7e0d577d-3325-4cfa-8803-a1085fb35f32-webhook-cert\") pod \"maas-controller-6b787498dd-ghr5r\" (UID: \"7e0d577d-3325-4cfa-8803-a1085fb35f32\") " pod="opendatahub/maas-controller-6b787498dd-ghr5r" Jun 14 13:46:12.137477 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:12.137444 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:46:12.222913 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:12.222873 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c0609b9e-c443-4ca7-b6e6-758e84429a57-webhook-cert\") pod \"maas-controller-5cc6889694-dcsvv\" (UID: \"c0609b9e-c443-4ca7-b6e6-758e84429a57\") " pod="opendatahub/maas-controller-5cc6889694-dcsvv" Jun 14 13:46:12.225283 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:12.225253 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c0609b9e-c443-4ca7-b6e6-758e84429a57-webhook-cert\") pod \"maas-controller-5cc6889694-dcsvv\" (UID: \"c0609b9e-c443-4ca7-b6e6-758e84429a57\") " pod="opendatahub/maas-controller-5cc6889694-dcsvv" Jun 14 13:46:12.334777 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:12.334746 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b787498dd-ghr5r" Jun 14 13:46:12.469262 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:12.469236 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b787498dd-ghr5r"] Jun 14 13:46:12.470614 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:46:12.470585 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e0d577d_3325_4cfa_8803_a1085fb35f32.slice/crio-f3da35f551eb6e90dfba1f186ea4958de64c0fa8a5443cb1b4c55f534295615d WatchSource:0}: Error finding container f3da35f551eb6e90dfba1f186ea4958de64c0fa8a5443cb1b4c55f534295615d: Status 404 returned error can't find the container with id f3da35f551eb6e90dfba1f186ea4958de64c0fa8a5443cb1b4c55f534295615d Jun 14 13:46:12.522729 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:12.522670 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cc6889694-dcsvv" Jun 14 13:46:12.656937 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:12.656909 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cc6889694-dcsvv"] Jun 14 13:46:12.658308 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:46:12.658281 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0609b9e_c443_4ca7_b6e6_758e84429a57.slice/crio-8461bdfa5d76b8477385dfe1a29cec390985c1267bd0059c31c7215e8d836a41 WatchSource:0}: Error finding container 8461bdfa5d76b8477385dfe1a29cec390985c1267bd0059c31c7215e8d836a41: Status 404 returned error can't find the container with id 8461bdfa5d76b8477385dfe1a29cec390985c1267bd0059c31c7215e8d836a41 Jun 14 13:46:12.675258 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:12.675228 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b787498dd-ghr5r" event={"ID":"7e0d577d-3325-4cfa-8803-a1085fb35f32","Type":"ContainerStarted","Data":"f3da35f551eb6e90dfba1f186ea4958de64c0fa8a5443cb1b4c55f534295615d"} Jun 14 13:46:12.676454 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:12.676432 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cc6889694-dcsvv" event={"ID":"c0609b9e-c443-4ca7-b6e6-758e84429a57","Type":"ContainerStarted","Data":"8461bdfa5d76b8477385dfe1a29cec390985c1267bd0059c31c7215e8d836a41"} Jun 14 13:46:15.334137 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:15.334101 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:46:15.436658 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:15.436560 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:46:15.706980 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:15.706871 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b787498dd-ghr5r" event={"ID":"7e0d577d-3325-4cfa-8803-a1085fb35f32","Type":"ContainerStarted","Data":"60b6b3881792e5b70108a855d6896c6af77da4064398102060dd490f513fda9c"} Jun 14 13:46:15.706980 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:15.706957 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6b787498dd-ghr5r" Jun 14 13:46:15.708591 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:15.708566 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cc6889694-dcsvv" event={"ID":"c0609b9e-c443-4ca7-b6e6-758e84429a57","Type":"ContainerStarted","Data":"d70e02345187cccf036246975fe4979d944fe55b22f967c751b039bef3a1da78"} Jun 14 13:46:15.708772 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:15.708627 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5cc6889694-dcsvv" Jun 14 13:46:15.726532 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:15.726481 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6b787498dd-ghr5r" podStartSLOduration=2.045311006 podStartE2EDuration="4.726467612s" totalImagesPullingTime="2.681156606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:46:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:46:15.725277397 +0000 UTC m=+808.398545343" watchObservedRunningTime="2026-06-14 13:46:15.726467612 +0000 UTC m=+808.399735558" Jun 14 13:46:15.743363 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:15.743317 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5cc6889694-dcsvv" podStartSLOduration=2.26219261 podStartE2EDuration="4.74330308s" totalImagesPullingTime="2.48111047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:46:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:46:15.74118773 +0000 UTC m=+808.414455691" watchObservedRunningTime="2026-06-14 13:46:15.74330308 +0000 UTC m=+808.416571026" Jun 14 13:46:26.721253 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:26.721214 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5cc6889694-dcsvv" Jun 14 13:46:26.721630 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:26.721477 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6b787498dd-ghr5r" Jun 14 13:46:26.773381 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:26.773348 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b787498dd-ghr5r"] Jun 14 13:46:26.778948 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:26.778895 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6b787498dd-ghr5r" podUID="7e0d577d-3325-4cfa-8803-a1085fb35f32" containerName="manager" containerID="cri-o://60b6b3881792e5b70108a855d6896c6af77da4064398102060dd490f513fda9c" gracePeriod=30 Jun 14 13:46:27.035033 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:27.035010 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b787498dd-ghr5r" Jun 14 13:46:27.162709 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:27.162650 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpph9\" (UniqueName: \"kubernetes.io/projected/7e0d577d-3325-4cfa-8803-a1085fb35f32-kube-api-access-rpph9\") pod \"7e0d577d-3325-4cfa-8803-a1085fb35f32\" (UID: \"7e0d577d-3325-4cfa-8803-a1085fb35f32\") " Jun 14 13:46:27.162871 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:27.162753 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7e0d577d-3325-4cfa-8803-a1085fb35f32-webhook-cert\") pod \"7e0d577d-3325-4cfa-8803-a1085fb35f32\" (UID: \"7e0d577d-3325-4cfa-8803-a1085fb35f32\") " Jun 14 13:46:27.164904 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:27.164878 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e0d577d-3325-4cfa-8803-a1085fb35f32-kube-api-access-rpph9" (OuterVolumeSpecName: "kube-api-access-rpph9") pod "7e0d577d-3325-4cfa-8803-a1085fb35f32" (UID: "7e0d577d-3325-4cfa-8803-a1085fb35f32"). InnerVolumeSpecName "kube-api-access-rpph9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 13:46:27.165020 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:27.164912 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e0d577d-3325-4cfa-8803-a1085fb35f32-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7e0d577d-3325-4cfa-8803-a1085fb35f32" (UID: "7e0d577d-3325-4cfa-8803-a1085fb35f32"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 13:46:27.263925 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:27.263846 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpph9\" (UniqueName: \"kubernetes.io/projected/7e0d577d-3325-4cfa-8803-a1085fb35f32-kube-api-access-rpph9\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:46:27.263925 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:27.263872 2557 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7e0d577d-3325-4cfa-8803-a1085fb35f32-webhook-cert\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\"" Jun 14 13:46:27.785368 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:27.785334 2557 generic.go:356] "Generic (PLEG): container finished" podID="7e0d577d-3325-4cfa-8803-a1085fb35f32" containerID="60b6b3881792e5b70108a855d6896c6af77da4064398102060dd490f513fda9c" exitCode=0 Jun 14 13:46:27.785808 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:27.785375 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b787498dd-ghr5r" Jun 14 13:46:27.785808 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:27.785420 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b787498dd-ghr5r" event={"ID":"7e0d577d-3325-4cfa-8803-a1085fb35f32","Type":"ContainerDied","Data":"60b6b3881792e5b70108a855d6896c6af77da4064398102060dd490f513fda9c"} Jun 14 13:46:27.785808 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:27.785474 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b787498dd-ghr5r" event={"ID":"7e0d577d-3325-4cfa-8803-a1085fb35f32","Type":"ContainerDied","Data":"f3da35f551eb6e90dfba1f186ea4958de64c0fa8a5443cb1b4c55f534295615d"} Jun 14 13:46:27.785808 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:27.785496 2557 scope.go:117] "RemoveContainer" containerID="60b6b3881792e5b70108a855d6896c6af77da4064398102060dd490f513fda9c" Jun 14 13:46:27.794880 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:27.794862 2557 scope.go:117] "RemoveContainer" containerID="60b6b3881792e5b70108a855d6896c6af77da4064398102060dd490f513fda9c" Jun 14 13:46:27.795156 ip-10-0-131-48 kubenswrapper[2557]: E0614 13:46:27.795136 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60b6b3881792e5b70108a855d6896c6af77da4064398102060dd490f513fda9c\": container with ID starting with 60b6b3881792e5b70108a855d6896c6af77da4064398102060dd490f513fda9c not found: ID does not exist" containerID="60b6b3881792e5b70108a855d6896c6af77da4064398102060dd490f513fda9c" Jun 14 13:46:27.795226 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:27.795168 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60b6b3881792e5b70108a855d6896c6af77da4064398102060dd490f513fda9c"} err="failed to get container status \"60b6b3881792e5b70108a855d6896c6af77da4064398102060dd490f513fda9c\": rpc error: code = NotFound desc = could not find container \"60b6b3881792e5b70108a855d6896c6af77da4064398102060dd490f513fda9c\": container with ID starting with 60b6b3881792e5b70108a855d6896c6af77da4064398102060dd490f513fda9c not found: ID does not exist" Jun 14 13:46:27.802739 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:27.802717 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b787498dd-ghr5r"] Jun 14 13:46:27.806392 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:27.806373 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6b787498dd-ghr5r"] Jun 14 13:46:29.734801 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:29.734770 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e0d577d-3325-4cfa-8803-a1085fb35f32" path="/var/lib/kubelet/pods/7e0d577d-3325-4cfa-8803-a1085fb35f32/volumes" Jun 14 13:46:44.901736 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:44.901702 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:46:44.963741 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:44.963704 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-94c5b9d7f-592vz"] Jun 14 13:46:44.964175 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:44.964158 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e0d577d-3325-4cfa-8803-a1085fb35f32" containerName="manager" Jun 14 13:46:44.964263 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:44.964180 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e0d577d-3325-4cfa-8803-a1085fb35f32" containerName="manager" Jun 14 13:46:44.964336 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:44.964323 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e0d577d-3325-4cfa-8803-a1085fb35f32" containerName="manager" Jun 14 13:46:44.967722 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:44.967676 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-94c5b9d7f-592vz" Jun 14 13:46:44.970660 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:44.970635 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-fbmt7\"" Jun 14 13:46:44.970783 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:44.970756 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 14 13:46:44.980492 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:44.980467 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-94c5b9d7f-592vz"] Jun 14 13:46:45.067212 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:45.067176 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:46:45.131706 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:45.131656 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqv4t\" (UniqueName: \"kubernetes.io/projected/9d69edf7-8f30-4c04-bef9-bb0f2ee9807b-kube-api-access-gqv4t\") pod \"maas-api-94c5b9d7f-592vz\" (UID: \"9d69edf7-8f30-4c04-bef9-bb0f2ee9807b\") " pod="opendatahub/maas-api-94c5b9d7f-592vz" Jun 14 13:46:45.131860 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:45.131713 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d69edf7-8f30-4c04-bef9-bb0f2ee9807b-openshift-service-ca\") pod \"maas-api-94c5b9d7f-592vz\" (UID: \"9d69edf7-8f30-4c04-bef9-bb0f2ee9807b\") " pod="opendatahub/maas-api-94c5b9d7f-592vz" Jun 14 13:46:45.131907 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:45.131857 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d69edf7-8f30-4c04-bef9-bb0f2ee9807b-maas-api-tls\") pod \"maas-api-94c5b9d7f-592vz\" (UID: \"9d69edf7-8f30-4c04-bef9-bb0f2ee9807b\") " pod="opendatahub/maas-api-94c5b9d7f-592vz" Jun 14 13:46:45.232541 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:45.232439 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqv4t\" (UniqueName: \"kubernetes.io/projected/9d69edf7-8f30-4c04-bef9-bb0f2ee9807b-kube-api-access-gqv4t\") pod \"maas-api-94c5b9d7f-592vz\" (UID: \"9d69edf7-8f30-4c04-bef9-bb0f2ee9807b\") " pod="opendatahub/maas-api-94c5b9d7f-592vz" Jun 14 13:46:45.232541 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:45.232496 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d69edf7-8f30-4c04-bef9-bb0f2ee9807b-openshift-service-ca\") pod \"maas-api-94c5b9d7f-592vz\" (UID: \"9d69edf7-8f30-4c04-bef9-bb0f2ee9807b\") " pod="opendatahub/maas-api-94c5b9d7f-592vz" Jun 14 13:46:45.232843 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:45.232581 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d69edf7-8f30-4c04-bef9-bb0f2ee9807b-maas-api-tls\") pod \"maas-api-94c5b9d7f-592vz\" (UID: \"9d69edf7-8f30-4c04-bef9-bb0f2ee9807b\") " pod="opendatahub/maas-api-94c5b9d7f-592vz" Jun 14 13:46:45.233220 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:45.233200 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d69edf7-8f30-4c04-bef9-bb0f2ee9807b-openshift-service-ca\") pod \"maas-api-94c5b9d7f-592vz\" (UID: \"9d69edf7-8f30-4c04-bef9-bb0f2ee9807b\") " pod="opendatahub/maas-api-94c5b9d7f-592vz" Jun 14 13:46:45.234978 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:45.234958 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d69edf7-8f30-4c04-bef9-bb0f2ee9807b-maas-api-tls\") pod \"maas-api-94c5b9d7f-592vz\" (UID: \"9d69edf7-8f30-4c04-bef9-bb0f2ee9807b\") " pod="opendatahub/maas-api-94c5b9d7f-592vz" Jun 14 13:46:45.239925 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:45.239904 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqv4t\" (UniqueName: \"kubernetes.io/projected/9d69edf7-8f30-4c04-bef9-bb0f2ee9807b-kube-api-access-gqv4t\") pod \"maas-api-94c5b9d7f-592vz\" (UID: \"9d69edf7-8f30-4c04-bef9-bb0f2ee9807b\") " pod="opendatahub/maas-api-94c5b9d7f-592vz" Jun 14 13:46:45.279767 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:45.279740 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-94c5b9d7f-592vz" Jun 14 13:46:45.313158 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:45.313127 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:46:45.411509 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:45.411475 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:46:45.418885 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:45.418856 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-lgs9j"] Jun 14 13:46:45.423489 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:45.423465 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-lgs9j" Jun 14 13:46:45.426474 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:45.426199 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 14 13:46:45.426474 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:45.426279 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-5mfxd\"" Jun 14 13:46:45.427919 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:45.427894 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-94c5b9d7f-592vz"] Jun 14 13:46:45.428728 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:46:45.428671 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d69edf7_8f30_4c04_bef9_bb0f2ee9807b.slice/crio-d7d11a09a21dd250db392d97534d1cfa7e6fe9ebd3146beb572e8138ac6554ec WatchSource:0}: Error finding container d7d11a09a21dd250db392d97534d1cfa7e6fe9ebd3146beb572e8138ac6554ec: Status 404 returned error can't find the container with id d7d11a09a21dd250db392d97534d1cfa7e6fe9ebd3146beb572e8138ac6554ec Jun 14 13:46:45.433776 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:45.433282 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-lgs9j"] Jun 14 13:46:45.439917 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:45.439893 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-5b2dr"] Jun 14 13:46:45.444012 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:45.443632 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-5b2dr" Jun 14 13:46:45.454083 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:45.454060 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-5b2dr"] Jun 14 13:46:45.535122 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:45.535051 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jknm2\" (UniqueName: \"kubernetes.io/projected/7c5a407c-3b50-45b3-8a65-27b60fb975bc-kube-api-access-jknm2\") pod \"payload-processing-699b6cd6c-5b2dr\" (UID: \"7c5a407c-3b50-45b3-8a65-27b60fb975bc\") " pod="openshift-ingress/payload-processing-699b6cd6c-5b2dr" Jun 14 13:46:45.535292 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:45.535145 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr69b\" (UniqueName: \"kubernetes.io/projected/cd489aad-2c62-4327-bfbb-17567d2ad0e9-kube-api-access-dr69b\") pod \"payload-pre-processing-579785bc64-lgs9j\" (UID: \"cd489aad-2c62-4327-bfbb-17567d2ad0e9\") " pod="openshift-ingress/payload-pre-processing-579785bc64-lgs9j" Jun 14 13:46:45.636207 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:45.636165 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr69b\" (UniqueName: \"kubernetes.io/projected/cd489aad-2c62-4327-bfbb-17567d2ad0e9-kube-api-access-dr69b\") pod \"payload-pre-processing-579785bc64-lgs9j\" (UID: \"cd489aad-2c62-4327-bfbb-17567d2ad0e9\") " pod="openshift-ingress/payload-pre-processing-579785bc64-lgs9j" Jun 14 13:46:45.636386 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:45.636336 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jknm2\" (UniqueName: \"kubernetes.io/projected/7c5a407c-3b50-45b3-8a65-27b60fb975bc-kube-api-access-jknm2\") pod \"payload-processing-699b6cd6c-5b2dr\" (UID: \"7c5a407c-3b50-45b3-8a65-27b60fb975bc\") " pod="openshift-ingress/payload-processing-699b6cd6c-5b2dr" Jun 14 13:46:45.645934 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:45.645905 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr69b\" (UniqueName: \"kubernetes.io/projected/cd489aad-2c62-4327-bfbb-17567d2ad0e9-kube-api-access-dr69b\") pod \"payload-pre-processing-579785bc64-lgs9j\" (UID: \"cd489aad-2c62-4327-bfbb-17567d2ad0e9\") " pod="openshift-ingress/payload-pre-processing-579785bc64-lgs9j" Jun 14 13:46:45.646051 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:45.645973 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jknm2\" (UniqueName: \"kubernetes.io/projected/7c5a407c-3b50-45b3-8a65-27b60fb975bc-kube-api-access-jknm2\") pod \"payload-processing-699b6cd6c-5b2dr\" (UID: \"7c5a407c-3b50-45b3-8a65-27b60fb975bc\") " pod="openshift-ingress/payload-processing-699b6cd6c-5b2dr" Jun 14 13:46:45.747375 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:45.747340 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-lgs9j" Jun 14 13:46:45.757457 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:45.757428 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-5b2dr" Jun 14 13:46:45.896101 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:45.895886 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-lgs9j"] Jun 14 13:46:45.898723 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:46:45.898677 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd489aad_2c62_4327_bfbb_17567d2ad0e9.slice/crio-e59ef92f3b2d1101c73ff2406ce077d941794e8d89c0f28805d3de9017df0e2b WatchSource:0}: Error finding container e59ef92f3b2d1101c73ff2406ce077d941794e8d89c0f28805d3de9017df0e2b: Status 404 returned error can't find the container with id e59ef92f3b2d1101c73ff2406ce077d941794e8d89c0f28805d3de9017df0e2b Jun 14 13:46:45.907186 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:45.906930 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-94c5b9d7f-592vz" event={"ID":"9d69edf7-8f30-4c04-bef9-bb0f2ee9807b","Type":"ContainerStarted","Data":"d7d11a09a21dd250db392d97534d1cfa7e6fe9ebd3146beb572e8138ac6554ec"} Jun 14 13:46:45.917465 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:45.917442 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-5b2dr"] Jun 14 13:46:45.919222 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:46:45.919197 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c5a407c_3b50_45b3_8a65_27b60fb975bc.slice/crio-afb5b3b7ab7b88d76f4872d18e1b46820891f546e9dd01afccc30066a00054f9 WatchSource:0}: Error finding container afb5b3b7ab7b88d76f4872d18e1b46820891f546e9dd01afccc30066a00054f9: Status 404 returned error can't find the container with id afb5b3b7ab7b88d76f4872d18e1b46820891f546e9dd01afccc30066a00054f9 Jun 14 13:46:46.921289 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:46.921230 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-5b2dr" event={"ID":"7c5a407c-3b50-45b3-8a65-27b60fb975bc","Type":"ContainerStarted","Data":"afb5b3b7ab7b88d76f4872d18e1b46820891f546e9dd01afccc30066a00054f9"} Jun 14 13:46:46.923164 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:46.923079 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-lgs9j" event={"ID":"cd489aad-2c62-4327-bfbb-17567d2ad0e9","Type":"ContainerStarted","Data":"e59ef92f3b2d1101c73ff2406ce077d941794e8d89c0f28805d3de9017df0e2b"} Jun 14 13:46:47.932038 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:47.931995 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-94c5b9d7f-592vz" event={"ID":"9d69edf7-8f30-4c04-bef9-bb0f2ee9807b","Type":"ContainerStarted","Data":"87731269bf63ff3cf82da91450cf8ceb6a238291d8ffcb03a1e02cf14548f84e"} Jun 14 13:46:47.932477 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:47.932087 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-94c5b9d7f-592vz" Jun 14 13:46:47.950508 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:47.950444 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-94c5b9d7f-592vz" podStartSLOduration=2.159290202 podStartE2EDuration="3.950422515s" totalImagesPullingTime="1.791132313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:46:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:46:47.947773012 +0000 UTC m=+840.621040959" watchObservedRunningTime="2026-06-14 13:46:47.950422515 +0000 UTC m=+840.623690462" Jun 14 13:46:48.372065 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:48.372037 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 14 13:46:48.940649 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:48.940613 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-5b2dr" event={"ID":"7c5a407c-3b50-45b3-8a65-27b60fb975bc","Type":"ContainerStarted","Data":"83856ffaf47978cc4f306706322d3c1d8fe3bd31a06e5889b8a8494539eaa4af"} Jun 14 13:46:48.941105 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:48.940693 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-5b2dr" Jun 14 13:46:48.942261 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:48.942238 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-lgs9j" event={"ID":"cd489aad-2c62-4327-bfbb-17567d2ad0e9","Type":"ContainerStarted","Data":"1afd486d71407960bec96a7e8e2dfde72e9f278e6ab915764049cb2ded7b3b7c"} Jun 14 13:46:48.942383 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:48.942373 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-lgs9j" Jun 14 13:46:48.956831 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:48.956787 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-5b2dr" podStartSLOduration=1.5084403530000001 podStartE2EDuration="3.956774327s" totalImagesPullingTime="2.448333974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:46:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:46:48.955472187 +0000 UTC m=+841.628740133" watchObservedRunningTime="2026-06-14 13:46:48.956774327 +0000 UTC m=+841.630042283" Jun 14 13:46:48.972032 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:48.971981 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-lgs9j" podStartSLOduration=1.501813823 podStartE2EDuration="3.971963989s" totalImagesPullingTime="2.470150166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:46:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:46:48.970408898 +0000 UTC m=+841.643676844" watchObservedRunningTime="2026-06-14 13:46:48.971963989 +0000 UTC m=+841.645231936" Jun 14 13:46:53.948920 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:53.948887 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-94c5b9d7f-592vz" Jun 14 13:46:59.950824 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:59.950794 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-5b2dr" Jun 14 13:46:59.951162 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:46:59.950857 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-lgs9j" Jun 14 13:47:34.920232 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:47:34.920193 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:47:35.018780 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:47:35.018738 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:47:37.745935 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:47:37.745843 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:47:47.785142 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:47:47.785029 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-dwq9q_1fea963c-a8b6-4071-8071-3e7149ef98cd/console-operator/1.log" Jun 14 13:47:47.788040 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:47:47.788017 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-dwq9q_1fea963c-a8b6-4071-8071-3e7149ef98cd/console-operator/1.log" Jun 14 13:47:47.789553 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:47:47.789535 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqj5p_08819fe4-b654-44d1-9773-a007a6044ec2/ovn-acl-logging/0.log" Jun 14 13:47:47.792690 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:47:47.792658 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqj5p_08819fe4-b654-44d1-9773-a007a6044ec2/ovn-acl-logging/0.log" Jun 14 13:47:49.419294 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:47:49.419251 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:47:51.481152 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:47:51.481119 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:48:00.082318 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:00.082282 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-2j9kz"] Jun 14 13:48:00.086699 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:00.086661 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2j9kz" Jun 14 13:48:00.089300 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:00.089277 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 14 13:48:00.089435 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:00.089280 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 14 13:48:00.090346 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:00.090326 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tzhcf\"" Jun 14 13:48:00.090469 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:00.090355 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 14 13:48:00.097311 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:00.097292 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-2j9kz"] Jun 14 13:48:00.103315 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:00.103291 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:48:00.245738 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:00.245677 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b87d160b-d18f-44e3-b0cc-d7dab09a4d51-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2j9kz\" (UID: \"b87d160b-d18f-44e3-b0cc-d7dab09a4d51\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2j9kz" Jun 14 13:48:00.245905 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:00.245762 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b87d160b-d18f-44e3-b0cc-d7dab09a4d51-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2j9kz\" (UID: \"b87d160b-d18f-44e3-b0cc-d7dab09a4d51\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2j9kz" Jun 14 13:48:00.245905 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:00.245786 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b87d160b-d18f-44e3-b0cc-d7dab09a4d51-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2j9kz\" (UID: \"b87d160b-d18f-44e3-b0cc-d7dab09a4d51\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2j9kz" Jun 14 13:48:00.245905 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:00.245806 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xv4m\" (UniqueName: \"kubernetes.io/projected/b87d160b-d18f-44e3-b0cc-d7dab09a4d51-kube-api-access-6xv4m\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2j9kz\" (UID: \"b87d160b-d18f-44e3-b0cc-d7dab09a4d51\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2j9kz" Jun 14 13:48:00.245905 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:00.245827 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b87d160b-d18f-44e3-b0cc-d7dab09a4d51-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2j9kz\" (UID: \"b87d160b-d18f-44e3-b0cc-d7dab09a4d51\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2j9kz" Jun 14 13:48:00.246050 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:00.245898 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b87d160b-d18f-44e3-b0cc-d7dab09a4d51-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2j9kz\" (UID: \"b87d160b-d18f-44e3-b0cc-d7dab09a4d51\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2j9kz" Jun 14 13:48:00.346602 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:00.346514 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b87d160b-d18f-44e3-b0cc-d7dab09a4d51-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2j9kz\" (UID: \"b87d160b-d18f-44e3-b0cc-d7dab09a4d51\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2j9kz" Jun 14 13:48:00.346602 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:00.346570 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b87d160b-d18f-44e3-b0cc-d7dab09a4d51-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2j9kz\" (UID: \"b87d160b-d18f-44e3-b0cc-d7dab09a4d51\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2j9kz" Jun 14 13:48:00.346602 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:00.346591 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b87d160b-d18f-44e3-b0cc-d7dab09a4d51-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2j9kz\" (UID: \"b87d160b-d18f-44e3-b0cc-d7dab09a4d51\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2j9kz" Jun 14 13:48:00.346880 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:00.346611 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xv4m\" (UniqueName: \"kubernetes.io/projected/b87d160b-d18f-44e3-b0cc-d7dab09a4d51-kube-api-access-6xv4m\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2j9kz\" (UID: \"b87d160b-d18f-44e3-b0cc-d7dab09a4d51\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2j9kz" Jun 14 13:48:00.346880 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:00.346640 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b87d160b-d18f-44e3-b0cc-d7dab09a4d51-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2j9kz\" (UID: \"b87d160b-d18f-44e3-b0cc-d7dab09a4d51\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2j9kz" Jun 14 13:48:00.346880 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:00.346662 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b87d160b-d18f-44e3-b0cc-d7dab09a4d51-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2j9kz\" (UID: \"b87d160b-d18f-44e3-b0cc-d7dab09a4d51\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2j9kz" Jun 14 13:48:00.347077 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:00.347056 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b87d160b-d18f-44e3-b0cc-d7dab09a4d51-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2j9kz\" (UID: \"b87d160b-d18f-44e3-b0cc-d7dab09a4d51\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2j9kz" Jun 14 13:48:00.347117 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:00.347053 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b87d160b-d18f-44e3-b0cc-d7dab09a4d51-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2j9kz\" (UID: \"b87d160b-d18f-44e3-b0cc-d7dab09a4d51\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2j9kz" Jun 14 13:48:00.347153 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:00.347133 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b87d160b-d18f-44e3-b0cc-d7dab09a4d51-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2j9kz\" (UID: \"b87d160b-d18f-44e3-b0cc-d7dab09a4d51\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2j9kz" Jun 14 13:48:00.348931 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:00.348914 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b87d160b-d18f-44e3-b0cc-d7dab09a4d51-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2j9kz\" (UID: \"b87d160b-d18f-44e3-b0cc-d7dab09a4d51\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2j9kz" Jun 14 13:48:00.349287 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:00.349270 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b87d160b-d18f-44e3-b0cc-d7dab09a4d51-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2j9kz\" (UID: \"b87d160b-d18f-44e3-b0cc-d7dab09a4d51\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2j9kz" Jun 14 13:48:00.355353 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:00.355330 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xv4m\" (UniqueName: \"kubernetes.io/projected/b87d160b-d18f-44e3-b0cc-d7dab09a4d51-kube-api-access-6xv4m\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2j9kz\" (UID: \"b87d160b-d18f-44e3-b0cc-d7dab09a4d51\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2j9kz" Jun 14 13:48:00.400342 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:00.400294 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2j9kz" Jun 14 13:48:00.545039 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:00.545012 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-2j9kz"] Jun 14 13:48:00.545868 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:48:00.545842 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb87d160b_d18f_44e3_b0cc_d7dab09a4d51.slice/crio-27bbfd72aeb18d7908d0f725858edec62e875cb0f999a823dc38125806b9821e WatchSource:0}: Error finding container 27bbfd72aeb18d7908d0f725858edec62e875cb0f999a823dc38125806b9821e: Status 404 returned error can't find the container with id 27bbfd72aeb18d7908d0f725858edec62e875cb0f999a823dc38125806b9821e Jun 14 13:48:01.382518 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:01.382483 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2j9kz" event={"ID":"b87d160b-d18f-44e3-b0cc-d7dab09a4d51","Type":"ContainerStarted","Data":"27bbfd72aeb18d7908d0f725858edec62e875cb0f999a823dc38125806b9821e"} Jun 14 13:48:03.398604 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:03.398565 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2j9kz" event={"ID":"b87d160b-d18f-44e3-b0cc-d7dab09a4d51","Type":"ContainerStarted","Data":"4a787baf61f8fa1f0620d6678e798d3fe034ce7c5ef1c8dad46b42120597f219"} Jun 14 13:48:05.864888 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:05.864855 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:48:08.430837 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:08.430804 2557 generic.go:356] "Generic (PLEG): container finished" podID="b87d160b-d18f-44e3-b0cc-d7dab09a4d51" containerID="4a787baf61f8fa1f0620d6678e798d3fe034ce7c5ef1c8dad46b42120597f219" exitCode=0 Jun 14 13:48:08.431231 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:08.430877 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2j9kz" event={"ID":"b87d160b-d18f-44e3-b0cc-d7dab09a4d51","Type":"ContainerDied","Data":"4a787baf61f8fa1f0620d6678e798d3fe034ce7c5ef1c8dad46b42120597f219"} Jun 14 13:48:10.445829 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:10.445795 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2j9kz" event={"ID":"b87d160b-d18f-44e3-b0cc-d7dab09a4d51","Type":"ContainerStarted","Data":"fabb6bd2455b9d12b50adf8f5aab0c491ce2392cdba49b93c079daaf28561d37"} Jun 14 13:48:10.464871 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:10.464819 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2j9kz" podStartSLOduration=2.5487435290000002 podStartE2EDuration="10.464804243s" totalImagesPullingTime="3.81303811s" totalInitContainerRuntime="4.103022604s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:48:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:48:10.463178917 +0000 UTC m=+923.136446890" watchObservedRunningTime="2026-06-14 13:48:10.464804243 +0000 UTC m=+923.138072192" Jun 14 13:48:20.400854 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:20.400801 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2j9kz" Jun 14 13:48:20.401445 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:20.400887 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2j9kz" Jun 14 13:48:20.413441 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:20.413413 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2j9kz" Jun 14 13:48:20.516410 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:20.516379 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2j9kz" Jun 14 13:48:24.680724 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:24.680690 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:48:49.380186 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:49.380151 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp"] Jun 14 13:48:49.384010 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:49.383993 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp" Jun 14 13:48:49.386830 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:49.386811 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 14 13:48:49.394288 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:49.394267 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp"] Jun 14 13:48:49.405047 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:49.405019 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:48:49.505404 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:49.505370 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c991c35-e3a2-44c0-aed0-db8df89017df-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp\" (UID: \"9c991c35-e3a2-44c0-aed0-db8df89017df\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp" Jun 14 13:48:49.505404 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:49.505416 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxvs5\" (UniqueName: \"kubernetes.io/projected/9c991c35-e3a2-44c0-aed0-db8df89017df-kube-api-access-cxvs5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp\" (UID: \"9c991c35-e3a2-44c0-aed0-db8df89017df\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp" Jun 14 13:48:49.505664 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:49.505435 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c991c35-e3a2-44c0-aed0-db8df89017df-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp\" (UID: \"9c991c35-e3a2-44c0-aed0-db8df89017df\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp" Jun 14 13:48:49.505664 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:49.505569 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c991c35-e3a2-44c0-aed0-db8df89017df-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp\" (UID: \"9c991c35-e3a2-44c0-aed0-db8df89017df\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp" Jun 14 13:48:49.505664 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:49.505612 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9c991c35-e3a2-44c0-aed0-db8df89017df-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp\" (UID: \"9c991c35-e3a2-44c0-aed0-db8df89017df\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp" Jun 14 13:48:49.505870 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:49.505783 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c991c35-e3a2-44c0-aed0-db8df89017df-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp\" (UID: \"9c991c35-e3a2-44c0-aed0-db8df89017df\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp" Jun 14 13:48:49.606427 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:49.606381 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c991c35-e3a2-44c0-aed0-db8df89017df-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp\" (UID: \"9c991c35-e3a2-44c0-aed0-db8df89017df\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp" Jun 14 13:48:49.606596 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:49.606442 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9c991c35-e3a2-44c0-aed0-db8df89017df-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp\" (UID: \"9c991c35-e3a2-44c0-aed0-db8df89017df\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp" Jun 14 13:48:49.606596 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:49.606544 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c991c35-e3a2-44c0-aed0-db8df89017df-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp\" (UID: \"9c991c35-e3a2-44c0-aed0-db8df89017df\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp" Jun 14 13:48:49.606596 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:49.606589 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c991c35-e3a2-44c0-aed0-db8df89017df-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp\" (UID: \"9c991c35-e3a2-44c0-aed0-db8df89017df\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp" Jun 14 13:48:49.606757 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:49.606628 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxvs5\" (UniqueName: \"kubernetes.io/projected/9c991c35-e3a2-44c0-aed0-db8df89017df-kube-api-access-cxvs5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp\" (UID: \"9c991c35-e3a2-44c0-aed0-db8df89017df\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp" Jun 14 13:48:49.606757 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:49.606653 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c991c35-e3a2-44c0-aed0-db8df89017df-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp\" (UID: \"9c991c35-e3a2-44c0-aed0-db8df89017df\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp" Jun 14 13:48:49.606878 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:49.606849 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c991c35-e3a2-44c0-aed0-db8df89017df-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp\" (UID: \"9c991c35-e3a2-44c0-aed0-db8df89017df\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp" Jun 14 13:48:49.607018 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:49.606883 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9c991c35-e3a2-44c0-aed0-db8df89017df-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp\" (UID: \"9c991c35-e3a2-44c0-aed0-db8df89017df\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp" Jun 14 13:48:49.607018 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:49.606998 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c991c35-e3a2-44c0-aed0-db8df89017df-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp\" (UID: \"9c991c35-e3a2-44c0-aed0-db8df89017df\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp" Jun 14 13:48:49.608915 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:49.608889 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c991c35-e3a2-44c0-aed0-db8df89017df-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp\" (UID: \"9c991c35-e3a2-44c0-aed0-db8df89017df\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp" Jun 14 13:48:49.609155 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:49.609138 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c991c35-e3a2-44c0-aed0-db8df89017df-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp\" (UID: \"9c991c35-e3a2-44c0-aed0-db8df89017df\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp" Jun 14 13:48:49.615065 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:49.615042 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxvs5\" (UniqueName: \"kubernetes.io/projected/9c991c35-e3a2-44c0-aed0-db8df89017df-kube-api-access-cxvs5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp\" (UID: \"9c991c35-e3a2-44c0-aed0-db8df89017df\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp" Jun 14 13:48:49.696129 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:49.696047 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp" Jun 14 13:48:49.841500 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:49.841472 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp"] Jun 14 13:48:49.842465 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:48:49.842440 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c991c35_e3a2_44c0_aed0_db8df89017df.slice/crio-fb7f9d01b617cb1afe0e2309dc3ed660b369cae34abbe8ade1573d899d99add5 WatchSource:0}: Error finding container fb7f9d01b617cb1afe0e2309dc3ed660b369cae34abbe8ade1573d899d99add5: Status 404 returned error can't find the container with id fb7f9d01b617cb1afe0e2309dc3ed660b369cae34abbe8ade1573d899d99add5 Jun 14 13:48:50.696451 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:50.696407 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp" event={"ID":"9c991c35-e3a2-44c0-aed0-db8df89017df","Type":"ContainerStarted","Data":"b4ba344137b9891f7ca734ba918053534e0051cc167bbcea4c686b43f77dd4b3"} Jun 14 13:48:50.696946 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:50.696508 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp" event={"ID":"9c991c35-e3a2-44c0-aed0-db8df89017df","Type":"ContainerStarted","Data":"fb7f9d01b617cb1afe0e2309dc3ed660b369cae34abbe8ade1573d899d99add5"} Jun 14 13:48:51.705718 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:51.705660 2557 generic.go:356] "Generic (PLEG): container finished" podID="9c991c35-e3a2-44c0-aed0-db8df89017df" containerID="b4ba344137b9891f7ca734ba918053534e0051cc167bbcea4c686b43f77dd4b3" exitCode=0 Jun 14 13:48:51.706392 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:51.705744 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp" event={"ID":"9c991c35-e3a2-44c0-aed0-db8df89017df","Type":"ContainerDied","Data":"b4ba344137b9891f7ca734ba918053534e0051cc167bbcea4c686b43f77dd4b3"} Jun 14 13:48:51.706392 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:51.706285 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 13:48:52.713964 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:52.713926 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp" event={"ID":"9c991c35-e3a2-44c0-aed0-db8df89017df","Type":"ContainerStarted","Data":"f64540be16683cfc7f64267c932bda4f8a700894d8bad1c4b38311d7d6a2ed1c"} Jun 14 13:48:52.734930 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:52.734875 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp" podStartSLOduration=2.285395109 podStartE2EDuration="3.734860459s" totalImagesPullingTime="160.381337ms" totalInitContainerRuntime="1.289084013s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:48:52.731854569 +0000 UTC m=+965.405122507" watchObservedRunningTime="2026-06-14 13:48:52.734860459 +0000 UTC m=+965.408128404" Jun 14 13:48:59.696273 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:59.696240 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp" Jun 14 13:48:59.696676 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:59.696325 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp" Jun 14 13:48:59.708712 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:59.708672 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp" Jun 14 13:48:59.766256 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:48:59.766224 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp" Jun 14 13:49:02.678411 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:49:02.678373 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wct6"] Jun 14 13:49:02.683326 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:49:02.683310 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wct6" Jun 14 13:49:02.685927 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:49:02.685911 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 14 13:49:02.692245 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:49:02.692219 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wct6"] Jun 14 13:49:02.727848 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:49:02.727816 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3a11db6-2b81-484b-9e32-a09fbf8a1485-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wct6\" (UID: \"b3a11db6-2b81-484b-9e32-a09fbf8a1485\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wct6" Jun 14 13:49:02.728021 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:49:02.727895 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3a11db6-2b81-484b-9e32-a09fbf8a1485-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wct6\" (UID: \"b3a11db6-2b81-484b-9e32-a09fbf8a1485\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wct6" Jun 14 13:49:02.728021 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:49:02.727933 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3a11db6-2b81-484b-9e32-a09fbf8a1485-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wct6\" (UID: \"b3a11db6-2b81-484b-9e32-a09fbf8a1485\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wct6" Jun 14 13:49:02.728021 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:49:02.727980 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b3a11db6-2b81-484b-9e32-a09fbf8a1485-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wct6\" (UID: \"b3a11db6-2b81-484b-9e32-a09fbf8a1485\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wct6" Jun 14 13:49:02.728021 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:49:02.728005 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwkq5\" (UniqueName: \"kubernetes.io/projected/b3a11db6-2b81-484b-9e32-a09fbf8a1485-kube-api-access-rwkq5\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wct6\" (UID: \"b3a11db6-2b81-484b-9e32-a09fbf8a1485\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wct6" Jun 14 13:49:02.728201 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:49:02.728076 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3a11db6-2b81-484b-9e32-a09fbf8a1485-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wct6\" (UID: \"b3a11db6-2b81-484b-9e32-a09fbf8a1485\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wct6" Jun 14 13:49:02.770034 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:49:02.769993 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:49:02.828857 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:49:02.828825 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3a11db6-2b81-484b-9e32-a09fbf8a1485-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wct6\" (UID: \"b3a11db6-2b81-484b-9e32-a09fbf8a1485\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wct6" Jun 14 13:49:02.829039 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:49:02.828866 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b3a11db6-2b81-484b-9e32-a09fbf8a1485-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wct6\" (UID: \"b3a11db6-2b81-484b-9e32-a09fbf8a1485\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wct6" Jun 14 13:49:02.829039 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:49:02.828886 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwkq5\" (UniqueName: \"kubernetes.io/projected/b3a11db6-2b81-484b-9e32-a09fbf8a1485-kube-api-access-rwkq5\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wct6\" (UID: \"b3a11db6-2b81-484b-9e32-a09fbf8a1485\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wct6" Jun 14 13:49:02.829039 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:49:02.828920 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3a11db6-2b81-484b-9e32-a09fbf8a1485-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wct6\" (UID: \"b3a11db6-2b81-484b-9e32-a09fbf8a1485\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wct6" Jun 14 13:49:02.829039 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:49:02.828994 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3a11db6-2b81-484b-9e32-a09fbf8a1485-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wct6\" (UID: \"b3a11db6-2b81-484b-9e32-a09fbf8a1485\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wct6" Jun 14 13:49:02.829281 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:49:02.829074 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3a11db6-2b81-484b-9e32-a09fbf8a1485-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wct6\" (UID: \"b3a11db6-2b81-484b-9e32-a09fbf8a1485\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wct6" Jun 14 13:49:02.829341 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:49:02.829324 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3a11db6-2b81-484b-9e32-a09fbf8a1485-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wct6\" (UID: \"b3a11db6-2b81-484b-9e32-a09fbf8a1485\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wct6" Jun 14 13:49:02.829392 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:49:02.829338 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b3a11db6-2b81-484b-9e32-a09fbf8a1485-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wct6\" (UID: \"b3a11db6-2b81-484b-9e32-a09fbf8a1485\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wct6" Jun 14 13:49:02.829460 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:49:02.829438 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3a11db6-2b81-484b-9e32-a09fbf8a1485-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wct6\" (UID: \"b3a11db6-2b81-484b-9e32-a09fbf8a1485\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wct6" Jun 14 13:49:02.831253 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:49:02.831230 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3a11db6-2b81-484b-9e32-a09fbf8a1485-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wct6\" (UID: \"b3a11db6-2b81-484b-9e32-a09fbf8a1485\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wct6" Jun 14 13:49:02.831511 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:49:02.831495 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3a11db6-2b81-484b-9e32-a09fbf8a1485-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wct6\" (UID: \"b3a11db6-2b81-484b-9e32-a09fbf8a1485\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wct6" Jun 14 13:49:02.836793 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:49:02.836775 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwkq5\" (UniqueName: \"kubernetes.io/projected/b3a11db6-2b81-484b-9e32-a09fbf8a1485-kube-api-access-rwkq5\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wct6\" (UID: \"b3a11db6-2b81-484b-9e32-a09fbf8a1485\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wct6" Jun 14 13:49:02.994628 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:49:02.994542 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wct6" Jun 14 13:49:03.131848 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:49:03.131821 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wct6"] Jun 14 13:49:03.133629 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:49:03.133600 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3a11db6_2b81_484b_9e32_a09fbf8a1485.slice/crio-96f3a7a7f8a57496140fcde189b89f61531ce67a7f6766dd607b227785a3e1f7 WatchSource:0}: Error finding container 96f3a7a7f8a57496140fcde189b89f61531ce67a7f6766dd607b227785a3e1f7: Status 404 returned error can't find the container with id 96f3a7a7f8a57496140fcde189b89f61531ce67a7f6766dd607b227785a3e1f7 Jun 14 13:49:03.780492 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:49:03.780455 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wct6" event={"ID":"b3a11db6-2b81-484b-9e32-a09fbf8a1485","Type":"ContainerStarted","Data":"abd7ba68c6d2c7cadd77ebad0cc6a08c44286e650e8cbaa9d19cad8ef36404af"} Jun 14 13:49:03.780901 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:49:03.780509 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wct6" event={"ID":"b3a11db6-2b81-484b-9e32-a09fbf8a1485","Type":"ContainerStarted","Data":"96f3a7a7f8a57496140fcde189b89f61531ce67a7f6766dd607b227785a3e1f7"} Jun 14 13:49:11.786912 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:49:11.786814 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:49:34.164832 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:49:34.164798 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:50:47.418165 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:50:47.418134 2557 generic.go:356] "Generic (PLEG): container finished" podID="b3a11db6-2b81-484b-9e32-a09fbf8a1485" containerID="abd7ba68c6d2c7cadd77ebad0cc6a08c44286e650e8cbaa9d19cad8ef36404af" exitCode=0 Jun 14 13:50:47.418657 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:50:47.418206 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wct6" event={"ID":"b3a11db6-2b81-484b-9e32-a09fbf8a1485","Type":"ContainerDied","Data":"abd7ba68c6d2c7cadd77ebad0cc6a08c44286e650e8cbaa9d19cad8ef36404af"} Jun 14 13:50:48.426204 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:50:48.426165 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wct6" event={"ID":"b3a11db6-2b81-484b-9e32-a09fbf8a1485","Type":"ContainerStarted","Data":"cceaf2da6ad0f15666e3a7a1239447d9535f7878583d2a42dd737f79c18aa724"} Jun 14 13:50:48.445151 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:50:48.445097 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wct6" podStartSLOduration=2.167404426 podStartE2EDuration="1m46.44507875s" totalImagesPullingTime="180.820623ms" totalInitContainerRuntime="1m44.096853701s" isStatefulPod=false podCreationTimestamp="2026-06-14 13:49:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:50:48.443377637 +0000 UTC m=+1081.116645584" watchObservedRunningTime="2026-06-14 13:50:48.44507875 +0000 UTC m=+1081.118346723" Jun 14 13:50:52.995270 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:50:52.995236 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wct6" Jun 14 13:50:52.995728 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:50:52.995398 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wct6" Jun 14 13:50:53.008135 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:50:53.008113 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wct6" Jun 14 13:50:53.469693 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:50:53.469648 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wct6" Jun 14 13:52:47.829490 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:52:47.829389 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-dwq9q_1fea963c-a8b6-4071-8071-3e7149ef98cd/console-operator/1.log" Jun 14 13:52:47.833581 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:52:47.833563 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqj5p_08819fe4-b654-44d1-9773-a007a6044ec2/ovn-acl-logging/0.log" Jun 14 13:52:47.834822 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:52:47.834799 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-dwq9q_1fea963c-a8b6-4071-8071-3e7149ef98cd/console-operator/1.log" Jun 14 13:52:47.838875 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:52:47.838860 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqj5p_08819fe4-b654-44d1-9773-a007a6044ec2/ovn-acl-logging/0.log" Jun 14 13:52:57.560926 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:52:57.560892 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:52:57.609415 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:52:57.609382 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:56:00.398663 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:00.398635 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-765bd5bf78-fdxg4_3f9d0f1a-4449-4aa0-b525-1751a0045b89/nginx/0.log" Jun 14 13:56:00.603591 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:00.603565 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-pvvpc_5dcb78f0-4d50-48c5-9eaf-666f497af019/manager/0.log" Jun 14 13:56:00.715396 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:00.715321 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-gjkfc_e50efa17-b71b-4dd7-b400-2987b066484c/manager/0.log" Jun 14 13:56:00.825201 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:00.825166 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-94c5b9d7f-592vz_9d69edf7-8f30-4c04-bef9-bb0f2ee9807b/maas-api/0.log" Jun 14 13:56:00.934389 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:00.934357 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5cc6889694-dcsvv_c0609b9e-c443-4ca7-b6e6-758e84429a57/manager/0.log" Jun 14 13:56:01.042671 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:01.042582 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-b9q9g_82a5a742-6e87-4232-ab75-fbb447d181ae/server/0.log" Jun 14 13:56:01.155756 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:01.155724 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-t6l8h_5b8c3d54-d4b9-4d03-b44d-9961b5cc38d8/manager/0.log" Jun 14 13:56:01.259174 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:01.259147 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b7b4955f8-dpchh_b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7/copy-manifests/0.log" Jun 14 13:56:01.265406 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:01.265385 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b7b4955f8-dpchh_b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7/manager/0.log" Jun 14 13:56:01.633203 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:01.633174 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-lzgh6_9010b236-55e0-4c02-97ea-5d7227dee236/postgres/0.log" Jun 14 13:56:02.356201 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:02.356169 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq_5f93def8-28bf-46a9-b56e-c83fa29d56f2/pull/0.log" Jun 14 13:56:02.362131 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:02.362108 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq_5f93def8-28bf-46a9-b56e-c83fa29d56f2/extract/0.log" Jun 14 13:56:02.367933 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:02.367909 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq_5f93def8-28bf-46a9-b56e-c83fa29d56f2/util/0.log" Jun 14 13:56:02.470479 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:02.470449 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr_07b7c58c-e6d1-48c8-b09d-76cb3edd79ca/util/0.log" Jun 14 13:56:02.475814 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:02.475792 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr_07b7c58c-e6d1-48c8-b09d-76cb3edd79ca/pull/0.log" Jun 14 13:56:02.481020 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:02.481002 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr_07b7c58c-e6d1-48c8-b09d-76cb3edd79ca/extract/0.log" Jun 14 13:56:02.616167 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:02.616084 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr_b6602eea-9856-483b-9eed-9627f36440a1/util/0.log" Jun 14 13:56:02.622177 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:02.622154 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr_b6602eea-9856-483b-9eed-9627f36440a1/pull/0.log" Jun 14 13:56:02.627925 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:02.627907 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr_b6602eea-9856-483b-9eed-9627f36440a1/extract/0.log" Jun 14 13:56:02.734938 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:02.734911 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r_524c838e-80d0-4f67-9ade-042a8a96bc21/util/0.log" Jun 14 13:56:02.740714 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:02.740671 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r_524c838e-80d0-4f67-9ade-042a8a96bc21/pull/0.log" Jun 14 13:56:02.746472 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:02.746451 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r_524c838e-80d0-4f67-9ade-042a8a96bc21/extract/0.log" Jun 14 13:56:02.954849 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:02.954821 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-5kkmg_a07c9b25-51cc-4d4d-ae55-631be3dcea14/manager/0.log" Jun 14 13:56:04.036647 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:04.036611 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-b5k8z_d45a6ea3-3615-4cce-8f85-6c15bf98fc5e/discovery/0.log" Jun 14 13:56:04.255466 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:04.255438 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f7b87855f-xfnvr_14125b39-a31f-40ce-be74-40bf60e697b4/kube-auth-proxy/0.log" Jun 14 13:56:04.462906 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:04.462875 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-lgs9j_cd489aad-2c62-4327-bfbb-17567d2ad0e9/payload-pre-processing/0.log" Jun 14 13:56:04.564843 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:04.564814 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-5b2dr_7c5a407c-3b50-45b3-8a65-27b60fb975bc/payload-processing/0.log" Jun 14 13:56:04.670577 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:04.670547 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-565d7ffdb8-hjw45_341c9198-cdc6-43c8-a9bd-eb0e957f2e19/router/0.log" Jun 14 13:56:05.110274 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:05.110247 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-2j9kz_b87d160b-d18f-44e3-b0cc-d7dab09a4d51/storage-initializer/0.log" Jun 14 13:56:05.116357 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:05.116339 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-2j9kz_b87d160b-d18f-44e3-b0cc-d7dab09a4d51/main/0.log" Jun 14 13:56:05.337660 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:05.337633 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp_9c991c35-e3a2-44c0-aed0-db8df89017df/storage-initializer/0.log" Jun 14 13:56:05.344537 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:05.344506 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgv8gp_9c991c35-e3a2-44c0-aed0-db8df89017df/main/0.log" Jun 14 13:56:05.449795 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:05.449767 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-7wct6_b3a11db6-2b81-484b-9e32-a09fbf8a1485/storage-initializer/0.log" Jun 14 13:56:05.456011 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:05.455993 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-7wct6_b3a11db6-2b81-484b-9e32-a09fbf8a1485/main/0.log" Jun 14 13:56:09.793296 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:09.793258 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:56:11.025891 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:11.025860 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" limit=1024 Jun 14 13:56:12.532610 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:12.532576 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6swkj_303004c7-a3eb-4fb8-9008-5aef0795ab73/global-pull-secret-syncer/0.log" Jun 14 13:56:12.661926 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:12.661898 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7x8bl_d2ff2189-8eba-41f8-a401-e8384449247f/konnectivity-agent/0.log" Jun 14 13:56:12.746173 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:12.746139 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-48.ec2.internal_1f8d5b9457c4cf20b7d985158db08cef/haproxy/0.log" Jun 14 13:56:17.120593 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:17.120562 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-qz494_8a3b3513-efbc-4410-afe5-279b435e75ff/sail-operator/0.log" Jun 14 13:56:17.507832 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:17.507808 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq_5f93def8-28bf-46a9-b56e-c83fa29d56f2/extract/0.log" Jun 14 13:56:17.535857 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:17.535822 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq_5f93def8-28bf-46a9-b56e-c83fa29d56f2/util/0.log" Jun 14 13:56:17.563598 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:17.563565 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2hq_5f93def8-28bf-46a9-b56e-c83fa29d56f2/pull/0.log" Jun 14 13:56:17.608291 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:17.608266 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr_07b7c58c-e6d1-48c8-b09d-76cb3edd79ca/extract/0.log" Jun 14 13:56:17.630219 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:17.630194 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr_07b7c58c-e6d1-48c8-b09d-76cb3edd79ca/util/0.log" Jun 14 13:56:17.657810 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:17.657787 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvwrr_07b7c58c-e6d1-48c8-b09d-76cb3edd79ca/pull/0.log" Jun 14 13:56:17.688102 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:17.688081 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr_b6602eea-9856-483b-9eed-9627f36440a1/extract/0.log" Jun 14 13:56:17.711659 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:17.711634 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr_b6602eea-9856-483b-9eed-9627f36440a1/util/0.log" Jun 14 13:56:17.732574 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:17.732549 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ps5wr_b6602eea-9856-483b-9eed-9627f36440a1/pull/0.log" Jun 14 13:56:17.771884 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:17.771814 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r_524c838e-80d0-4f67-9ade-042a8a96bc21/extract/0.log" Jun 14 13:56:17.802155 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:17.802123 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r_524c838e-80d0-4f67-9ade-042a8a96bc21/util/0.log" Jun 14 13:56:17.824402 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:17.824379 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15552r_524c838e-80d0-4f67-9ade-042a8a96bc21/pull/0.log" Jun 14 13:56:17.888832 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:17.888803 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-5kkmg_a07c9b25-51cc-4d4d-ae55-631be3dcea14/manager/0.log" Jun 14 13:56:19.719210 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:19.719182 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_afac4dcf-ccb7-4426-8560-b191b6fce992/alertmanager/0.log" Jun 14 13:56:19.743544 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:19.743518 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_afac4dcf-ccb7-4426-8560-b191b6fce992/config-reloader/0.log" Jun 14 13:56:19.770343 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:19.770321 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_afac4dcf-ccb7-4426-8560-b191b6fce992/kube-rbac-proxy-web/0.log" Jun 14 13:56:19.790919 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:19.790897 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_afac4dcf-ccb7-4426-8560-b191b6fce992/kube-rbac-proxy/0.log" Jun 14 13:56:19.814589 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:19.814566 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_afac4dcf-ccb7-4426-8560-b191b6fce992/kube-rbac-proxy-metric/0.log" Jun 14 13:56:19.842437 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:19.842414 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_afac4dcf-ccb7-4426-8560-b191b6fce992/prom-label-proxy/0.log" Jun 14 13:56:19.865016 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:19.864989 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_afac4dcf-ccb7-4426-8560-b191b6fce992/init-config-reloader/0.log" Jun 14 13:56:19.898118 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:19.898088 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-g5jx2_2a66a11c-63e7-477b-a84d-3cf0102368a1/cluster-monitoring-operator/0.log" Jun 14 13:56:20.098442 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:20.098370 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dkgnm_58b2bd4e-cddf-4ac6-a384-fa94a0d02993/node-exporter/0.log" Jun 14 13:56:20.121932 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:20.121905 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dkgnm_58b2bd4e-cddf-4ac6-a384-fa94a0d02993/kube-rbac-proxy/0.log" Jun 14 13:56:20.141770 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:20.141747 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dkgnm_58b2bd4e-cddf-4ac6-a384-fa94a0d02993/init-textfile/0.log" Jun 14 13:56:20.841126 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:20.841090 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-jcbhd_2668b4ae-b476-4d0c-88f1-c83578a8fc03/prometheus-operator-admission-webhook/0.log" Jun 14 13:56:20.873203 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:20.873175 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-76765544d8-vznw9_dbaf557b-e49d-4783-99a7-20698b22658d/telemeter-client/0.log" Jun 14 13:56:20.900274 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:20.900248 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-76765544d8-vznw9_dbaf557b-e49d-4783-99a7-20698b22658d/reload/0.log" Jun 14 13:56:20.943300 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:20.943275 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-76765544d8-vznw9_dbaf557b-e49d-4783-99a7-20698b22658d/kube-rbac-proxy/0.log" Jun 14 13:56:21.003515 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:21.003488 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75548b57c-bdt42_6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1/thanos-query/0.log" Jun 14 13:56:21.046174 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:21.046148 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75548b57c-bdt42_6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1/kube-rbac-proxy-web/0.log" Jun 14 13:56:21.078184 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:21.078162 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75548b57c-bdt42_6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1/kube-rbac-proxy/0.log" Jun 14 13:56:21.099580 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:21.099508 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75548b57c-bdt42_6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1/prom-label-proxy/0.log" Jun 14 13:56:21.120666 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:21.120645 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75548b57c-bdt42_6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1/kube-rbac-proxy-rules/0.log" Jun 14 13:56:21.144078 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:21.144041 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75548b57c-bdt42_6e30ee4b-81b2-4755-a7d0-f7c8d1181ce1/kube-rbac-proxy-metrics/0.log" Jun 14 13:56:22.394187 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:22.394156 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-9d55q_ae58844c-88ca-4244-862a-0ceb52ca66f8/networking-console-plugin/0.log" Jun 14 13:56:23.036635 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:23.036605 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-dwq9q_1fea963c-a8b6-4071-8071-3e7149ef98cd/console-operator/1.log" Jun 14 13:56:23.041769 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:23.041748 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-dwq9q_1fea963c-a8b6-4071-8071-3e7149ef98cd/console-operator/2.log" Jun 14 13:56:23.476123 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:23.476090 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-x86pv/perf-node-gather-daemonset-kckzs"] Jun 14 13:56:23.479999 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:23.479982 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x86pv/perf-node-gather-daemonset-kckzs" Jun 14 13:56:23.482506 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:23.482488 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x86pv\"/\"kube-root-ca.crt\"" Jun 14 13:56:23.483626 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:23.483603 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-x86pv\"/\"default-dockercfg-8gvvl\"" Jun 14 13:56:23.483794 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:23.483663 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x86pv\"/\"openshift-service-ca.crt\"" Jun 14 13:56:23.489040 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:23.489019 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x86pv/perf-node-gather-daemonset-kckzs"] Jun 14 13:56:23.644189 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:23.644155 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58c7582e-74b1-46a2-a270-171ee0b89282-lib-modules\") pod \"perf-node-gather-daemonset-kckzs\" (UID: \"58c7582e-74b1-46a2-a270-171ee0b89282\") " pod="openshift-must-gather-x86pv/perf-node-gather-daemonset-kckzs" Jun 14 13:56:23.644388 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:23.644246 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/58c7582e-74b1-46a2-a270-171ee0b89282-proc\") pod \"perf-node-gather-daemonset-kckzs\" (UID: \"58c7582e-74b1-46a2-a270-171ee0b89282\") " pod="openshift-must-gather-x86pv/perf-node-gather-daemonset-kckzs" Jun 14 13:56:23.644388 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:23.644284 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6px8\" (UniqueName: \"kubernetes.io/projected/58c7582e-74b1-46a2-a270-171ee0b89282-kube-api-access-g6px8\") pod \"perf-node-gather-daemonset-kckzs\" (UID: \"58c7582e-74b1-46a2-a270-171ee0b89282\") " pod="openshift-must-gather-x86pv/perf-node-gather-daemonset-kckzs" Jun 14 13:56:23.644388 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:23.644360 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/58c7582e-74b1-46a2-a270-171ee0b89282-podres\") pod \"perf-node-gather-daemonset-kckzs\" (UID: \"58c7582e-74b1-46a2-a270-171ee0b89282\") " pod="openshift-must-gather-x86pv/perf-node-gather-daemonset-kckzs" Jun 14 13:56:23.644529 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:23.644401 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58c7582e-74b1-46a2-a270-171ee0b89282-sys\") pod \"perf-node-gather-daemonset-kckzs\" (UID: \"58c7582e-74b1-46a2-a270-171ee0b89282\") " pod="openshift-must-gather-x86pv/perf-node-gather-daemonset-kckzs" Jun 14 13:56:23.744949 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:23.744865 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58c7582e-74b1-46a2-a270-171ee0b89282-lib-modules\") pod \"perf-node-gather-daemonset-kckzs\" (UID: \"58c7582e-74b1-46a2-a270-171ee0b89282\") " pod="openshift-must-gather-x86pv/perf-node-gather-daemonset-kckzs" Jun 14 13:56:23.744949 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:23.744946 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/58c7582e-74b1-46a2-a270-171ee0b89282-proc\") pod \"perf-node-gather-daemonset-kckzs\" (UID: \"58c7582e-74b1-46a2-a270-171ee0b89282\") " pod="openshift-must-gather-x86pv/perf-node-gather-daemonset-kckzs" Jun 14 13:56:23.745125 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:23.744975 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6px8\" (UniqueName: \"kubernetes.io/projected/58c7582e-74b1-46a2-a270-171ee0b89282-kube-api-access-g6px8\") pod \"perf-node-gather-daemonset-kckzs\" (UID: \"58c7582e-74b1-46a2-a270-171ee0b89282\") " pod="openshift-must-gather-x86pv/perf-node-gather-daemonset-kckzs" Jun 14 13:56:23.745125 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:23.745023 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/58c7582e-74b1-46a2-a270-171ee0b89282-podres\") pod \"perf-node-gather-daemonset-kckzs\" (UID: \"58c7582e-74b1-46a2-a270-171ee0b89282\") " pod="openshift-must-gather-x86pv/perf-node-gather-daemonset-kckzs" Jun 14 13:56:23.745125 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:23.745043 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58c7582e-74b1-46a2-a270-171ee0b89282-lib-modules\") pod \"perf-node-gather-daemonset-kckzs\" (UID: \"58c7582e-74b1-46a2-a270-171ee0b89282\") " pod="openshift-must-gather-x86pv/perf-node-gather-daemonset-kckzs" Jun 14 13:56:23.745125 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:23.745047 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58c7582e-74b1-46a2-a270-171ee0b89282-sys\") pod \"perf-node-gather-daemonset-kckzs\" (UID: \"58c7582e-74b1-46a2-a270-171ee0b89282\") " pod="openshift-must-gather-x86pv/perf-node-gather-daemonset-kckzs" Jun 14 13:56:23.745125 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:23.745067 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/58c7582e-74b1-46a2-a270-171ee0b89282-proc\") pod \"perf-node-gather-daemonset-kckzs\" (UID: \"58c7582e-74b1-46a2-a270-171ee0b89282\") " pod="openshift-must-gather-x86pv/perf-node-gather-daemonset-kckzs" Jun 14 13:56:23.745293 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:23.745132 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/58c7582e-74b1-46a2-a270-171ee0b89282-podres\") pod \"perf-node-gather-daemonset-kckzs\" (UID: \"58c7582e-74b1-46a2-a270-171ee0b89282\") " pod="openshift-must-gather-x86pv/perf-node-gather-daemonset-kckzs" Jun 14 13:56:23.745293 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:23.745186 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58c7582e-74b1-46a2-a270-171ee0b89282-sys\") pod \"perf-node-gather-daemonset-kckzs\" (UID: \"58c7582e-74b1-46a2-a270-171ee0b89282\") " pod="openshift-must-gather-x86pv/perf-node-gather-daemonset-kckzs" Jun 14 13:56:23.753354 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:23.753321 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6px8\" (UniqueName: \"kubernetes.io/projected/58c7582e-74b1-46a2-a270-171ee0b89282-kube-api-access-g6px8\") pod \"perf-node-gather-daemonset-kckzs\" (UID: \"58c7582e-74b1-46a2-a270-171ee0b89282\") " pod="openshift-must-gather-x86pv/perf-node-gather-daemonset-kckzs" Jun 14 13:56:23.791474 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:23.791440 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x86pv/perf-node-gather-daemonset-kckzs" Jun 14 13:56:23.927046 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:23.927014 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x86pv/perf-node-gather-daemonset-kckzs"] Jun 14 13:56:23.928454 ip-10-0-131-48 kubenswrapper[2557]: W0614 13:56:23.928426 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod58c7582e_74b1_46a2_a270_171ee0b89282.slice/crio-25422921110d8e8fb1814ebeac109276f61645a02f9b0b0e5f6c7247bfdd525d WatchSource:0}: Error finding container 25422921110d8e8fb1814ebeac109276f61645a02f9b0b0e5f6c7247bfdd525d: Status 404 returned error can't find the container with id 25422921110d8e8fb1814ebeac109276f61645a02f9b0b0e5f6c7247bfdd525d Jun 14 13:56:24.352165 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:24.352077 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-bd4ccd799-kfm5z_efba00b2-fae9-4f69-88a9-f4cf7692107f/volume-data-source-validator/0.log" Jun 14 13:56:24.516149 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:24.516111 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x86pv/perf-node-gather-daemonset-kckzs" event={"ID":"58c7582e-74b1-46a2-a270-171ee0b89282","Type":"ContainerStarted","Data":"47d503448684ebde6a706e1c5c7fce0b5340e24e1fabe4aca67866df5c38e9b0"} Jun 14 13:56:24.516524 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:24.516163 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x86pv/perf-node-gather-daemonset-kckzs" event={"ID":"58c7582e-74b1-46a2-a270-171ee0b89282","Type":"ContainerStarted","Data":"25422921110d8e8fb1814ebeac109276f61645a02f9b0b0e5f6c7247bfdd525d"} Jun 14 13:56:24.516524 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:24.516210 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-x86pv/perf-node-gather-daemonset-kckzs" Jun 14 13:56:24.534101 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:24.534056 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-x86pv/perf-node-gather-daemonset-kckzs" podStartSLOduration=1.534043181 podStartE2EDuration="1.534043181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 13:56:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 13:56:24.531132386 +0000 UTC m=+1417.204400345" watchObservedRunningTime="2026-06-14 13:56:24.534043181 +0000 UTC m=+1417.207311127" Jun 14 13:56:25.527168 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:25.527142 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fr9gb_5a6e5105-b1a2-4429-825b-6c8509d6bf90/dns/0.log" Jun 14 13:56:25.547591 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:25.547564 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fr9gb_5a6e5105-b1a2-4429-825b-6c8509d6bf90/kube-rbac-proxy/0.log" Jun 14 13:56:25.600496 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:25.600463 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hcsvf_31339707-4ec8-4cbb-8014-695a9f156efa/dns-node-resolver/0.log" Jun 14 13:56:26.204611 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:26.204577 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vhpwp_be7e69d3-6286-4f5c-a895-51baff1834b8/node-ca/0.log" Jun 14 13:56:27.217703 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:27.217654 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-b5k8z_d45a6ea3-3615-4cce-8f85-6c15bf98fc5e/discovery/0.log" Jun 14 13:56:27.260992 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:27.260968 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f7b87855f-xfnvr_14125b39-a31f-40ce-be74-40bf60e697b4/kube-auth-proxy/0.log" Jun 14 13:56:27.313205 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:27.313178 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-lgs9j_cd489aad-2c62-4327-bfbb-17567d2ad0e9/payload-pre-processing/0.log" Jun 14 13:56:27.337104 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:27.337079 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-5b2dr_7c5a407c-3b50-45b3-8a65-27b60fb975bc/payload-processing/0.log" Jun 14 13:56:27.365261 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:27.365235 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-565d7ffdb8-hjw45_341c9198-cdc6-43c8-a9bd-eb0e957f2e19/router/0.log" Jun 14 13:56:28.006173 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:28.006144 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qhs44_bc9554de-2cf6-4067-aaf8-59003ac80ddf/serve-healthcheck-canary/0.log" Jun 14 13:56:28.518189 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:28.518156 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-5rkgs_fa652aa2-ad08-4742-9489-be4b1d474712/insights-operator/0.log" Jun 14 13:56:28.518189 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:28.518180 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-5rkgs_fa652aa2-ad08-4742-9489-be4b1d474712/insights-operator/1.log" Jun 14 13:56:28.609460 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:28.609434 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qfjzz_41378e80-cec7-4a96-acce-1d65b6e764d3/kube-rbac-proxy/0.log" Jun 14 13:56:28.629214 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:28.629186 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qfjzz_41378e80-cec7-4a96-acce-1d65b6e764d3/exporter/0.log" Jun 14 13:56:28.649944 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:28.649917 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qfjzz_41378e80-cec7-4a96-acce-1d65b6e764d3/extractor/0.log" Jun 14 13:56:30.532398 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:30.532372 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-x86pv/perf-node-gather-daemonset-kckzs" Jun 14 13:56:30.934832 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:30.934808 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-765bd5bf78-fdxg4_3f9d0f1a-4449-4aa0-b525-1751a0045b89/nginx/0.log" Jun 14 13:56:30.986056 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:30.986027 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-pvvpc_5dcb78f0-4d50-48c5-9eaf-666f497af019/manager/0.log" Jun 14 13:56:31.019006 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:31.018978 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-gjkfc_e50efa17-b71b-4dd7-b400-2987b066484c/manager/0.log" Jun 14 13:56:31.038743 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:31.038715 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-94c5b9d7f-592vz_9d69edf7-8f30-4c04-bef9-bb0f2ee9807b/maas-api/0.log" Jun 14 13:56:31.064327 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:31.064303 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5cc6889694-dcsvv_c0609b9e-c443-4ca7-b6e6-758e84429a57/manager/0.log" Jun 14 13:56:31.082045 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:31.082023 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-b9q9g_82a5a742-6e87-4232-ab75-fbb447d181ae/server/0.log" Jun 14 13:56:31.130630 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:31.130600 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-t6l8h_5b8c3d54-d4b9-4d03-b44d-9961b5cc38d8/manager/0.log" Jun 14 13:56:31.152849 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:31.152825 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b7b4955f8-dpchh_b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7/manager/0.log" Jun 14 13:56:31.173016 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:31.172990 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b7b4955f8-dpchh_b7adc24e-f5ad-4fbd-8a8f-e3060c5977a7/copy-manifests/0.log" Jun 14 13:56:31.333460 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:31.333379 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-lzgh6_9010b236-55e0-4c02-97ea-5d7227dee236/postgres/0.log" Jun 14 13:56:33.065389 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:33.065359 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-z4slj_1da755b9-22a7-48b6-acaa-b1e96276ab99/openshift-lws-operator/0.log" Jun 14 13:56:38.286209 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:38.286129 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-b5k8z_d45a6ea3-3615-4cce-8f85-6c15bf98fc5e/discovery/0.log" Jun 14 13:56:38.308459 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:38.308431 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f7b87855f-xfnvr_14125b39-a31f-40ce-be74-40bf60e697b4/kube-auth-proxy/0.log" Jun 14 13:56:38.337173 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:38.337147 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-lgs9j_cd489aad-2c62-4327-bfbb-17567d2ad0e9/payload-pre-processing/0.log" Jun 14 13:56:38.351724 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:38.351697 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-5b2dr_7c5a407c-3b50-45b3-8a65-27b60fb975bc/payload-processing/0.log" Jun 14 13:56:38.372098 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:38.372077 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-565d7ffdb8-hjw45_341c9198-cdc6-43c8-a9bd-eb0e957f2e19/router/0.log" Jun 14 13:56:39.567473 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:39.567388 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-b5k8z_d45a6ea3-3615-4cce-8f85-6c15bf98fc5e/discovery/0.log" Jun 14 13:56:39.592725 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:39.592676 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f7b87855f-xfnvr_14125b39-a31f-40ce-be74-40bf60e697b4/kube-auth-proxy/0.log" Jun 14 13:56:39.625658 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:39.625632 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-lgs9j_cd489aad-2c62-4327-bfbb-17567d2ad0e9/payload-pre-processing/0.log" Jun 14 13:56:39.641653 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:39.641632 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-5b2dr_7c5a407c-3b50-45b3-8a65-27b60fb975bc/payload-processing/0.log" Jun 14 13:56:39.658840 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:39.658823 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-565d7ffdb8-hjw45_341c9198-cdc6-43c8-a9bd-eb0e957f2e19/router/0.log" Jun 14 13:56:39.992696 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:39.992658 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9x9kd_01786353-4e34-48af-90ce-aea4533819b1/kube-multus-additional-cni-plugins/0.log" Jun 14 13:56:40.014144 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:40.014118 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9x9kd_01786353-4e34-48af-90ce-aea4533819b1/egress-router-binary-copy/0.log" Jun 14 13:56:40.034497 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:40.034475 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9x9kd_01786353-4e34-48af-90ce-aea4533819b1/cni-plugins/0.log" Jun 14 13:56:40.054179 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:40.054158 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9x9kd_01786353-4e34-48af-90ce-aea4533819b1/bond-cni-plugin/0.log" Jun 14 13:56:40.073921 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:40.073897 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9x9kd_01786353-4e34-48af-90ce-aea4533819b1/routeoverride-cni/0.log" Jun 14 13:56:40.097322 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:40.097299 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9x9kd_01786353-4e34-48af-90ce-aea4533819b1/whereabouts-cni-bincopy/0.log" Jun 14 13:56:40.117548 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:40.117527 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9x9kd_01786353-4e34-48af-90ce-aea4533819b1/whereabouts-cni/0.log" Jun 14 13:56:40.595094 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:40.595060 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mblwf_6cb96268-7f2e-421e-9e23-c22d5d10bd0d/kube-multus/0.log" Jun 14 13:56:40.705805 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:40.705776 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xq27q_a5cff939-d984-4037-9dbb-2f4bbf3a6073/network-metrics-daemon/0.log" Jun 14 13:56:40.728378 ip-10-0-131-48 kubenswrapper[2557]: I0614 13:56:40.728355 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xq27q_a5cff939-d984-4037-9dbb-2f4bbf3a6073/kube-rbac-proxy/0.log"