Jun 11 23:07:43.774785 ip-10-0-130-215 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 11 23:07:43.774798 ip-10-0-130-215 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 11 23:07:43.774808 ip-10-0-130-215 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 11 23:07:43.775128 ip-10-0-130-215 systemd[1]: Failed to start Kubernetes Kubelet. Jun 11 23:07:53.999395 ip-10-0-130-215 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 11 23:07:53.999415 ip-10-0-130-215 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 8812f38ae6a742468a574423e8baf65b -- Jun 11 23:10:26.458380 ip-10-0-130-215 systemd[1]: Starting Kubernetes Kubelet... Jun 11 23:10:26.851824 ip-10-0-130-215 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 23:10:26.851824 ip-10-0-130-215 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 23:10:26.851824 ip-10-0-130-215 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 23:10:26.851824 ip-10-0-130-215 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 23:10:26.851824 ip-10-0-130-215 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 23:10:26.852766 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.852676 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 23:10:26.858927 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.858901 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:10:26.858927 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.858921 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:10:26.858927 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.858926 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:10:26.858927 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.858931 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:10:26.858927 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.858936 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:10:26.859166 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.858940 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:10:26.859166 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.858943 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:10:26.859166 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.858946 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:10:26.859166 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.858949 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:10:26.859166 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.858952 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:10:26.859166 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.858955 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:10:26.859166 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.858958 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:10:26.859166 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.858960 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:10:26.859166 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.858963 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:10:26.859166 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.858966 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:10:26.859166 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.858968 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:10:26.859166 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.858971 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:10:26.859166 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.858989 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:10:26.859166 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.858992 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:10:26.859166 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.858995 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:10:26.859166 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.858998 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:10:26.859166 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859001 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:10:26.859166 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859003 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:10:26.859166 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859007 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:10:26.859626 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859011 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:10:26.859626 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859014 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:10:26.859626 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859017 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:10:26.859626 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859020 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:10:26.859626 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859023 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:10:26.859626 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859025 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:10:26.859626 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859028 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:10:26.859626 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859030 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:10:26.859626 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859038 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:10:26.859626 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859042 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:10:26.859626 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859046 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:10:26.859626 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859049 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:10:26.859626 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859052 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:10:26.859626 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859054 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:10:26.859626 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859059 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:10:26.859626 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859062 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:10:26.859626 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859065 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:10:26.859626 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859067 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:10:26.859626 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859070 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:10:26.860155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859073 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:10:26.860155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859076 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:10:26.860155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859079 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:10:26.860155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859083 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:10:26.860155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859086 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:10:26.860155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859089 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:10:26.860155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859092 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:10:26.860155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859095 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:10:26.860155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859098 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:10:26.860155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859101 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:10:26.860155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859104 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:10:26.860155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859107 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:10:26.860155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859110 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:10:26.860155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859112 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:10:26.860155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859115 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:10:26.860155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859118 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:10:26.860155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859121 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:10:26.860155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859124 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:10:26.860155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859127 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:10:26.860155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859129 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:10:26.860645 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859132 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:10:26.860645 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859135 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:10:26.860645 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859137 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:10:26.860645 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859140 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:10:26.860645 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859142 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:10:26.860645 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859145 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:10:26.860645 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859148 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:10:26.860645 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859151 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:10:26.860645 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859154 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:10:26.860645 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859157 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:10:26.860645 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859161 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:10:26.860645 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859164 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:10:26.860645 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859166 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:10:26.860645 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859169 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:10:26.860645 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859172 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:10:26.860645 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859175 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:10:26.860645 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859178 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:10:26.860645 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859181 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:10:26.860645 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859184 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:10:26.860645 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859186 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:10:26.861143 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859190 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:10:26.861143 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859193 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:10:26.861143 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859195 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:10:26.861143 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859198 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:10:26.861143 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859200 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:10:26.861143 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859203 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:10:26.861143 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859206 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:10:26.861143 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859209 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:10:26.861143 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859212 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:10:26.861143 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859214 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:10:26.861143 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859217 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:10:26.861143 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859220 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:10:26.861143 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859222 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:10:26.861143 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859225 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:10:26.861143 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859228 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:10:26.861143 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859231 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:10:26.861143 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859964 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:10:26.861143 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859993 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:10:26.861143 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.859998 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:10:26.861143 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860001 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:10:26.861617 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860004 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:10:26.861617 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860010 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:10:26.861617 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860014 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:10:26.861617 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860017 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:10:26.861617 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860020 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:10:26.861617 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860023 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:10:26.861617 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860026 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:10:26.861617 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860029 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:10:26.861617 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860031 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:10:26.861617 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860034 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:10:26.861617 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860037 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:10:26.861617 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860040 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:10:26.861617 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860043 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:10:26.861617 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860047 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:10:26.861617 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860049 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:10:26.861617 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860052 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:10:26.861617 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860055 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:10:26.861617 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860058 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:10:26.861617 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860060 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:10:26.861617 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860063 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:10:26.862132 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860067 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:10:26.862132 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860070 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:10:26.862132 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860073 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:10:26.862132 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860077 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:10:26.862132 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860080 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:10:26.862132 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860082 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:10:26.862132 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860085 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:10:26.862132 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860088 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:10:26.862132 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860091 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:10:26.862132 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860093 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:10:26.862132 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860096 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:10:26.862132 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860099 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:10:26.862132 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860101 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:10:26.862132 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860105 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:10:26.862132 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860107 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:10:26.862132 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860110 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:10:26.862132 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860112 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:10:26.862132 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860115 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:10:26.862132 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860117 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:10:26.862132 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860120 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:10:26.862621 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860123 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:10:26.862621 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860125 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:10:26.862621 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860128 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:10:26.862621 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860131 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:10:26.862621 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860133 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:10:26.862621 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860136 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:10:26.862621 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860139 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:10:26.862621 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860142 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:10:26.862621 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860145 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:10:26.862621 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860147 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:10:26.862621 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860150 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:10:26.862621 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860152 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:10:26.862621 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860155 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:10:26.862621 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860158 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:10:26.862621 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860163 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:10:26.862621 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860166 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:10:26.862621 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860169 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:10:26.862621 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860171 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:10:26.862621 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860174 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:10:26.862621 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860177 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:10:26.863155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860179 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:10:26.863155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860182 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:10:26.863155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860185 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:10:26.863155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860188 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:10:26.863155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860192 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:10:26.863155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860196 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:10:26.863155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860200 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:10:26.863155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860202 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:10:26.863155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860205 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:10:26.863155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860209 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:10:26.863155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860211 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:10:26.863155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860214 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:10:26.863155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860217 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:10:26.863155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860219 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:10:26.863155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860222 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:10:26.863155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860225 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:10:26.863155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860228 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:10:26.863155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860230 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:10:26.863155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860233 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:10:26.863615 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860236 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:10:26.863615 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860239 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:10:26.863615 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860242 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:10:26.863615 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860245 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:10:26.863615 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860247 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:10:26.863615 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860250 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:10:26.863615 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860252 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:10:26.863615 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860256 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:10:26.863615 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860259 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:10:26.863615 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860261 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:10:26.863615 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860264 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:10:26.863615 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860267 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:10:26.863615 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860269 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:10:26.863615 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860272 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:10:26.863615 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860274 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:10:26.863615 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860277 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:10:26.863615 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860690 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:10:26.863615 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860696 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:10:26.863615 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860699 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:10:26.864098 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860701 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:10:26.864098 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860704 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:10:26.864098 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860707 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:10:26.864098 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860710 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:10:26.864098 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860713 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:10:26.864098 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860716 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:10:26.864098 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860718 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:10:26.864098 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860721 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:10:26.864098 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860724 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:10:26.864098 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860728 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:10:26.864098 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860732 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:10:26.864098 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860735 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:10:26.864098 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860738 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:10:26.864098 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860741 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:10:26.864098 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860744 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:10:26.864098 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860747 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:10:26.864098 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860749 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:10:26.864098 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860752 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:10:26.864098 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860755 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:10:26.864559 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860757 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:10:26.864559 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860760 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:10:26.864559 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860763 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:10:26.864559 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860765 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:10:26.864559 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860768 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:10:26.864559 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860770 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:10:26.864559 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860773 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:10:26.864559 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860775 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:10:26.864559 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860777 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:10:26.864559 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860780 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:10:26.864559 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860783 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:10:26.864559 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860785 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:10:26.864559 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860788 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:10:26.864559 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860790 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:10:26.864559 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860793 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:10:26.864559 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860795 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:10:26.864559 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860798 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:10:26.864559 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860800 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:10:26.864559 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860803 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:10:26.865029 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860805 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:10:26.865029 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860808 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:10:26.865029 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860810 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:10:26.865029 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860813 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:10:26.865029 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860815 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:10:26.865029 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860818 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:10:26.865029 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860820 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:10:26.865029 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860823 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:10:26.865029 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860826 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:10:26.865029 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860828 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:10:26.865029 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860831 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:10:26.865029 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860834 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:10:26.865029 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860837 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:10:26.865029 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860839 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:10:26.865029 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860842 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:10:26.865029 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860845 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:10:26.865029 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860847 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:10:26.865029 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860850 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:10:26.865029 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860853 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:10:26.865029 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860855 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:10:26.865514 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860858 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:10:26.865514 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860861 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:10:26.865514 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860864 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:10:26.865514 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860866 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:10:26.865514 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860869 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:10:26.865514 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860872 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:10:26.865514 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860874 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:10:26.865514 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860877 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:10:26.865514 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860879 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:10:26.865514 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860882 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:10:26.865514 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860884 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:10:26.865514 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860887 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:10:26.865514 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860889 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:10:26.865514 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860892 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:10:26.865514 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860894 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:10:26.865514 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860898 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:10:26.865514 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860902 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:10:26.865514 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860905 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:10:26.865514 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860908 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:10:26.865514 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860911 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:10:26.866028 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860916 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:10:26.866028 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860919 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:10:26.866028 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860922 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:10:26.866028 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860925 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:10:26.866028 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860927 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:10:26.866028 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860930 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:10:26.866028 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860933 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:10:26.866028 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860935 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:10:26.866028 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860938 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:10:26.866028 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860941 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:10:26.866028 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860945 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:10:26.866028 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860948 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:10:26.866028 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860950 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:10:26.866028 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860953 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:10:26.866028 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860955 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:10:26.866028 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860958 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:10:26.866028 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860961 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:10:26.866028 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.860964 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:10:26.866028 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861048 2563 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 23:10:26.866028 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861066 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 23:10:26.866028 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861075 2563 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 23:10:26.866539 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861080 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 23:10:26.866539 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861085 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 23:10:26.866539 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861088 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 23:10:26.866539 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861092 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 23:10:26.866539 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861097 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 23:10:26.866539 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861100 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 23:10:26.866539 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861103 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 23:10:26.866539 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861107 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 23:10:26.866539 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861110 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 23:10:26.866539 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861113 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 23:10:26.866539 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861116 2563 flags.go:64] FLAG: --cgroup-root="" Jun 11 23:10:26.866539 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861121 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 23:10:26.866539 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861124 2563 flags.go:64] FLAG: --client-ca-file="" Jun 11 23:10:26.866539 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861128 2563 flags.go:64] FLAG: --cloud-provider="external" Jun 11 23:10:26.866539 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861131 2563 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 23:10:26.866539 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861136 2563 flags.go:64] FLAG: --cluster-domain="" Jun 11 23:10:26.866539 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861139 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 23:10:26.866539 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861142 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 23:10:26.866539 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861145 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 23:10:26.866539 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861149 2563 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 23:10:26.866539 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861153 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 23:10:26.866539 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861156 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 23:10:26.866539 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861159 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 23:10:26.867106 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861162 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 23:10:26.867106 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861165 2563 flags.go:64] FLAG: --contention-profiling="false" Jun 11 23:10:26.867106 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861168 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 23:10:26.867106 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861171 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 23:10:26.867106 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861174 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 23:10:26.867106 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861177 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 23:10:26.867106 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861181 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 23:10:26.867106 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861184 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 23:10:26.867106 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861187 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 23:10:26.867106 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861189 2563 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 23:10:26.867106 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861192 2563 flags.go:64] FLAG: --enable-server="true" Jun 11 23:10:26.867106 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861195 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 23:10:26.867106 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861202 2563 flags.go:64] FLAG: --event-burst="100" Jun 11 23:10:26.867106 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861206 2563 flags.go:64] FLAG: --event-qps="50" Jun 11 23:10:26.867106 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861209 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 23:10:26.867106 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861212 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 23:10:26.867106 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861215 2563 flags.go:64] FLAG: --eviction-hard="" Jun 11 23:10:26.867106 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861218 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 23:10:26.867106 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861221 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 23:10:26.867106 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861224 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 23:10:26.867106 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861228 2563 flags.go:64] FLAG: --eviction-soft="" Jun 11 23:10:26.867106 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861231 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 23:10:26.867106 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861233 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 23:10:26.867106 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861237 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 23:10:26.867106 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861240 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 23:10:26.867826 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861244 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 23:10:26.867826 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861247 2563 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 23:10:26.867826 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861250 2563 flags.go:64] FLAG: --feature-gates="" Jun 11 23:10:26.867826 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861254 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 23:10:26.867826 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861257 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 23:10:26.867826 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861260 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 23:10:26.867826 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861263 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 23:10:26.867826 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861266 2563 flags.go:64] FLAG: --healthz-port="10248" Jun 11 23:10:26.867826 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861269 2563 flags.go:64] FLAG: --help="false" Jun 11 23:10:26.867826 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861272 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-130-215.ec2.internal" Jun 11 23:10:26.867826 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861275 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 23:10:26.867826 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861278 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 23:10:26.867826 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861281 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 23:10:26.867826 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861284 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 23:10:26.867826 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861287 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 23:10:26.867826 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861290 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 23:10:26.867826 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861293 2563 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 23:10:26.867826 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861296 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 23:10:26.867826 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861299 2563 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 23:10:26.867826 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861301 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 23:10:26.867826 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861304 2563 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 23:10:26.867826 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861307 2563 flags.go:64] FLAG: --kube-reserved="" Jun 11 23:10:26.867826 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861310 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 23:10:26.867826 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861313 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 23:10:26.868440 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861316 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 23:10:26.868440 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861319 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 23:10:26.868440 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861322 2563 flags.go:64] FLAG: --lock-file="" Jun 11 23:10:26.868440 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861330 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 23:10:26.868440 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861333 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 23:10:26.868440 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861336 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 23:10:26.868440 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861341 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 23:10:26.868440 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861345 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 23:10:26.868440 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861349 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 23:10:26.868440 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861352 2563 flags.go:64] FLAG: --logging-format="text" Jun 11 23:10:26.868440 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861354 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 23:10:26.868440 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861358 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 23:10:26.868440 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861361 2563 flags.go:64] FLAG: --manifest-url="" Jun 11 23:10:26.868440 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861363 2563 flags.go:64] FLAG: --manifest-url-header="" Jun 11 23:10:26.868440 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861368 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 23:10:26.868440 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861371 2563 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 23:10:26.868440 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861375 2563 flags.go:64] FLAG: --max-pods="110" Jun 11 23:10:26.868440 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861378 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 23:10:26.868440 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861381 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 23:10:26.868440 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861383 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 23:10:26.868440 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861386 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 23:10:26.868440 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861389 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 23:10:26.868440 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861392 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 23:10:26.868440 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861395 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 23:10:26.868440 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861403 2563 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 23:10:26.869075 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861406 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 23:10:26.869075 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861409 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 23:10:26.869075 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861429 2563 flags.go:64] FLAG: --pod-cidr="" Jun 11 23:10:26.869075 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861432 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 11 23:10:26.869075 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861438 2563 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 23:10:26.869075 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861442 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 23:10:26.869075 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861445 2563 flags.go:64] FLAG: --pods-per-core="0" Jun 11 23:10:26.869075 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861448 2563 flags.go:64] FLAG: --port="10250" Jun 11 23:10:26.869075 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861451 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 23:10:26.869075 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861454 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-099315cb34cc13176" Jun 11 23:10:26.869075 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861458 2563 flags.go:64] FLAG: --qos-reserved="" Jun 11 23:10:26.869075 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861462 2563 flags.go:64] FLAG: --read-only-port="10255" Jun 11 23:10:26.869075 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861464 2563 flags.go:64] FLAG: --register-node="true" Jun 11 23:10:26.869075 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861467 2563 flags.go:64] FLAG: --register-with-taints="" Jun 11 23:10:26.869075 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861471 2563 flags.go:64] FLAG: --registry-burst="10" Jun 11 23:10:26.869075 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861474 2563 flags.go:64] FLAG: --registry-qps="5" Jun 11 23:10:26.869075 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861479 2563 flags.go:64] FLAG: --reserved-cpus="" Jun 11 23:10:26.869075 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861482 2563 flags.go:64] FLAG: --reserved-memory="" Jun 11 23:10:26.869075 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861486 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 23:10:26.869075 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861489 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 23:10:26.869075 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861492 2563 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 23:10:26.869075 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861495 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 23:10:26.869075 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861499 2563 flags.go:64] FLAG: --runonce="false" Jun 11 23:10:26.869075 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861501 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 23:10:26.869075 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861504 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 23:10:26.869683 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861507 2563 flags.go:64] FLAG: --seccomp-default="false" Jun 11 23:10:26.869683 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861510 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 23:10:26.869683 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861513 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 23:10:26.869683 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861516 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 23:10:26.869683 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861519 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 23:10:26.869683 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861522 2563 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 23:10:26.869683 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861525 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 23:10:26.869683 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861528 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 23:10:26.869683 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861531 2563 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 23:10:26.869683 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861533 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 23:10:26.869683 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861537 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 23:10:26.869683 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861540 2563 flags.go:64] FLAG: --system-cgroups="" Jun 11 23:10:26.869683 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861543 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 23:10:26.869683 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861548 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 23:10:26.869683 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861551 2563 flags.go:64] FLAG: --tls-cert-file="" Jun 11 23:10:26.869683 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861554 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 23:10:26.869683 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861558 2563 flags.go:64] FLAG: --tls-min-version="" Jun 11 23:10:26.869683 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861563 2563 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 23:10:26.869683 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861566 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 23:10:26.869683 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861569 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 23:10:26.869683 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861572 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 23:10:26.869683 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861575 2563 flags.go:64] FLAG: --v="2" Jun 11 23:10:26.869683 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861579 2563 flags.go:64] FLAG: --version="false" Jun 11 23:10:26.869683 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861586 2563 flags.go:64] FLAG: --vmodule="" Jun 11 23:10:26.869683 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861589 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 23:10:26.870298 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.861593 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 23:10:26.870298 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861708 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:10:26.870298 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861712 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:10:26.870298 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861715 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:10:26.870298 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861717 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:10:26.870298 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861720 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:10:26.870298 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861723 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:10:26.870298 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861725 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:10:26.870298 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861728 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:10:26.870298 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861730 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:10:26.870298 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861733 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:10:26.870298 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861736 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:10:26.870298 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861738 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:10:26.870298 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861741 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:10:26.870298 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861743 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:10:26.870298 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861746 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:10:26.870298 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861749 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:10:26.870298 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861752 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:10:26.870298 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861756 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:10:26.870298 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861759 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:10:26.870787 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861762 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:10:26.870787 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861764 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:10:26.870787 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861767 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:10:26.870787 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861769 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:10:26.870787 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861773 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:10:26.870787 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861776 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:10:26.870787 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861779 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:10:26.870787 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861781 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:10:26.870787 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861784 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:10:26.870787 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861787 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:10:26.870787 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861791 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:10:26.870787 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861795 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:10:26.870787 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861797 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:10:26.870787 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861800 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:10:26.870787 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861803 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:10:26.870787 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861805 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:10:26.870787 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861808 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:10:26.870787 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861811 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:10:26.870787 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861813 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:10:26.870787 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861816 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:10:26.871299 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861818 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:10:26.871299 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861821 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:10:26.871299 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861824 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:10:26.871299 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861826 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:10:26.871299 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861829 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:10:26.871299 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861831 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:10:26.871299 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861834 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:10:26.871299 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861837 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:10:26.871299 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861839 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:10:26.871299 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861843 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:10:26.871299 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861845 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:10:26.871299 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861849 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:10:26.871299 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861852 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:10:26.871299 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861855 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:10:26.871299 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861859 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:10:26.871299 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861862 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:10:26.871299 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861866 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:10:26.871299 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861868 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:10:26.871299 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861871 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:10:26.871762 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861875 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:10:26.871762 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861878 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:10:26.871762 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861881 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:10:26.871762 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861886 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:10:26.871762 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861889 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:10:26.871762 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861892 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:10:26.871762 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861895 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:10:26.871762 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861898 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:10:26.871762 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861900 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:10:26.871762 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861903 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:10:26.871762 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861905 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:10:26.871762 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861908 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:10:26.871762 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861911 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:10:26.871762 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861914 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:10:26.871762 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861917 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:10:26.871762 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861920 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:10:26.871762 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861922 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:10:26.871762 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861925 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:10:26.871762 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861928 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:10:26.871762 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861930 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:10:26.872316 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861933 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:10:26.872316 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861935 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:10:26.872316 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861938 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:10:26.872316 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861941 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:10:26.872316 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861943 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:10:26.872316 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861946 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:10:26.872316 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861949 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:10:26.872316 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861951 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:10:26.872316 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861954 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:10:26.872316 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861958 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:10:26.872316 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861960 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:10:26.872316 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861963 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:10:26.872316 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861965 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:10:26.872316 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861968 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:10:26.872316 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861985 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:10:26.872316 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861990 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:10:26.872316 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861993 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:10:26.872316 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861995 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:10:26.872316 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.861998 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:10:26.872316 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.862001 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:10:26.872808 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.862004 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:10:26.872808 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.862009 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 23:10:26.872808 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.872148 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 23:10:26.872808 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.872168 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 23:10:26.872808 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.872188 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 23:10:26.872808 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.872194 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 23:10:26.872808 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872256 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:10:26.872808 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872262 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:10:26.872808 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872265 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:10:26.872808 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872268 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:10:26.872808 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872270 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:10:26.872808 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872274 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:10:26.872808 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872277 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:10:26.872808 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872279 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:10:26.872808 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872282 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:10:26.873203 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872285 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:10:26.873203 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872288 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:10:26.873203 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872291 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:10:26.873203 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872293 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:10:26.873203 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872296 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:10:26.873203 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872299 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:10:26.873203 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872301 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:10:26.873203 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872304 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:10:26.873203 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872307 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:10:26.873203 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872310 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:10:26.873203 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872313 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:10:26.873203 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872315 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:10:26.873203 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872320 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:10:26.873203 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872324 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:10:26.873203 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872327 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:10:26.873203 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872330 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:10:26.873203 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872334 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:10:26.873203 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872336 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:10:26.873203 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872340 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:10:26.873662 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872342 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:10:26.873662 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872346 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:10:26.873662 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872350 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:10:26.873662 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872353 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:10:26.873662 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872356 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:10:26.873662 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872358 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:10:26.873662 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872361 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:10:26.873662 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872364 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:10:26.873662 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872367 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:10:26.873662 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872370 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:10:26.873662 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872372 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:10:26.873662 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872375 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:10:26.873662 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872378 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:10:26.873662 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872380 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:10:26.873662 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872383 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:10:26.873662 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872385 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:10:26.873662 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872388 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:10:26.873662 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872391 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:10:26.873662 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872394 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:10:26.873662 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872396 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:10:26.874157 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872399 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:10:26.874157 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872401 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:10:26.874157 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872404 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:10:26.874157 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872406 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:10:26.874157 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872409 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:10:26.874157 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872412 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:10:26.874157 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872414 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:10:26.874157 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872417 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:10:26.874157 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872420 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:10:26.874157 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872422 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:10:26.874157 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872425 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:10:26.874157 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872427 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:10:26.874157 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872430 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:10:26.874157 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872433 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:10:26.874157 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872437 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:10:26.874157 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872439 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:10:26.874157 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872442 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:10:26.874157 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872445 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:10:26.874157 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872447 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:10:26.874157 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872450 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:10:26.874644 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872452 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:10:26.874644 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872455 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:10:26.874644 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872458 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:10:26.874644 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872460 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:10:26.874644 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872463 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:10:26.874644 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872465 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:10:26.874644 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872468 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:10:26.874644 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872471 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:10:26.874644 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872473 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:10:26.874644 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872476 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:10:26.874644 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872478 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:10:26.874644 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872481 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:10:26.874644 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872485 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:10:26.874644 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872489 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:10:26.874644 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872493 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:10:26.874644 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872497 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:10:26.874644 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872500 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:10:26.874644 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872503 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:10:26.874644 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872506 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:10:26.875133 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872509 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:10:26.875133 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872511 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:10:26.875133 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872514 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:10:26.875133 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872517 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:10:26.875133 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872520 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:10:26.875133 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872522 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:10:26.875133 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872526 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:10:26.875133 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872530 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:10:26.875133 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872533 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:10:26.875133 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872535 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:10:26.875133 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872538 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:10:26.875133 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872541 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:10:26.875133 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.872546 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 23:10:26.875133 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872682 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:10:26.875525 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872687 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:10:26.875525 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872691 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:10:26.875525 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872694 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:10:26.875525 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872697 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:10:26.875525 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872700 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:10:26.875525 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872703 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:10:26.875525 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872705 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:10:26.875525 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872708 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:10:26.875525 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872711 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:10:26.875525 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872713 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:10:26.875525 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872716 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:10:26.875525 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872719 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:10:26.875525 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872721 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:10:26.875525 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872724 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:10:26.875525 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872728 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:10:26.875525 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872731 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:10:26.875525 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872734 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:10:26.875525 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872737 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:10:26.875525 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872740 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:10:26.875525 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872743 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:10:26.876030 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872746 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:10:26.876030 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872749 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:10:26.876030 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872752 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:10:26.876030 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872755 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:10:26.876030 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872758 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:10:26.876030 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872761 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:10:26.876030 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872764 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:10:26.876030 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872773 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:10:26.876030 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872778 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:10:26.876030 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872781 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:10:26.876030 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872784 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:10:26.876030 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872787 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:10:26.876030 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872790 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:10:26.876030 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872792 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:10:26.876030 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872795 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:10:26.876030 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872798 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:10:26.876030 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872801 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:10:26.876030 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872803 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:10:26.876030 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872806 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:10:26.876506 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872809 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:10:26.876506 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872812 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:10:26.876506 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872814 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:10:26.876506 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872817 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:10:26.876506 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872820 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:10:26.876506 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872822 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:10:26.876506 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872825 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:10:26.876506 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872827 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:10:26.876506 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872830 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:10:26.876506 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872832 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:10:26.876506 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872835 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:10:26.876506 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872837 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:10:26.876506 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872840 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:10:26.876506 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872842 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:10:26.876506 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872845 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:10:26.876506 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872847 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:10:26.876506 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872850 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:10:26.876506 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872853 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:10:26.876506 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872856 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:10:26.876506 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872858 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:10:26.876987 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872861 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:10:26.876987 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872869 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:10:26.876987 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872872 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:10:26.876987 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872875 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:10:26.876987 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872878 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:10:26.876987 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872880 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:10:26.876987 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872883 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:10:26.876987 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872885 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:10:26.876987 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872888 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:10:26.876987 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872891 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:10:26.876987 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872893 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:10:26.876987 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872896 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:10:26.876987 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872898 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:10:26.876987 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872901 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:10:26.876987 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872903 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:10:26.876987 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872906 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:10:26.876987 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872908 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:10:26.876987 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872910 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:10:26.876987 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872913 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:10:26.876987 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872915 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:10:26.877468 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872918 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:10:26.877468 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872920 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:10:26.877468 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872923 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:10:26.877468 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872926 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:10:26.877468 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872928 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:10:26.877468 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872931 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:10:26.877468 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872934 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:10:26.877468 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872936 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:10:26.877468 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872939 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:10:26.877468 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872942 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:10:26.877468 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872945 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:10:26.877468 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872947 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:10:26.877468 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872950 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:10:26.877468 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872952 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:10:26.877468 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872960 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:10:26.877468 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872963 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:10:26.877468 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872966 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:10:26.877468 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872968 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:10:26.877468 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:26.872987 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:10:26.877921 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.872994 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 23:10:26.877921 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.873126 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 23:10:26.877921 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.875171 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 23:10:26.877921 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.876374 2563 server.go:1019] "Starting client certificate rotation" Jun 11 23:10:26.877921 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.876479 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 23:10:26.877921 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.876511 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 23:10:26.878722 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.878702 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 23:10:26.880665 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.880644 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 23:10:26.893347 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.893327 2563 log.go:25] "Validated CRI v1 runtime API" Jun 11 23:10:26.896806 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.896777 2563 log.go:25] "Validated CRI v1 image API" Jun 11 23:10:26.897656 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.897642 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 23:10:26.900839 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.900812 2563 fs.go:135] Filesystem UUIDs: map[2a5a3b8a-62d5-416c-a1ff-456562f11339:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7a609e0a-2bcf-442e-83ad-2ff3b5f54f55:/dev/nvme0n1p4] Jun 11 23:10:26.900911 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.900831 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 23:10:26.907141 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.907008 2563 manager.go:216] Machine: {Timestamp:2026-06-11 23:10:26.905676896 +0000 UTC m=+0.328461853 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100046 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d21cfbd620d2da4bbbc7d6b116041 SystemUUID:ec2d21cf-bd62-0d2d-a4bb-bc7d6b116041 BootID:8812f38a-e6a7-4246-8a57-4423e8baf65b Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:94:c5:d5:27:3b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:94:c5:d5:27:3b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:65:15:72:bd:38 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 23:10:26.907141 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.907136 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 23:10:26.907259 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.907218 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 23:10:26.907783 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.907767 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 23:10:26.910394 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.910367 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 23:10:26.910539 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.910398 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-215.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 23:10:26.911210 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.911201 2563 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 23:10:26.911248 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.911213 2563 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 23:10:26.911248 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.911222 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 23:10:26.911985 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.911962 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 23:10:26.913307 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.913298 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 23:10:26.915959 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.915947 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 11 23:10:26.916273 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.916262 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 23:10:26.916317 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.916297 2563 kubelet.go:486] "Attempting to sync node with API server" Jun 11 23:10:26.916317 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.916307 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 23:10:26.916396 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.916325 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 23:10:26.916396 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.916336 2563 kubelet.go:398] "Adding apiserver pod source" Jun 11 23:10:26.916396 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.916345 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 23:10:26.916734 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.916720 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 23:10:26.916792 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.916739 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 23:10:26.919042 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.919026 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 23:10:26.920408 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.920392 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 23:10:26.920481 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.920430 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 23:10:26.920637 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.920625 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 23:10:26.920695 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.920645 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 23:10:26.920695 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.920654 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 23:10:26.920695 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.920663 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 23:10:26.920695 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.920675 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 23:10:26.920695 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.920684 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 23:10:26.921236 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.921220 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 23:10:26.921298 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.921238 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 23:10:26.921298 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.921252 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 23:10:26.921298 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.921263 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 23:10:26.921298 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.921280 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 23:10:26.921298 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.921292 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 23:10:26.922832 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.922820 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 23:10:26.922888 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.922835 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 23:10:26.926470 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.926451 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-215.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 23:10:26.926548 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:26.926531 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-215.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 23:10:26.926611 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.926561 2563 server.go:1268] "Started kubelet" Jun 11 23:10:26.926652 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:26.926617 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 23:10:26.926694 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.926646 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 23:10:26.927544 ip-10-0-130-215 systemd[1]: Started Kubernetes Kubelet. Jun 11 23:10:26.927691 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.927512 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 23:10:26.927691 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.927581 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 23:10:26.930546 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.930343 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 23:10:26.931598 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.931576 2563 server.go:310] "Adding debug handlers to kubelet server" Jun 11 23:10:26.934317 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:26.934284 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 23:10:26.935156 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.935142 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 23:10:26.935322 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:26.935301 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-215.ec2.internal\" not found" Jun 11 23:10:26.935389 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.935326 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 23:10:26.935824 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.935805 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 23:10:26.935923 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.935830 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 23:10:26.935923 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.935842 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 23:10:26.936070 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.936052 2563 factory.go:55] Registering systemd factory Jun 11 23:10:26.936070 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.936071 2563 factory.go:223] Registration of the systemd container factory successfully Jun 11 23:10:26.936234 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.936216 2563 reconstruct.go:97] "Volume reconstruction finished" Jun 11 23:10:26.936234 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.936225 2563 reconciler.go:29] "Reconciler: start to sync state" Jun 11 23:10:26.936356 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.936264 2563 factory.go:153] Registering CRI-O factory Jun 11 23:10:26.936356 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.936277 2563 factory.go:223] Registration of the crio container factory successfully Jun 11 23:10:26.936356 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.936322 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 23:10:26.936356 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.936345 2563 factory.go:103] Registering Raw factory Jun 11 23:10:26.936529 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.936360 2563 manager.go:1196] Started watching for new ooms in manager Jun 11 23:10:26.936653 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.936641 2563 manager.go:349] Starting recovery of all containers Jun 11 23:10:26.938254 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:26.937175 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-215.ec2.internal.18b829a1a8fb1ad4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-215.ec2.internal,UID:ip-10-0-130-215.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-215.ec2.internal,},FirstTimestamp:2026-06-11 23:10:26.926533332 +0000 UTC m=+0.349318293,LastTimestamp:2026-06-11 23:10:26.926533332 +0000 UTC m=+0.349318293,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-215.ec2.internal,}" Jun 11 23:10:26.938759 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.938737 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5vgpq" Jun 11 23:10:26.945825 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.945670 2563 manager.go:354] Recovery completed Jun 11 23:10:26.946555 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:26.946532 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-215.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 23:10:26.946640 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:26.946603 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 23:10:26.948503 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.948485 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5vgpq" Jun 11 23:10:26.950713 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.950702 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:10:26.952654 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.952638 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:10:26.952729 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.952667 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:10:26.952729 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.952682 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:10:26.953224 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.953200 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 23:10:26.953224 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.953215 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 23:10:26.953339 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.953231 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 11 23:10:26.953339 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.953238 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:10:26.953912 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.953899 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:10:26.953961 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.953925 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:10:26.953961 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.953936 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:10:26.954192 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.954181 2563 policy_none.go:49] "None policy: Start" Jun 11 23:10:26.954229 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.954197 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 23:10:26.954229 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.954209 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 23:10:26.955124 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.955113 2563 policy_none.go:47] "Start" Jun 11 23:10:26.955487 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:26.955401 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-215.ec2.internal.18b829a1aa89a793 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-215.ec2.internal,UID:ip-10-0-130-215.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-215.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-215.ec2.internal,},FirstTimestamp:2026-06-11 23:10:26.952652691 +0000 UTC m=+0.375437647,LastTimestamp:2026-06-11 23:10:26.952652691 +0000 UTC m=+0.375437647,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-215.ec2.internal,}" Jun 11 23:10:26.990562 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.990546 2563 manager.go:337] "Starting Device Plugin manager" Jun 11 23:10:27.000675 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:26.990580 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 23:10:27.000675 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.990593 2563 server.go:87] "Starting device plugin registration server" Jun 11 23:10:27.000675 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.990840 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 23:10:27.000675 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.990850 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 23:10:27.000675 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.990966 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 23:10:27.000675 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.991055 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 23:10:27.000675 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.991063 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 23:10:27.000675 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:26.991644 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 23:10:27.000675 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:26.991698 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-215.ec2.internal\" not found" Jun 11 23:10:27.000675 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.997522 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 23:10:27.000675 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.998831 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 23:10:27.000675 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.998861 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 23:10:27.000675 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:26.998884 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 23:10:27.000675 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:26.998920 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 23:10:27.000675 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.000477 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:10:27.091292 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.091243 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:10:27.092314 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.092291 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:10:27.092390 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.092334 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:10:27.092390 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.092348 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:10:27.092390 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.092378 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-215.ec2.internal" Jun 11 23:10:27.099186 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.099164 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-215.ec2.internal"] Jun 11 23:10:27.099243 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.099237 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:10:27.100171 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.100154 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:10:27.100259 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.100182 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:10:27.100259 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.100198 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:10:27.100627 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.100614 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-215.ec2.internal" Jun 11 23:10:27.100660 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:27.100634 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-215.ec2.internal\": node \"ip-10-0-130-215.ec2.internal\" not found" Jun 11 23:10:27.101585 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.101573 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:10:27.101750 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.101736 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal" Jun 11 23:10:27.101785 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.101773 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:10:27.102683 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.102626 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:10:27.102683 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.102641 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:10:27.102683 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.102659 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:10:27.102683 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.102673 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:10:27.102903 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.102661 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:10:27.102903 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.102751 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:10:27.103942 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.103926 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-215.ec2.internal" Jun 11 23:10:27.104039 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.103955 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:10:27.104628 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.104614 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:10:27.104699 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.104637 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:10:27.104699 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.104645 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:10:27.118434 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:27.118414 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-215.ec2.internal\" not found" Jun 11 23:10:27.119588 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:27.119571 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-215.ec2.internal\" not found" node="ip-10-0-130-215.ec2.internal" Jun 11 23:10:27.123174 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:27.123160 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-215.ec2.internal\" not found" node="ip-10-0-130-215.ec2.internal" Jun 11 23:10:27.138127 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.138104 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f503121fd80d1d4612f0e076464c96cf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal\" (UID: \"f503121fd80d1d4612f0e076464c96cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal" Jun 11 23:10:27.138127 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.138127 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/14e8d091aa6dad66da2b682cebda410b-config\") pod \"kube-apiserver-proxy-ip-10-0-130-215.ec2.internal\" (UID: \"14e8d091aa6dad66da2b682cebda410b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-215.ec2.internal" Jun 11 23:10:27.138241 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.138147 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f503121fd80d1d4612f0e076464c96cf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal\" (UID: \"f503121fd80d1d4612f0e076464c96cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal" Jun 11 23:10:27.219217 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:27.219187 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-215.ec2.internal\" not found" Jun 11 23:10:27.238922 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.238893 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f503121fd80d1d4612f0e076464c96cf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal\" (UID: \"f503121fd80d1d4612f0e076464c96cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal" Jun 11 23:10:27.239066 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.238927 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f503121fd80d1d4612f0e076464c96cf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal\" (UID: \"f503121fd80d1d4612f0e076464c96cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal" Jun 11 23:10:27.239066 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.238944 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/14e8d091aa6dad66da2b682cebda410b-config\") pod \"kube-apiserver-proxy-ip-10-0-130-215.ec2.internal\" (UID: \"14e8d091aa6dad66da2b682cebda410b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-215.ec2.internal" Jun 11 23:10:27.239066 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.239011 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/14e8d091aa6dad66da2b682cebda410b-config\") pod \"kube-apiserver-proxy-ip-10-0-130-215.ec2.internal\" (UID: \"14e8d091aa6dad66da2b682cebda410b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-215.ec2.internal" Jun 11 23:10:27.239066 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.239025 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f503121fd80d1d4612f0e076464c96cf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal\" (UID: \"f503121fd80d1d4612f0e076464c96cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal" Jun 11 23:10:27.239066 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.239026 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f503121fd80d1d4612f0e076464c96cf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal\" (UID: \"f503121fd80d1d4612f0e076464c96cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal" Jun 11 23:10:27.320115 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:27.320084 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-215.ec2.internal\" not found" Jun 11 23:10:27.420887 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:27.420809 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-215.ec2.internal\" not found" Jun 11 23:10:27.421913 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.421892 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal" Jun 11 23:10:27.427005 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.426965 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-215.ec2.internal" Jun 11 23:10:27.521321 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:27.521282 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-215.ec2.internal\" not found" Jun 11 23:10:27.621855 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:27.621815 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-215.ec2.internal\" not found" Jun 11 23:10:27.722376 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:27.722290 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-215.ec2.internal\" not found" Jun 11 23:10:27.822847 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:27.822820 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-215.ec2.internal\" not found" Jun 11 23:10:27.831892 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.831870 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:10:27.875769 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.875739 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 23:10:27.876570 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.875891 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 23:10:27.876570 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.875924 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 23:10:27.923208 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:27.923179 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-215.ec2.internal\" not found" Jun 11 23:10:27.941155 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:27.941127 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf503121fd80d1d4612f0e076464c96cf.slice/crio-f090a1b46d023561f5de183439cc7adb73b170d50ab3710e775ce41b7bc4a67b WatchSource:0}: Error finding container f090a1b46d023561f5de183439cc7adb73b170d50ab3710e775ce41b7bc4a67b: Status 404 returned error can't find the container with id f090a1b46d023561f5de183439cc7adb73b170d50ab3710e775ce41b7bc4a67b Jun 11 23:10:27.941490 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:27.941467 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14e8d091aa6dad66da2b682cebda410b.slice/crio-6ae0758833e73a7a967db75a1ccd6823154298c014e55dcde205a69de179ccc3 WatchSource:0}: Error finding container 6ae0758833e73a7a967db75a1ccd6823154298c014e55dcde205a69de179ccc3: Status 404 returned error can't find the container with id 6ae0758833e73a7a967db75a1ccd6823154298c014e55dcde205a69de179ccc3 Jun 11 23:10:27.946275 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.946262 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 23:10:27.950381 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.950364 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:10:27.953423 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.953399 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 23:05:26 +0000 UTC" deadline="2028-02-23 22:19:44.191264412 +0000 UTC" Jun 11 23:10:27.953500 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:27.953423 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14927h9m16.237845998s" Jun 11 23:10:28.001934 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.001831 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal" event={"ID":"f503121fd80d1d4612f0e076464c96cf","Type":"ContainerStarted","Data":"f090a1b46d023561f5de183439cc7adb73b170d50ab3710e775ce41b7bc4a67b"} Jun 11 23:10:28.002805 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.002778 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-215.ec2.internal" event={"ID":"14e8d091aa6dad66da2b682cebda410b","Type":"ContainerStarted","Data":"6ae0758833e73a7a967db75a1ccd6823154298c014e55dcde205a69de179ccc3"} Jun 11 23:10:28.024016 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:28.023995 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-215.ec2.internal\" not found" Jun 11 23:10:28.124522 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:28.124490 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-215.ec2.internal\" not found" Jun 11 23:10:28.225035 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:28.225010 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-215.ec2.internal\" not found" Jun 11 23:10:28.325577 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:28.325495 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-215.ec2.internal\" not found" Jun 11 23:10:28.416119 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.416086 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:10:28.435681 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.435648 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal" Jun 11 23:10:28.455370 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.455339 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 23:10:28.456544 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.456527 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-215.ec2.internal" Jun 11 23:10:28.467206 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.467174 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 23:10:28.917938 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.917903 2563 apiserver.go:52] "Watching apiserver" Jun 11 23:10:28.925934 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.925911 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 23:10:28.926361 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.926329 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-8lglz","openshift-multus/multus-hrhdl","openshift-multus/network-metrics-daemon-2pfzs","kube-system/global-pull-secret-syncer-n4lnc","kube-system/konnectivity-agent-xzq6f","kube-system/kube-apiserver-proxy-ip-10-0-130-215.ec2.internal","openshift-network-diagnostics/network-check-target-qrcp9","openshift-network-operator/iptables-alerter-z4mfm","openshift-ovn-kubernetes/ovnkube-node-lrmgd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sbfz","openshift-cluster-node-tuning-operator/tuned-2zjf4","openshift-dns/node-resolver-vkn8f","openshift-image-registry/node-ca-gqkl4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal"] Jun 11 23:10:28.928023 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.927947 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:10:28.928118 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:28.928090 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrcp9" podUID="a3b91f55-09c0-428d-a1d4-301859a89cdb" Jun 11 23:10:28.928406 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.928381 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:10:28.929173 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.929154 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gqkl4" Jun 11 23:10:28.930489 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.930467 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:10:28.930580 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:28.930538 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pfzs" podUID="4e46db09-c19b-4f8b-9eb4-370984f52a4c" Jun 11 23:10:28.931653 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.931628 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 23:10:28.931916 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.931900 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 23:10:28.932004 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.931921 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 23:10:28.932396 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.932375 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:10:28.932536 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:28.932439 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4lnc" podUID="8fb03f32-8124-418d-99c4-3c16de6e020d" Jun 11 23:10:28.932536 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.932445 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-x2wqv\"" Jun 11 23:10:28.933731 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.933711 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xzq6f" Jun 11 23:10:28.935244 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.934867 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z4mfm" Jun 11 23:10:28.935859 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.935835 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 23:10:28.936549 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.936477 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:28.936549 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.936539 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pf57m\"" Jun 11 23:10:28.936779 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.936708 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 23:10:28.938269 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.938247 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8lglz" Jun 11 23:10:28.939524 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.939508 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hrhdl" Jun 11 23:10:28.940090 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.940070 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 23:10:28.940360 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.940342 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 23:10:28.940559 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.940541 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lhvll\"" Jun 11 23:10:28.941123 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.941105 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sbfz" Jun 11 23:10:28.942383 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.942363 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 23:10:28.943367 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.943314 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 23:10:28.943367 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.943333 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:28.945243 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.944860 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 23:10:28.945243 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.944960 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-q8psm\"" Jun 11 23:10:28.945243 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.945001 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 23:10:28.945243 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.945019 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 23:10:28.945506 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.945467 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 23:10:28.945506 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.945470 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vkn8f" Jun 11 23:10:28.947922 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.947592 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 23:10:28.948645 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.948122 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 23:10:28.948645 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.948162 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 23:10:28.948645 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.948380 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 23:10:28.948645 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.948593 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 23:10:28.948880 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.948711 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 23:10:28.948931 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.948882 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 23:10:28.949408 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.949043 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 23:10:28.949408 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.949164 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tlt84\"" Jun 11 23:10:28.949532 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.949435 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 23:10:28.949532 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.949496 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 23:10:28.949927 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.949693 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cv6dl\"" Jun 11 23:10:28.949927 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.949742 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 23:10:28.949927 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.949770 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qmq5j\"" Jun 11 23:10:28.949927 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.949801 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zlfj9\"" Jun 11 23:10:28.949927 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.949696 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 23:10:28.950216 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.950013 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 23:10:28.950216 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.950147 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 23:10:28.950360 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.950338 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-host-run-ovn-kubernetes\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:28.950426 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.950379 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:28.950482 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.950428 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64v7l\" (UniqueName: \"kubernetes.io/projected/4e46db09-c19b-4f8b-9eb4-370984f52a4c-kube-api-access-64v7l\") pod \"network-metrics-daemon-2pfzs\" (UID: \"4e46db09-c19b-4f8b-9eb4-370984f52a4c\") " pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:10:28.950482 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.950466 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4fsd\" (UniqueName: \"kubernetes.io/projected/a3b91f55-09c0-428d-a1d4-301859a89cdb-kube-api-access-l4fsd\") pod \"network-check-target-qrcp9\" (UID: \"a3b91f55-09c0-428d-a1d4-301859a89cdb\") " pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:10:28.950576 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.950498 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-node-log\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:28.950576 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.950509 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sbqpc\"" Jun 11 23:10:28.950576 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.950524 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-log-socket\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:28.950576 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.950553 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkgpb\" (UniqueName: \"kubernetes.io/projected/243ee797-2187-41bc-ad0c-116ec1a4888f-kube-api-access-xkgpb\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:28.950748 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.950586 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps4g4\" (UniqueName: \"kubernetes.io/projected/3e60827b-9162-445d-a1f3-c9b8203587b8-kube-api-access-ps4g4\") pod \"iptables-alerter-z4mfm\" (UID: \"3e60827b-9162-445d-a1f3-c9b8203587b8\") " pod="openshift-network-operator/iptables-alerter-z4mfm" Jun 11 23:10:28.950748 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.950619 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-etc-openvswitch\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:28.950748 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.950646 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-run-openvswitch\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:28.950748 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.950669 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/243ee797-2187-41bc-ad0c-116ec1a4888f-env-overrides\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:28.950748 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.950703 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0997dc48-5058-46f2-b737-e37f618d472a-agent-certs\") pod \"konnectivity-agent-xzq6f\" (UID: \"0997dc48-5058-46f2-b737-e37f618d472a\") " pod="kube-system/konnectivity-agent-xzq6f" Jun 11 23:10:28.950748 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.950734 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gblvd\" (UniqueName: \"kubernetes.io/projected/eeef2be9-5af9-4766-af41-7c89fa431f22-kube-api-access-gblvd\") pod \"node-ca-gqkl4\" (UID: \"eeef2be9-5af9-4766-af41-7c89fa431f22\") " pod="openshift-image-registry/node-ca-gqkl4" Jun 11 23:10:28.951011 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.950788 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-host-kubelet\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:28.951011 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.950834 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-host-cni-bin\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:28.951011 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.950862 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-host-cni-netd\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:28.951011 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.950897 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8fb03f32-8124-418d-99c4-3c16de6e020d-original-pull-secret\") pod \"global-pull-secret-syncer-n4lnc\" (UID: \"8fb03f32-8124-418d-99c4-3c16de6e020d\") " pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:10:28.951011 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.950953 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3e60827b-9162-445d-a1f3-c9b8203587b8-iptables-alerter-script\") pod \"iptables-alerter-z4mfm\" (UID: \"3e60827b-9162-445d-a1f3-c9b8203587b8\") " pod="openshift-network-operator/iptables-alerter-z4mfm" Jun 11 23:10:28.951236 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.951082 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eeef2be9-5af9-4766-af41-7c89fa431f22-serviceca\") pod \"node-ca-gqkl4\" (UID: \"eeef2be9-5af9-4766-af41-7c89fa431f22\") " pod="openshift-image-registry/node-ca-gqkl4" Jun 11 23:10:28.951236 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.951141 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-systemd-units\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:28.951236 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.951173 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-host-run-netns\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:28.951236 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.951226 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-run-systemd\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:28.951423 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.951285 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-run-ovn\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:28.951423 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.951335 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/243ee797-2187-41bc-ad0c-116ec1a4888f-ovnkube-script-lib\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:28.951423 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.951369 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8fb03f32-8124-418d-99c4-3c16de6e020d-kubelet-config\") pod \"global-pull-secret-syncer-n4lnc\" (UID: \"8fb03f32-8124-418d-99c4-3c16de6e020d\") " pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:10:28.951423 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.951409 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-host-slash\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:28.951646 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.951460 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/243ee797-2187-41bc-ad0c-116ec1a4888f-ovnkube-config\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:28.951646 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.951503 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8fb03f32-8124-418d-99c4-3c16de6e020d-dbus\") pod \"global-pull-secret-syncer-n4lnc\" (UID: \"8fb03f32-8124-418d-99c4-3c16de6e020d\") " pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:10:28.951646 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.951545 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e60827b-9162-445d-a1f3-c9b8203587b8-host-slash\") pod \"iptables-alerter-z4mfm\" (UID: \"3e60827b-9162-445d-a1f3-c9b8203587b8\") " pod="openshift-network-operator/iptables-alerter-z4mfm" Jun 11 23:10:28.951646 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.951577 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eeef2be9-5af9-4766-af41-7c89fa431f22-host\") pod \"node-ca-gqkl4\" (UID: \"eeef2be9-5af9-4766-af41-7c89fa431f22\") " pod="openshift-image-registry/node-ca-gqkl4" Jun 11 23:10:28.951646 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.951609 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e46db09-c19b-4f8b-9eb4-370984f52a4c-metrics-certs\") pod \"network-metrics-daemon-2pfzs\" (UID: \"4e46db09-c19b-4f8b-9eb4-370984f52a4c\") " pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:10:28.951646 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.951637 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-var-lib-openvswitch\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:28.951918 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.951664 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/243ee797-2187-41bc-ad0c-116ec1a4888f-ovn-node-metrics-cert\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:28.951918 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.951703 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0997dc48-5058-46f2-b737-e37f618d472a-konnectivity-ca\") pod \"konnectivity-agent-xzq6f\" (UID: \"0997dc48-5058-46f2-b737-e37f618d472a\") " pod="kube-system/konnectivity-agent-xzq6f" Jun 11 23:10:28.954738 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.954524 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 23:10:28.959927 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.959904 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 23:10:28.981819 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.981798 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bnm7b" Jun 11 23:10:28.993334 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:28.993311 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bnm7b" Jun 11 23:10:29.037176 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.037147 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 23:10:29.052435 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.052405 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41fa8546-880a-4598-8a4e-67a217cc8136-tmp\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.052435 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.052440 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-host-var-lib-cni-multus\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.052657 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.052481 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-host-run-ovn-kubernetes\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.052657 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.052514 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-cnibin\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.052657 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.052543 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/271b39b1-c4a4-4b5b-a9d8-6482eae6fb06-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8sbfz\" (UID: \"271b39b1-c4a4-4b5b-a9d8-6482eae6fb06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sbfz" Jun 11 23:10:29.052657 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.052567 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/271b39b1-c4a4-4b5b-a9d8-6482eae6fb06-device-dir\") pod \"aws-ebs-csi-driver-node-8sbfz\" (UID: \"271b39b1-c4a4-4b5b-a9d8-6482eae6fb06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sbfz" Jun 11 23:10:29.052657 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.052572 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-host-run-ovn-kubernetes\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.052657 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.052589 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-node-log\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.052657 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.052634 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-node-log\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.052657 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.052644 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-log-socket\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.053066 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.052668 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkgpb\" (UniqueName: \"kubernetes.io/projected/243ee797-2187-41bc-ad0c-116ec1a4888f-kube-api-access-xkgpb\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.053066 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.052692 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/41fa8546-880a-4598-8a4e-67a217cc8136-etc-sysctl-d\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.053066 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.052718 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-host-run-netns\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.053066 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.052742 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/271b39b1-c4a4-4b5b-a9d8-6482eae6fb06-etc-selinux\") pod \"aws-ebs-csi-driver-node-8sbfz\" (UID: \"271b39b1-c4a4-4b5b-a9d8-6482eae6fb06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sbfz" Jun 11 23:10:29.053066 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.052744 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-log-socket\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.053066 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.052767 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps4g4\" (UniqueName: \"kubernetes.io/projected/3e60827b-9162-445d-a1f3-c9b8203587b8-kube-api-access-ps4g4\") pod \"iptables-alerter-z4mfm\" (UID: \"3e60827b-9162-445d-a1f3-c9b8203587b8\") " pod="openshift-network-operator/iptables-alerter-z4mfm" Jun 11 23:10:29.053066 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.052820 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-etc-openvswitch\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.053066 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.052859 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/243ee797-2187-41bc-ad0c-116ec1a4888f-env-overrides\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.053066 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.052886 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-etc-openvswitch\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.053066 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.052890 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0997dc48-5058-46f2-b737-e37f618d472a-agent-certs\") pod \"konnectivity-agent-xzq6f\" (UID: \"0997dc48-5058-46f2-b737-e37f618d472a\") " pod="kube-system/konnectivity-agent-xzq6f" Jun 11 23:10:29.053066 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.052922 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41fa8546-880a-4598-8a4e-67a217cc8136-etc-kubernetes\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.053066 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.052946 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/41fa8546-880a-4598-8a4e-67a217cc8136-etc-tuned\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.053066 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.052971 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-host-run-k8s-cni-cncf-io\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.053066 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.053019 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gblvd\" (UniqueName: \"kubernetes.io/projected/eeef2be9-5af9-4766-af41-7c89fa431f22-kube-api-access-gblvd\") pod \"node-ca-gqkl4\" (UID: \"eeef2be9-5af9-4766-af41-7c89fa431f22\") " pod="openshift-image-registry/node-ca-gqkl4" Jun 11 23:10:29.053066 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.053052 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-host-cni-bin\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.053775 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.053142 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8fb03f32-8124-418d-99c4-3c16de6e020d-original-pull-secret\") pod \"global-pull-secret-syncer-n4lnc\" (UID: \"8fb03f32-8124-418d-99c4-3c16de6e020d\") " pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:10:29.053775 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.053165 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/41fa8546-880a-4598-8a4e-67a217cc8136-lib-modules\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.053775 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.053206 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-multus-conf-dir\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.053775 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:29.053258 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:10:29.053775 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.053280 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea89baa6-2814-4cf0-8171-73946de5e446-tmp-dir\") pod \"node-resolver-vkn8f\" (UID: \"ea89baa6-2814-4cf0-8171-73946de5e446\") " pod="openshift-dns/node-resolver-vkn8f" Jun 11 23:10:29.053775 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.053308 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 23:10:29.053775 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:29.053368 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fb03f32-8124-418d-99c4-3c16de6e020d-original-pull-secret podName:8fb03f32-8124-418d-99c4-3c16de6e020d nodeName:}" failed. No retries permitted until 2026-06-11 23:10:29.553304843 +0000 UTC m=+2.976089812 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8fb03f32-8124-418d-99c4-3c16de6e020d-original-pull-secret") pod "global-pull-secret-syncer-n4lnc" (UID: "8fb03f32-8124-418d-99c4-3c16de6e020d") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:10:29.053775 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.053386 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87mjp\" (UniqueName: \"kubernetes.io/projected/ea89baa6-2814-4cf0-8171-73946de5e446-kube-api-access-87mjp\") pod \"node-resolver-vkn8f\" (UID: \"ea89baa6-2814-4cf0-8171-73946de5e446\") " pod="openshift-dns/node-resolver-vkn8f" Jun 11 23:10:29.053775 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.053415 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3e60827b-9162-445d-a1f3-c9b8203587b8-iptables-alerter-script\") pod \"iptables-alerter-z4mfm\" (UID: \"3e60827b-9162-445d-a1f3-c9b8203587b8\") " pod="openshift-network-operator/iptables-alerter-z4mfm" Jun 11 23:10:29.053775 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.053339 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-host-cni-bin\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.053775 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.053451 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/243ee797-2187-41bc-ad0c-116ec1a4888f-env-overrides\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.053775 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.053497 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-systemd-units\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.053775 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.053455 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-systemd-units\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.053775 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.053538 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-host-run-netns\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.053775 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.053566 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-run-systemd\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.053775 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.053596 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-run-ovn\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.053775 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.053618 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/243ee797-2187-41bc-ad0c-116ec1a4888f-ovnkube-script-lib\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.054586 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.053621 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-host-run-netns\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.054586 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.053694 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-run-systemd\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.054586 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.053749 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/41fa8546-880a-4598-8a4e-67a217cc8136-etc-systemd\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.054586 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.053781 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-run-ovn\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.054586 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.053777 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41fa8546-880a-4598-8a4e-67a217cc8136-sys\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.054586 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.053829 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/243ee797-2187-41bc-ad0c-116ec1a4888f-ovnkube-config\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.054586 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.053881 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8fb03f32-8124-418d-99c4-3c16de6e020d-dbus\") pod \"global-pull-secret-syncer-n4lnc\" (UID: \"8fb03f32-8124-418d-99c4-3c16de6e020d\") " pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:10:29.054586 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.054009 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5b94329-259b-4886-bd03-2205cf371d90-cnibin\") pod \"multus-additional-cni-plugins-8lglz\" (UID: \"f5b94329-259b-4886-bd03-2205cf371d90\") " pod="openshift-multus/multus-additional-cni-plugins-8lglz" Jun 11 23:10:29.054586 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.054041 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5b94329-259b-4886-bd03-2205cf371d90-cni-binary-copy\") pod \"multus-additional-cni-plugins-8lglz\" (UID: \"f5b94329-259b-4886-bd03-2205cf371d90\") " pod="openshift-multus/multus-additional-cni-plugins-8lglz" Jun 11 23:10:29.054586 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.054058 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3e60827b-9162-445d-a1f3-c9b8203587b8-iptables-alerter-script\") pod \"iptables-alerter-z4mfm\" (UID: \"3e60827b-9162-445d-a1f3-c9b8203587b8\") " pod="openshift-network-operator/iptables-alerter-z4mfm" Jun 11 23:10:29.054586 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.054080 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8fb03f32-8124-418d-99c4-3c16de6e020d-dbus\") pod \"global-pull-secret-syncer-n4lnc\" (UID: \"8fb03f32-8124-418d-99c4-3c16de6e020d\") " pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:10:29.054586 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.054067 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-system-cni-dir\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.054586 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.054137 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-host-var-lib-cni-bin\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.054586 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.054167 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/51a4a947-5f6d-4279-bb6a-0f4122de575a-multus-daemon-config\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.054586 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.054186 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-etc-kubernetes\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.054586 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.054203 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e60827b-9162-445d-a1f3-c9b8203587b8-host-slash\") pod \"iptables-alerter-z4mfm\" (UID: \"3e60827b-9162-445d-a1f3-c9b8203587b8\") " pod="openshift-network-operator/iptables-alerter-z4mfm" Jun 11 23:10:29.054586 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.054219 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p52vx\" (UniqueName: \"kubernetes.io/projected/41fa8546-880a-4598-8a4e-67a217cc8136-kube-api-access-p52vx\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.055363 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.054266 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e60827b-9162-445d-a1f3-c9b8203587b8-host-slash\") pod \"iptables-alerter-z4mfm\" (UID: \"3e60827b-9162-445d-a1f3-c9b8203587b8\") " pod="openshift-network-operator/iptables-alerter-z4mfm" Jun 11 23:10:29.055363 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.054283 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/243ee797-2187-41bc-ad0c-116ec1a4888f-ovnkube-script-lib\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.055363 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.054285 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f5b94329-259b-4886-bd03-2205cf371d90-os-release\") pod \"multus-additional-cni-plugins-8lglz\" (UID: \"f5b94329-259b-4886-bd03-2205cf371d90\") " pod="openshift-multus/multus-additional-cni-plugins-8lglz" Jun 11 23:10:29.055363 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.054336 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-host-var-lib-kubelet\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.055363 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.054364 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/243ee797-2187-41bc-ad0c-116ec1a4888f-ovn-node-metrics-cert\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.055363 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.054817 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5b94329-259b-4886-bd03-2205cf371d90-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8lglz\" (UID: \"f5b94329-259b-4886-bd03-2205cf371d90\") " pod="openshift-multus/multus-additional-cni-plugins-8lglz" Jun 11 23:10:29.055363 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.054857 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.055363 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.054887 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64v7l\" (UniqueName: \"kubernetes.io/projected/4e46db09-c19b-4f8b-9eb4-370984f52a4c-kube-api-access-64v7l\") pod \"network-metrics-daemon-2pfzs\" (UID: \"4e46db09-c19b-4f8b-9eb4-370984f52a4c\") " pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:10:29.055363 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.054915 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41fa8546-880a-4598-8a4e-67a217cc8136-var-lib-kubelet\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.055363 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.054938 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-os-release\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.055363 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.054962 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-multus-socket-dir-parent\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.055363 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055011 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/271b39b1-c4a4-4b5b-a9d8-6482eae6fb06-registration-dir\") pod \"aws-ebs-csi-driver-node-8sbfz\" (UID: \"271b39b1-c4a4-4b5b-a9d8-6482eae6fb06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sbfz" Jun 11 23:10:29.055363 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055037 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4fsd\" (UniqueName: \"kubernetes.io/projected/a3b91f55-09c0-428d-a1d4-301859a89cdb-kube-api-access-l4fsd\") pod \"network-check-target-qrcp9\" (UID: \"a3b91f55-09c0-428d-a1d4-301859a89cdb\") " pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:10:29.055363 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055063 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/41fa8546-880a-4598-8a4e-67a217cc8136-etc-sysconfig\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.055363 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055078 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.055363 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055087 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f5b94329-259b-4886-bd03-2205cf371d90-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8lglz\" (UID: \"f5b94329-259b-4886-bd03-2205cf371d90\") " pod="openshift-multus/multus-additional-cni-plugins-8lglz" Jun 11 23:10:29.056117 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055126 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-host-run-multus-certs\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.056117 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055159 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-run-openvswitch\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.056117 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055184 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwbj5\" (UniqueName: \"kubernetes.io/projected/51a4a947-5f6d-4279-bb6a-0f4122de575a-kube-api-access-jwbj5\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.056117 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055210 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-host-kubelet\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.056117 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055236 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-host-cni-netd\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.056117 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055272 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6878\" (UniqueName: \"kubernetes.io/projected/f5b94329-259b-4886-bd03-2205cf371d90-kube-api-access-f6878\") pod \"multus-additional-cni-plugins-8lglz\" (UID: \"f5b94329-259b-4886-bd03-2205cf371d90\") " pod="openshift-multus/multus-additional-cni-plugins-8lglz" Jun 11 23:10:29.056117 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055303 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/271b39b1-c4a4-4b5b-a9d8-6482eae6fb06-socket-dir\") pod \"aws-ebs-csi-driver-node-8sbfz\" (UID: \"271b39b1-c4a4-4b5b-a9d8-6482eae6fb06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sbfz" Jun 11 23:10:29.056117 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055329 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eeef2be9-5af9-4766-af41-7c89fa431f22-serviceca\") pod \"node-ca-gqkl4\" (UID: \"eeef2be9-5af9-4766-af41-7c89fa431f22\") " pod="openshift-image-registry/node-ca-gqkl4" Jun 11 23:10:29.056117 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055358 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8fb03f32-8124-418d-99c4-3c16de6e020d-kubelet-config\") pod \"global-pull-secret-syncer-n4lnc\" (UID: \"8fb03f32-8124-418d-99c4-3c16de6e020d\") " pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:10:29.056117 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055384 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/41fa8546-880a-4598-8a4e-67a217cc8136-etc-modprobe-d\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.056117 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055409 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/41fa8546-880a-4598-8a4e-67a217cc8136-etc-sysctl-conf\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.056117 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055433 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/41fa8546-880a-4598-8a4e-67a217cc8136-run\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.056117 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055457 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f5b94329-259b-4886-bd03-2205cf371d90-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8lglz\" (UID: \"f5b94329-259b-4886-bd03-2205cf371d90\") " pod="openshift-multus/multus-additional-cni-plugins-8lglz" Jun 11 23:10:29.056117 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055483 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-host-slash\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.056117 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055530 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/41fa8546-880a-4598-8a4e-67a217cc8136-host\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.056117 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055545 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/243ee797-2187-41bc-ad0c-116ec1a4888f-ovnkube-config\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.056117 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055564 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5b94329-259b-4886-bd03-2205cf371d90-system-cni-dir\") pod \"multus-additional-cni-plugins-8lglz\" (UID: \"f5b94329-259b-4886-bd03-2205cf371d90\") " pod="openshift-multus/multus-additional-cni-plugins-8lglz" Jun 11 23:10:29.056764 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055598 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-multus-cni-dir\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.056764 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055606 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-host-kubelet\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.056764 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055601 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-host-cni-netd\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.056764 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055640 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-run-openvswitch\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.056764 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055658 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-hostroot\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.056764 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055705 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8fb03f32-8124-418d-99c4-3c16de6e020d-kubelet-config\") pod \"global-pull-secret-syncer-n4lnc\" (UID: \"8fb03f32-8124-418d-99c4-3c16de6e020d\") " pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:10:29.056764 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055734 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ea89baa6-2814-4cf0-8171-73946de5e446-hosts-file\") pod \"node-resolver-vkn8f\" (UID: \"ea89baa6-2814-4cf0-8171-73946de5e446\") " pod="openshift-dns/node-resolver-vkn8f" Jun 11 23:10:29.056764 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055759 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eeef2be9-5af9-4766-af41-7c89fa431f22-host\") pod \"node-ca-gqkl4\" (UID: \"eeef2be9-5af9-4766-af41-7c89fa431f22\") " pod="openshift-image-registry/node-ca-gqkl4" Jun 11 23:10:29.056764 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055783 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e46db09-c19b-4f8b-9eb4-370984f52a4c-metrics-certs\") pod \"network-metrics-daemon-2pfzs\" (UID: \"4e46db09-c19b-4f8b-9eb4-370984f52a4c\") " pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:10:29.056764 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055805 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/51a4a947-5f6d-4279-bb6a-0f4122de575a-cni-binary-copy\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.056764 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055827 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/271b39b1-c4a4-4b5b-a9d8-6482eae6fb06-sys-fs\") pod \"aws-ebs-csi-driver-node-8sbfz\" (UID: \"271b39b1-c4a4-4b5b-a9d8-6482eae6fb06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sbfz" Jun 11 23:10:29.056764 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055881 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d6pk\" (UniqueName: \"kubernetes.io/projected/271b39b1-c4a4-4b5b-a9d8-6482eae6fb06-kube-api-access-7d6pk\") pod \"aws-ebs-csi-driver-node-8sbfz\" (UID: \"271b39b1-c4a4-4b5b-a9d8-6482eae6fb06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sbfz" Jun 11 23:10:29.056764 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055904 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-var-lib-openvswitch\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.056764 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.055929 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0997dc48-5058-46f2-b737-e37f618d472a-konnectivity-ca\") pod \"konnectivity-agent-xzq6f\" (UID: \"0997dc48-5058-46f2-b737-e37f618d472a\") " pod="kube-system/konnectivity-agent-xzq6f" Jun 11 23:10:29.056764 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.056031 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eeef2be9-5af9-4766-af41-7c89fa431f22-serviceca\") pod \"node-ca-gqkl4\" (UID: \"eeef2be9-5af9-4766-af41-7c89fa431f22\") " pod="openshift-image-registry/node-ca-gqkl4" Jun 11 23:10:29.056764 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.056109 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-host-slash\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.056764 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.056152 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eeef2be9-5af9-4766-af41-7c89fa431f22-host\") pod \"node-ca-gqkl4\" (UID: \"eeef2be9-5af9-4766-af41-7c89fa431f22\") " pod="openshift-image-registry/node-ca-gqkl4" Jun 11 23:10:29.056764 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:29.056220 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:10:29.057527 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.056282 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/243ee797-2187-41bc-ad0c-116ec1a4888f-var-lib-openvswitch\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.057527 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:29.056324 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e46db09-c19b-4f8b-9eb4-370984f52a4c-metrics-certs podName:4e46db09-c19b-4f8b-9eb4-370984f52a4c nodeName:}" failed. No retries permitted until 2026-06-11 23:10:29.556303866 +0000 UTC m=+2.979088817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e46db09-c19b-4f8b-9eb4-370984f52a4c-metrics-certs") pod "network-metrics-daemon-2pfzs" (UID: "4e46db09-c19b-4f8b-9eb4-370984f52a4c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:10:29.057527 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.056458 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0997dc48-5058-46f2-b737-e37f618d472a-konnectivity-ca\") pod \"konnectivity-agent-xzq6f\" (UID: \"0997dc48-5058-46f2-b737-e37f618d472a\") " pod="kube-system/konnectivity-agent-xzq6f" Jun 11 23:10:29.057527 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.057260 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/243ee797-2187-41bc-ad0c-116ec1a4888f-ovn-node-metrics-cert\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.057527 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.057291 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0997dc48-5058-46f2-b737-e37f618d472a-agent-certs\") pod \"konnectivity-agent-xzq6f\" (UID: \"0997dc48-5058-46f2-b737-e37f618d472a\") " pod="kube-system/konnectivity-agent-xzq6f" Jun 11 23:10:29.063844 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.063819 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps4g4\" (UniqueName: \"kubernetes.io/projected/3e60827b-9162-445d-a1f3-c9b8203587b8-kube-api-access-ps4g4\") pod \"iptables-alerter-z4mfm\" (UID: \"3e60827b-9162-445d-a1f3-c9b8203587b8\") " pod="openshift-network-operator/iptables-alerter-z4mfm" Jun 11 23:10:29.063968 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.063900 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gblvd\" (UniqueName: \"kubernetes.io/projected/eeef2be9-5af9-4766-af41-7c89fa431f22-kube-api-access-gblvd\") pod \"node-ca-gqkl4\" (UID: \"eeef2be9-5af9-4766-af41-7c89fa431f22\") " pod="openshift-image-registry/node-ca-gqkl4" Jun 11 23:10:29.064527 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.064459 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkgpb\" (UniqueName: \"kubernetes.io/projected/243ee797-2187-41bc-ad0c-116ec1a4888f-kube-api-access-xkgpb\") pod \"ovnkube-node-lrmgd\" (UID: \"243ee797-2187-41bc-ad0c-116ec1a4888f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.066033 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:29.066013 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:10:29.066135 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:29.066041 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:10:29.066135 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:29.066055 2563 projected.go:196] Error preparing data for projected volume kube-api-access-l4fsd for pod openshift-network-diagnostics/network-check-target-qrcp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:10:29.066233 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:29.066150 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3b91f55-09c0-428d-a1d4-301859a89cdb-kube-api-access-l4fsd podName:a3b91f55-09c0-428d-a1d4-301859a89cdb nodeName:}" failed. No retries permitted until 2026-06-11 23:10:29.566122742 +0000 UTC m=+2.988907704 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-l4fsd" (UniqueName: "kubernetes.io/projected/a3b91f55-09c0-428d-a1d4-301859a89cdb-kube-api-access-l4fsd") pod "network-check-target-qrcp9" (UID: "a3b91f55-09c0-428d-a1d4-301859a89cdb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:10:29.067481 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.067460 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64v7l\" (UniqueName: \"kubernetes.io/projected/4e46db09-c19b-4f8b-9eb4-370984f52a4c-kube-api-access-64v7l\") pod \"network-metrics-daemon-2pfzs\" (UID: \"4e46db09-c19b-4f8b-9eb4-370984f52a4c\") " pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:10:29.156701 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.156664 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5b94329-259b-4886-bd03-2205cf371d90-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8lglz\" (UID: \"f5b94329-259b-4886-bd03-2205cf371d90\") " pod="openshift-multus/multus-additional-cni-plugins-8lglz" Jun 11 23:10:29.156912 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.156709 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41fa8546-880a-4598-8a4e-67a217cc8136-var-lib-kubelet\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.156912 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.156735 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-os-release\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.156912 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.156759 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-multus-socket-dir-parent\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.156912 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.156783 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/271b39b1-c4a4-4b5b-a9d8-6482eae6fb06-registration-dir\") pod \"aws-ebs-csi-driver-node-8sbfz\" (UID: \"271b39b1-c4a4-4b5b-a9d8-6482eae6fb06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sbfz" Jun 11 23:10:29.156912 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.156817 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/41fa8546-880a-4598-8a4e-67a217cc8136-etc-sysconfig\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.156912 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.156841 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f5b94329-259b-4886-bd03-2205cf371d90-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8lglz\" (UID: \"f5b94329-259b-4886-bd03-2205cf371d90\") " pod="openshift-multus/multus-additional-cni-plugins-8lglz" Jun 11 23:10:29.156912 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.156847 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-os-release\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.156912 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.156848 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-multus-socket-dir-parent\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.156912 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.156868 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-host-run-multus-certs\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.156912 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.156890 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/271b39b1-c4a4-4b5b-a9d8-6482eae6fb06-registration-dir\") pod \"aws-ebs-csi-driver-node-8sbfz\" (UID: \"271b39b1-c4a4-4b5b-a9d8-6482eae6fb06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sbfz" Jun 11 23:10:29.156912 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.156902 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-host-run-multus-certs\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.157478 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.156909 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/41fa8546-880a-4598-8a4e-67a217cc8136-etc-sysconfig\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.157478 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.156911 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwbj5\" (UniqueName: \"kubernetes.io/projected/51a4a947-5f6d-4279-bb6a-0f4122de575a-kube-api-access-jwbj5\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.157478 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.156837 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41fa8546-880a-4598-8a4e-67a217cc8136-var-lib-kubelet\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.157478 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.156917 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5b94329-259b-4886-bd03-2205cf371d90-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8lglz\" (UID: \"f5b94329-259b-4886-bd03-2205cf371d90\") " pod="openshift-multus/multus-additional-cni-plugins-8lglz" Jun 11 23:10:29.157478 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157009 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6878\" (UniqueName: \"kubernetes.io/projected/f5b94329-259b-4886-bd03-2205cf371d90-kube-api-access-f6878\") pod \"multus-additional-cni-plugins-8lglz\" (UID: \"f5b94329-259b-4886-bd03-2205cf371d90\") " pod="openshift-multus/multus-additional-cni-plugins-8lglz" Jun 11 23:10:29.157478 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157041 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/271b39b1-c4a4-4b5b-a9d8-6482eae6fb06-socket-dir\") pod \"aws-ebs-csi-driver-node-8sbfz\" (UID: \"271b39b1-c4a4-4b5b-a9d8-6482eae6fb06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sbfz" Jun 11 23:10:29.157478 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157159 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/41fa8546-880a-4598-8a4e-67a217cc8136-etc-modprobe-d\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.157478 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157168 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/271b39b1-c4a4-4b5b-a9d8-6482eae6fb06-socket-dir\") pod \"aws-ebs-csi-driver-node-8sbfz\" (UID: \"271b39b1-c4a4-4b5b-a9d8-6482eae6fb06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sbfz" Jun 11 23:10:29.157478 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157182 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/41fa8546-880a-4598-8a4e-67a217cc8136-etc-sysctl-conf\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.157478 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157203 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/41fa8546-880a-4598-8a4e-67a217cc8136-run\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.157478 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157219 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f5b94329-259b-4886-bd03-2205cf371d90-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8lglz\" (UID: \"f5b94329-259b-4886-bd03-2205cf371d90\") " pod="openshift-multus/multus-additional-cni-plugins-8lglz" Jun 11 23:10:29.157478 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157244 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/41fa8546-880a-4598-8a4e-67a217cc8136-host\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.157478 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157268 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5b94329-259b-4886-bd03-2205cf371d90-system-cni-dir\") pod \"multus-additional-cni-plugins-8lglz\" (UID: \"f5b94329-259b-4886-bd03-2205cf371d90\") " pod="openshift-multus/multus-additional-cni-plugins-8lglz" Jun 11 23:10:29.157478 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157278 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/41fa8546-880a-4598-8a4e-67a217cc8136-etc-modprobe-d\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.157478 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157290 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-multus-cni-dir\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.157478 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157278 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/41fa8546-880a-4598-8a4e-67a217cc8136-run\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.157478 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157314 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-hostroot\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.158291 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157321 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/41fa8546-880a-4598-8a4e-67a217cc8136-host\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.158291 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157321 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/41fa8546-880a-4598-8a4e-67a217cc8136-etc-sysctl-conf\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.158291 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157335 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5b94329-259b-4886-bd03-2205cf371d90-system-cni-dir\") pod \"multus-additional-cni-plugins-8lglz\" (UID: \"f5b94329-259b-4886-bd03-2205cf371d90\") " pod="openshift-multus/multus-additional-cni-plugins-8lglz" Jun 11 23:10:29.158291 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157339 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ea89baa6-2814-4cf0-8171-73946de5e446-hosts-file\") pod \"node-resolver-vkn8f\" (UID: \"ea89baa6-2814-4cf0-8171-73946de5e446\") " pod="openshift-dns/node-resolver-vkn8f" Jun 11 23:10:29.158291 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157372 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-hostroot\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.158291 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157375 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-multus-cni-dir\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.158291 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157388 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/51a4a947-5f6d-4279-bb6a-0f4122de575a-cni-binary-copy\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.158291 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157412 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/271b39b1-c4a4-4b5b-a9d8-6482eae6fb06-sys-fs\") pod \"aws-ebs-csi-driver-node-8sbfz\" (UID: \"271b39b1-c4a4-4b5b-a9d8-6482eae6fb06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sbfz" Jun 11 23:10:29.158291 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157429 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d6pk\" (UniqueName: \"kubernetes.io/projected/271b39b1-c4a4-4b5b-a9d8-6482eae6fb06-kube-api-access-7d6pk\") pod \"aws-ebs-csi-driver-node-8sbfz\" (UID: \"271b39b1-c4a4-4b5b-a9d8-6482eae6fb06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sbfz" Jun 11 23:10:29.158291 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157437 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ea89baa6-2814-4cf0-8171-73946de5e446-hosts-file\") pod \"node-resolver-vkn8f\" (UID: \"ea89baa6-2814-4cf0-8171-73946de5e446\") " pod="openshift-dns/node-resolver-vkn8f" Jun 11 23:10:29.158291 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157450 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41fa8546-880a-4598-8a4e-67a217cc8136-tmp\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.158291 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157464 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f5b94329-259b-4886-bd03-2205cf371d90-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8lglz\" (UID: \"f5b94329-259b-4886-bd03-2205cf371d90\") " pod="openshift-multus/multus-additional-cni-plugins-8lglz" Jun 11 23:10:29.158291 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157472 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-host-var-lib-cni-multus\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.158291 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157498 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-cnibin\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.158291 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157522 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/271b39b1-c4a4-4b5b-a9d8-6482eae6fb06-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8sbfz\" (UID: \"271b39b1-c4a4-4b5b-a9d8-6482eae6fb06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sbfz" Jun 11 23:10:29.158291 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157530 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-host-var-lib-cni-multus\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.158291 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157497 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/271b39b1-c4a4-4b5b-a9d8-6482eae6fb06-sys-fs\") pod \"aws-ebs-csi-driver-node-8sbfz\" (UID: \"271b39b1-c4a4-4b5b-a9d8-6482eae6fb06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sbfz" Jun 11 23:10:29.158291 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157545 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/271b39b1-c4a4-4b5b-a9d8-6482eae6fb06-device-dir\") pod \"aws-ebs-csi-driver-node-8sbfz\" (UID: \"271b39b1-c4a4-4b5b-a9d8-6482eae6fb06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sbfz" Jun 11 23:10:29.159174 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157573 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/41fa8546-880a-4598-8a4e-67a217cc8136-etc-sysctl-d\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.159174 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157584 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-cnibin\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.159174 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157595 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-host-run-netns\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.159174 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157623 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/271b39b1-c4a4-4b5b-a9d8-6482eae6fb06-etc-selinux\") pod \"aws-ebs-csi-driver-node-8sbfz\" (UID: \"271b39b1-c4a4-4b5b-a9d8-6482eae6fb06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sbfz" Jun 11 23:10:29.159174 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157626 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/271b39b1-c4a4-4b5b-a9d8-6482eae6fb06-device-dir\") pod \"aws-ebs-csi-driver-node-8sbfz\" (UID: \"271b39b1-c4a4-4b5b-a9d8-6482eae6fb06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sbfz" Jun 11 23:10:29.159174 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157659 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-host-run-netns\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.159174 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157674 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41fa8546-880a-4598-8a4e-67a217cc8136-etc-kubernetes\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.159174 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157696 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/271b39b1-c4a4-4b5b-a9d8-6482eae6fb06-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8sbfz\" (UID: \"271b39b1-c4a4-4b5b-a9d8-6482eae6fb06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sbfz" Jun 11 23:10:29.159174 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157702 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/41fa8546-880a-4598-8a4e-67a217cc8136-etc-tuned\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.159174 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157715 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/271b39b1-c4a4-4b5b-a9d8-6482eae6fb06-etc-selinux\") pod \"aws-ebs-csi-driver-node-8sbfz\" (UID: \"271b39b1-c4a4-4b5b-a9d8-6482eae6fb06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sbfz" Jun 11 23:10:29.159174 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157720 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f5b94329-259b-4886-bd03-2205cf371d90-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8lglz\" (UID: \"f5b94329-259b-4886-bd03-2205cf371d90\") " pod="openshift-multus/multus-additional-cni-plugins-8lglz" Jun 11 23:10:29.159174 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157728 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-host-run-k8s-cni-cncf-io\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.159174 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157760 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41fa8546-880a-4598-8a4e-67a217cc8136-etc-kubernetes\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.159174 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157766 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/41fa8546-880a-4598-8a4e-67a217cc8136-lib-modules\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.159174 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157783 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/41fa8546-880a-4598-8a4e-67a217cc8136-etc-sysctl-d\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.159174 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157805 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-host-run-k8s-cni-cncf-io\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.159174 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157831 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-multus-conf-dir\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.159174 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157852 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea89baa6-2814-4cf0-8171-73946de5e446-tmp-dir\") pod \"node-resolver-vkn8f\" (UID: \"ea89baa6-2814-4cf0-8171-73946de5e446\") " pod="openshift-dns/node-resolver-vkn8f" Jun 11 23:10:29.160019 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157875 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/51a4a947-5f6d-4279-bb6a-0f4122de575a-cni-binary-copy\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.160019 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157881 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/41fa8546-880a-4598-8a4e-67a217cc8136-lib-modules\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.160019 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157878 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87mjp\" (UniqueName: \"kubernetes.io/projected/ea89baa6-2814-4cf0-8171-73946de5e446-kube-api-access-87mjp\") pod \"node-resolver-vkn8f\" (UID: \"ea89baa6-2814-4cf0-8171-73946de5e446\") " pod="openshift-dns/node-resolver-vkn8f" Jun 11 23:10:29.160019 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157911 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-multus-conf-dir\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.160019 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157929 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/41fa8546-880a-4598-8a4e-67a217cc8136-etc-systemd\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.160019 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157954 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41fa8546-880a-4598-8a4e-67a217cc8136-sys\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.160019 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.157997 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/41fa8546-880a-4598-8a4e-67a217cc8136-etc-systemd\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.160019 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.158000 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5b94329-259b-4886-bd03-2205cf371d90-cnibin\") pod \"multus-additional-cni-plugins-8lglz\" (UID: \"f5b94329-259b-4886-bd03-2205cf371d90\") " pod="openshift-multus/multus-additional-cni-plugins-8lglz" Jun 11 23:10:29.160019 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.158024 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41fa8546-880a-4598-8a4e-67a217cc8136-sys\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.160019 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.158035 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5b94329-259b-4886-bd03-2205cf371d90-cnibin\") pod \"multus-additional-cni-plugins-8lglz\" (UID: \"f5b94329-259b-4886-bd03-2205cf371d90\") " pod="openshift-multus/multus-additional-cni-plugins-8lglz" Jun 11 23:10:29.160019 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.158045 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5b94329-259b-4886-bd03-2205cf371d90-cni-binary-copy\") pod \"multus-additional-cni-plugins-8lglz\" (UID: \"f5b94329-259b-4886-bd03-2205cf371d90\") " pod="openshift-multus/multus-additional-cni-plugins-8lglz" Jun 11 23:10:29.160019 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.158074 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-system-cni-dir\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.160019 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.158099 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-host-var-lib-cni-bin\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.160019 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.158121 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/51a4a947-5f6d-4279-bb6a-0f4122de575a-multus-daemon-config\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.160019 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.158143 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-etc-kubernetes\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.160019 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.158164 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea89baa6-2814-4cf0-8171-73946de5e446-tmp-dir\") pod \"node-resolver-vkn8f\" (UID: \"ea89baa6-2814-4cf0-8171-73946de5e446\") " pod="openshift-dns/node-resolver-vkn8f" Jun 11 23:10:29.160019 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.158174 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-system-cni-dir\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.160019 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.158167 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p52vx\" (UniqueName: \"kubernetes.io/projected/41fa8546-880a-4598-8a4e-67a217cc8136-kube-api-access-p52vx\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.160899 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.158227 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f5b94329-259b-4886-bd03-2205cf371d90-os-release\") pod \"multus-additional-cni-plugins-8lglz\" (UID: \"f5b94329-259b-4886-bd03-2205cf371d90\") " pod="openshift-multus/multus-additional-cni-plugins-8lglz" Jun 11 23:10:29.160899 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.158254 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-host-var-lib-kubelet\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.160899 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.158319 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-host-var-lib-kubelet\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.160899 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.158375 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f5b94329-259b-4886-bd03-2205cf371d90-os-release\") pod \"multus-additional-cni-plugins-8lglz\" (UID: \"f5b94329-259b-4886-bd03-2205cf371d90\") " pod="openshift-multus/multus-additional-cni-plugins-8lglz" Jun 11 23:10:29.160899 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.158379 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-etc-kubernetes\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.160899 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.158403 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51a4a947-5f6d-4279-bb6a-0f4122de575a-host-var-lib-cni-bin\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.160899 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.158554 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5b94329-259b-4886-bd03-2205cf371d90-cni-binary-copy\") pod \"multus-additional-cni-plugins-8lglz\" (UID: \"f5b94329-259b-4886-bd03-2205cf371d90\") " pod="openshift-multus/multus-additional-cni-plugins-8lglz" Jun 11 23:10:29.160899 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.158628 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/51a4a947-5f6d-4279-bb6a-0f4122de575a-multus-daemon-config\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.160899 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.160075 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/41fa8546-880a-4598-8a4e-67a217cc8136-etc-tuned\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.160899 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.160107 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41fa8546-880a-4598-8a4e-67a217cc8136-tmp\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.168217 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.168120 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwbj5\" (UniqueName: \"kubernetes.io/projected/51a4a947-5f6d-4279-bb6a-0f4122de575a-kube-api-access-jwbj5\") pod \"multus-hrhdl\" (UID: \"51a4a947-5f6d-4279-bb6a-0f4122de575a\") " pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.168217 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.168152 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p52vx\" (UniqueName: \"kubernetes.io/projected/41fa8546-880a-4598-8a4e-67a217cc8136-kube-api-access-p52vx\") pod \"tuned-2zjf4\" (UID: \"41fa8546-880a-4598-8a4e-67a217cc8136\") " pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.168217 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.168167 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d6pk\" (UniqueName: \"kubernetes.io/projected/271b39b1-c4a4-4b5b-a9d8-6482eae6fb06-kube-api-access-7d6pk\") pod \"aws-ebs-csi-driver-node-8sbfz\" (UID: \"271b39b1-c4a4-4b5b-a9d8-6482eae6fb06\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sbfz" Jun 11 23:10:29.168467 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.168450 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87mjp\" (UniqueName: \"kubernetes.io/projected/ea89baa6-2814-4cf0-8171-73946de5e446-kube-api-access-87mjp\") pod \"node-resolver-vkn8f\" (UID: \"ea89baa6-2814-4cf0-8171-73946de5e446\") " pod="openshift-dns/node-resolver-vkn8f" Jun 11 23:10:29.169062 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.169041 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6878\" (UniqueName: \"kubernetes.io/projected/f5b94329-259b-4886-bd03-2205cf371d90-kube-api-access-f6878\") pod \"multus-additional-cni-plugins-8lglz\" (UID: \"f5b94329-259b-4886-bd03-2205cf371d90\") " pod="openshift-multus/multus-additional-cni-plugins-8lglz" Jun 11 23:10:29.242108 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.242071 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gqkl4" Jun 11 23:10:29.251865 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.251841 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xzq6f" Jun 11 23:10:29.261525 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.261497 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z4mfm" Jun 11 23:10:29.267534 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.267508 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:29.274237 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.274213 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8lglz" Jun 11 23:10:29.279914 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.279891 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hrhdl" Jun 11 23:10:29.285621 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.285600 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sbfz" Jun 11 23:10:29.292271 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.292244 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" Jun 11 23:10:29.297901 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.297877 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vkn8f" Jun 11 23:10:29.490393 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.490309 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:10:29.560621 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.560588 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e46db09-c19b-4f8b-9eb4-370984f52a4c-metrics-certs\") pod \"network-metrics-daemon-2pfzs\" (UID: \"4e46db09-c19b-4f8b-9eb4-370984f52a4c\") " pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:10:29.560822 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.560655 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8fb03f32-8124-418d-99c4-3c16de6e020d-original-pull-secret\") pod \"global-pull-secret-syncer-n4lnc\" (UID: \"8fb03f32-8124-418d-99c4-3c16de6e020d\") " pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:10:29.560822 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:29.560785 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:10:29.560822 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:29.560798 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:10:29.560944 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:29.560867 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e46db09-c19b-4f8b-9eb4-370984f52a4c-metrics-certs podName:4e46db09-c19b-4f8b-9eb4-370984f52a4c nodeName:}" failed. No retries permitted until 2026-06-11 23:10:30.560847455 +0000 UTC m=+3.983632413 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e46db09-c19b-4f8b-9eb4-370984f52a4c-metrics-certs") pod "network-metrics-daemon-2pfzs" (UID: "4e46db09-c19b-4f8b-9eb4-370984f52a4c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:10:29.560944 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:29.560888 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fb03f32-8124-418d-99c4-3c16de6e020d-original-pull-secret podName:8fb03f32-8124-418d-99c4-3c16de6e020d nodeName:}" failed. No retries permitted until 2026-06-11 23:10:30.560877598 +0000 UTC m=+3.983662546 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8fb03f32-8124-418d-99c4-3c16de6e020d-original-pull-secret") pod "global-pull-secret-syncer-n4lnc" (UID: "8fb03f32-8124-418d-99c4-3c16de6e020d") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:10:29.661535 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.661504 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4fsd\" (UniqueName: \"kubernetes.io/projected/a3b91f55-09c0-428d-a1d4-301859a89cdb-kube-api-access-l4fsd\") pod \"network-check-target-qrcp9\" (UID: \"a3b91f55-09c0-428d-a1d4-301859a89cdb\") " pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:10:29.661721 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:29.661709 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:10:29.661765 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:29.661729 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:10:29.661765 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:29.661738 2563 projected.go:196] Error preparing data for projected volume kube-api-access-l4fsd for pod openshift-network-diagnostics/network-check-target-qrcp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:10:29.661834 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:29.661790 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3b91f55-09c0-428d-a1d4-301859a89cdb-kube-api-access-l4fsd podName:a3b91f55-09c0-428d-a1d4-301859a89cdb nodeName:}" failed. No retries permitted until 2026-06-11 23:10:30.661777748 +0000 UTC m=+4.084562706 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-l4fsd" (UniqueName: "kubernetes.io/projected/a3b91f55-09c0-428d-a1d4-301859a89cdb-kube-api-access-l4fsd") pod "network-check-target-qrcp9" (UID: "a3b91f55-09c0-428d-a1d4-301859a89cdb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:10:29.974203 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:29.974174 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51a4a947_5f6d_4279_bb6a_0f4122de575a.slice/crio-c9f74b8294d0fb131a80144bebc337a990eb15d5b736195cb84c33470dff737b WatchSource:0}: Error finding container c9f74b8294d0fb131a80144bebc337a990eb15d5b736195cb84c33470dff737b: Status 404 returned error can't find the container with id c9f74b8294d0fb131a80144bebc337a990eb15d5b736195cb84c33470dff737b Jun 11 23:10:29.975556 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:29.975454 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod243ee797_2187_41bc_ad0c_116ec1a4888f.slice/crio-166ed9013b09ab17cea1c9f84c4061f6f2661d740a79ed1112617328685dbfd4 WatchSource:0}: Error finding container 166ed9013b09ab17cea1c9f84c4061f6f2661d740a79ed1112617328685dbfd4: Status 404 returned error can't find the container with id 166ed9013b09ab17cea1c9f84c4061f6f2661d740a79ed1112617328685dbfd4 Jun 11 23:10:29.979657 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:29.979588 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e60827b_9162_445d_a1f3_c9b8203587b8.slice/crio-858761025fbcfe560ace0c56ff6a08c10b94ba10de6d81fdb768cd15f60da047 WatchSource:0}: Error finding container 858761025fbcfe560ace0c56ff6a08c10b94ba10de6d81fdb768cd15f60da047: Status 404 returned error can't find the container with id 858761025fbcfe560ace0c56ff6a08c10b94ba10de6d81fdb768cd15f60da047 Jun 11 23:10:29.980499 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:29.980471 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeef2be9_5af9_4766_af41_7c89fa431f22.slice/crio-369e2eb8f33bce9111fb20ce2e56c927da2a2f0b318af56a748581987ddb341b WatchSource:0}: Error finding container 369e2eb8f33bce9111fb20ce2e56c927da2a2f0b318af56a748581987ddb341b: Status 404 returned error can't find the container with id 369e2eb8f33bce9111fb20ce2e56c927da2a2f0b318af56a748581987ddb341b Jun 11 23:10:29.981143 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:29.981116 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea89baa6_2814_4cf0_8171_73946de5e446.slice/crio-483772cc0e7060c6bc1e04b1711dcf683b9b137d15edb5d0f755af0af22512b5 WatchSource:0}: Error finding container 483772cc0e7060c6bc1e04b1711dcf683b9b137d15edb5d0f755af0af22512b5: Status 404 returned error can't find the container with id 483772cc0e7060c6bc1e04b1711dcf683b9b137d15edb5d0f755af0af22512b5 Jun 11 23:10:29.982109 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:29.982084 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41fa8546_880a_4598_8a4e_67a217cc8136.slice/crio-b398600e4e762b7075b95938c1fd6ff45c8809d8fecd5747ab7a07f0de6866cb WatchSource:0}: Error finding container b398600e4e762b7075b95938c1fd6ff45c8809d8fecd5747ab7a07f0de6866cb: Status 404 returned error can't find the container with id b398600e4e762b7075b95938c1fd6ff45c8809d8fecd5747ab7a07f0de6866cb Jun 11 23:10:29.984054 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:10:29.983850 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0997dc48_5058_46f2_b737_e37f618d472a.slice/crio-cc3884757c56ce27345f13ac4660d07377e1339a7e3a9ff994c3b3961dfd2f32 WatchSource:0}: Error finding container cc3884757c56ce27345f13ac4660d07377e1339a7e3a9ff994c3b3961dfd2f32: Status 404 returned error can't find the container with id cc3884757c56ce27345f13ac4660d07377e1339a7e3a9ff994c3b3961dfd2f32 Jun 11 23:10:29.995864 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.995808 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 23:05:28 +0000 UTC" deadline="2027-12-05 03:05:41.600639639 +0000 UTC" Jun 11 23:10:29.995997 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:29.995865 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12987h55m11.604779921s" Jun 11 23:10:30.006480 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:30.006425 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sbfz" event={"ID":"271b39b1-c4a4-4b5b-a9d8-6482eae6fb06","Type":"ContainerStarted","Data":"ffdb84285a0d378b7ee089eb2295d5499332f61a6d05a290fb9961dedbe203b2"} Jun 11 23:10:30.010941 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:30.010908 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vkn8f" event={"ID":"ea89baa6-2814-4cf0-8171-73946de5e446","Type":"ContainerStarted","Data":"483772cc0e7060c6bc1e04b1711dcf683b9b137d15edb5d0f755af0af22512b5"} Jun 11 23:10:30.013820 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:30.013788 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z4mfm" event={"ID":"3e60827b-9162-445d-a1f3-c9b8203587b8","Type":"ContainerStarted","Data":"858761025fbcfe560ace0c56ff6a08c10b94ba10de6d81fdb768cd15f60da047"} Jun 11 23:10:30.017417 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:30.017379 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hrhdl" event={"ID":"51a4a947-5f6d-4279-bb6a-0f4122de575a","Type":"ContainerStarted","Data":"c9f74b8294d0fb131a80144bebc337a990eb15d5b736195cb84c33470dff737b"} Jun 11 23:10:30.019350 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:30.018995 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8lglz" event={"ID":"f5b94329-259b-4886-bd03-2205cf371d90","Type":"ContainerStarted","Data":"e229d460d306263db2e09c4b95ecc80b4d8ef438f24654d84e526a1a72c63718"} Jun 11 23:10:30.022764 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:30.022739 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xzq6f" event={"ID":"0997dc48-5058-46f2-b737-e37f618d472a","Type":"ContainerStarted","Data":"cc3884757c56ce27345f13ac4660d07377e1339a7e3a9ff994c3b3961dfd2f32"} Jun 11 23:10:30.023752 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:30.023730 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" event={"ID":"41fa8546-880a-4598-8a4e-67a217cc8136","Type":"ContainerStarted","Data":"b398600e4e762b7075b95938c1fd6ff45c8809d8fecd5747ab7a07f0de6866cb"} Jun 11 23:10:30.024713 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:30.024689 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gqkl4" event={"ID":"eeef2be9-5af9-4766-af41-7c89fa431f22","Type":"ContainerStarted","Data":"369e2eb8f33bce9111fb20ce2e56c927da2a2f0b318af56a748581987ddb341b"} Jun 11 23:10:30.025655 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:30.025637 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" event={"ID":"243ee797-2187-41bc-ad0c-116ec1a4888f","Type":"ContainerStarted","Data":"166ed9013b09ab17cea1c9f84c4061f6f2661d740a79ed1112617328685dbfd4"} Jun 11 23:10:30.569111 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:30.569024 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8fb03f32-8124-418d-99c4-3c16de6e020d-original-pull-secret\") pod \"global-pull-secret-syncer-n4lnc\" (UID: \"8fb03f32-8124-418d-99c4-3c16de6e020d\") " pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:10:30.569111 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:30.569102 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:10:30.569327 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:30.569146 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e46db09-c19b-4f8b-9eb4-370984f52a4c-metrics-certs\") pod \"network-metrics-daemon-2pfzs\" (UID: \"4e46db09-c19b-4f8b-9eb4-370984f52a4c\") " pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:10:30.569327 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:30.569170 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fb03f32-8124-418d-99c4-3c16de6e020d-original-pull-secret podName:8fb03f32-8124-418d-99c4-3c16de6e020d nodeName:}" failed. No retries permitted until 2026-06-11 23:10:32.569150457 +0000 UTC m=+5.991935413 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8fb03f32-8124-418d-99c4-3c16de6e020d-original-pull-secret") pod "global-pull-secret-syncer-n4lnc" (UID: "8fb03f32-8124-418d-99c4-3c16de6e020d") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:10:30.569327 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:30.569233 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:10:30.569327 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:30.569286 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e46db09-c19b-4f8b-9eb4-370984f52a4c-metrics-certs podName:4e46db09-c19b-4f8b-9eb4-370984f52a4c nodeName:}" failed. No retries permitted until 2026-06-11 23:10:32.569269708 +0000 UTC m=+5.992054656 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e46db09-c19b-4f8b-9eb4-370984f52a4c-metrics-certs") pod "network-metrics-daemon-2pfzs" (UID: "4e46db09-c19b-4f8b-9eb4-370984f52a4c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:10:30.670661 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:30.670556 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4fsd\" (UniqueName: \"kubernetes.io/projected/a3b91f55-09c0-428d-a1d4-301859a89cdb-kube-api-access-l4fsd\") pod \"network-check-target-qrcp9\" (UID: \"a3b91f55-09c0-428d-a1d4-301859a89cdb\") " pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:10:30.670819 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:30.670709 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:10:30.670819 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:30.670730 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:10:30.670819 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:30.670738 2563 projected.go:196] Error preparing data for projected volume kube-api-access-l4fsd for pod openshift-network-diagnostics/network-check-target-qrcp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:10:30.670819 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:30.670780 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3b91f55-09c0-428d-a1d4-301859a89cdb-kube-api-access-l4fsd podName:a3b91f55-09c0-428d-a1d4-301859a89cdb nodeName:}" failed. No retries permitted until 2026-06-11 23:10:32.670767366 +0000 UTC m=+6.093552323 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-l4fsd" (UniqueName: "kubernetes.io/projected/a3b91f55-09c0-428d-a1d4-301859a89cdb-kube-api-access-l4fsd") pod "network-check-target-qrcp9" (UID: "a3b91f55-09c0-428d-a1d4-301859a89cdb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:10:30.996246 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:30.996136 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 23:05:28 +0000 UTC" deadline="2028-02-13 10:28:07.720225829 +0000 UTC" Jun 11 23:10:30.996246 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:30.996200 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14675h17m36.724029654s" Jun 11 23:10:31.002067 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:31.002034 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:10:31.002225 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:31.002198 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4lnc" podUID="8fb03f32-8124-418d-99c4-3c16de6e020d" Jun 11 23:10:31.002641 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:31.002621 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:10:31.002738 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:31.002717 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrcp9" podUID="a3b91f55-09c0-428d-a1d4-301859a89cdb" Jun 11 23:10:31.002814 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:31.002793 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:10:31.002955 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:31.002934 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pfzs" podUID="4e46db09-c19b-4f8b-9eb4-370984f52a4c" Jun 11 23:10:31.042328 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:31.041933 2563 generic.go:356] "Generic (PLEG): container finished" podID="f503121fd80d1d4612f0e076464c96cf" containerID="3f30ca1f4058382d150af0437844c9251b55091816878e06d2e9a35dbe6743af" exitCode=0 Jun 11 23:10:31.042328 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:31.042066 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal" event={"ID":"f503121fd80d1d4612f0e076464c96cf","Type":"ContainerDied","Data":"3f30ca1f4058382d150af0437844c9251b55091816878e06d2e9a35dbe6743af"} Jun 11 23:10:31.053402 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:31.052496 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-215.ec2.internal" event={"ID":"14e8d091aa6dad66da2b682cebda410b","Type":"ContainerStarted","Data":"7f5ff322a19aeada6553a3abe6fd93a2ca4ee73e0b079ca15d15f0c4e098a109"} Jun 11 23:10:32.070134 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:32.070040 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal" event={"ID":"f503121fd80d1d4612f0e076464c96cf","Type":"ContainerStarted","Data":"ff4471f319fca3bed334aaf1bfb7634b5a8a8d09e6fe34eb4c1aabe6d27de8ab"} Jun 11 23:10:32.115065 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:32.115002 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-215.ec2.internal" podStartSLOduration=4.114962611 podStartE2EDuration="4.114962611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:10:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:10:31.108881356 +0000 UTC m=+4.531666325" watchObservedRunningTime="2026-06-11 23:10:32.114962611 +0000 UTC m=+5.537747579" Jun 11 23:10:32.115807 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:32.115767 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal" podStartSLOduration=4.115754737 podStartE2EDuration="4.115754737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:10:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:10:32.113195183 +0000 UTC m=+5.535980197" watchObservedRunningTime="2026-06-11 23:10:32.115754737 +0000 UTC m=+5.538539706" Jun 11 23:10:32.585608 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:32.585572 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e46db09-c19b-4f8b-9eb4-370984f52a4c-metrics-certs\") pod \"network-metrics-daemon-2pfzs\" (UID: \"4e46db09-c19b-4f8b-9eb4-370984f52a4c\") " pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:10:32.585798 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:32.585632 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8fb03f32-8124-418d-99c4-3c16de6e020d-original-pull-secret\") pod \"global-pull-secret-syncer-n4lnc\" (UID: \"8fb03f32-8124-418d-99c4-3c16de6e020d\") " pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:10:32.585798 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:32.585751 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:10:32.585798 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:32.585759 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:10:32.586041 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:32.585819 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fb03f32-8124-418d-99c4-3c16de6e020d-original-pull-secret podName:8fb03f32-8124-418d-99c4-3c16de6e020d nodeName:}" failed. No retries permitted until 2026-06-11 23:10:36.585801056 +0000 UTC m=+10.008586008 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8fb03f32-8124-418d-99c4-3c16de6e020d-original-pull-secret") pod "global-pull-secret-syncer-n4lnc" (UID: "8fb03f32-8124-418d-99c4-3c16de6e020d") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:10:32.586041 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:32.585838 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e46db09-c19b-4f8b-9eb4-370984f52a4c-metrics-certs podName:4e46db09-c19b-4f8b-9eb4-370984f52a4c nodeName:}" failed. No retries permitted until 2026-06-11 23:10:36.585828965 +0000 UTC m=+10.008613911 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e46db09-c19b-4f8b-9eb4-370984f52a4c-metrics-certs") pod "network-metrics-daemon-2pfzs" (UID: "4e46db09-c19b-4f8b-9eb4-370984f52a4c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:10:32.686189 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:32.686152 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4fsd\" (UniqueName: \"kubernetes.io/projected/a3b91f55-09c0-428d-a1d4-301859a89cdb-kube-api-access-l4fsd\") pod \"network-check-target-qrcp9\" (UID: \"a3b91f55-09c0-428d-a1d4-301859a89cdb\") " pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:10:32.686385 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:32.686335 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:10:32.686385 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:32.686353 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:10:32.686385 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:32.686365 2563 projected.go:196] Error preparing data for projected volume kube-api-access-l4fsd for pod openshift-network-diagnostics/network-check-target-qrcp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:10:32.686597 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:32.686419 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3b91f55-09c0-428d-a1d4-301859a89cdb-kube-api-access-l4fsd podName:a3b91f55-09c0-428d-a1d4-301859a89cdb nodeName:}" failed. No retries permitted until 2026-06-11 23:10:36.686402993 +0000 UTC m=+10.109187941 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-l4fsd" (UniqueName: "kubernetes.io/projected/a3b91f55-09c0-428d-a1d4-301859a89cdb-kube-api-access-l4fsd") pod "network-check-target-qrcp9" (UID: "a3b91f55-09c0-428d-a1d4-301859a89cdb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:10:33.000158 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:33.000075 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:10:33.000312 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:33.000208 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrcp9" podUID="a3b91f55-09c0-428d-a1d4-301859a89cdb" Jun 11 23:10:33.000596 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:33.000578 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:10:33.000720 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:33.000685 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pfzs" podUID="4e46db09-c19b-4f8b-9eb4-370984f52a4c" Jun 11 23:10:33.000777 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:33.000738 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:10:33.000825 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:33.000805 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4lnc" podUID="8fb03f32-8124-418d-99c4-3c16de6e020d" Jun 11 23:10:35.000227 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:35.000191 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:10:35.000666 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:35.000345 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pfzs" podUID="4e46db09-c19b-4f8b-9eb4-370984f52a4c" Jun 11 23:10:35.000666 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:35.000373 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:10:35.000666 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:35.000438 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:10:35.000666 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:35.000544 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrcp9" podUID="a3b91f55-09c0-428d-a1d4-301859a89cdb" Jun 11 23:10:35.000666 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:35.000622 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4lnc" podUID="8fb03f32-8124-418d-99c4-3c16de6e020d" Jun 11 23:10:36.618999 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:36.618951 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e46db09-c19b-4f8b-9eb4-370984f52a4c-metrics-certs\") pod \"network-metrics-daemon-2pfzs\" (UID: \"4e46db09-c19b-4f8b-9eb4-370984f52a4c\") " pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:10:36.619500 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:36.619028 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8fb03f32-8124-418d-99c4-3c16de6e020d-original-pull-secret\") pod \"global-pull-secret-syncer-n4lnc\" (UID: \"8fb03f32-8124-418d-99c4-3c16de6e020d\") " pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:10:36.619500 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:36.619151 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:10:36.619500 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:36.619151 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:10:36.619500 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:36.619214 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e46db09-c19b-4f8b-9eb4-370984f52a4c-metrics-certs podName:4e46db09-c19b-4f8b-9eb4-370984f52a4c nodeName:}" failed. No retries permitted until 2026-06-11 23:10:44.619196805 +0000 UTC m=+18.041981769 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e46db09-c19b-4f8b-9eb4-370984f52a4c-metrics-certs") pod "network-metrics-daemon-2pfzs" (UID: "4e46db09-c19b-4f8b-9eb4-370984f52a4c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:10:36.619500 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:36.619233 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fb03f32-8124-418d-99c4-3c16de6e020d-original-pull-secret podName:8fb03f32-8124-418d-99c4-3c16de6e020d nodeName:}" failed. No retries permitted until 2026-06-11 23:10:44.619223531 +0000 UTC m=+18.042008483 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8fb03f32-8124-418d-99c4-3c16de6e020d-original-pull-secret") pod "global-pull-secret-syncer-n4lnc" (UID: "8fb03f32-8124-418d-99c4-3c16de6e020d") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:10:36.720289 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:36.720254 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4fsd\" (UniqueName: \"kubernetes.io/projected/a3b91f55-09c0-428d-a1d4-301859a89cdb-kube-api-access-l4fsd\") pod \"network-check-target-qrcp9\" (UID: \"a3b91f55-09c0-428d-a1d4-301859a89cdb\") " pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:10:36.720477 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:36.720414 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:10:36.720477 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:36.720433 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:10:36.720477 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:36.720445 2563 projected.go:196] Error preparing data for projected volume kube-api-access-l4fsd for pod openshift-network-diagnostics/network-check-target-qrcp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:10:36.720634 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:36.720506 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3b91f55-09c0-428d-a1d4-301859a89cdb-kube-api-access-l4fsd podName:a3b91f55-09c0-428d-a1d4-301859a89cdb nodeName:}" failed. No retries permitted until 2026-06-11 23:10:44.720488073 +0000 UTC m=+18.143273022 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-l4fsd" (UniqueName: "kubernetes.io/projected/a3b91f55-09c0-428d-a1d4-301859a89cdb-kube-api-access-l4fsd") pod "network-check-target-qrcp9" (UID: "a3b91f55-09c0-428d-a1d4-301859a89cdb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:10:37.002050 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:37.000701 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:10:37.002050 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:37.000816 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4lnc" podUID="8fb03f32-8124-418d-99c4-3c16de6e020d" Jun 11 23:10:37.002050 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:37.001306 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:10:37.002050 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:37.001397 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrcp9" podUID="a3b91f55-09c0-428d-a1d4-301859a89cdb" Jun 11 23:10:37.002050 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:37.001632 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:10:37.002050 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:37.001729 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pfzs" podUID="4e46db09-c19b-4f8b-9eb4-370984f52a4c" Jun 11 23:10:39.000006 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:38.999887 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:10:39.000006 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:38.999910 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:10:39.000594 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:39.000038 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrcp9" podUID="a3b91f55-09c0-428d-a1d4-301859a89cdb" Jun 11 23:10:39.000594 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:39.000068 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:10:39.000594 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:39.000167 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4lnc" podUID="8fb03f32-8124-418d-99c4-3c16de6e020d" Jun 11 23:10:39.000594 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:39.000254 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pfzs" podUID="4e46db09-c19b-4f8b-9eb4-370984f52a4c" Jun 11 23:10:40.999339 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:40.999279 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:10:40.999339 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:40.999321 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:10:40.999836 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:40.999279 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:10:40.999836 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:40.999422 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pfzs" podUID="4e46db09-c19b-4f8b-9eb4-370984f52a4c" Jun 11 23:10:40.999836 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:40.999511 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4lnc" podUID="8fb03f32-8124-418d-99c4-3c16de6e020d" Jun 11 23:10:40.999836 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:40.999575 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrcp9" podUID="a3b91f55-09c0-428d-a1d4-301859a89cdb" Jun 11 23:10:42.999195 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:42.999162 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:10:42.999704 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:42.999162 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:10:42.999704 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:42.999296 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4lnc" podUID="8fb03f32-8124-418d-99c4-3c16de6e020d" Jun 11 23:10:42.999704 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:42.999172 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:10:42.999704 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:42.999372 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pfzs" podUID="4e46db09-c19b-4f8b-9eb4-370984f52a4c" Jun 11 23:10:42.999704 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:42.999425 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrcp9" podUID="a3b91f55-09c0-428d-a1d4-301859a89cdb" Jun 11 23:10:44.681835 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:44.681730 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8fb03f32-8124-418d-99c4-3c16de6e020d-original-pull-secret\") pod \"global-pull-secret-syncer-n4lnc\" (UID: \"8fb03f32-8124-418d-99c4-3c16de6e020d\") " pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:10:44.681835 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:44.681835 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e46db09-c19b-4f8b-9eb4-370984f52a4c-metrics-certs\") pod \"network-metrics-daemon-2pfzs\" (UID: \"4e46db09-c19b-4f8b-9eb4-370984f52a4c\") " pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:10:44.682332 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:44.681925 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:10:44.682332 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:44.681942 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:10:44.682332 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:44.682013 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e46db09-c19b-4f8b-9eb4-370984f52a4c-metrics-certs podName:4e46db09-c19b-4f8b-9eb4-370984f52a4c nodeName:}" failed. No retries permitted until 2026-06-11 23:11:00.681995713 +0000 UTC m=+34.104780664 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e46db09-c19b-4f8b-9eb4-370984f52a4c-metrics-certs") pod "network-metrics-daemon-2pfzs" (UID: "4e46db09-c19b-4f8b-9eb4-370984f52a4c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:10:44.682332 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:44.682031 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fb03f32-8124-418d-99c4-3c16de6e020d-original-pull-secret podName:8fb03f32-8124-418d-99c4-3c16de6e020d nodeName:}" failed. No retries permitted until 2026-06-11 23:11:00.682022168 +0000 UTC m=+34.104807112 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8fb03f32-8124-418d-99c4-3c16de6e020d-original-pull-secret") pod "global-pull-secret-syncer-n4lnc" (UID: "8fb03f32-8124-418d-99c4-3c16de6e020d") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:10:44.783059 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:44.783019 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4fsd\" (UniqueName: \"kubernetes.io/projected/a3b91f55-09c0-428d-a1d4-301859a89cdb-kube-api-access-l4fsd\") pod \"network-check-target-qrcp9\" (UID: \"a3b91f55-09c0-428d-a1d4-301859a89cdb\") " pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:10:44.783231 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:44.783158 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:10:44.783231 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:44.783188 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:10:44.783231 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:44.783202 2563 projected.go:196] Error preparing data for projected volume kube-api-access-l4fsd for pod openshift-network-diagnostics/network-check-target-qrcp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:10:44.783380 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:44.783273 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3b91f55-09c0-428d-a1d4-301859a89cdb-kube-api-access-l4fsd podName:a3b91f55-09c0-428d-a1d4-301859a89cdb nodeName:}" failed. No retries permitted until 2026-06-11 23:11:00.78325712 +0000 UTC m=+34.206042066 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-l4fsd" (UniqueName: "kubernetes.io/projected/a3b91f55-09c0-428d-a1d4-301859a89cdb-kube-api-access-l4fsd") pod "network-check-target-qrcp9" (UID: "a3b91f55-09c0-428d-a1d4-301859a89cdb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:10:45.000175 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:45.000090 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:10:45.000336 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:45.000090 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:10:45.000336 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:45.000229 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4lnc" podUID="8fb03f32-8124-418d-99c4-3c16de6e020d" Jun 11 23:10:45.000336 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:45.000090 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:10:45.000336 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:45.000302 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pfzs" podUID="4e46db09-c19b-4f8b-9eb4-370984f52a4c" Jun 11 23:10:45.000537 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:45.000401 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrcp9" podUID="a3b91f55-09c0-428d-a1d4-301859a89cdb" Jun 11 23:10:46.999907 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:46.999872 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:10:47.000358 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:46.999998 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:10:47.000358 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:47.000001 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrcp9" podUID="a3b91f55-09c0-428d-a1d4-301859a89cdb" Jun 11 23:10:47.000358 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:47.000101 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:10:47.000358 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:47.000224 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pfzs" podUID="4e46db09-c19b-4f8b-9eb4-370984f52a4c" Jun 11 23:10:47.000358 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:47.000320 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4lnc" podUID="8fb03f32-8124-418d-99c4-3c16de6e020d" Jun 11 23:10:49.000187 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:49.000097 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:10:49.000187 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:49.000122 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:10:49.000724 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:49.000097 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:10:49.000724 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:49.000250 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pfzs" podUID="4e46db09-c19b-4f8b-9eb4-370984f52a4c" Jun 11 23:10:49.000724 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:49.000375 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4lnc" podUID="8fb03f32-8124-418d-99c4-3c16de6e020d" Jun 11 23:10:49.000724 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:49.000432 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrcp9" podUID="a3b91f55-09c0-428d-a1d4-301859a89cdb" Jun 11 23:10:49.106772 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:49.106745 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sbfz" event={"ID":"271b39b1-c4a4-4b5b-a9d8-6482eae6fb06","Type":"ContainerStarted","Data":"1577aad7f33832486800b887a9c998a7637990ee45634c944479bf63aadcfad6"} Jun 11 23:10:49.108096 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:49.108067 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vkn8f" event={"ID":"ea89baa6-2814-4cf0-8171-73946de5e446","Type":"ContainerStarted","Data":"0a07e67ba6b60ee429058bc3b421ad461bd19cee9a2aadbc61e2497e40c59ada"} Jun 11 23:10:49.109620 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:49.109595 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hrhdl" event={"ID":"51a4a947-5f6d-4279-bb6a-0f4122de575a","Type":"ContainerStarted","Data":"bc85c55a0190c1491fbdcd7ea1d3039226b1c2a08c0ce49b0505fe7973af723f"} Jun 11 23:10:49.111007 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:49.110963 2563 generic.go:356] "Generic (PLEG): container finished" podID="f5b94329-259b-4886-bd03-2205cf371d90" containerID="fd31c32750791e7967adc0426dbfcc501620c65696ab0118faa3d8e529430fd8" exitCode=0 Jun 11 23:10:49.111110 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:49.111004 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8lglz" event={"ID":"f5b94329-259b-4886-bd03-2205cf371d90","Type":"ContainerDied","Data":"fd31c32750791e7967adc0426dbfcc501620c65696ab0118faa3d8e529430fd8"} Jun 11 23:10:49.112583 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:49.112556 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xzq6f" event={"ID":"0997dc48-5058-46f2-b737-e37f618d472a","Type":"ContainerStarted","Data":"bc33f125799421a12922ed3dfda6f092fcf1bcc77ed3fd6ffafb20c9ac5f2482"} Jun 11 23:10:49.114188 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:49.114154 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" event={"ID":"41fa8546-880a-4598-8a4e-67a217cc8136","Type":"ContainerStarted","Data":"052e5ddf8ba45f7634a83ad22a5e69b7597b13e7e93e67a14e9980ba302f704d"} Jun 11 23:10:49.115542 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:49.115523 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gqkl4" event={"ID":"eeef2be9-5af9-4766-af41-7c89fa431f22","Type":"ContainerStarted","Data":"fb995ec0d3900248fbe828accbabbfb4ca894f2a3ca786e139501425a9c4105a"} Jun 11 23:10:49.117157 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:49.117140 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lrmgd_243ee797-2187-41bc-ad0c-116ec1a4888f/ovn-acl-logging/0.log" Jun 11 23:10:49.117487 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:49.117461 2563 generic.go:356] "Generic (PLEG): container finished" podID="243ee797-2187-41bc-ad0c-116ec1a4888f" containerID="1aca9f33ce1e5255f778529d0071b6296f9a80b2ae7bd7a20db66b59abff190f" exitCode=1 Jun 11 23:10:49.117546 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:49.117490 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" event={"ID":"243ee797-2187-41bc-ad0c-116ec1a4888f","Type":"ContainerDied","Data":"1aca9f33ce1e5255f778529d0071b6296f9a80b2ae7bd7a20db66b59abff190f"} Jun 11 23:10:49.117546 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:49.117533 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" event={"ID":"243ee797-2187-41bc-ad0c-116ec1a4888f","Type":"ContainerStarted","Data":"c3778f82d2cf0b6009c339176f08043ea4d7d7782469165ecc3203d33201f537"} Jun 11 23:10:49.129730 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:49.129689 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vkn8f" podStartSLOduration=3.440899955 podStartE2EDuration="22.129677216s" totalImagesPullingTime="18.688777261s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:10:49.129029518 +0000 UTC m=+22.551814488" watchObservedRunningTime="2026-06-11 23:10:49.129677216 +0000 UTC m=+22.552462183" Jun 11 23:10:49.144958 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:49.144919 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gqkl4" podStartSLOduration=7.767278115 podStartE2EDuration="22.144908565s" totalImagesPullingTime="14.37763045s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:10:49.144577047 +0000 UTC m=+22.567362016" watchObservedRunningTime="2026-06-11 23:10:49.144908565 +0000 UTC m=+22.567693551" Jun 11 23:10:49.163462 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:49.163395 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hrhdl" podStartSLOduration=3.419978945 podStartE2EDuration="22.163375631s" totalImagesPullingTime="18.743396686s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:10:49.162334814 +0000 UTC m=+22.585119825" watchObservedRunningTime="2026-06-11 23:10:49.163375631 +0000 UTC m=+22.586160599" Jun 11 23:10:49.178421 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:49.178380 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2zjf4" podStartSLOduration=3.48770467 podStartE2EDuration="22.178368244s" totalImagesPullingTime="18.690663574s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:10:49.178013919 +0000 UTC m=+22.600798883" watchObservedRunningTime="2026-06-11 23:10:49.178368244 +0000 UTC m=+22.601153210" Jun 11 23:10:49.193597 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:49.193559 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xzq6f" podStartSLOduration=3.5060482779999997 podStartE2EDuration="22.193546401s" totalImagesPullingTime="18.687498123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:10:49.193304307 +0000 UTC m=+22.616089274" watchObservedRunningTime="2026-06-11 23:10:49.193546401 +0000 UTC m=+22.616331368" Jun 11 23:10:50.124855 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:50.124628 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lrmgd_243ee797-2187-41bc-ad0c-116ec1a4888f/ovn-acl-logging/0.log" Jun 11 23:10:50.125641 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:50.125610 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" event={"ID":"243ee797-2187-41bc-ad0c-116ec1a4888f","Type":"ContainerStarted","Data":"83e3870ef45daaf870f3e1c32f494f522e7bbd180d430c1e961128f43640b47b"} Jun 11 23:10:50.125775 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:50.125723 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" event={"ID":"243ee797-2187-41bc-ad0c-116ec1a4888f","Type":"ContainerStarted","Data":"0dd283e1423bac7f4ddb7841619ab6196805a435bd1f1811d91dce0513c3ff5f"} Jun 11 23:10:50.125775 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:50.125756 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" event={"ID":"243ee797-2187-41bc-ad0c-116ec1a4888f","Type":"ContainerStarted","Data":"223eaf4f1f547e7ca493f75b1909f851e4a0f750cfe3413a77ad96b48f3003ad"} Jun 11 23:10:50.125882 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:50.125787 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" event={"ID":"243ee797-2187-41bc-ad0c-116ec1a4888f","Type":"ContainerStarted","Data":"e6152c0714ebb18cebb6b6e16e6bdafba38861638f4eb7817a39fa7507276676"} Jun 11 23:10:50.145707 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:50.145678 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xzq6f" Jun 11 23:10:50.146277 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:50.146257 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xzq6f" Jun 11 23:10:50.228296 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:50.228275 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 23:10:50.999111 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:50.999081 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:10:50.999306 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:50.999079 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:10:50.999306 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:50.999217 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrcp9" podUID="a3b91f55-09c0-428d-a1d4-301859a89cdb" Jun 11 23:10:50.999426 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:50.999087 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:10:50.999426 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:50.999336 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pfzs" podUID="4e46db09-c19b-4f8b-9eb4-370984f52a4c" Jun 11 23:10:50.999522 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:50.999451 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4lnc" podUID="8fb03f32-8124-418d-99c4-3c16de6e020d" Jun 11 23:10:51.003115 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:51.001673 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T23:10:50.228290134Z","UUID":"7b5df92b-0fa6-46ca-9713-5199be1a9945","Handler":null,"Name":"","Endpoint":""} Jun 11 23:10:51.004089 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:51.004068 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 23:10:51.004194 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:51.004111 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 23:10:51.129497 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:51.129462 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sbfz" event={"ID":"271b39b1-c4a4-4b5b-a9d8-6482eae6fb06","Type":"ContainerStarted","Data":"83b190298f5b200555f48c60be56c108ced90fec982ef336b77a7b4a97382121"} Jun 11 23:10:51.130737 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:51.130715 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z4mfm" event={"ID":"3e60827b-9162-445d-a1f3-c9b8203587b8","Type":"ContainerStarted","Data":"2e8bf81796ff35d3df8aad6cc3eb80f6093bfb846c7fb0942dc7cb0099d0eb0d"} Jun 11 23:10:51.131104 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:51.131088 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xzq6f" Jun 11 23:10:51.131452 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:51.131438 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xzq6f" Jun 11 23:10:51.147828 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:51.147786 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z4mfm" podStartSLOduration=5.456289022 podStartE2EDuration="24.147773729s" totalImagesPullingTime="18.691484707s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:10:51.147351883 +0000 UTC m=+24.570136847" watchObservedRunningTime="2026-06-11 23:10:51.147773729 +0000 UTC m=+24.570558703" Jun 11 23:10:52.134728 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:52.134695 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sbfz" event={"ID":"271b39b1-c4a4-4b5b-a9d8-6482eae6fb06","Type":"ContainerStarted","Data":"3f6034cc6514a8a1d378bd8dd06bf5b5f954279eb4e9c03ee64d422a50d0750a"} Jun 11 23:10:52.137757 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:52.137607 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lrmgd_243ee797-2187-41bc-ad0c-116ec1a4888f/ovn-acl-logging/0.log" Jun 11 23:10:52.138138 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:52.138112 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" event={"ID":"243ee797-2187-41bc-ad0c-116ec1a4888f","Type":"ContainerStarted","Data":"860a18c72db0e5ee9e53cbf0ceb15b178518edfa77b139d43884fb69d7b63c8d"} Jun 11 23:10:52.156763 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:52.156719 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sbfz" podStartSLOduration=4.162786785 podStartE2EDuration="25.156706226s" totalImagesPullingTime="20.993919441s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:10:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:10:52.156215086 +0000 UTC m=+25.579000054" watchObservedRunningTime="2026-06-11 23:10:52.156706226 +0000 UTC m=+25.579491193" Jun 11 23:10:53.002809 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:53.002779 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:10:53.003003 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:53.002879 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:10:53.003003 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:53.002894 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4lnc" podUID="8fb03f32-8124-418d-99c4-3c16de6e020d" Jun 11 23:10:53.003003 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:53.002907 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:10:53.003003 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:53.002946 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrcp9" podUID="a3b91f55-09c0-428d-a1d4-301859a89cdb" Jun 11 23:10:53.003132 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:53.003026 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pfzs" podUID="4e46db09-c19b-4f8b-9eb4-370984f52a4c" Jun 11 23:10:54.146838 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:54.146809 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lrmgd_243ee797-2187-41bc-ad0c-116ec1a4888f/ovn-acl-logging/0.log" Jun 11 23:10:54.147636 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:54.147237 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" event={"ID":"243ee797-2187-41bc-ad0c-116ec1a4888f","Type":"ContainerStarted","Data":"7e00399c2c27e5de25c0e43b60a0104d543cd2ca15bee16f38627ac9046e81e1"} Jun 11 23:10:54.147636 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:54.147508 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:54.147765 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:54.147745 2563 scope.go:117] "RemoveContainer" containerID="1aca9f33ce1e5255f778529d0071b6296f9a80b2ae7bd7a20db66b59abff190f" Jun 11 23:10:54.164716 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:54.164687 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:55.001943 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:55.001765 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:10:55.002154 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:55.001825 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:10:55.002154 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:55.002038 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrcp9" podUID="a3b91f55-09c0-428d-a1d4-301859a89cdb" Jun 11 23:10:55.002154 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:55.001825 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:10:55.002154 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:55.002077 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4lnc" podUID="8fb03f32-8124-418d-99c4-3c16de6e020d" Jun 11 23:10:55.002154 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:55.002140 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pfzs" podUID="4e46db09-c19b-4f8b-9eb4-370984f52a4c" Jun 11 23:10:55.154463 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:55.154436 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lrmgd_243ee797-2187-41bc-ad0c-116ec1a4888f/ovn-acl-logging/0.log" Jun 11 23:10:55.154897 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:55.154875 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" event={"ID":"243ee797-2187-41bc-ad0c-116ec1a4888f","Type":"ContainerStarted","Data":"4f84269f760959b9bf92cdfd921e207a4db36286573cd09ab1786b85ec10ecf6"} Jun 11 23:10:55.155258 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:55.155233 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:55.155386 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:55.155307 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:55.170819 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:55.170797 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:10:55.188300 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:55.188256 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" podStartSLOduration=9.450407367 podStartE2EDuration="28.188241636s" totalImagesPullingTime="18.737834269s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:10:55.187556083 +0000 UTC m=+28.610341050" watchObservedRunningTime="2026-06-11 23:10:55.188241636 +0000 UTC m=+28.611026602" Jun 11 23:10:57.002529 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:57.002506 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:10:57.002529 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:57.002520 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:10:57.002967 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:57.002512 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:10:57.002967 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:57.002617 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4lnc" podUID="8fb03f32-8124-418d-99c4-3c16de6e020d" Jun 11 23:10:57.002967 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:57.002706 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pfzs" podUID="4e46db09-c19b-4f8b-9eb4-370984f52a4c" Jun 11 23:10:57.002967 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:57.002786 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrcp9" podUID="a3b91f55-09c0-428d-a1d4-301859a89cdb" Jun 11 23:10:57.162810 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:57.162779 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8lglz" event={"ID":"f5b94329-259b-4886-bd03-2205cf371d90","Type":"ContainerStarted","Data":"1136909b27c82a3a8a0a6e20eae7cd06ec0b0b327e4773599f7adce170a33703"} Jun 11 23:10:58.165879 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:58.165845 2563 generic.go:356] "Generic (PLEG): container finished" podID="f5b94329-259b-4886-bd03-2205cf371d90" containerID="1136909b27c82a3a8a0a6e20eae7cd06ec0b0b327e4773599f7adce170a33703" exitCode=0 Jun 11 23:10:58.166322 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:58.165901 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8lglz" event={"ID":"f5b94329-259b-4886-bd03-2205cf371d90","Type":"ContainerDied","Data":"1136909b27c82a3a8a0a6e20eae7cd06ec0b0b327e4773599f7adce170a33703"} Jun 11 23:10:58.999760 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:58.999725 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:10:58.999939 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:58.999733 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:10:58.999939 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:58.999852 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pfzs" podUID="4e46db09-c19b-4f8b-9eb4-370984f52a4c" Jun 11 23:10:58.999939 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:10:58.999736 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:10:58.999939 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:58.999912 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4lnc" podUID="8fb03f32-8124-418d-99c4-3c16de6e020d" Jun 11 23:10:59.000108 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:10:58.999965 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrcp9" podUID="a3b91f55-09c0-428d-a1d4-301859a89cdb" Jun 11 23:11:00.171656 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:00.171619 2563 generic.go:356] "Generic (PLEG): container finished" podID="f5b94329-259b-4886-bd03-2205cf371d90" containerID="82ec7b78c71cca2f31e6d88fff41afeff44a0bab70740cb1ef6311f6d034bf53" exitCode=0 Jun 11 23:11:00.172070 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:00.171675 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8lglz" event={"ID":"f5b94329-259b-4886-bd03-2205cf371d90","Type":"ContainerDied","Data":"82ec7b78c71cca2f31e6d88fff41afeff44a0bab70740cb1ef6311f6d034bf53"} Jun 11 23:11:00.699749 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:00.699708 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e46db09-c19b-4f8b-9eb4-370984f52a4c-metrics-certs\") pod \"network-metrics-daemon-2pfzs\" (UID: \"4e46db09-c19b-4f8b-9eb4-370984f52a4c\") " pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:11:00.699915 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:00.699773 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8fb03f32-8124-418d-99c4-3c16de6e020d-original-pull-secret\") pod \"global-pull-secret-syncer-n4lnc\" (UID: \"8fb03f32-8124-418d-99c4-3c16de6e020d\") " pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:11:00.699915 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:11:00.699873 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:11:00.699915 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:11:00.699878 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:11:00.700076 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:11:00.699930 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fb03f32-8124-418d-99c4-3c16de6e020d-original-pull-secret podName:8fb03f32-8124-418d-99c4-3c16de6e020d nodeName:}" failed. No retries permitted until 2026-06-11 23:11:32.699912593 +0000 UTC m=+66.122697552 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8fb03f32-8124-418d-99c4-3c16de6e020d-original-pull-secret") pod "global-pull-secret-syncer-n4lnc" (UID: "8fb03f32-8124-418d-99c4-3c16de6e020d") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:11:00.700076 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:11:00.699949 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e46db09-c19b-4f8b-9eb4-370984f52a4c-metrics-certs podName:4e46db09-c19b-4f8b-9eb4-370984f52a4c nodeName:}" failed. No retries permitted until 2026-06-11 23:11:32.699942427 +0000 UTC m=+66.122727371 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e46db09-c19b-4f8b-9eb4-370984f52a4c-metrics-certs") pod "network-metrics-daemon-2pfzs" (UID: "4e46db09-c19b-4f8b-9eb4-370984f52a4c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:11:00.800176 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:00.800135 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4fsd\" (UniqueName: \"kubernetes.io/projected/a3b91f55-09c0-428d-a1d4-301859a89cdb-kube-api-access-l4fsd\") pod \"network-check-target-qrcp9\" (UID: \"a3b91f55-09c0-428d-a1d4-301859a89cdb\") " pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:11:00.800345 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:11:00.800313 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:11:00.800345 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:11:00.800333 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:11:00.800345 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:11:00.800342 2563 projected.go:196] Error preparing data for projected volume kube-api-access-l4fsd for pod openshift-network-diagnostics/network-check-target-qrcp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:11:00.800461 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:11:00.800394 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3b91f55-09c0-428d-a1d4-301859a89cdb-kube-api-access-l4fsd podName:a3b91f55-09c0-428d-a1d4-301859a89cdb nodeName:}" failed. No retries permitted until 2026-06-11 23:11:32.800381215 +0000 UTC m=+66.223166188 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-l4fsd" (UniqueName: "kubernetes.io/projected/a3b91f55-09c0-428d-a1d4-301859a89cdb-kube-api-access-l4fsd") pod "network-check-target-qrcp9" (UID: "a3b91f55-09c0-428d-a1d4-301859a89cdb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:11:00.999842 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:00.999809 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:11:01.000003 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:00.999810 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:11:01.000003 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:00.999933 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:11:01.000003 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:11:00.999933 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pfzs" podUID="4e46db09-c19b-4f8b-9eb4-370984f52a4c" Jun 11 23:11:01.000167 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:11:01.000026 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrcp9" podUID="a3b91f55-09c0-428d-a1d4-301859a89cdb" Jun 11 23:11:01.000167 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:11:01.000093 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4lnc" podUID="8fb03f32-8124-418d-99c4-3c16de6e020d" Jun 11 23:11:01.176572 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:01.176540 2563 generic.go:356] "Generic (PLEG): container finished" podID="f5b94329-259b-4886-bd03-2205cf371d90" containerID="33beda006f4a78d41b7432f7bf7c23ac9c2737db70dfe0fb6e1423b1d098a321" exitCode=0 Jun 11 23:11:01.176958 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:01.176596 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8lglz" event={"ID":"f5b94329-259b-4886-bd03-2205cf371d90","Type":"ContainerDied","Data":"33beda006f4a78d41b7432f7bf7c23ac9c2737db70dfe0fb6e1423b1d098a321"} Jun 11 23:11:03.000128 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:03.000097 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:11:03.000599 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:03.000097 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:11:03.000599 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:11:03.000233 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4lnc" podUID="8fb03f32-8124-418d-99c4-3c16de6e020d" Jun 11 23:11:03.000599 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:03.000097 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:11:03.000599 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:11:03.000302 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrcp9" podUID="a3b91f55-09c0-428d-a1d4-301859a89cdb" Jun 11 23:11:03.000599 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:11:03.000431 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pfzs" podUID="4e46db09-c19b-4f8b-9eb4-370984f52a4c" Jun 11 23:11:03.096898 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:03.096849 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2pfzs"] Jun 11 23:11:03.100596 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:03.100570 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qrcp9"] Jun 11 23:11:03.115320 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:03.115293 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n4lnc"] Jun 11 23:11:03.180532 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:03.180448 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:11:03.180532 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:03.180465 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:11:03.180737 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:03.180448 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:11:03.180737 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:11:03.180574 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4lnc" podUID="8fb03f32-8124-418d-99c4-3c16de6e020d" Jun 11 23:11:03.180737 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:11:03.180643 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pfzs" podUID="4e46db09-c19b-4f8b-9eb4-370984f52a4c" Jun 11 23:11:03.180737 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:11:03.180695 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrcp9" podUID="a3b91f55-09c0-428d-a1d4-301859a89cdb" Jun 11 23:11:04.999754 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:04.999671 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:11:05.000437 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:11:04.999822 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pfzs" podUID="4e46db09-c19b-4f8b-9eb4-370984f52a4c" Jun 11 23:11:05.000437 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:04.999871 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:11:05.000437 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:11:04.999970 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrcp9" podUID="a3b91f55-09c0-428d-a1d4-301859a89cdb" Jun 11 23:11:05.000437 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:05.000021 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:11:05.000437 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:11:05.000089 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4lnc" podUID="8fb03f32-8124-418d-99c4-3c16de6e020d" Jun 11 23:11:06.190321 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.190288 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8lglz" event={"ID":"f5b94329-259b-4886-bd03-2205cf371d90","Type":"ContainerStarted","Data":"e754ae3bdbde43166d589f8cc66386e1e0e2009588a65a60f6b56a6ddcba61a4"} Jun 11 23:11:06.367815 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.367786 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeReady" Jun 11 23:11:06.367951 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.367912 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 23:11:06.450108 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.450080 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qk2pw"] Jun 11 23:11:06.453621 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.453601 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qk2pw" Jun 11 23:11:06.454959 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.454936 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dh48l"] Jun 11 23:11:06.456838 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.456815 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tjk8r\"" Jun 11 23:11:06.456939 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.456918 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 23:11:06.457165 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.457151 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 23:11:06.458961 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.458944 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dh48l" Jun 11 23:11:06.461697 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.461678 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 23:11:06.462126 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.462102 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zbcp8\"" Jun 11 23:11:06.464916 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.462552 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 23:11:06.465391 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.465373 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 23:11:06.468964 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.468942 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qk2pw"] Jun 11 23:11:06.475771 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.475751 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dh48l"] Jun 11 23:11:06.549800 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.549697 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e01b3859-b744-476e-80ff-bfa6a00ada95-metrics-tls\") pod \"dns-default-qk2pw\" (UID: \"e01b3859-b744-476e-80ff-bfa6a00ada95\") " pod="openshift-dns/dns-default-qk2pw" Jun 11 23:11:06.549800 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.549768 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7zdq\" (UniqueName: \"kubernetes.io/projected/080f3422-c177-4ce2-9ef2-78f801a2db6b-kube-api-access-m7zdq\") pod \"ingress-canary-dh48l\" (UID: \"080f3422-c177-4ce2-9ef2-78f801a2db6b\") " pod="openshift-ingress-canary/ingress-canary-dh48l" Jun 11 23:11:06.550041 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.549804 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e01b3859-b744-476e-80ff-bfa6a00ada95-tmp-dir\") pod \"dns-default-qk2pw\" (UID: \"e01b3859-b744-476e-80ff-bfa6a00ada95\") " pod="openshift-dns/dns-default-qk2pw" Jun 11 23:11:06.550041 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.549833 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl7pq\" (UniqueName: \"kubernetes.io/projected/e01b3859-b744-476e-80ff-bfa6a00ada95-kube-api-access-zl7pq\") pod \"dns-default-qk2pw\" (UID: \"e01b3859-b744-476e-80ff-bfa6a00ada95\") " pod="openshift-dns/dns-default-qk2pw" Jun 11 23:11:06.550041 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.549953 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e01b3859-b744-476e-80ff-bfa6a00ada95-config-volume\") pod \"dns-default-qk2pw\" (UID: \"e01b3859-b744-476e-80ff-bfa6a00ada95\") " pod="openshift-dns/dns-default-qk2pw" Jun 11 23:11:06.550041 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.550011 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/080f3422-c177-4ce2-9ef2-78f801a2db6b-cert\") pod \"ingress-canary-dh48l\" (UID: \"080f3422-c177-4ce2-9ef2-78f801a2db6b\") " pod="openshift-ingress-canary/ingress-canary-dh48l" Jun 11 23:11:06.550950 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.550926 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6b7r7"] Jun 11 23:11:06.554387 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.554373 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6b7r7" Jun 11 23:11:06.558919 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.558887 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 23:11:06.559049 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.558899 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 23:11:06.559049 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.558960 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ljmsx\"" Jun 11 23:11:06.559049 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.559015 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 23:11:06.559235 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.559221 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 23:11:06.571730 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.571706 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6b7r7"] Jun 11 23:11:06.651015 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.650959 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e01b3859-b744-476e-80ff-bfa6a00ada95-config-volume\") pod \"dns-default-qk2pw\" (UID: \"e01b3859-b744-476e-80ff-bfa6a00ada95\") " pod="openshift-dns/dns-default-qk2pw" Jun 11 23:11:06.651161 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.651021 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/080f3422-c177-4ce2-9ef2-78f801a2db6b-cert\") pod \"ingress-canary-dh48l\" (UID: \"080f3422-c177-4ce2-9ef2-78f801a2db6b\") " pod="openshift-ingress-canary/ingress-canary-dh48l" Jun 11 23:11:06.651161 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.651124 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe1d7acb-364e-4486-b170-da37b2e68eca-data-volume\") pod \"insights-runtime-extractor-6b7r7\" (UID: \"fe1d7acb-364e-4486-b170-da37b2e68eca\") " pod="openshift-insights/insights-runtime-extractor-6b7r7" Jun 11 23:11:06.651161 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.651155 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e01b3859-b744-476e-80ff-bfa6a00ada95-metrics-tls\") pod \"dns-default-qk2pw\" (UID: \"e01b3859-b744-476e-80ff-bfa6a00ada95\") " pod="openshift-dns/dns-default-qk2pw" Jun 11 23:11:06.651317 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.651180 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fe1d7acb-364e-4486-b170-da37b2e68eca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6b7r7\" (UID: \"fe1d7acb-364e-4486-b170-da37b2e68eca\") " pod="openshift-insights/insights-runtime-extractor-6b7r7" Jun 11 23:11:06.651317 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.651302 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qng7b\" (UniqueName: \"kubernetes.io/projected/fe1d7acb-364e-4486-b170-da37b2e68eca-kube-api-access-qng7b\") pod \"insights-runtime-extractor-6b7r7\" (UID: \"fe1d7acb-364e-4486-b170-da37b2e68eca\") " pod="openshift-insights/insights-runtime-extractor-6b7r7" Jun 11 23:11:06.651427 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.651367 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fe1d7acb-364e-4486-b170-da37b2e68eca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6b7r7\" (UID: \"fe1d7acb-364e-4486-b170-da37b2e68eca\") " pod="openshift-insights/insights-runtime-extractor-6b7r7" Jun 11 23:11:06.651427 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.651401 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7zdq\" (UniqueName: \"kubernetes.io/projected/080f3422-c177-4ce2-9ef2-78f801a2db6b-kube-api-access-m7zdq\") pod \"ingress-canary-dh48l\" (UID: \"080f3422-c177-4ce2-9ef2-78f801a2db6b\") " pod="openshift-ingress-canary/ingress-canary-dh48l" Jun 11 23:11:06.651520 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.651439 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e01b3859-b744-476e-80ff-bfa6a00ada95-tmp-dir\") pod \"dns-default-qk2pw\" (UID: \"e01b3859-b744-476e-80ff-bfa6a00ada95\") " pod="openshift-dns/dns-default-qk2pw" Jun 11 23:11:06.651520 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.651466 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fe1d7acb-364e-4486-b170-da37b2e68eca-crio-socket\") pod \"insights-runtime-extractor-6b7r7\" (UID: \"fe1d7acb-364e-4486-b170-da37b2e68eca\") " pod="openshift-insights/insights-runtime-extractor-6b7r7" Jun 11 23:11:06.651520 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.651497 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl7pq\" (UniqueName: \"kubernetes.io/projected/e01b3859-b744-476e-80ff-bfa6a00ada95-kube-api-access-zl7pq\") pod \"dns-default-qk2pw\" (UID: \"e01b3859-b744-476e-80ff-bfa6a00ada95\") " pod="openshift-dns/dns-default-qk2pw" Jun 11 23:11:06.651658 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.651615 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e01b3859-b744-476e-80ff-bfa6a00ada95-config-volume\") pod \"dns-default-qk2pw\" (UID: \"e01b3859-b744-476e-80ff-bfa6a00ada95\") " pod="openshift-dns/dns-default-qk2pw" Jun 11 23:11:06.651749 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.651732 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e01b3859-b744-476e-80ff-bfa6a00ada95-tmp-dir\") pod \"dns-default-qk2pw\" (UID: \"e01b3859-b744-476e-80ff-bfa6a00ada95\") " pod="openshift-dns/dns-default-qk2pw" Jun 11 23:11:06.655011 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.654970 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e01b3859-b744-476e-80ff-bfa6a00ada95-metrics-tls\") pod \"dns-default-qk2pw\" (UID: \"e01b3859-b744-476e-80ff-bfa6a00ada95\") " pod="openshift-dns/dns-default-qk2pw" Jun 11 23:11:06.655106 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.655062 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/080f3422-c177-4ce2-9ef2-78f801a2db6b-cert\") pod \"ingress-canary-dh48l\" (UID: \"080f3422-c177-4ce2-9ef2-78f801a2db6b\") " pod="openshift-ingress-canary/ingress-canary-dh48l" Jun 11 23:11:06.664879 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.664859 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl7pq\" (UniqueName: \"kubernetes.io/projected/e01b3859-b744-476e-80ff-bfa6a00ada95-kube-api-access-zl7pq\") pod \"dns-default-qk2pw\" (UID: \"e01b3859-b744-476e-80ff-bfa6a00ada95\") " pod="openshift-dns/dns-default-qk2pw" Jun 11 23:11:06.665486 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.665465 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7zdq\" (UniqueName: \"kubernetes.io/projected/080f3422-c177-4ce2-9ef2-78f801a2db6b-kube-api-access-m7zdq\") pod \"ingress-canary-dh48l\" (UID: \"080f3422-c177-4ce2-9ef2-78f801a2db6b\") " pod="openshift-ingress-canary/ingress-canary-dh48l" Jun 11 23:11:06.752492 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.752461 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe1d7acb-364e-4486-b170-da37b2e68eca-data-volume\") pod \"insights-runtime-extractor-6b7r7\" (UID: \"fe1d7acb-364e-4486-b170-da37b2e68eca\") " pod="openshift-insights/insights-runtime-extractor-6b7r7" Jun 11 23:11:06.752492 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.752497 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fe1d7acb-364e-4486-b170-da37b2e68eca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6b7r7\" (UID: \"fe1d7acb-364e-4486-b170-da37b2e68eca\") " pod="openshift-insights/insights-runtime-extractor-6b7r7" Jun 11 23:11:06.752689 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.752517 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qng7b\" (UniqueName: \"kubernetes.io/projected/fe1d7acb-364e-4486-b170-da37b2e68eca-kube-api-access-qng7b\") pod \"insights-runtime-extractor-6b7r7\" (UID: \"fe1d7acb-364e-4486-b170-da37b2e68eca\") " pod="openshift-insights/insights-runtime-extractor-6b7r7" Jun 11 23:11:06.752689 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.752650 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fe1d7acb-364e-4486-b170-da37b2e68eca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6b7r7\" (UID: \"fe1d7acb-364e-4486-b170-da37b2e68eca\") " pod="openshift-insights/insights-runtime-extractor-6b7r7" Jun 11 23:11:06.752768 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.752688 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fe1d7acb-364e-4486-b170-da37b2e68eca-crio-socket\") pod \"insights-runtime-extractor-6b7r7\" (UID: \"fe1d7acb-364e-4486-b170-da37b2e68eca\") " pod="openshift-insights/insights-runtime-extractor-6b7r7" Jun 11 23:11:06.752869 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.752848 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe1d7acb-364e-4486-b170-da37b2e68eca-data-volume\") pod \"insights-runtime-extractor-6b7r7\" (UID: \"fe1d7acb-364e-4486-b170-da37b2e68eca\") " pod="openshift-insights/insights-runtime-extractor-6b7r7" Jun 11 23:11:06.752943 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.752917 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fe1d7acb-364e-4486-b170-da37b2e68eca-crio-socket\") pod \"insights-runtime-extractor-6b7r7\" (UID: \"fe1d7acb-364e-4486-b170-da37b2e68eca\") " pod="openshift-insights/insights-runtime-extractor-6b7r7" Jun 11 23:11:06.753201 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.753185 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fe1d7acb-364e-4486-b170-da37b2e68eca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6b7r7\" (UID: \"fe1d7acb-364e-4486-b170-da37b2e68eca\") " pod="openshift-insights/insights-runtime-extractor-6b7r7" Jun 11 23:11:06.754726 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.754706 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fe1d7acb-364e-4486-b170-da37b2e68eca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6b7r7\" (UID: \"fe1d7acb-364e-4486-b170-da37b2e68eca\") " pod="openshift-insights/insights-runtime-extractor-6b7r7" Jun 11 23:11:06.761214 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.761195 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qng7b\" (UniqueName: \"kubernetes.io/projected/fe1d7acb-364e-4486-b170-da37b2e68eca-kube-api-access-qng7b\") pod \"insights-runtime-extractor-6b7r7\" (UID: \"fe1d7acb-364e-4486-b170-da37b2e68eca\") " pod="openshift-insights/insights-runtime-extractor-6b7r7" Jun 11 23:11:06.766132 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.766116 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qk2pw" Jun 11 23:11:06.770770 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.770758 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dh48l" Jun 11 23:11:06.863153 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.863044 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6b7r7" Jun 11 23:11:06.916345 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.916309 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dh48l"] Jun 11 23:11:06.919762 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:11:06.919728 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod080f3422_c177_4ce2_9ef2_78f801a2db6b.slice/crio-37845aeada4f0c9a007f9a8603fe3266c8cf8cb4ea49c0e0d310e5fd7c3583b4 WatchSource:0}: Error finding container 37845aeada4f0c9a007f9a8603fe3266c8cf8cb4ea49c0e0d310e5fd7c3583b4: Status 404 returned error can't find the container with id 37845aeada4f0c9a007f9a8603fe3266c8cf8cb4ea49c0e0d310e5fd7c3583b4 Jun 11 23:11:06.928917 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.928887 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qk2pw"] Jun 11 23:11:06.933901 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:11:06.933878 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode01b3859_b744_476e_80ff_bfa6a00ada95.slice/crio-6cc6c51212604b7a83f68c350d7814e5da2ba1826655d499a2ff2682e21e3838 WatchSource:0}: Error finding container 6cc6c51212604b7a83f68c350d7814e5da2ba1826655d499a2ff2682e21e3838: Status 404 returned error can't find the container with id 6cc6c51212604b7a83f68c350d7814e5da2ba1826655d499a2ff2682e21e3838 Jun 11 23:11:06.993721 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:06.993688 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6b7r7"] Jun 11 23:11:06.996444 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:11:06.996413 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe1d7acb_364e_4486_b170_da37b2e68eca.slice/crio-b2fbb34e8cdffe2678bfc9b6396c68299206c9e99432bbc071ac7e8a2797230a WatchSource:0}: Error finding container b2fbb34e8cdffe2678bfc9b6396c68299206c9e99432bbc071ac7e8a2797230a: Status 404 returned error can't find the container with id b2fbb34e8cdffe2678bfc9b6396c68299206c9e99432bbc071ac7e8a2797230a Jun 11 23:11:07.000241 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:07.000217 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:11:07.000333 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:07.000310 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:11:07.000454 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:07.000424 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:11:07.003487 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:07.003344 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 23:11:07.003487 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:07.003361 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 23:11:07.003487 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:07.003382 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t5cps\"" Jun 11 23:11:07.003487 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:07.003364 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 23:11:07.003487 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:07.003383 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8q79j\"" Jun 11 23:11:07.003698 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:07.003491 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 23:11:07.196128 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:07.196091 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dh48l" event={"ID":"080f3422-c177-4ce2-9ef2-78f801a2db6b","Type":"ContainerStarted","Data":"37845aeada4f0c9a007f9a8603fe3266c8cf8cb4ea49c0e0d310e5fd7c3583b4"} Jun 11 23:11:07.197200 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:07.197174 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qk2pw" event={"ID":"e01b3859-b744-476e-80ff-bfa6a00ada95","Type":"ContainerStarted","Data":"6cc6c51212604b7a83f68c350d7814e5da2ba1826655d499a2ff2682e21e3838"} Jun 11 23:11:07.199791 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:07.199766 2563 generic.go:356] "Generic (PLEG): container finished" podID="f5b94329-259b-4886-bd03-2205cf371d90" containerID="e754ae3bdbde43166d589f8cc66386e1e0e2009588a65a60f6b56a6ddcba61a4" exitCode=0 Jun 11 23:11:07.199894 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:07.199849 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8lglz" event={"ID":"f5b94329-259b-4886-bd03-2205cf371d90","Type":"ContainerDied","Data":"e754ae3bdbde43166d589f8cc66386e1e0e2009588a65a60f6b56a6ddcba61a4"} Jun 11 23:11:07.200877 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:07.200855 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6b7r7" event={"ID":"fe1d7acb-364e-4486-b170-da37b2e68eca","Type":"ContainerStarted","Data":"b2fbb34e8cdffe2678bfc9b6396c68299206c9e99432bbc071ac7e8a2797230a"} Jun 11 23:11:08.208689 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:08.208399 2563 generic.go:356] "Generic (PLEG): container finished" podID="f5b94329-259b-4886-bd03-2205cf371d90" containerID="5ff1fa84fac4428c787576054cf2dd21bd3de43e0095c216a7ac3cf7df8635e1" exitCode=0 Jun 11 23:11:08.208689 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:08.208614 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8lglz" event={"ID":"f5b94329-259b-4886-bd03-2205cf371d90","Type":"ContainerDied","Data":"5ff1fa84fac4428c787576054cf2dd21bd3de43e0095c216a7ac3cf7df8635e1"} Jun 11 23:11:08.880795 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:08.880759 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-lp68n"] Jun 11 23:11:08.884089 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:08.884065 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lp68n" Jun 11 23:11:08.887110 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:08.887078 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 11 23:11:08.887260 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:08.887212 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 23:11:08.887332 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:08.887257 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-zg9fk\"" Jun 11 23:11:08.888350 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:08.888330 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 23:11:08.888474 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:08.888353 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 11 23:11:08.888474 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:08.888369 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 23:11:08.899547 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:08.899518 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-lp68n"] Jun 11 23:11:09.071327 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.071287 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2xh2\" (UniqueName: \"kubernetes.io/projected/a0db75ab-e481-478b-aeac-7f91e9610b3a-kube-api-access-p2xh2\") pod \"prometheus-operator-864fcfc6f9-lp68n\" (UID: \"a0db75ab-e481-478b-aeac-7f91e9610b3a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lp68n" Jun 11 23:11:09.071585 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.071373 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0db75ab-e481-478b-aeac-7f91e9610b3a-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-lp68n\" (UID: \"a0db75ab-e481-478b-aeac-7f91e9610b3a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lp68n" Jun 11 23:11:09.071585 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.071407 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0db75ab-e481-478b-aeac-7f91e9610b3a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-lp68n\" (UID: \"a0db75ab-e481-478b-aeac-7f91e9610b3a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lp68n" Jun 11 23:11:09.071585 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.071487 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0db75ab-e481-478b-aeac-7f91e9610b3a-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-lp68n\" (UID: \"a0db75ab-e481-478b-aeac-7f91e9610b3a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lp68n" Jun 11 23:11:09.172061 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.171957 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0db75ab-e481-478b-aeac-7f91e9610b3a-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-lp68n\" (UID: \"a0db75ab-e481-478b-aeac-7f91e9610b3a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lp68n" Jun 11 23:11:09.172061 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.172021 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0db75ab-e481-478b-aeac-7f91e9610b3a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-lp68n\" (UID: \"a0db75ab-e481-478b-aeac-7f91e9610b3a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lp68n" Jun 11 23:11:09.172061 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.172050 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0db75ab-e481-478b-aeac-7f91e9610b3a-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-lp68n\" (UID: \"a0db75ab-e481-478b-aeac-7f91e9610b3a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lp68n" Jun 11 23:11:09.172335 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.172217 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2xh2\" (UniqueName: \"kubernetes.io/projected/a0db75ab-e481-478b-aeac-7f91e9610b3a-kube-api-access-p2xh2\") pod \"prometheus-operator-864fcfc6f9-lp68n\" (UID: \"a0db75ab-e481-478b-aeac-7f91e9610b3a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lp68n" Jun 11 23:11:09.172926 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.172898 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0db75ab-e481-478b-aeac-7f91e9610b3a-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-lp68n\" (UID: \"a0db75ab-e481-478b-aeac-7f91e9610b3a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lp68n" Jun 11 23:11:09.174708 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.174688 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0db75ab-e481-478b-aeac-7f91e9610b3a-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-lp68n\" (UID: \"a0db75ab-e481-478b-aeac-7f91e9610b3a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lp68n" Jun 11 23:11:09.174795 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.174709 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0db75ab-e481-478b-aeac-7f91e9610b3a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-lp68n\" (UID: \"a0db75ab-e481-478b-aeac-7f91e9610b3a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lp68n" Jun 11 23:11:09.181565 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.181522 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2xh2\" (UniqueName: \"kubernetes.io/projected/a0db75ab-e481-478b-aeac-7f91e9610b3a-kube-api-access-p2xh2\") pod \"prometheus-operator-864fcfc6f9-lp68n\" (UID: \"a0db75ab-e481-478b-aeac-7f91e9610b3a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lp68n" Jun 11 23:11:09.207998 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.207098 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lp68n" Jun 11 23:11:09.217130 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.217105 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8lglz" event={"ID":"f5b94329-259b-4886-bd03-2205cf371d90","Type":"ContainerStarted","Data":"d62a81edb2dfcad9caf809731ae4b7dc65360992b60d4c7e78d6c2e1119d17c3"} Jun 11 23:11:09.257334 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.257282 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8lglz" podStartSLOduration=8.926700523000001 podStartE2EDuration="42.257264854s" totalImagesPullingTime="33.330564331s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:10:27 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:09.256640862 +0000 UTC m=+42.679425832" watchObservedRunningTime="2026-06-11 23:11:09.257264854 +0000 UTC m=+42.680049821" Jun 11 23:11:09.479048 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.478951 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b6b4848f5-7zncs"] Jun 11 23:11:09.484920 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.484895 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6b4848f5-7zncs" Jun 11 23:11:09.491178 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.491149 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 23:11:09.491312 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.491152 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 23:11:09.491312 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.491183 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-csrcf\"" Jun 11 23:11:09.492185 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.492164 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 23:11:09.492299 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.492260 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 23:11:09.497032 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.497012 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 23:11:09.502908 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.502892 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 23:11:09.508343 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.508326 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 23:11:09.522008 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.521970 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b6b4848f5-7zncs"] Jun 11 23:11:09.575477 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.575438 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/745baec5-931e-48b1-bfec-8b95a571359b-service-ca\") pod \"console-b6b4848f5-7zncs\" (UID: \"745baec5-931e-48b1-bfec-8b95a571359b\") " pod="openshift-console/console-b6b4848f5-7zncs" Jun 11 23:11:09.575645 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.575526 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/745baec5-931e-48b1-bfec-8b95a571359b-console-serving-cert\") pod \"console-b6b4848f5-7zncs\" (UID: \"745baec5-931e-48b1-bfec-8b95a571359b\") " pod="openshift-console/console-b6b4848f5-7zncs" Jun 11 23:11:09.575645 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.575549 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kp6n\" (UniqueName: \"kubernetes.io/projected/745baec5-931e-48b1-bfec-8b95a571359b-kube-api-access-6kp6n\") pod \"console-b6b4848f5-7zncs\" (UID: \"745baec5-931e-48b1-bfec-8b95a571359b\") " pod="openshift-console/console-b6b4848f5-7zncs" Jun 11 23:11:09.575645 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.575576 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/745baec5-931e-48b1-bfec-8b95a571359b-console-oauth-config\") pod \"console-b6b4848f5-7zncs\" (UID: \"745baec5-931e-48b1-bfec-8b95a571359b\") " pod="openshift-console/console-b6b4848f5-7zncs" Jun 11 23:11:09.575645 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.575625 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/745baec5-931e-48b1-bfec-8b95a571359b-oauth-serving-cert\") pod \"console-b6b4848f5-7zncs\" (UID: \"745baec5-931e-48b1-bfec-8b95a571359b\") " pod="openshift-console/console-b6b4848f5-7zncs" Jun 11 23:11:09.575878 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.575720 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/745baec5-931e-48b1-bfec-8b95a571359b-console-config\") pod \"console-b6b4848f5-7zncs\" (UID: \"745baec5-931e-48b1-bfec-8b95a571359b\") " pod="openshift-console/console-b6b4848f5-7zncs" Jun 11 23:11:09.676830 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.676773 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/745baec5-931e-48b1-bfec-8b95a571359b-console-serving-cert\") pod \"console-b6b4848f5-7zncs\" (UID: \"745baec5-931e-48b1-bfec-8b95a571359b\") " pod="openshift-console/console-b6b4848f5-7zncs" Jun 11 23:11:09.676830 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.676818 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kp6n\" (UniqueName: \"kubernetes.io/projected/745baec5-931e-48b1-bfec-8b95a571359b-kube-api-access-6kp6n\") pod \"console-b6b4848f5-7zncs\" (UID: \"745baec5-931e-48b1-bfec-8b95a571359b\") " pod="openshift-console/console-b6b4848f5-7zncs" Jun 11 23:11:09.677095 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.676846 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/745baec5-931e-48b1-bfec-8b95a571359b-console-oauth-config\") pod \"console-b6b4848f5-7zncs\" (UID: \"745baec5-931e-48b1-bfec-8b95a571359b\") " pod="openshift-console/console-b6b4848f5-7zncs" Jun 11 23:11:09.677095 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.676869 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/745baec5-931e-48b1-bfec-8b95a571359b-oauth-serving-cert\") pod \"console-b6b4848f5-7zncs\" (UID: \"745baec5-931e-48b1-bfec-8b95a571359b\") " pod="openshift-console/console-b6b4848f5-7zncs" Jun 11 23:11:09.677194 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.677132 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/745baec5-931e-48b1-bfec-8b95a571359b-console-config\") pod \"console-b6b4848f5-7zncs\" (UID: \"745baec5-931e-48b1-bfec-8b95a571359b\") " pod="openshift-console/console-b6b4848f5-7zncs" Jun 11 23:11:09.677194 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.677182 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/745baec5-931e-48b1-bfec-8b95a571359b-service-ca\") pod \"console-b6b4848f5-7zncs\" (UID: \"745baec5-931e-48b1-bfec-8b95a571359b\") " pod="openshift-console/console-b6b4848f5-7zncs" Jun 11 23:11:09.677711 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.677679 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/745baec5-931e-48b1-bfec-8b95a571359b-oauth-serving-cert\") pod \"console-b6b4848f5-7zncs\" (UID: \"745baec5-931e-48b1-bfec-8b95a571359b\") " pod="openshift-console/console-b6b4848f5-7zncs" Jun 11 23:11:09.677913 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.677893 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/745baec5-931e-48b1-bfec-8b95a571359b-service-ca\") pod \"console-b6b4848f5-7zncs\" (UID: \"745baec5-931e-48b1-bfec-8b95a571359b\") " pod="openshift-console/console-b6b4848f5-7zncs" Jun 11 23:11:09.678001 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.677922 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/745baec5-931e-48b1-bfec-8b95a571359b-console-config\") pod \"console-b6b4848f5-7zncs\" (UID: \"745baec5-931e-48b1-bfec-8b95a571359b\") " pod="openshift-console/console-b6b4848f5-7zncs" Jun 11 23:11:09.679863 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.679842 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/745baec5-931e-48b1-bfec-8b95a571359b-console-serving-cert\") pod \"console-b6b4848f5-7zncs\" (UID: \"745baec5-931e-48b1-bfec-8b95a571359b\") " pod="openshift-console/console-b6b4848f5-7zncs" Jun 11 23:11:09.679959 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.679875 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/745baec5-931e-48b1-bfec-8b95a571359b-console-oauth-config\") pod \"console-b6b4848f5-7zncs\" (UID: \"745baec5-931e-48b1-bfec-8b95a571359b\") " pod="openshift-console/console-b6b4848f5-7zncs" Jun 11 23:11:09.696799 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.696770 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kp6n\" (UniqueName: \"kubernetes.io/projected/745baec5-931e-48b1-bfec-8b95a571359b-kube-api-access-6kp6n\") pod \"console-b6b4848f5-7zncs\" (UID: \"745baec5-931e-48b1-bfec-8b95a571359b\") " pod="openshift-console/console-b6b4848f5-7zncs" Jun 11 23:11:09.795423 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:09.795338 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6b4848f5-7zncs" Jun 11 23:11:10.842630 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:10.842596 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7fdf5fcd74-ccvmr"] Jun 11 23:11:10.849379 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:10.849355 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fdf5fcd74-ccvmr" Jun 11 23:11:10.862709 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:10.861082 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 23:11:10.885590 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:10.885564 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fdf5fcd74-ccvmr"] Jun 11 23:11:10.987688 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:10.987602 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08265be8-968c-4081-867c-65662529deea-oauth-serving-cert\") pod \"console-7fdf5fcd74-ccvmr\" (UID: \"08265be8-968c-4081-867c-65662529deea\") " pod="openshift-console/console-7fdf5fcd74-ccvmr" Jun 11 23:11:10.987688 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:10.987641 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08265be8-968c-4081-867c-65662529deea-console-config\") pod \"console-7fdf5fcd74-ccvmr\" (UID: \"08265be8-968c-4081-867c-65662529deea\") " pod="openshift-console/console-7fdf5fcd74-ccvmr" Jun 11 23:11:10.987688 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:10.987657 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08265be8-968c-4081-867c-65662529deea-trusted-ca-bundle\") pod \"console-7fdf5fcd74-ccvmr\" (UID: \"08265be8-968c-4081-867c-65662529deea\") " pod="openshift-console/console-7fdf5fcd74-ccvmr" Jun 11 23:11:10.987688 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:10.987672 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvwvk\" (UniqueName: \"kubernetes.io/projected/08265be8-968c-4081-867c-65662529deea-kube-api-access-lvwvk\") pod \"console-7fdf5fcd74-ccvmr\" (UID: \"08265be8-968c-4081-867c-65662529deea\") " pod="openshift-console/console-7fdf5fcd74-ccvmr" Jun 11 23:11:10.987928 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:10.987698 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08265be8-968c-4081-867c-65662529deea-service-ca\") pod \"console-7fdf5fcd74-ccvmr\" (UID: \"08265be8-968c-4081-867c-65662529deea\") " pod="openshift-console/console-7fdf5fcd74-ccvmr" Jun 11 23:11:10.987928 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:10.987765 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08265be8-968c-4081-867c-65662529deea-console-oauth-config\") pod \"console-7fdf5fcd74-ccvmr\" (UID: \"08265be8-968c-4081-867c-65662529deea\") " pod="openshift-console/console-7fdf5fcd74-ccvmr" Jun 11 23:11:10.987928 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:10.987784 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08265be8-968c-4081-867c-65662529deea-console-serving-cert\") pod \"console-7fdf5fcd74-ccvmr\" (UID: \"08265be8-968c-4081-867c-65662529deea\") " pod="openshift-console/console-7fdf5fcd74-ccvmr" Jun 11 23:11:11.088234 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:11.088191 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08265be8-968c-4081-867c-65662529deea-oauth-serving-cert\") pod \"console-7fdf5fcd74-ccvmr\" (UID: \"08265be8-968c-4081-867c-65662529deea\") " pod="openshift-console/console-7fdf5fcd74-ccvmr" Jun 11 23:11:11.088234 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:11.088239 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08265be8-968c-4081-867c-65662529deea-console-config\") pod \"console-7fdf5fcd74-ccvmr\" (UID: \"08265be8-968c-4081-867c-65662529deea\") " pod="openshift-console/console-7fdf5fcd74-ccvmr" Jun 11 23:11:11.088483 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:11.088261 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08265be8-968c-4081-867c-65662529deea-trusted-ca-bundle\") pod \"console-7fdf5fcd74-ccvmr\" (UID: \"08265be8-968c-4081-867c-65662529deea\") " pod="openshift-console/console-7fdf5fcd74-ccvmr" Jun 11 23:11:11.088483 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:11.088284 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvwvk\" (UniqueName: \"kubernetes.io/projected/08265be8-968c-4081-867c-65662529deea-kube-api-access-lvwvk\") pod \"console-7fdf5fcd74-ccvmr\" (UID: \"08265be8-968c-4081-867c-65662529deea\") " pod="openshift-console/console-7fdf5fcd74-ccvmr" Jun 11 23:11:11.088483 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:11.088314 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08265be8-968c-4081-867c-65662529deea-service-ca\") pod \"console-7fdf5fcd74-ccvmr\" (UID: \"08265be8-968c-4081-867c-65662529deea\") " pod="openshift-console/console-7fdf5fcd74-ccvmr" Jun 11 23:11:11.088608 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:11.088514 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08265be8-968c-4081-867c-65662529deea-console-oauth-config\") pod \"console-7fdf5fcd74-ccvmr\" (UID: \"08265be8-968c-4081-867c-65662529deea\") " pod="openshift-console/console-7fdf5fcd74-ccvmr" Jun 11 23:11:11.088608 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:11.088563 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08265be8-968c-4081-867c-65662529deea-console-serving-cert\") pod \"console-7fdf5fcd74-ccvmr\" (UID: \"08265be8-968c-4081-867c-65662529deea\") " pod="openshift-console/console-7fdf5fcd74-ccvmr" Jun 11 23:11:11.089147 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:11.089080 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08265be8-968c-4081-867c-65662529deea-oauth-serving-cert\") pod \"console-7fdf5fcd74-ccvmr\" (UID: \"08265be8-968c-4081-867c-65662529deea\") " pod="openshift-console/console-7fdf5fcd74-ccvmr" Jun 11 23:11:11.089147 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:11.089078 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08265be8-968c-4081-867c-65662529deea-console-config\") pod \"console-7fdf5fcd74-ccvmr\" (UID: \"08265be8-968c-4081-867c-65662529deea\") " pod="openshift-console/console-7fdf5fcd74-ccvmr" Jun 11 23:11:11.089322 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:11.089265 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08265be8-968c-4081-867c-65662529deea-service-ca\") pod \"console-7fdf5fcd74-ccvmr\" (UID: \"08265be8-968c-4081-867c-65662529deea\") " pod="openshift-console/console-7fdf5fcd74-ccvmr" Jun 11 23:11:11.089384 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:11.089348 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08265be8-968c-4081-867c-65662529deea-trusted-ca-bundle\") pod \"console-7fdf5fcd74-ccvmr\" (UID: \"08265be8-968c-4081-867c-65662529deea\") " pod="openshift-console/console-7fdf5fcd74-ccvmr" Jun 11 23:11:11.091357 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:11.091330 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08265be8-968c-4081-867c-65662529deea-console-oauth-config\") pod \"console-7fdf5fcd74-ccvmr\" (UID: \"08265be8-968c-4081-867c-65662529deea\") " pod="openshift-console/console-7fdf5fcd74-ccvmr" Jun 11 23:11:11.091357 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:11.091345 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08265be8-968c-4081-867c-65662529deea-console-serving-cert\") pod \"console-7fdf5fcd74-ccvmr\" (UID: \"08265be8-968c-4081-867c-65662529deea\") " pod="openshift-console/console-7fdf5fcd74-ccvmr" Jun 11 23:11:11.100340 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:11.100320 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvwvk\" (UniqueName: \"kubernetes.io/projected/08265be8-968c-4081-867c-65662529deea-kube-api-access-lvwvk\") pod \"console-7fdf5fcd74-ccvmr\" (UID: \"08265be8-968c-4081-867c-65662529deea\") " pod="openshift-console/console-7fdf5fcd74-ccvmr" Jun 11 23:11:11.160257 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:11.160223 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fdf5fcd74-ccvmr" Jun 11 23:11:11.476374 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:11.474008 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-lp68n"] Jun 11 23:11:11.480331 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:11:11.480293 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0db75ab_e481_478b_aeac_7f91e9610b3a.slice/crio-09f89443d1c6fd3091dd4a1c6d960577c38a84efeae4807d5427e7c96cdda19b WatchSource:0}: Error finding container 09f89443d1c6fd3091dd4a1c6d960577c38a84efeae4807d5427e7c96cdda19b: Status 404 returned error can't find the container with id 09f89443d1c6fd3091dd4a1c6d960577c38a84efeae4807d5427e7c96cdda19b Jun 11 23:11:11.496510 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:11.496441 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fdf5fcd74-ccvmr"] Jun 11 23:11:11.504202 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:11:11.504170 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08265be8_968c_4081_867c_65662529deea.slice/crio-284c18eb92a54deb1b73c0c1d8ff237984728dd500bd69d093e06ba6c9e80033 WatchSource:0}: Error finding container 284c18eb92a54deb1b73c0c1d8ff237984728dd500bd69d093e06ba6c9e80033: Status 404 returned error can't find the container with id 284c18eb92a54deb1b73c0c1d8ff237984728dd500bd69d093e06ba6c9e80033 Jun 11 23:11:11.514214 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:11.514183 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b6b4848f5-7zncs"] Jun 11 23:11:12.229341 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:12.229302 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qk2pw" event={"ID":"e01b3859-b744-476e-80ff-bfa6a00ada95","Type":"ContainerStarted","Data":"0d8c899aed1db0319a34856b9ee063576d6b85e87c9fe475f4c10d4e3d4e253e"} Jun 11 23:11:12.229796 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:12.229371 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qk2pw" event={"ID":"e01b3859-b744-476e-80ff-bfa6a00ada95","Type":"ContainerStarted","Data":"19b49bbbffcd2d029934b3b4112379a5fa802bf81a263d04c7a8b1f9f655b43b"} Jun 11 23:11:12.230336 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:12.230230 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qk2pw" Jun 11 23:11:12.232672 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:12.232592 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6b7r7" event={"ID":"fe1d7acb-364e-4486-b170-da37b2e68eca","Type":"ContainerStarted","Data":"e1fb6ac812f5cb27ff3f1520c7077780536488bc850b8fd42cf00fa004607685"} Jun 11 23:11:12.235666 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:12.235630 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fdf5fcd74-ccvmr" event={"ID":"08265be8-968c-4081-867c-65662529deea","Type":"ContainerStarted","Data":"284c18eb92a54deb1b73c0c1d8ff237984728dd500bd69d093e06ba6c9e80033"} Jun 11 23:11:12.238064 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:12.237999 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dh48l" event={"ID":"080f3422-c177-4ce2-9ef2-78f801a2db6b","Type":"ContainerStarted","Data":"562f426dc33102204b2ff57755adac23604df43540d12252ce81512750f95fc8"} Jun 11 23:11:12.240211 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:12.240181 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6b4848f5-7zncs" event={"ID":"745baec5-931e-48b1-bfec-8b95a571359b","Type":"ContainerStarted","Data":"e8d127f577bf64f5ef7dec34fa10e0848fbd603144faabd2134d49283820b55c"} Jun 11 23:11:12.241745 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:12.241687 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lp68n" event={"ID":"a0db75ab-e481-478b-aeac-7f91e9610b3a","Type":"ContainerStarted","Data":"09f89443d1c6fd3091dd4a1c6d960577c38a84efeae4807d5427e7c96cdda19b"} Jun 11 23:11:12.274037 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:12.273875 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qk2pw" podStartSLOduration=1.9112669549999999 podStartE2EDuration="6.273853219s" totalImagesPullingTime="4.362586264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:11:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:12.254827026 +0000 UTC m=+45.677611992" watchObservedRunningTime="2026-06-11 23:11:12.273853219 +0000 UTC m=+45.696638188" Jun 11 23:11:12.274340 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:12.274285 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dh48l" podStartSLOduration=1.894889885 podStartE2EDuration="6.274272276s" totalImagesPullingTime="4.379382391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:11:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:12.27362395 +0000 UTC m=+45.696408917" watchObservedRunningTime="2026-06-11 23:11:12.274272276 +0000 UTC m=+45.697057246" Jun 11 23:11:13.251154 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:13.251105 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6b7r7" event={"ID":"fe1d7acb-364e-4486-b170-da37b2e68eca","Type":"ContainerStarted","Data":"c7341bd9e6a88ed032ccec0e2c7944e789c42e178c3deb80520c78d98246e053"} Jun 11 23:11:16.264270 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:16.263692 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6b7r7" event={"ID":"fe1d7acb-364e-4486-b170-da37b2e68eca","Type":"ContainerStarted","Data":"ac5d9d2cfa525fe31a502aa8f8778e2e54e169fce1f1d94d9e7ee3395e4a5238"} Jun 11 23:11:16.265664 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:16.265620 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fdf5fcd74-ccvmr" event={"ID":"08265be8-968c-4081-867c-65662529deea","Type":"ContainerStarted","Data":"3a29cf14330638ef3212d7e45d61c3dad3348f96a096c4d9a4b23985e01bc782"} Jun 11 23:11:16.267651 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:16.267623 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6b4848f5-7zncs" event={"ID":"745baec5-931e-48b1-bfec-8b95a571359b","Type":"ContainerStarted","Data":"de5675c0da437a72d62392c7f274b607e4b481071741f7668327fc10d3677e24"} Jun 11 23:11:16.269429 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:16.269395 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lp68n" event={"ID":"a0db75ab-e481-478b-aeac-7f91e9610b3a","Type":"ContainerStarted","Data":"c72b7455f27cf8d57743b29671b2e8a3c0a0bdd1b5eba6d821100fc36849932f"} Jun 11 23:11:16.269519 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:16.269445 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lp68n" event={"ID":"a0db75ab-e481-478b-aeac-7f91e9610b3a","Type":"ContainerStarted","Data":"5d95b479e530758316f36ff515ae0a33e8f9c9d088cb95f26577cb6b9e6537e1"} Jun 11 23:11:16.337619 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:16.337491 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6b7r7" podStartSLOduration=1.6174621679999999 podStartE2EDuration="10.337471779s" totalImagesPullingTime="8.720009611s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:11:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:16.336671974 +0000 UTC m=+49.759456942" watchObservedRunningTime="2026-06-11 23:11:16.337471779 +0000 UTC m=+49.760256747" Jun 11 23:11:16.403818 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:16.403767 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lp68n" podStartSLOduration=4.068618123 podStartE2EDuration="8.403750086s" totalImagesPullingTime="4.335131963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:11:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:16.403256155 +0000 UTC m=+49.826041104" watchObservedRunningTime="2026-06-11 23:11:16.403750086 +0000 UTC m=+49.826535050" Jun 11 23:11:16.451084 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:16.450916 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7fdf5fcd74-ccvmr" podStartSLOduration=1.973750664 podStartE2EDuration="6.450899129s" totalImagesPullingTime="4.477148465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:11:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:16.44942015 +0000 UTC m=+49.872205118" watchObservedRunningTime="2026-06-11 23:11:16.450899129 +0000 UTC m=+49.873684097" Jun 11 23:11:16.510337 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:16.510277 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b6b4848f5-7zncs" podStartSLOduration=3.056460579 podStartE2EDuration="7.510261248s" totalImagesPullingTime="4.453800669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:11:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:16.509689296 +0000 UTC m=+49.932474275" watchObservedRunningTime="2026-06-11 23:11:16.510261248 +0000 UTC m=+49.933046276" Jun 11 23:11:18.613581 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.613547 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-r9dgv"] Jun 11 23:11:18.642463 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.642430 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-r9dgv"] Jun 11 23:11:18.642611 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.642554 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-r9dgv" Jun 11 23:11:18.647740 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.647692 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 11 23:11:18.648099 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.648085 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 11 23:11:18.648539 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.648525 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-5w5tc\"" Jun 11 23:11:18.654959 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.654935 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66dlq\" (UniqueName: \"kubernetes.io/projected/27da07e2-d8e4-4319-962c-5ab1bb12d90b-kube-api-access-66dlq\") pod \"openshift-state-metrics-6b8d965dd5-r9dgv\" (UID: \"27da07e2-d8e4-4319-962c-5ab1bb12d90b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-r9dgv" Jun 11 23:11:18.655079 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.654972 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27da07e2-d8e4-4319-962c-5ab1bb12d90b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-r9dgv\" (UID: \"27da07e2-d8e4-4319-962c-5ab1bb12d90b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-r9dgv" Jun 11 23:11:18.655079 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.655065 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27da07e2-d8e4-4319-962c-5ab1bb12d90b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-r9dgv\" (UID: \"27da07e2-d8e4-4319-962c-5ab1bb12d90b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-r9dgv" Jun 11 23:11:18.655157 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.655140 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27da07e2-d8e4-4319-962c-5ab1bb12d90b-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-r9dgv\" (UID: \"27da07e2-d8e4-4319-962c-5ab1bb12d90b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-r9dgv" Jun 11 23:11:18.655659 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.655639 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-82tw7"] Jun 11 23:11:18.670243 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.670224 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-82tw7" Jun 11 23:11:18.673784 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.673769 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 23:11:18.673991 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.673961 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6x6hf\"" Jun 11 23:11:18.674245 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.674228 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 23:11:18.675196 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.675153 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 23:11:18.675897 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.675881 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-h6mh9"] Jun 11 23:11:18.694579 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.694558 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-h6mh9" Jun 11 23:11:18.698248 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.698227 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-bxq4n\"" Jun 11 23:11:18.698730 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.698714 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-h6mh9"] Jun 11 23:11:18.699054 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.699038 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 11 23:11:18.699168 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.699144 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 11 23:11:18.700556 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.700535 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 11 23:11:18.756099 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.756077 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/79f147ec-24ff-4190-bdd9-c4552db1c883-node-exporter-textfile\") pod \"node-exporter-82tw7\" (UID: \"79f147ec-24ff-4190-bdd9-c4552db1c883\") " pod="openshift-monitoring/node-exporter-82tw7" Jun 11 23:11:18.756214 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.756108 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/811341ae-6172-4b68-ada2-858413c24d0f-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-h6mh9\" (UID: \"811341ae-6172-4b68-ada2-858413c24d0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h6mh9" Jun 11 23:11:18.756214 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.756132 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27da07e2-d8e4-4319-962c-5ab1bb12d90b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-r9dgv\" (UID: \"27da07e2-d8e4-4319-962c-5ab1bb12d90b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-r9dgv" Jun 11 23:11:18.756214 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.756158 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79f147ec-24ff-4190-bdd9-c4552db1c883-metrics-client-ca\") pod \"node-exporter-82tw7\" (UID: \"79f147ec-24ff-4190-bdd9-c4552db1c883\") " pod="openshift-monitoring/node-exporter-82tw7" Jun 11 23:11:18.756355 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.756277 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/811341ae-6172-4b68-ada2-858413c24d0f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-h6mh9\" (UID: \"811341ae-6172-4b68-ada2-858413c24d0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h6mh9" Jun 11 23:11:18.756355 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.756324 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27da07e2-d8e4-4319-962c-5ab1bb12d90b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-r9dgv\" (UID: \"27da07e2-d8e4-4319-962c-5ab1bb12d90b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-r9dgv" Jun 11 23:11:18.756448 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.756362 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/811341ae-6172-4b68-ada2-858413c24d0f-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-h6mh9\" (UID: \"811341ae-6172-4b68-ada2-858413c24d0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h6mh9" Jun 11 23:11:18.756448 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:11:18.756405 2563 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 11 23:11:18.756554 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:11:18.756467 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27da07e2-d8e4-4319-962c-5ab1bb12d90b-openshift-state-metrics-tls podName:27da07e2-d8e4-4319-962c-5ab1bb12d90b nodeName:}" failed. No retries permitted until 2026-06-11 23:11:19.256447978 +0000 UTC m=+52.679232954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/27da07e2-d8e4-4319-962c-5ab1bb12d90b-openshift-state-metrics-tls") pod "openshift-state-metrics-6b8d965dd5-r9dgv" (UID: "27da07e2-d8e4-4319-962c-5ab1bb12d90b") : secret "openshift-state-metrics-tls" not found Jun 11 23:11:18.756554 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.756492 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27da07e2-d8e4-4319-962c-5ab1bb12d90b-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-r9dgv\" (UID: \"27da07e2-d8e4-4319-962c-5ab1bb12d90b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-r9dgv" Jun 11 23:11:18.756554 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.756526 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79f147ec-24ff-4190-bdd9-c4552db1c883-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-82tw7\" (UID: \"79f147ec-24ff-4190-bdd9-c4552db1c883\") " pod="openshift-monitoring/node-exporter-82tw7" Jun 11 23:11:18.756832 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.756798 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sphj9\" (UniqueName: \"kubernetes.io/projected/79f147ec-24ff-4190-bdd9-c4552db1c883-kube-api-access-sphj9\") pod \"node-exporter-82tw7\" (UID: \"79f147ec-24ff-4190-bdd9-c4552db1c883\") " pod="openshift-monitoring/node-exporter-82tw7" Jun 11 23:11:18.756957 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.756847 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/79f147ec-24ff-4190-bdd9-c4552db1c883-node-exporter-wtmp\") pod \"node-exporter-82tw7\" (UID: \"79f147ec-24ff-4190-bdd9-c4552db1c883\") " pod="openshift-monitoring/node-exporter-82tw7" Jun 11 23:11:18.756957 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.756880 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/811341ae-6172-4b68-ada2-858413c24d0f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-h6mh9\" (UID: \"811341ae-6172-4b68-ada2-858413c24d0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h6mh9" Jun 11 23:11:18.756957 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.756907 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/79f147ec-24ff-4190-bdd9-c4552db1c883-root\") pod \"node-exporter-82tw7\" (UID: \"79f147ec-24ff-4190-bdd9-c4552db1c883\") " pod="openshift-monitoring/node-exporter-82tw7" Jun 11 23:11:18.757147 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.756956 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79f147ec-24ff-4190-bdd9-c4552db1c883-sys\") pod \"node-exporter-82tw7\" (UID: \"79f147ec-24ff-4190-bdd9-c4552db1c883\") " pod="openshift-monitoring/node-exporter-82tw7" Jun 11 23:11:18.757147 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.757010 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llpch\" (UniqueName: \"kubernetes.io/projected/811341ae-6172-4b68-ada2-858413c24d0f-kube-api-access-llpch\") pod \"kube-state-metrics-678bc549d7-h6mh9\" (UID: \"811341ae-6172-4b68-ada2-858413c24d0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h6mh9" Jun 11 23:11:18.757147 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.757049 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/79f147ec-24ff-4190-bdd9-c4552db1c883-node-exporter-tls\") pod \"node-exporter-82tw7\" (UID: \"79f147ec-24ff-4190-bdd9-c4552db1c883\") " pod="openshift-monitoring/node-exporter-82tw7" Jun 11 23:11:18.757147 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.757089 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66dlq\" (UniqueName: \"kubernetes.io/projected/27da07e2-d8e4-4319-962c-5ab1bb12d90b-kube-api-access-66dlq\") pod \"openshift-state-metrics-6b8d965dd5-r9dgv\" (UID: \"27da07e2-d8e4-4319-962c-5ab1bb12d90b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-r9dgv" Jun 11 23:11:18.757147 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.757118 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/79f147ec-24ff-4190-bdd9-c4552db1c883-node-exporter-accelerators-collector-config\") pod \"node-exporter-82tw7\" (UID: \"79f147ec-24ff-4190-bdd9-c4552db1c883\") " pod="openshift-monitoring/node-exporter-82tw7" Jun 11 23:11:18.757147 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.757144 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/811341ae-6172-4b68-ada2-858413c24d0f-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-h6mh9\" (UID: \"811341ae-6172-4b68-ada2-858413c24d0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h6mh9" Jun 11 23:11:18.757430 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.757231 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27da07e2-d8e4-4319-962c-5ab1bb12d90b-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-r9dgv\" (UID: \"27da07e2-d8e4-4319-962c-5ab1bb12d90b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-r9dgv" Jun 11 23:11:18.758826 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.758806 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27da07e2-d8e4-4319-962c-5ab1bb12d90b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-r9dgv\" (UID: \"27da07e2-d8e4-4319-962c-5ab1bb12d90b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-r9dgv" Jun 11 23:11:18.770676 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.770646 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66dlq\" (UniqueName: \"kubernetes.io/projected/27da07e2-d8e4-4319-962c-5ab1bb12d90b-kube-api-access-66dlq\") pod \"openshift-state-metrics-6b8d965dd5-r9dgv\" (UID: \"27da07e2-d8e4-4319-962c-5ab1bb12d90b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-r9dgv" Jun 11 23:11:18.857726 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.857687 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/79f147ec-24ff-4190-bdd9-c4552db1c883-node-exporter-textfile\") pod \"node-exporter-82tw7\" (UID: \"79f147ec-24ff-4190-bdd9-c4552db1c883\") " pod="openshift-monitoring/node-exporter-82tw7" Jun 11 23:11:18.857898 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.857731 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/811341ae-6172-4b68-ada2-858413c24d0f-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-h6mh9\" (UID: \"811341ae-6172-4b68-ada2-858413c24d0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h6mh9" Jun 11 23:11:18.857898 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.857756 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79f147ec-24ff-4190-bdd9-c4552db1c883-metrics-client-ca\") pod \"node-exporter-82tw7\" (UID: \"79f147ec-24ff-4190-bdd9-c4552db1c883\") " pod="openshift-monitoring/node-exporter-82tw7" Jun 11 23:11:18.857898 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.857840 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/811341ae-6172-4b68-ada2-858413c24d0f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-h6mh9\" (UID: \"811341ae-6172-4b68-ada2-858413c24d0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h6mh9" Jun 11 23:11:18.858082 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.857924 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/811341ae-6172-4b68-ada2-858413c24d0f-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-h6mh9\" (UID: \"811341ae-6172-4b68-ada2-858413c24d0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h6mh9" Jun 11 23:11:18.858082 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.857968 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79f147ec-24ff-4190-bdd9-c4552db1c883-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-82tw7\" (UID: \"79f147ec-24ff-4190-bdd9-c4552db1c883\") " pod="openshift-monitoring/node-exporter-82tw7" Jun 11 23:11:18.858082 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.858010 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sphj9\" (UniqueName: \"kubernetes.io/projected/79f147ec-24ff-4190-bdd9-c4552db1c883-kube-api-access-sphj9\") pod \"node-exporter-82tw7\" (UID: \"79f147ec-24ff-4190-bdd9-c4552db1c883\") " pod="openshift-monitoring/node-exporter-82tw7" Jun 11 23:11:18.858082 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.858041 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/79f147ec-24ff-4190-bdd9-c4552db1c883-node-exporter-wtmp\") pod \"node-exporter-82tw7\" (UID: \"79f147ec-24ff-4190-bdd9-c4552db1c883\") " pod="openshift-monitoring/node-exporter-82tw7" Jun 11 23:11:18.858082 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.858062 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/811341ae-6172-4b68-ada2-858413c24d0f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-h6mh9\" (UID: \"811341ae-6172-4b68-ada2-858413c24d0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h6mh9" Jun 11 23:11:18.858326 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.858087 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/79f147ec-24ff-4190-bdd9-c4552db1c883-root\") pod \"node-exporter-82tw7\" (UID: \"79f147ec-24ff-4190-bdd9-c4552db1c883\") " pod="openshift-monitoring/node-exporter-82tw7" Jun 11 23:11:18.858326 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.858107 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79f147ec-24ff-4190-bdd9-c4552db1c883-sys\") pod \"node-exporter-82tw7\" (UID: \"79f147ec-24ff-4190-bdd9-c4552db1c883\") " pod="openshift-monitoring/node-exporter-82tw7" Jun 11 23:11:18.858326 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.858114 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/79f147ec-24ff-4190-bdd9-c4552db1c883-node-exporter-textfile\") pod \"node-exporter-82tw7\" (UID: \"79f147ec-24ff-4190-bdd9-c4552db1c883\") " pod="openshift-monitoring/node-exporter-82tw7" Jun 11 23:11:18.858326 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.858122 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llpch\" (UniqueName: \"kubernetes.io/projected/811341ae-6172-4b68-ada2-858413c24d0f-kube-api-access-llpch\") pod \"kube-state-metrics-678bc549d7-h6mh9\" (UID: \"811341ae-6172-4b68-ada2-858413c24d0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h6mh9" Jun 11 23:11:18.858326 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.858190 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/79f147ec-24ff-4190-bdd9-c4552db1c883-node-exporter-tls\") pod \"node-exporter-82tw7\" (UID: \"79f147ec-24ff-4190-bdd9-c4552db1c883\") " pod="openshift-monitoring/node-exporter-82tw7" Jun 11 23:11:18.858326 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.858235 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/79f147ec-24ff-4190-bdd9-c4552db1c883-node-exporter-accelerators-collector-config\") pod \"node-exporter-82tw7\" (UID: \"79f147ec-24ff-4190-bdd9-c4552db1c883\") " pod="openshift-monitoring/node-exporter-82tw7" Jun 11 23:11:18.858326 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.858263 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/811341ae-6172-4b68-ada2-858413c24d0f-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-h6mh9\" (UID: \"811341ae-6172-4b68-ada2-858413c24d0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h6mh9" Jun 11 23:11:18.858662 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:11:18.858352 2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 23:11:18.858662 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:11:18.858410 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79f147ec-24ff-4190-bdd9-c4552db1c883-node-exporter-tls podName:79f147ec-24ff-4190-bdd9-c4552db1c883 nodeName:}" failed. No retries permitted until 2026-06-11 23:11:19.358390854 +0000 UTC m=+52.781175820 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/79f147ec-24ff-4190-bdd9-c4552db1c883-node-exporter-tls") pod "node-exporter-82tw7" (UID: "79f147ec-24ff-4190-bdd9-c4552db1c883") : secret "node-exporter-tls" not found Jun 11 23:11:18.858662 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:11:18.858419 2563 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 11 23:11:18.858662 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.858423 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79f147ec-24ff-4190-bdd9-c4552db1c883-metrics-client-ca\") pod \"node-exporter-82tw7\" (UID: \"79f147ec-24ff-4190-bdd9-c4552db1c883\") " pod="openshift-monitoring/node-exporter-82tw7" Jun 11 23:11:18.858662 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:11:18.858461 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/811341ae-6172-4b68-ada2-858413c24d0f-kube-state-metrics-tls podName:811341ae-6172-4b68-ada2-858413c24d0f nodeName:}" failed. No retries permitted until 2026-06-11 23:11:19.358446439 +0000 UTC m=+52.781231398 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/811341ae-6172-4b68-ada2-858413c24d0f-kube-state-metrics-tls") pod "kube-state-metrics-678bc549d7-h6mh9" (UID: "811341ae-6172-4b68-ada2-858413c24d0f") : secret "kube-state-metrics-tls" not found Jun 11 23:11:18.858662 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.858645 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/811341ae-6172-4b68-ada2-858413c24d0f-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-h6mh9\" (UID: \"811341ae-6172-4b68-ada2-858413c24d0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h6mh9" Jun 11 23:11:18.859531 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.859227 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/79f147ec-24ff-4190-bdd9-c4552db1c883-node-exporter-accelerators-collector-config\") pod \"node-exporter-82tw7\" (UID: \"79f147ec-24ff-4190-bdd9-c4552db1c883\") " pod="openshift-monitoring/node-exporter-82tw7" Jun 11 23:11:18.859531 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.859254 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/811341ae-6172-4b68-ada2-858413c24d0f-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-h6mh9\" (UID: \"811341ae-6172-4b68-ada2-858413c24d0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h6mh9" Jun 11 23:11:18.859531 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.859259 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/811341ae-6172-4b68-ada2-858413c24d0f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-h6mh9\" (UID: \"811341ae-6172-4b68-ada2-858413c24d0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h6mh9" Jun 11 23:11:18.859531 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.859329 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/79f147ec-24ff-4190-bdd9-c4552db1c883-root\") pod \"node-exporter-82tw7\" (UID: \"79f147ec-24ff-4190-bdd9-c4552db1c883\") " pod="openshift-monitoring/node-exporter-82tw7" Jun 11 23:11:18.859531 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.859371 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79f147ec-24ff-4190-bdd9-c4552db1c883-sys\") pod \"node-exporter-82tw7\" (UID: \"79f147ec-24ff-4190-bdd9-c4552db1c883\") " pod="openshift-monitoring/node-exporter-82tw7" Jun 11 23:11:18.859531 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.859422 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/79f147ec-24ff-4190-bdd9-c4552db1c883-node-exporter-wtmp\") pod \"node-exporter-82tw7\" (UID: \"79f147ec-24ff-4190-bdd9-c4552db1c883\") " pod="openshift-monitoring/node-exporter-82tw7" Jun 11 23:11:18.860612 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.860587 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/811341ae-6172-4b68-ada2-858413c24d0f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-h6mh9\" (UID: \"811341ae-6172-4b68-ada2-858413c24d0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h6mh9" Jun 11 23:11:18.860786 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.860766 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79f147ec-24ff-4190-bdd9-c4552db1c883-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-82tw7\" (UID: \"79f147ec-24ff-4190-bdd9-c4552db1c883\") " pod="openshift-monitoring/node-exporter-82tw7" Jun 11 23:11:18.874279 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.874182 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sphj9\" (UniqueName: \"kubernetes.io/projected/79f147ec-24ff-4190-bdd9-c4552db1c883-kube-api-access-sphj9\") pod \"node-exporter-82tw7\" (UID: \"79f147ec-24ff-4190-bdd9-c4552db1c883\") " pod="openshift-monitoring/node-exporter-82tw7" Jun 11 23:11:18.874393 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:18.874293 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llpch\" (UniqueName: \"kubernetes.io/projected/811341ae-6172-4b68-ada2-858413c24d0f-kube-api-access-llpch\") pod \"kube-state-metrics-678bc549d7-h6mh9\" (UID: \"811341ae-6172-4b68-ada2-858413c24d0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h6mh9" Jun 11 23:11:19.261333 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.261251 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27da07e2-d8e4-4319-962c-5ab1bb12d90b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-r9dgv\" (UID: \"27da07e2-d8e4-4319-962c-5ab1bb12d90b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-r9dgv" Jun 11 23:11:19.263657 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.263633 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27da07e2-d8e4-4319-962c-5ab1bb12d90b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-r9dgv\" (UID: \"27da07e2-d8e4-4319-962c-5ab1bb12d90b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-r9dgv" Jun 11 23:11:19.361842 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.361802 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/811341ae-6172-4b68-ada2-858413c24d0f-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-h6mh9\" (UID: \"811341ae-6172-4b68-ada2-858413c24d0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h6mh9" Jun 11 23:11:19.362040 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.361871 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/79f147ec-24ff-4190-bdd9-c4552db1c883-node-exporter-tls\") pod \"node-exporter-82tw7\" (UID: \"79f147ec-24ff-4190-bdd9-c4552db1c883\") " pod="openshift-monitoring/node-exporter-82tw7" Jun 11 23:11:19.362040 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:11:19.361972 2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 23:11:19.362120 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:11:19.362053 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79f147ec-24ff-4190-bdd9-c4552db1c883-node-exporter-tls podName:79f147ec-24ff-4190-bdd9-c4552db1c883 nodeName:}" failed. No retries permitted until 2026-06-11 23:11:20.362038672 +0000 UTC m=+53.784823617 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/79f147ec-24ff-4190-bdd9-c4552db1c883-node-exporter-tls") pod "node-exporter-82tw7" (UID: "79f147ec-24ff-4190-bdd9-c4552db1c883") : secret "node-exporter-tls" not found Jun 11 23:11:19.364280 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.364256 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/811341ae-6172-4b68-ada2-858413c24d0f-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-h6mh9\" (UID: \"811341ae-6172-4b68-ada2-858413c24d0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h6mh9" Jun 11 23:11:19.551894 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.551804 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-r9dgv" Jun 11 23:11:19.603567 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.603543 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-h6mh9" Jun 11 23:11:19.641529 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.641488 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 23:11:19.670682 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.670581 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.673779 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.673594 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 23:11:19.674562 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.674474 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 23:11:19.676478 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.676443 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 23:11:19.676712 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.676691 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 23:11:19.677152 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.676913 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 23:11:19.677152 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.677140 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 23:11:19.677590 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.677554 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 23:11:19.678487 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.677826 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 23:11:19.678487 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.678058 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8l4s5\"" Jun 11 23:11:19.678487 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.678267 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 23:11:19.678487 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.678481 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 23:11:19.764623 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.764592 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-web-config\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.764775 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.764646 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6af73598-b3a0-4eeb-85b2-170cb4cdc210-config-out\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.764775 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.764673 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.764775 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.764694 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6af73598-b3a0-4eeb-85b2-170cb4cdc210-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.764775 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.764714 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.764923 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.764781 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6af73598-b3a0-4eeb-85b2-170cb4cdc210-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.764923 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.764811 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-config-volume\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.764923 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.764830 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6af73598-b3a0-4eeb-85b2-170cb4cdc210-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.764923 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.764847 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.764923 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.764864 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6af73598-b3a0-4eeb-85b2-170cb4cdc210-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.765321 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.764988 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.765321 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.765023 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.765321 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.765040 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctpmb\" (UniqueName: \"kubernetes.io/projected/6af73598-b3a0-4eeb-85b2-170cb4cdc210-kube-api-access-ctpmb\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.786554 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.786416 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-r9dgv"] Jun 11 23:11:19.789178 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:11:19.789155 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27da07e2_d8e4_4319_962c_5ab1bb12d90b.slice/crio-0fddb15753aefe4941e030dad1ce0218ba93da31c8c7db4b1f22039f29107f34 WatchSource:0}: Error finding container 0fddb15753aefe4941e030dad1ce0218ba93da31c8c7db4b1f22039f29107f34: Status 404 returned error can't find the container with id 0fddb15753aefe4941e030dad1ce0218ba93da31c8c7db4b1f22039f29107f34 Jun 11 23:11:19.795751 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.795729 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b6b4848f5-7zncs" Jun 11 23:11:19.795830 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.795781 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b6b4848f5-7zncs" Jun 11 23:11:19.797081 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.797051 2563 patch_prober.go:28] interesting pod/console-b6b4848f5-7zncs container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.10:8443/health\": dial tcp 10.134.0.10:8443: connect: connection refused" start-of-body= Jun 11 23:11:19.797180 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.797096 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-b6b4848f5-7zncs" podUID="745baec5-931e-48b1-bfec-8b95a571359b" containerName="console" probeResult="failure" output="Get \"https://10.134.0.10:8443/health\": dial tcp 10.134.0.10:8443: connect: connection refused" Jun 11 23:11:19.804083 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.804030 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-h6mh9"] Jun 11 23:11:19.807000 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:11:19.806960 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod811341ae_6172_4b68_ada2_858413c24d0f.slice/crio-0fe03e8f8629a8acb17a9e6fa5db4911a436186b20ba920f7a92dbdd2867b5f3 WatchSource:0}: Error finding container 0fe03e8f8629a8acb17a9e6fa5db4911a436186b20ba920f7a92dbdd2867b5f3: Status 404 returned error can't find the container with id 0fe03e8f8629a8acb17a9e6fa5db4911a436186b20ba920f7a92dbdd2867b5f3 Jun 11 23:11:19.866363 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.866335 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.866505 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.866366 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.866505 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.866389 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctpmb\" (UniqueName: \"kubernetes.io/projected/6af73598-b3a0-4eeb-85b2-170cb4cdc210-kube-api-access-ctpmb\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.866680 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.866568 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-web-config\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.866680 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.866636 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6af73598-b3a0-4eeb-85b2-170cb4cdc210-config-out\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.866680 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.866670 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.866844 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.866718 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6af73598-b3a0-4eeb-85b2-170cb4cdc210-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.866844 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.866748 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.866844 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.866801 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6af73598-b3a0-4eeb-85b2-170cb4cdc210-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.866844 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.866831 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-config-volume\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.867069 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.866886 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6af73598-b3a0-4eeb-85b2-170cb4cdc210-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.867069 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.866929 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.867069 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.866954 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6af73598-b3a0-4eeb-85b2-170cb4cdc210-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.868822 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.867939 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6af73598-b3a0-4eeb-85b2-170cb4cdc210-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.868822 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.868273 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6af73598-b3a0-4eeb-85b2-170cb4cdc210-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.869655 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.869628 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6af73598-b3a0-4eeb-85b2-170cb4cdc210-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.869754 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.869723 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.869821 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.869754 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6af73598-b3a0-4eeb-85b2-170cb4cdc210-config-out\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.869882 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.869870 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-web-config\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.870092 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.870068 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.870190 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.870116 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6af73598-b3a0-4eeb-85b2-170cb4cdc210-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.870425 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.870404 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.870739 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.870719 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.871501 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.871480 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.871823 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.871806 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-config-volume\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.894475 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.894455 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctpmb\" (UniqueName: \"kubernetes.io/projected/6af73598-b3a0-4eeb-85b2-170cb4cdc210-kube-api-access-ctpmb\") pod \"alertmanager-main-0\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:19.983830 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:19.983801 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:20.176521 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:20.176477 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 23:11:20.180757 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:11:20.180729 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6af73598_b3a0_4eeb_85b2_170cb4cdc210.slice/crio-c9798f1e710ec5b08a7ec230ad612ba95d88bfa3ffe9516dc2fcbeadf0cd7006 WatchSource:0}: Error finding container c9798f1e710ec5b08a7ec230ad612ba95d88bfa3ffe9516dc2fcbeadf0cd7006: Status 404 returned error can't find the container with id c9798f1e710ec5b08a7ec230ad612ba95d88bfa3ffe9516dc2fcbeadf0cd7006 Jun 11 23:11:20.283060 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:20.283024 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-r9dgv" event={"ID":"27da07e2-d8e4-4319-962c-5ab1bb12d90b","Type":"ContainerStarted","Data":"0ffce778024d46b5272c539036eacbc52c08f35111eea100fefeaeb1e2c8ecc8"} Jun 11 23:11:20.283232 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:20.283079 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-r9dgv" event={"ID":"27da07e2-d8e4-4319-962c-5ab1bb12d90b","Type":"ContainerStarted","Data":"0cb87260ecacf4d049cb7cb0b22d2b5f59d7544e1a50a65670e8dfb5fc44ebb4"} Jun 11 23:11:20.283232 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:20.283108 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-r9dgv" event={"ID":"27da07e2-d8e4-4319-962c-5ab1bb12d90b","Type":"ContainerStarted","Data":"0fddb15753aefe4941e030dad1ce0218ba93da31c8c7db4b1f22039f29107f34"} Jun 11 23:11:20.284181 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:20.284161 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-h6mh9" event={"ID":"811341ae-6172-4b68-ada2-858413c24d0f","Type":"ContainerStarted","Data":"0fe03e8f8629a8acb17a9e6fa5db4911a436186b20ba920f7a92dbdd2867b5f3"} Jun 11 23:11:20.285215 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:20.285191 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6af73598-b3a0-4eeb-85b2-170cb4cdc210","Type":"ContainerStarted","Data":"c9798f1e710ec5b08a7ec230ad612ba95d88bfa3ffe9516dc2fcbeadf0cd7006"} Jun 11 23:11:20.370655 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:20.370623 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/79f147ec-24ff-4190-bdd9-c4552db1c883-node-exporter-tls\") pod \"node-exporter-82tw7\" (UID: \"79f147ec-24ff-4190-bdd9-c4552db1c883\") " pod="openshift-monitoring/node-exporter-82tw7" Jun 11 23:11:20.373290 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:20.373258 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/79f147ec-24ff-4190-bdd9-c4552db1c883-node-exporter-tls\") pod \"node-exporter-82tw7\" (UID: \"79f147ec-24ff-4190-bdd9-c4552db1c883\") " pod="openshift-monitoring/node-exporter-82tw7" Jun 11 23:11:20.478885 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:20.478830 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-82tw7" Jun 11 23:11:20.507472 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:11:20.507438 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79f147ec_24ff_4190_bdd9_c4552db1c883.slice/crio-b55be10ccc01a0a9f14897ff0e0bf91a4995c61f460053cd8a48cf5759f4e65c WatchSource:0}: Error finding container b55be10ccc01a0a9f14897ff0e0bf91a4995c61f460053cd8a48cf5759f4e65c: Status 404 returned error can't find the container with id b55be10ccc01a0a9f14897ff0e0bf91a4995c61f460053cd8a48cf5759f4e65c Jun 11 23:11:21.161054 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.161017 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7fdf5fcd74-ccvmr" Jun 11 23:11:21.161488 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.161091 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7fdf5fcd74-ccvmr" Jun 11 23:11:21.162213 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.162193 2563 patch_prober.go:28] interesting pod/console-7fdf5fcd74-ccvmr container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.11:8443/health\": dial tcp 10.134.0.11:8443: connect: connection refused" start-of-body= Jun 11 23:11:21.162282 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.162232 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7fdf5fcd74-ccvmr" podUID="08265be8-968c-4081-867c-65662529deea" containerName="console" probeResult="failure" output="Get \"https://10.134.0.11:8443/health\": dial tcp 10.134.0.11:8443: connect: connection refused" Jun 11 23:11:21.293273 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.293225 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-82tw7" event={"ID":"79f147ec-24ff-4190-bdd9-c4552db1c883","Type":"ContainerStarted","Data":"b55be10ccc01a0a9f14897ff0e0bf91a4995c61f460053cd8a48cf5759f4e65c"} Jun 11 23:11:21.642817 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.642775 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-558d8445bd-v8tg9"] Jun 11 23:11:21.661241 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.661205 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-558d8445bd-v8tg9"] Jun 11 23:11:21.661430 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.661325 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" Jun 11 23:11:21.664436 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.664414 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 11 23:11:21.664436 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.664427 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 11 23:11:21.664634 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.664478 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 11 23:11:21.664634 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.664541 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 11 23:11:21.664634 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.664556 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 11 23:11:21.664827 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.664803 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-n8mmc\"" Jun 11 23:11:21.664905 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.664884 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-eqaf64e0csipv\"" Jun 11 23:11:21.683465 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.683435 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/28561be7-dd09-4680-a505-041bcced174d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-558d8445bd-v8tg9\" (UID: \"28561be7-dd09-4680-a505-041bcced174d\") " pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" Jun 11 23:11:21.683623 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.683562 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/28561be7-dd09-4680-a505-041bcced174d-secret-grpc-tls\") pod \"thanos-querier-558d8445bd-v8tg9\" (UID: \"28561be7-dd09-4680-a505-041bcced174d\") " pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" Jun 11 23:11:21.683623 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.683606 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/28561be7-dd09-4680-a505-041bcced174d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-558d8445bd-v8tg9\" (UID: \"28561be7-dd09-4680-a505-041bcced174d\") " pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" Jun 11 23:11:21.683729 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.683644 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/28561be7-dd09-4680-a505-041bcced174d-secret-thanos-querier-tls\") pod \"thanos-querier-558d8445bd-v8tg9\" (UID: \"28561be7-dd09-4680-a505-041bcced174d\") " pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" Jun 11 23:11:21.683729 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.683718 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/28561be7-dd09-4680-a505-041bcced174d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-558d8445bd-v8tg9\" (UID: \"28561be7-dd09-4680-a505-041bcced174d\") " pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" Jun 11 23:11:21.683808 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.683752 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/28561be7-dd09-4680-a505-041bcced174d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-558d8445bd-v8tg9\" (UID: \"28561be7-dd09-4680-a505-041bcced174d\") " pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" Jun 11 23:11:21.683808 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.683775 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28561be7-dd09-4680-a505-041bcced174d-metrics-client-ca\") pod \"thanos-querier-558d8445bd-v8tg9\" (UID: \"28561be7-dd09-4680-a505-041bcced174d\") " pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" Jun 11 23:11:21.683872 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.683812 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcmdx\" (UniqueName: \"kubernetes.io/projected/28561be7-dd09-4680-a505-041bcced174d-kube-api-access-pcmdx\") pod \"thanos-querier-558d8445bd-v8tg9\" (UID: \"28561be7-dd09-4680-a505-041bcced174d\") " pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" Jun 11 23:11:21.784767 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.784718 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/28561be7-dd09-4680-a505-041bcced174d-secret-grpc-tls\") pod \"thanos-querier-558d8445bd-v8tg9\" (UID: \"28561be7-dd09-4680-a505-041bcced174d\") " pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" Jun 11 23:11:21.784952 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.784788 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/28561be7-dd09-4680-a505-041bcced174d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-558d8445bd-v8tg9\" (UID: \"28561be7-dd09-4680-a505-041bcced174d\") " pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" Jun 11 23:11:21.784952 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.784862 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/28561be7-dd09-4680-a505-041bcced174d-secret-thanos-querier-tls\") pod \"thanos-querier-558d8445bd-v8tg9\" (UID: \"28561be7-dd09-4680-a505-041bcced174d\") " pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" Jun 11 23:11:21.784952 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.784907 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/28561be7-dd09-4680-a505-041bcced174d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-558d8445bd-v8tg9\" (UID: \"28561be7-dd09-4680-a505-041bcced174d\") " pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" Jun 11 23:11:21.784952 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.784943 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/28561be7-dd09-4680-a505-041bcced174d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-558d8445bd-v8tg9\" (UID: \"28561be7-dd09-4680-a505-041bcced174d\") " pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" Jun 11 23:11:21.785185 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.785087 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28561be7-dd09-4680-a505-041bcced174d-metrics-client-ca\") pod \"thanos-querier-558d8445bd-v8tg9\" (UID: \"28561be7-dd09-4680-a505-041bcced174d\") " pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" Jun 11 23:11:21.785185 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.785117 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcmdx\" (UniqueName: \"kubernetes.io/projected/28561be7-dd09-4680-a505-041bcced174d-kube-api-access-pcmdx\") pod \"thanos-querier-558d8445bd-v8tg9\" (UID: \"28561be7-dd09-4680-a505-041bcced174d\") " pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" Jun 11 23:11:21.785185 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.785150 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/28561be7-dd09-4680-a505-041bcced174d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-558d8445bd-v8tg9\" (UID: \"28561be7-dd09-4680-a505-041bcced174d\") " pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" Jun 11 23:11:21.786771 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.786716 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28561be7-dd09-4680-a505-041bcced174d-metrics-client-ca\") pod \"thanos-querier-558d8445bd-v8tg9\" (UID: \"28561be7-dd09-4680-a505-041bcced174d\") " pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" Jun 11 23:11:21.788036 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.788009 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/28561be7-dd09-4680-a505-041bcced174d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-558d8445bd-v8tg9\" (UID: \"28561be7-dd09-4680-a505-041bcced174d\") " pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" Jun 11 23:11:21.788457 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.788431 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/28561be7-dd09-4680-a505-041bcced174d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-558d8445bd-v8tg9\" (UID: \"28561be7-dd09-4680-a505-041bcced174d\") " pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" Jun 11 23:11:21.788558 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.788532 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/28561be7-dd09-4680-a505-041bcced174d-secret-grpc-tls\") pod \"thanos-querier-558d8445bd-v8tg9\" (UID: \"28561be7-dd09-4680-a505-041bcced174d\") " pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" Jun 11 23:11:21.789301 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.789253 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/28561be7-dd09-4680-a505-041bcced174d-secret-thanos-querier-tls\") pod \"thanos-querier-558d8445bd-v8tg9\" (UID: \"28561be7-dd09-4680-a505-041bcced174d\") " pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" Jun 11 23:11:21.789696 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.789672 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/28561be7-dd09-4680-a505-041bcced174d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-558d8445bd-v8tg9\" (UID: \"28561be7-dd09-4680-a505-041bcced174d\") " pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" Jun 11 23:11:21.791192 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.791143 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/28561be7-dd09-4680-a505-041bcced174d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-558d8445bd-v8tg9\" (UID: \"28561be7-dd09-4680-a505-041bcced174d\") " pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" Jun 11 23:11:21.799006 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.798947 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcmdx\" (UniqueName: \"kubernetes.io/projected/28561be7-dd09-4680-a505-041bcced174d-kube-api-access-pcmdx\") pod \"thanos-querier-558d8445bd-v8tg9\" (UID: \"28561be7-dd09-4680-a505-041bcced174d\") " pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" Jun 11 23:11:21.970553 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:21.970475 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" Jun 11 23:11:22.534857 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:22.534816 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-558d8445bd-v8tg9"] Jun 11 23:11:22.695040 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:11:22.694955 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28561be7_dd09_4680_a505_041bcced174d.slice/crio-03ad51588c76392db7e3d9d9290fd6c9736fc0bf6f70f8ec2dedd3669c0d3fde WatchSource:0}: Error finding container 03ad51588c76392db7e3d9d9290fd6c9736fc0bf6f70f8ec2dedd3669c0d3fde: Status 404 returned error can't find the container with id 03ad51588c76392db7e3d9d9290fd6c9736fc0bf6f70f8ec2dedd3669c0d3fde Jun 11 23:11:23.177515 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.177494 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5bdd4d99bf-h8kgz"] Jun 11 23:11:23.210319 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.210292 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5bdd4d99bf-h8kgz" Jun 11 23:11:23.215478 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.215119 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-bt69isokl1jfc\"" Jun 11 23:11:23.215478 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.215371 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-nsctq\"" Jun 11 23:11:23.215478 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.215423 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 23:11:23.216101 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.216065 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 11 23:11:23.216424 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.216294 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 11 23:11:23.216542 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.216467 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 11 23:11:23.262729 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.262697 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qk2pw" Jun 11 23:11:23.272503 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.272468 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5bdd4d99bf-h8kgz"] Jun 11 23:11:23.273488 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.273465 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b6b4848f5-7zncs"] Jun 11 23:11:23.297656 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.297621 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2c80a13b-3c21-4070-99a8-4fa82caba269-secret-metrics-server-client-certs\") pod \"metrics-server-5bdd4d99bf-h8kgz\" (UID: \"2c80a13b-3c21-4070-99a8-4fa82caba269\") " pod="openshift-monitoring/metrics-server-5bdd4d99bf-h8kgz" Jun 11 23:11:23.297847 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.297820 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c80a13b-3c21-4070-99a8-4fa82caba269-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bdd4d99bf-h8kgz\" (UID: \"2c80a13b-3c21-4070-99a8-4fa82caba269\") " pod="openshift-monitoring/metrics-server-5bdd4d99bf-h8kgz" Jun 11 23:11:23.298086 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.298061 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2c80a13b-3c21-4070-99a8-4fa82caba269-secret-metrics-server-tls\") pod \"metrics-server-5bdd4d99bf-h8kgz\" (UID: \"2c80a13b-3c21-4070-99a8-4fa82caba269\") " pod="openshift-monitoring/metrics-server-5bdd4d99bf-h8kgz" Jun 11 23:11:23.298185 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.298097 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5c4g\" (UniqueName: \"kubernetes.io/projected/2c80a13b-3c21-4070-99a8-4fa82caba269-kube-api-access-m5c4g\") pod \"metrics-server-5bdd4d99bf-h8kgz\" (UID: \"2c80a13b-3c21-4070-99a8-4fa82caba269\") " pod="openshift-monitoring/metrics-server-5bdd4d99bf-h8kgz" Jun 11 23:11:23.298185 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.298171 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2c80a13b-3c21-4070-99a8-4fa82caba269-metrics-server-audit-profiles\") pod \"metrics-server-5bdd4d99bf-h8kgz\" (UID: \"2c80a13b-3c21-4070-99a8-4fa82caba269\") " pod="openshift-monitoring/metrics-server-5bdd4d99bf-h8kgz" Jun 11 23:11:23.298287 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.298239 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2c80a13b-3c21-4070-99a8-4fa82caba269-audit-log\") pod \"metrics-server-5bdd4d99bf-h8kgz\" (UID: \"2c80a13b-3c21-4070-99a8-4fa82caba269\") " pod="openshift-monitoring/metrics-server-5bdd4d99bf-h8kgz" Jun 11 23:11:23.298287 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.298263 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c80a13b-3c21-4070-99a8-4fa82caba269-client-ca-bundle\") pod \"metrics-server-5bdd4d99bf-h8kgz\" (UID: \"2c80a13b-3c21-4070-99a8-4fa82caba269\") " pod="openshift-monitoring/metrics-server-5bdd4d99bf-h8kgz" Jun 11 23:11:23.306153 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.305173 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-r9dgv" event={"ID":"27da07e2-d8e4-4319-962c-5ab1bb12d90b","Type":"ContainerStarted","Data":"02e12062d0166f0bb93b52407e924a4527ef662f46fccb3fb92e5757e906e8ca"} Jun 11 23:11:23.308042 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.308013 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" event={"ID":"28561be7-dd09-4680-a505-041bcced174d","Type":"ContainerStarted","Data":"03ad51588c76392db7e3d9d9290fd6c9736fc0bf6f70f8ec2dedd3669c0d3fde"} Jun 11 23:11:23.311116 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.311073 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-h6mh9" event={"ID":"811341ae-6172-4b68-ada2-858413c24d0f","Type":"ContainerStarted","Data":"ddfd9699fa1952f48a55be9cf8c0839e8d69135df09396be31b107477fb56ac7"} Jun 11 23:11:23.311310 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.311140 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-h6mh9" event={"ID":"811341ae-6172-4b68-ada2-858413c24d0f","Type":"ContainerStarted","Data":"a7960b2a0741a9eb987505dc53bfe117276448509a09bf6522a6feaf1f783938"} Jun 11 23:11:23.311310 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.311173 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-h6mh9" event={"ID":"811341ae-6172-4b68-ada2-858413c24d0f","Type":"ContainerStarted","Data":"6a1e757d5e59011e46d5db98468d57b2bb58638a5f5b01b2c1448603898818e2"} Jun 11 23:11:23.313028 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.312916 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-82tw7" event={"ID":"79f147ec-24ff-4190-bdd9-c4552db1c883","Type":"ContainerStarted","Data":"c622ae1dbc05a665a6f3506ce5ff05e0a70540056df20ab4062fa80168690811"} Jun 11 23:11:23.315235 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.315209 2563 generic.go:356] "Generic (PLEG): container finished" podID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" containerID="1dc55552968bddab86f072b98de797f83e149225fd4ca43fe29c2f898bf0f631" exitCode=0 Jun 11 23:11:23.315341 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.315278 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6af73598-b3a0-4eeb-85b2-170cb4cdc210","Type":"ContainerDied","Data":"1dc55552968bddab86f072b98de797f83e149225fd4ca43fe29c2f898bf0f631"} Jun 11 23:11:23.341713 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.341625 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-pft7t"] Jun 11 23:11:23.357825 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.357120 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6dfbf98945-xm8g2"] Jun 11 23:11:23.357825 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.357205 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-pft7t" Jun 11 23:11:23.369873 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.369823 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-pft7t"] Jun 11 23:11:23.369873 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.369863 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dfbf98945-xm8g2"] Jun 11 23:11:23.370068 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.369939 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dfbf98945-xm8g2" Jun 11 23:11:23.370646 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.370454 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-qkd57\"" Jun 11 23:11:23.373046 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.372842 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 11 23:11:23.399608 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.399577 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c80a13b-3c21-4070-99a8-4fa82caba269-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bdd4d99bf-h8kgz\" (UID: \"2c80a13b-3c21-4070-99a8-4fa82caba269\") " pod="openshift-monitoring/metrics-server-5bdd4d99bf-h8kgz" Jun 11 23:11:23.399727 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.399643 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7sk7\" (UniqueName: \"kubernetes.io/projected/69a7f58f-1787-4ceb-b79c-a06688aabbef-kube-api-access-x7sk7\") pod \"console-6dfbf98945-xm8g2\" (UID: \"69a7f58f-1787-4ceb-b79c-a06688aabbef\") " pod="openshift-console/console-6dfbf98945-xm8g2" Jun 11 23:11:23.399802 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.399735 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69a7f58f-1787-4ceb-b79c-a06688aabbef-console-serving-cert\") pod \"console-6dfbf98945-xm8g2\" (UID: \"69a7f58f-1787-4ceb-b79c-a06688aabbef\") " pod="openshift-console/console-6dfbf98945-xm8g2" Jun 11 23:11:23.399856 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.399799 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2c80a13b-3c21-4070-99a8-4fa82caba269-secret-metrics-server-tls\") pod \"metrics-server-5bdd4d99bf-h8kgz\" (UID: \"2c80a13b-3c21-4070-99a8-4fa82caba269\") " pod="openshift-monitoring/metrics-server-5bdd4d99bf-h8kgz" Jun 11 23:11:23.399856 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.399826 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5c4g\" (UniqueName: \"kubernetes.io/projected/2c80a13b-3c21-4070-99a8-4fa82caba269-kube-api-access-m5c4g\") pod \"metrics-server-5bdd4d99bf-h8kgz\" (UID: \"2c80a13b-3c21-4070-99a8-4fa82caba269\") " pod="openshift-monitoring/metrics-server-5bdd4d99bf-h8kgz" Jun 11 23:11:23.399963 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.399869 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e7198ab7-2dbb-45a1-9e52-6f3bee93d2ae-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-pft7t\" (UID: \"e7198ab7-2dbb-45a1-9e52-6f3bee93d2ae\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-pft7t" Jun 11 23:11:23.399963 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.399893 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69a7f58f-1787-4ceb-b79c-a06688aabbef-console-oauth-config\") pod \"console-6dfbf98945-xm8g2\" (UID: \"69a7f58f-1787-4ceb-b79c-a06688aabbef\") " pod="openshift-console/console-6dfbf98945-xm8g2" Jun 11 23:11:23.400071 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.400053 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27b9w\" (UniqueName: \"kubernetes.io/projected/e7198ab7-2dbb-45a1-9e52-6f3bee93d2ae-kube-api-access-27b9w\") pod \"monitoring-plugin-589576dfc7-pft7t\" (UID: \"e7198ab7-2dbb-45a1-9e52-6f3bee93d2ae\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-pft7t" Jun 11 23:11:23.400117 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.400098 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2c80a13b-3c21-4070-99a8-4fa82caba269-metrics-server-audit-profiles\") pod \"metrics-server-5bdd4d99bf-h8kgz\" (UID: \"2c80a13b-3c21-4070-99a8-4fa82caba269\") " pod="openshift-monitoring/metrics-server-5bdd4d99bf-h8kgz" Jun 11 23:11:23.400167 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.400142 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69a7f58f-1787-4ceb-b79c-a06688aabbef-console-config\") pod \"console-6dfbf98945-xm8g2\" (UID: \"69a7f58f-1787-4ceb-b79c-a06688aabbef\") " pod="openshift-console/console-6dfbf98945-xm8g2" Jun 11 23:11:23.402039 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.401395 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2c80a13b-3c21-4070-99a8-4fa82caba269-metrics-server-audit-profiles\") pod \"metrics-server-5bdd4d99bf-h8kgz\" (UID: \"2c80a13b-3c21-4070-99a8-4fa82caba269\") " pod="openshift-monitoring/metrics-server-5bdd4d99bf-h8kgz" Jun 11 23:11:23.402039 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.401715 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69a7f58f-1787-4ceb-b79c-a06688aabbef-service-ca\") pod \"console-6dfbf98945-xm8g2\" (UID: \"69a7f58f-1787-4ceb-b79c-a06688aabbef\") " pod="openshift-console/console-6dfbf98945-xm8g2" Jun 11 23:11:23.402039 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.401750 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69a7f58f-1787-4ceb-b79c-a06688aabbef-trusted-ca-bundle\") pod \"console-6dfbf98945-xm8g2\" (UID: \"69a7f58f-1787-4ceb-b79c-a06688aabbef\") " pod="openshift-console/console-6dfbf98945-xm8g2" Jun 11 23:11:23.402039 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.401781 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69a7f58f-1787-4ceb-b79c-a06688aabbef-oauth-serving-cert\") pod \"console-6dfbf98945-xm8g2\" (UID: \"69a7f58f-1787-4ceb-b79c-a06688aabbef\") " pod="openshift-console/console-6dfbf98945-xm8g2" Jun 11 23:11:23.402039 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.401829 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2c80a13b-3c21-4070-99a8-4fa82caba269-audit-log\") pod \"metrics-server-5bdd4d99bf-h8kgz\" (UID: \"2c80a13b-3c21-4070-99a8-4fa82caba269\") " pod="openshift-monitoring/metrics-server-5bdd4d99bf-h8kgz" Jun 11 23:11:23.402039 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.401855 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c80a13b-3c21-4070-99a8-4fa82caba269-client-ca-bundle\") pod \"metrics-server-5bdd4d99bf-h8kgz\" (UID: \"2c80a13b-3c21-4070-99a8-4fa82caba269\") " pod="openshift-monitoring/metrics-server-5bdd4d99bf-h8kgz" Jun 11 23:11:23.402039 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.401933 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2c80a13b-3c21-4070-99a8-4fa82caba269-secret-metrics-server-client-certs\") pod \"metrics-server-5bdd4d99bf-h8kgz\" (UID: \"2c80a13b-3c21-4070-99a8-4fa82caba269\") " pod="openshift-monitoring/metrics-server-5bdd4d99bf-h8kgz" Jun 11 23:11:23.402837 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.402810 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c80a13b-3c21-4070-99a8-4fa82caba269-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bdd4d99bf-h8kgz\" (UID: \"2c80a13b-3c21-4070-99a8-4fa82caba269\") " pod="openshift-monitoring/metrics-server-5bdd4d99bf-h8kgz" Jun 11 23:11:23.403272 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.403240 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2c80a13b-3c21-4070-99a8-4fa82caba269-audit-log\") pod \"metrics-server-5bdd4d99bf-h8kgz\" (UID: \"2c80a13b-3c21-4070-99a8-4fa82caba269\") " pod="openshift-monitoring/metrics-server-5bdd4d99bf-h8kgz" Jun 11 23:11:23.403486 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.403459 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2c80a13b-3c21-4070-99a8-4fa82caba269-secret-metrics-server-tls\") pod \"metrics-server-5bdd4d99bf-h8kgz\" (UID: \"2c80a13b-3c21-4070-99a8-4fa82caba269\") " pod="openshift-monitoring/metrics-server-5bdd4d99bf-h8kgz" Jun 11 23:11:23.406022 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.405999 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c80a13b-3c21-4070-99a8-4fa82caba269-client-ca-bundle\") pod \"metrics-server-5bdd4d99bf-h8kgz\" (UID: \"2c80a13b-3c21-4070-99a8-4fa82caba269\") " pod="openshift-monitoring/metrics-server-5bdd4d99bf-h8kgz" Jun 11 23:11:23.406149 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.406131 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2c80a13b-3c21-4070-99a8-4fa82caba269-secret-metrics-server-client-certs\") pod \"metrics-server-5bdd4d99bf-h8kgz\" (UID: \"2c80a13b-3c21-4070-99a8-4fa82caba269\") " pod="openshift-monitoring/metrics-server-5bdd4d99bf-h8kgz" Jun 11 23:11:23.419452 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.419434 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5c4g\" (UniqueName: \"kubernetes.io/projected/2c80a13b-3c21-4070-99a8-4fa82caba269-kube-api-access-m5c4g\") pod \"metrics-server-5bdd4d99bf-h8kgz\" (UID: \"2c80a13b-3c21-4070-99a8-4fa82caba269\") " pod="openshift-monitoring/metrics-server-5bdd4d99bf-h8kgz" Jun 11 23:11:23.444952 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.444890 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-h6mh9" podStartSLOduration=2.864121703 podStartE2EDuration="5.44487273s" totalImagesPullingTime="2.580751027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:11:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:23.443653377 +0000 UTC m=+56.866438345" watchObservedRunningTime="2026-06-11 23:11:23.44487273 +0000 UTC m=+56.867657697" Jun 11 23:11:23.502693 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.502606 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7sk7\" (UniqueName: \"kubernetes.io/projected/69a7f58f-1787-4ceb-b79c-a06688aabbef-kube-api-access-x7sk7\") pod \"console-6dfbf98945-xm8g2\" (UID: \"69a7f58f-1787-4ceb-b79c-a06688aabbef\") " pod="openshift-console/console-6dfbf98945-xm8g2" Jun 11 23:11:23.502693 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.502658 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69a7f58f-1787-4ceb-b79c-a06688aabbef-console-serving-cert\") pod \"console-6dfbf98945-xm8g2\" (UID: \"69a7f58f-1787-4ceb-b79c-a06688aabbef\") " pod="openshift-console/console-6dfbf98945-xm8g2" Jun 11 23:11:23.502693 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.502690 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e7198ab7-2dbb-45a1-9e52-6f3bee93d2ae-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-pft7t\" (UID: \"e7198ab7-2dbb-45a1-9e52-6f3bee93d2ae\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-pft7t" Jun 11 23:11:23.502951 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.502716 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69a7f58f-1787-4ceb-b79c-a06688aabbef-console-oauth-config\") pod \"console-6dfbf98945-xm8g2\" (UID: \"69a7f58f-1787-4ceb-b79c-a06688aabbef\") " pod="openshift-console/console-6dfbf98945-xm8g2" Jun 11 23:11:23.502951 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.502762 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27b9w\" (UniqueName: \"kubernetes.io/projected/e7198ab7-2dbb-45a1-9e52-6f3bee93d2ae-kube-api-access-27b9w\") pod \"monitoring-plugin-589576dfc7-pft7t\" (UID: \"e7198ab7-2dbb-45a1-9e52-6f3bee93d2ae\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-pft7t" Jun 11 23:11:23.502951 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.502798 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69a7f58f-1787-4ceb-b79c-a06688aabbef-console-config\") pod \"console-6dfbf98945-xm8g2\" (UID: \"69a7f58f-1787-4ceb-b79c-a06688aabbef\") " pod="openshift-console/console-6dfbf98945-xm8g2" Jun 11 23:11:23.502951 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.502826 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69a7f58f-1787-4ceb-b79c-a06688aabbef-service-ca\") pod \"console-6dfbf98945-xm8g2\" (UID: \"69a7f58f-1787-4ceb-b79c-a06688aabbef\") " pod="openshift-console/console-6dfbf98945-xm8g2" Jun 11 23:11:23.502951 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.502853 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69a7f58f-1787-4ceb-b79c-a06688aabbef-trusted-ca-bundle\") pod \"console-6dfbf98945-xm8g2\" (UID: \"69a7f58f-1787-4ceb-b79c-a06688aabbef\") " pod="openshift-console/console-6dfbf98945-xm8g2" Jun 11 23:11:23.502951 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.502891 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69a7f58f-1787-4ceb-b79c-a06688aabbef-oauth-serving-cert\") pod \"console-6dfbf98945-xm8g2\" (UID: \"69a7f58f-1787-4ceb-b79c-a06688aabbef\") " pod="openshift-console/console-6dfbf98945-xm8g2" Jun 11 23:11:23.503706 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.503684 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69a7f58f-1787-4ceb-b79c-a06688aabbef-console-config\") pod \"console-6dfbf98945-xm8g2\" (UID: \"69a7f58f-1787-4ceb-b79c-a06688aabbef\") " pod="openshift-console/console-6dfbf98945-xm8g2" Jun 11 23:11:23.503824 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.503804 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69a7f58f-1787-4ceb-b79c-a06688aabbef-oauth-serving-cert\") pod \"console-6dfbf98945-xm8g2\" (UID: \"69a7f58f-1787-4ceb-b79c-a06688aabbef\") " pod="openshift-console/console-6dfbf98945-xm8g2" Jun 11 23:11:23.503885 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.503837 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69a7f58f-1787-4ceb-b79c-a06688aabbef-service-ca\") pod \"console-6dfbf98945-xm8g2\" (UID: \"69a7f58f-1787-4ceb-b79c-a06688aabbef\") " pod="openshift-console/console-6dfbf98945-xm8g2" Jun 11 23:11:23.504663 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.504633 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69a7f58f-1787-4ceb-b79c-a06688aabbef-trusted-ca-bundle\") pod \"console-6dfbf98945-xm8g2\" (UID: \"69a7f58f-1787-4ceb-b79c-a06688aabbef\") " pod="openshift-console/console-6dfbf98945-xm8g2" Jun 11 23:11:23.505727 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.505702 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e7198ab7-2dbb-45a1-9e52-6f3bee93d2ae-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-pft7t\" (UID: \"e7198ab7-2dbb-45a1-9e52-6f3bee93d2ae\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-pft7t" Jun 11 23:11:23.505835 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.505809 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69a7f58f-1787-4ceb-b79c-a06688aabbef-console-oauth-config\") pod \"console-6dfbf98945-xm8g2\" (UID: \"69a7f58f-1787-4ceb-b79c-a06688aabbef\") " pod="openshift-console/console-6dfbf98945-xm8g2" Jun 11 23:11:23.506340 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.506321 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69a7f58f-1787-4ceb-b79c-a06688aabbef-console-serving-cert\") pod \"console-6dfbf98945-xm8g2\" (UID: \"69a7f58f-1787-4ceb-b79c-a06688aabbef\") " pod="openshift-console/console-6dfbf98945-xm8g2" Jun 11 23:11:23.523529 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.523505 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7sk7\" (UniqueName: \"kubernetes.io/projected/69a7f58f-1787-4ceb-b79c-a06688aabbef-kube-api-access-x7sk7\") pod \"console-6dfbf98945-xm8g2\" (UID: \"69a7f58f-1787-4ceb-b79c-a06688aabbef\") " pod="openshift-console/console-6dfbf98945-xm8g2" Jun 11 23:11:23.524180 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.524141 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5bdd4d99bf-h8kgz" Jun 11 23:11:23.528335 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.528314 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27b9w\" (UniqueName: \"kubernetes.io/projected/e7198ab7-2dbb-45a1-9e52-6f3bee93d2ae-kube-api-access-27b9w\") pod \"monitoring-plugin-589576dfc7-pft7t\" (UID: \"e7198ab7-2dbb-45a1-9e52-6f3bee93d2ae\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-pft7t" Jun 11 23:11:23.541788 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.541584 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-r9dgv" podStartSLOduration=3.211405788 podStartE2EDuration="5.541563441s" totalImagesPullingTime="2.330157653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:11:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:23.540773206 +0000 UTC m=+56.963558175" watchObservedRunningTime="2026-06-11 23:11:23.541563441 +0000 UTC m=+56.964348409" Jun 11 23:11:23.672694 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.672644 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-pft7t" Jun 11 23:11:23.682953 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.682925 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dfbf98945-xm8g2" Jun 11 23:11:23.703705 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.703503 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5bdd4d99bf-h8kgz"] Jun 11 23:11:23.705848 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:11:23.705825 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c80a13b_3c21_4070_99a8_4fa82caba269.slice/crio-eab2f1bd2ae91e0be2220f24797dc0ad5346f562537a30844008b9197e23876b WatchSource:0}: Error finding container eab2f1bd2ae91e0be2220f24797dc0ad5346f562537a30844008b9197e23876b: Status 404 returned error can't find the container with id eab2f1bd2ae91e0be2220f24797dc0ad5346f562537a30844008b9197e23876b Jun 11 23:11:23.922027 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.921929 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-pft7t"] Jun 11 23:11:23.926190 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:11:23.926154 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7198ab7_2dbb_45a1_9e52_6f3bee93d2ae.slice/crio-004b894f38566c80822a2ec650af71b811a34a9d7da1a2bb785228d2335fe068 WatchSource:0}: Error finding container 004b894f38566c80822a2ec650af71b811a34a9d7da1a2bb785228d2335fe068: Status 404 returned error can't find the container with id 004b894f38566c80822a2ec650af71b811a34a9d7da1a2bb785228d2335fe068 Jun 11 23:11:23.934668 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:23.934327 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dfbf98945-xm8g2"] Jun 11 23:11:23.937027 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:11:23.936997 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69a7f58f_1787_4ceb_b79c_a06688aabbef.slice/crio-604f81fbfa04600c6e3531b26555e8bf999e700fb84703f536ec3140576b17ed WatchSource:0}: Error finding container 604f81fbfa04600c6e3531b26555e8bf999e700fb84703f536ec3140576b17ed: Status 404 returned error can't find the container with id 604f81fbfa04600c6e3531b26555e8bf999e700fb84703f536ec3140576b17ed Jun 11 23:11:24.322764 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:24.322592 2563 generic.go:356] "Generic (PLEG): container finished" podID="79f147ec-24ff-4190-bdd9-c4552db1c883" containerID="c622ae1dbc05a665a6f3506ce5ff05e0a70540056df20ab4062fa80168690811" exitCode=0 Jun 11 23:11:24.322764 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:24.322705 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-82tw7" event={"ID":"79f147ec-24ff-4190-bdd9-c4552db1c883","Type":"ContainerDied","Data":"c622ae1dbc05a665a6f3506ce5ff05e0a70540056df20ab4062fa80168690811"} Jun 11 23:11:24.325331 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:24.325269 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-pft7t" event={"ID":"e7198ab7-2dbb-45a1-9e52-6f3bee93d2ae","Type":"ContainerStarted","Data":"004b894f38566c80822a2ec650af71b811a34a9d7da1a2bb785228d2335fe068"} Jun 11 23:11:24.326774 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:24.326734 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5bdd4d99bf-h8kgz" event={"ID":"2c80a13b-3c21-4070-99a8-4fa82caba269","Type":"ContainerStarted","Data":"eab2f1bd2ae91e0be2220f24797dc0ad5346f562537a30844008b9197e23876b"} Jun 11 23:11:24.329653 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:24.329140 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dfbf98945-xm8g2" event={"ID":"69a7f58f-1787-4ceb-b79c-a06688aabbef","Type":"ContainerStarted","Data":"26a1bdd0db4521a9d76c9620977e3515733d058fb0a645730703d7457db77c56"} Jun 11 23:11:24.329653 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:24.329190 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dfbf98945-xm8g2" event={"ID":"69a7f58f-1787-4ceb-b79c-a06688aabbef","Type":"ContainerStarted","Data":"604f81fbfa04600c6e3531b26555e8bf999e700fb84703f536ec3140576b17ed"} Jun 11 23:11:24.395857 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:24.395794 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6dfbf98945-xm8g2" podStartSLOduration=1.395770404 podStartE2EDuration="1.395770404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:11:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:24.394659509 +0000 UTC m=+57.817444482" watchObservedRunningTime="2026-06-11 23:11:24.395770404 +0000 UTC m=+57.818555365" Jun 11 23:11:25.105951 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.105917 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 23:11:25.116642 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.116612 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.122672 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.122640 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 23:11:25.122672 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.122663 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 23:11:25.122850 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.122663 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bak9uuu8990dm\"" Jun 11 23:11:25.127725 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.127704 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 23:11:25.127858 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.127801 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 23:11:25.128446 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.128426 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 23:11:25.128446 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.128440 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 23:11:25.128594 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.128572 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 23:11:25.128683 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.128663 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 23:11:25.129319 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.128942 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 23:11:25.129319 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.129167 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 23:11:25.129319 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.129183 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 23:11:25.129509 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.129481 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 23:11:25.129608 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.129590 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-cvrvd\"" Jun 11 23:11:25.130925 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.130905 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 23:11:25.138618 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.138594 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 23:11:25.183491 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.183457 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 23:11:25.226063 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.222519 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.226063 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.222572 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-config-out\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.226063 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.222630 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.226063 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.222674 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.226063 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.222709 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.226063 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.222746 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.226063 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.222775 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.226063 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.222805 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.226063 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.222859 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.226063 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.222911 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.226063 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.223088 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.226063 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.223126 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.226063 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.223154 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsj56\" (UniqueName: \"kubernetes.io/projected/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-kube-api-access-dsj56\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.226063 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.223193 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.226063 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.223267 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-config\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.226063 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.223296 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.226812 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.223336 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-web-config\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.226812 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.223366 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.226812 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.223452 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.226812 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.223500 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.324815 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.324773 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.324991 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.324855 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.324991 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.324885 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-config-out\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.324991 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.324919 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.324991 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.324949 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.324991 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.324990 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.325219 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.325023 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.325219 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.325051 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.325219 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.325075 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.325219 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.325114 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.325219 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.325141 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.325219 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.325166 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.325964 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.325937 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.326074 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.325946 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.326074 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.326028 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsj56\" (UniqueName: \"kubernetes.io/projected/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-kube-api-access-dsj56\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.326074 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.326064 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.326221 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.326131 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-config\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.326221 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.326156 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.326221 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.326189 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-web-config\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.326221 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.326217 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.326415 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.326294 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.327888 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.327573 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.328970 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.328940 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.329490 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.329461 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.329804 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.329783 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.331162 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.330434 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.331162 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.330456 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.331162 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.330909 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.331162 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.331042 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-web-config\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.331162 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.331070 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.332823 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.332756 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-config-out\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.333364 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.333316 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.333364 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.333328 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.333364 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.333350 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-config\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.333575 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.333328 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.333835 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.333810 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.334183 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.334163 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.335273 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.335241 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.336422 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.336372 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.341886 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.341841 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsj56\" (UniqueName: \"kubernetes.io/projected/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-kube-api-access-dsj56\") pod \"prometheus-k8s-0\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:25.427815 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:25.427783 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:26.085228 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:26.085046 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 23:11:26.092456 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:11:26.091464 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod376d9ba1_6c0e_4c3c_9b01_510de93b6caa.slice/crio-fa90d371a8ba8f76798e3094eec7c8099229203c5ff7398426b2d1d30711e5f4 WatchSource:0}: Error finding container fa90d371a8ba8f76798e3094eec7c8099229203c5ff7398426b2d1d30711e5f4: Status 404 returned error can't find the container with id fa90d371a8ba8f76798e3094eec7c8099229203c5ff7398426b2d1d30711e5f4 Jun 11 23:11:26.346689 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:26.346603 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5bdd4d99bf-h8kgz" event={"ID":"2c80a13b-3c21-4070-99a8-4fa82caba269","Type":"ContainerStarted","Data":"0fb85dac893de5b8f4b24526e7570ca9e03f0e4bd7adaa08050795b281a9c88d"} Jun 11 23:11:26.348424 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:26.348398 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"376d9ba1-6c0e-4c3c-9b01-510de93b6caa","Type":"ContainerStarted","Data":"f7756ddca2a222579242331af6a84e33ae9e00a5e082401f82cf27845e7e4b92"} Jun 11 23:11:26.348539 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:26.348484 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"376d9ba1-6c0e-4c3c-9b01-510de93b6caa","Type":"ContainerStarted","Data":"fa90d371a8ba8f76798e3094eec7c8099229203c5ff7398426b2d1d30711e5f4"} Jun 11 23:11:26.350627 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:26.350593 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" event={"ID":"28561be7-dd09-4680-a505-041bcced174d","Type":"ContainerStarted","Data":"0c1434ac749673369e31a8465bdf83ab3ec531eabc78a050a5f95964772ad016"} Jun 11 23:11:26.350720 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:26.350668 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" event={"ID":"28561be7-dd09-4680-a505-041bcced174d","Type":"ContainerStarted","Data":"0fda775ff22b7bcccf3869e0f2008342884bcd5b19d1df83fa5cae73796ad14a"} Jun 11 23:11:26.350720 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:26.350710 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" event={"ID":"28561be7-dd09-4680-a505-041bcced174d","Type":"ContainerStarted","Data":"387db45a9718592d3dada2ab485dbb46aaa227fc29fcb5e1ae33747589ff759d"} Jun 11 23:11:26.353166 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:26.353144 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-82tw7" event={"ID":"79f147ec-24ff-4190-bdd9-c4552db1c883","Type":"ContainerStarted","Data":"4df92bcac4a0c1ab6a03686be94678c33a0c95a73f0a121e28cca725455ffdad"} Jun 11 23:11:26.353259 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:26.353191 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-82tw7" event={"ID":"79f147ec-24ff-4190-bdd9-c4552db1c883","Type":"ContainerStarted","Data":"ba3923c085b0f25fed6b63cd536018556ac6825fce11320216305e86ea9eb035"} Jun 11 23:11:26.357149 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:26.357127 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6af73598-b3a0-4eeb-85b2-170cb4cdc210","Type":"ContainerStarted","Data":"bf6d6f87ecd42bc249a7872820f22aee3842a9a4d177bacd8a91ea41006983a0"} Jun 11 23:11:26.357229 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:26.357190 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6af73598-b3a0-4eeb-85b2-170cb4cdc210","Type":"ContainerStarted","Data":"feedf5d3176106bae96ba2e43a9ce6396a9eefe94c7d96af1fa07ddf05acc0df"} Jun 11 23:11:26.357277 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:26.357231 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6af73598-b3a0-4eeb-85b2-170cb4cdc210","Type":"ContainerStarted","Data":"c64d0e4a5bf959aab699dd515f5fbdef27ce19beba563a367dc57676dcbd035b"} Jun 11 23:11:26.357277 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:26.357269 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6af73598-b3a0-4eeb-85b2-170cb4cdc210","Type":"ContainerStarted","Data":"f87af97e17268e4ef3f9f63ec5679bacab79a4bcd9d8685978ad00b04ef6b8c5"} Jun 11 23:11:26.372308 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:26.372264 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5bdd4d99bf-h8kgz" podStartSLOduration=1.22938657 podStartE2EDuration="3.372251944s" totalImagesPullingTime="2.142865374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:11:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:26.371200839 +0000 UTC m=+59.793985807" watchObservedRunningTime="2026-06-11 23:11:26.372251944 +0000 UTC m=+59.795036915" Jun 11 23:11:26.399341 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:26.399284 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-82tw7" podStartSLOduration=5.665256182 podStartE2EDuration="8.399267275s" totalImagesPullingTime="2.613993903s" totalInitContainerRuntime="120.01719ms" isStatefulPod=true podCreationTimestamp="2026-06-11 23:11:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:26.397226722 +0000 UTC m=+59.820011690" watchObservedRunningTime="2026-06-11 23:11:26.399267275 +0000 UTC m=+59.822052222" Jun 11 23:11:27.174153 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:27.174092 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgd" Jun 11 23:11:27.364162 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:27.364122 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-pft7t" event={"ID":"e7198ab7-2dbb-45a1-9e52-6f3bee93d2ae","Type":"ContainerStarted","Data":"3c407cf099c7af50736830bc7cdff7b645d5dfdce5bb99295d25374ea0e93c0f"} Jun 11 23:11:27.364581 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:27.364477 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-pft7t" Jun 11 23:11:27.365818 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:27.365793 2563 generic.go:356] "Generic (PLEG): container finished" podID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" containerID="f7756ddca2a222579242331af6a84e33ae9e00a5e082401f82cf27845e7e4b92" exitCode=0 Jun 11 23:11:27.365932 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:27.365871 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"376d9ba1-6c0e-4c3c-9b01-510de93b6caa","Type":"ContainerDied","Data":"f7756ddca2a222579242331af6a84e33ae9e00a5e082401f82cf27845e7e4b92"} Jun 11 23:11:27.369344 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:27.369316 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" event={"ID":"28561be7-dd09-4680-a505-041bcced174d","Type":"ContainerStarted","Data":"30f542a32da678771aef06565ad8392d9016019712a93fb159ffe3024b5d1b71"} Jun 11 23:11:27.369448 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:27.369388 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" Jun 11 23:11:27.369502 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:27.369479 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" event={"ID":"28561be7-dd09-4680-a505-041bcced174d","Type":"ContainerStarted","Data":"55fe9e074f8abe37cb8ea3374dfdb0d50bdf9b2731eb5205941ff22e2f35c289"} Jun 11 23:11:27.369562 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:27.369521 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" event={"ID":"28561be7-dd09-4680-a505-041bcced174d","Type":"ContainerStarted","Data":"2056bbd204973dc5c0ccf1719112958fee212b9d2e2d9342c71702776e72c722"} Jun 11 23:11:27.370816 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:27.370798 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-pft7t" Jun 11 23:11:27.372730 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:27.372710 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6af73598-b3a0-4eeb-85b2-170cb4cdc210","Type":"ContainerStarted","Data":"2cce1f5dc03c75e14d7be48c80b6aa2bd1cc3b712f71cdf5fde4ea6eecc8f5aa"} Jun 11 23:11:27.372830 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:27.372771 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6af73598-b3a0-4eeb-85b2-170cb4cdc210","Type":"ContainerStarted","Data":"c1e2faf0f1df5ce24441a190e28099f2972df91f2f2c70b30683dcc7a559fbfc"} Jun 11 23:11:27.384538 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:27.384489 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-pft7t" podStartSLOduration=1.667909595 podStartE2EDuration="4.384473663s" totalImagesPullingTime="2.716564068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:11:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:27.383990194 +0000 UTC m=+60.806775159" watchObservedRunningTime="2026-06-11 23:11:27.384473663 +0000 UTC m=+60.807258633" Jun 11 23:11:27.416535 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:27.416497 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" podStartSLOduration=2.374495872 podStartE2EDuration="6.41648464s" totalImagesPullingTime="4.041988768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:11:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:27.415680203 +0000 UTC m=+60.838465181" watchObservedRunningTime="2026-06-11 23:11:27.41648464 +0000 UTC m=+60.839269607" Jun 11 23:11:27.560483 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:27.560426 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.388000627 podStartE2EDuration="8.560407736s" totalImagesPullingTime="5.141420117s" totalInitContainerRuntime="30.986992ms" isStatefulPod=false podCreationTimestamp="2026-06-11 23:11:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:27.558500282 +0000 UTC m=+60.981285271" watchObservedRunningTime="2026-06-11 23:11:27.560407736 +0000 UTC m=+60.983192702" Jun 11 23:11:31.165296 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:31.165267 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7fdf5fcd74-ccvmr" Jun 11 23:11:31.168918 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:31.168897 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7fdf5fcd74-ccvmr" Jun 11 23:11:31.396456 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:31.396410 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"376d9ba1-6c0e-4c3c-9b01-510de93b6caa","Type":"ContainerStarted","Data":"348bbfa78600b11c00dc0c651cb8abfda2508d07df1a14499c81c24337b87cdc"} Jun 11 23:11:31.396627 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:31.396482 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"376d9ba1-6c0e-4c3c-9b01-510de93b6caa","Type":"ContainerStarted","Data":"eb73d732a141843ef88c7b1d504d519a9daceb0b02fbd942de401b57b921315b"} Jun 11 23:11:31.396627 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:31.396511 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"376d9ba1-6c0e-4c3c-9b01-510de93b6caa","Type":"ContainerStarted","Data":"b5b48d88bf7e81085e0093824bb980f9edc0ac02506a5e35324c460a498086a5"} Jun 11 23:11:31.396627 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:31.396539 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"376d9ba1-6c0e-4c3c-9b01-510de93b6caa","Type":"ContainerStarted","Data":"29017d26c0fe6335eebbc4d367984e4187db3ae1dde072bb1a80e37c897ca277"} Jun 11 23:11:31.396627 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:31.396566 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"376d9ba1-6c0e-4c3c-9b01-510de93b6caa","Type":"ContainerStarted","Data":"2d5f45ec30d8151c71a4b40c19465b450f41efa6b32641bc90e4725136d38f54"} Jun 11 23:11:31.396627 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:31.396597 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"376d9ba1-6c0e-4c3c-9b01-510de93b6caa","Type":"ContainerStarted","Data":"7260cec0c10221f4bfda3533acdb9bf19fcbc094ce686b180db83ca782d0e9a0"} Jun 11 23:11:31.431724 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:31.431620 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.401850144 podStartE2EDuration="6.43160024s" totalImagesPullingTime="3.001941825s" totalInitContainerRuntime="27.808271ms" isStatefulPod=false podCreationTimestamp="2026-06-11 23:11:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:31.428465594 +0000 UTC m=+64.851250560" watchObservedRunningTime="2026-06-11 23:11:31.43160024 +0000 UTC m=+64.854385207" Jun 11 23:11:32.714221 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:32.714171 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e46db09-c19b-4f8b-9eb4-370984f52a4c-metrics-certs\") pod \"network-metrics-daemon-2pfzs\" (UID: \"4e46db09-c19b-4f8b-9eb4-370984f52a4c\") " pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:11:32.714620 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:32.714238 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8fb03f32-8124-418d-99c4-3c16de6e020d-original-pull-secret\") pod \"global-pull-secret-syncer-n4lnc\" (UID: \"8fb03f32-8124-418d-99c4-3c16de6e020d\") " pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:11:32.717505 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:32.717486 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 23:11:32.718659 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:32.718642 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 23:11:32.727137 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:32.727114 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8fb03f32-8124-418d-99c4-3c16de6e020d-original-pull-secret\") pod \"global-pull-secret-syncer-n4lnc\" (UID: \"8fb03f32-8124-418d-99c4-3c16de6e020d\") " pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:11:32.727238 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:32.727177 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e46db09-c19b-4f8b-9eb4-370984f52a4c-metrics-certs\") pod \"network-metrics-daemon-2pfzs\" (UID: \"4e46db09-c19b-4f8b-9eb4-370984f52a4c\") " pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:11:32.814787 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:32.814756 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4fsd\" (UniqueName: \"kubernetes.io/projected/a3b91f55-09c0-428d-a1d4-301859a89cdb-kube-api-access-l4fsd\") pod \"network-check-target-qrcp9\" (UID: \"a3b91f55-09c0-428d-a1d4-301859a89cdb\") " pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:11:32.818103 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:32.818077 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 23:11:32.820863 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:32.820842 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4lnc" Jun 11 23:11:32.828635 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:32.828611 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 23:11:32.834213 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:32.834196 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t5cps\"" Jun 11 23:11:32.838546 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:32.838526 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4fsd\" (UniqueName: \"kubernetes.io/projected/a3b91f55-09c0-428d-a1d4-301859a89cdb-kube-api-access-l4fsd\") pod \"network-check-target-qrcp9\" (UID: \"a3b91f55-09c0-428d-a1d4-301859a89cdb\") " pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:11:32.842264 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:32.842243 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pfzs" Jun 11 23:11:32.972713 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:32.972688 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n4lnc"] Jun 11 23:11:32.974100 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:11:32.974075 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fb03f32_8124_418d_99c4_3c16de6e020d.slice/crio-f1cc87ea57f3022e2ffaf7163c3574e883b4198604b6c9e8e5cbd7564c75540f WatchSource:0}: Error finding container f1cc87ea57f3022e2ffaf7163c3574e883b4198604b6c9e8e5cbd7564c75540f: Status 404 returned error can't find the container with id f1cc87ea57f3022e2ffaf7163c3574e883b4198604b6c9e8e5cbd7564c75540f Jun 11 23:11:33.006188 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:33.006160 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2pfzs"] Jun 11 23:11:33.009197 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:11:33.009171 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e46db09_c19b_4f8b_9eb4_370984f52a4c.slice/crio-73fdbf6d99894d3b5103fe4406cf4de8631d90321307d4e7b9a0af1ea84cd04c WatchSource:0}: Error finding container 73fdbf6d99894d3b5103fe4406cf4de8631d90321307d4e7b9a0af1ea84cd04c: Status 404 returned error can't find the container with id 73fdbf6d99894d3b5103fe4406cf4de8631d90321307d4e7b9a0af1ea84cd04c Jun 11 23:11:33.130278 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:33.130244 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8q79j\"" Jun 11 23:11:33.136614 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:33.136587 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:11:33.270657 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:33.270631 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qrcp9"] Jun 11 23:11:33.273345 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:11:33.273316 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3b91f55_09c0_428d_a1d4_301859a89cdb.slice/crio-ebb7f0dfe35613210ad9fd867566f73c26046af41e33a0360650f9c30498d5c7 WatchSource:0}: Error finding container ebb7f0dfe35613210ad9fd867566f73c26046af41e33a0360650f9c30498d5c7: Status 404 returned error can't find the container with id ebb7f0dfe35613210ad9fd867566f73c26046af41e33a0360650f9c30498d5c7 Jun 11 23:11:33.383414 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:33.383384 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-558d8445bd-v8tg9" Jun 11 23:11:33.405463 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:33.405427 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n4lnc" event={"ID":"8fb03f32-8124-418d-99c4-3c16de6e020d","Type":"ContainerStarted","Data":"f1cc87ea57f3022e2ffaf7163c3574e883b4198604b6c9e8e5cbd7564c75540f"} Jun 11 23:11:33.406566 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:33.406526 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qrcp9" event={"ID":"a3b91f55-09c0-428d-a1d4-301859a89cdb","Type":"ContainerStarted","Data":"ebb7f0dfe35613210ad9fd867566f73c26046af41e33a0360650f9c30498d5c7"} Jun 11 23:11:33.407640 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:33.407622 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2pfzs" event={"ID":"4e46db09-c19b-4f8b-9eb4-370984f52a4c","Type":"ContainerStarted","Data":"73fdbf6d99894d3b5103fe4406cf4de8631d90321307d4e7b9a0af1ea84cd04c"} Jun 11 23:11:33.683746 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:33.683690 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6dfbf98945-xm8g2" Jun 11 23:11:33.684214 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:33.684169 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6dfbf98945-xm8g2" Jun 11 23:11:33.692462 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:33.690030 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6dfbf98945-xm8g2" Jun 11 23:11:34.415530 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:34.415495 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2pfzs" event={"ID":"4e46db09-c19b-4f8b-9eb4-370984f52a4c","Type":"ContainerStarted","Data":"aefcb0825a776267a9c39003306e77b95b3fe493997117c99834d03168c7febd"} Jun 11 23:11:34.416011 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:34.415556 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2pfzs" event={"ID":"4e46db09-c19b-4f8b-9eb4-370984f52a4c","Type":"ContainerStarted","Data":"2406d1aa13b8ef01800c3b8c27cecf02d60fe8844c219d840c331c2fd0ccdeef"} Jun 11 23:11:34.420802 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:34.420776 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6dfbf98945-xm8g2" Jun 11 23:11:34.450879 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:34.450807 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2pfzs" podStartSLOduration=66.415881307 podStartE2EDuration="1m7.450791836s" totalImagesPullingTime="1.034910529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:34.448646472 +0000 UTC m=+67.871431433" watchObservedRunningTime="2026-06-11 23:11:34.450791836 +0000 UTC m=+67.873576856" Jun 11 23:11:34.580794 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:34.580706 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fdf5fcd74-ccvmr"] Jun 11 23:11:35.428591 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:35.428553 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:38.435107 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:38.435067 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n4lnc" event={"ID":"8fb03f32-8124-418d-99c4-3c16de6e020d","Type":"ContainerStarted","Data":"eaab0cde61af79850a7d91ab8d891adda9aebc31e9786a3ddbbf84b6f2be525c"} Jun 11 23:11:38.436519 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:38.436498 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qrcp9" event={"ID":"a3b91f55-09c0-428d-a1d4-301859a89cdb","Type":"ContainerStarted","Data":"3095d31a73add5d3de68675ab59b30def06d2c6246be032adb64534b5cc5a2bb"} Jun 11 23:11:38.436633 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:38.436622 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:11:38.457970 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:38.457926 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-n4lnc" podStartSLOduration=66.468528999 podStartE2EDuration="1m11.457912029s" totalImagesPullingTime="4.98938303s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:38.457502027 +0000 UTC m=+71.880287005" watchObservedRunningTime="2026-06-11 23:11:38.457912029 +0000 UTC m=+71.880696995" Jun 11 23:11:38.485837 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:38.485773 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qrcp9" podStartSLOduration=66.801210369 podStartE2EDuration="1m11.48575157s" totalImagesPullingTime="4.684541201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:38.4841381 +0000 UTC m=+71.906923066" watchObservedRunningTime="2026-06-11 23:11:38.48575157 +0000 UTC m=+71.908536538" Jun 11 23:11:43.524924 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:43.524893 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5bdd4d99bf-h8kgz" Jun 11 23:11:43.525317 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:43.524949 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5bdd4d99bf-h8kgz" Jun 11 23:11:44.148323 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:44.148285 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:44.222718 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:44.222687 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:44.292501 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:44.292466 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dh48l_080f3422-c177-4ce2-9ef2-78f801a2db6b/serve-healthcheck-canary/0.log" Jun 11 23:11:44.477560 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:44.477488 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:11:48.300967 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:48.300905 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-b6b4848f5-7zncs" podUID="745baec5-931e-48b1-bfec-8b95a571359b" containerName="console" containerID="cri-o://de5675c0da437a72d62392c7f274b607e4b481071741f7668327fc10d3677e24" gracePeriod=15 Jun 11 23:11:48.486920 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:48.486887 2563 generic.go:356] "Generic (PLEG): container finished" podID="745baec5-931e-48b1-bfec-8b95a571359b" containerID="de5675c0da437a72d62392c7f274b607e4b481071741f7668327fc10d3677e24" exitCode=0 Jun 11 23:11:48.487170 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:48.486935 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6b4848f5-7zncs" event={"ID":"745baec5-931e-48b1-bfec-8b95a571359b","Type":"ContainerDied","Data":"de5675c0da437a72d62392c7f274b607e4b481071741f7668327fc10d3677e24"} Jun 11 23:11:48.549653 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:48.549606 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6b4848f5-7zncs" Jun 11 23:11:48.577517 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:48.577435 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kp6n\" (UniqueName: \"kubernetes.io/projected/745baec5-931e-48b1-bfec-8b95a571359b-kube-api-access-6kp6n\") pod \"745baec5-931e-48b1-bfec-8b95a571359b\" (UID: \"745baec5-931e-48b1-bfec-8b95a571359b\") " Jun 11 23:11:48.577668 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:48.577520 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/745baec5-931e-48b1-bfec-8b95a571359b-service-ca\") pod \"745baec5-931e-48b1-bfec-8b95a571359b\" (UID: \"745baec5-931e-48b1-bfec-8b95a571359b\") " Jun 11 23:11:48.577668 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:48.577566 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/745baec5-931e-48b1-bfec-8b95a571359b-console-serving-cert\") pod \"745baec5-931e-48b1-bfec-8b95a571359b\" (UID: \"745baec5-931e-48b1-bfec-8b95a571359b\") " Jun 11 23:11:48.577668 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:48.577588 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/745baec5-931e-48b1-bfec-8b95a571359b-console-oauth-config\") pod \"745baec5-931e-48b1-bfec-8b95a571359b\" (UID: \"745baec5-931e-48b1-bfec-8b95a571359b\") " Jun 11 23:11:48.577668 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:48.577623 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/745baec5-931e-48b1-bfec-8b95a571359b-oauth-serving-cert\") pod \"745baec5-931e-48b1-bfec-8b95a571359b\" (UID: \"745baec5-931e-48b1-bfec-8b95a571359b\") " Jun 11 23:11:48.577668 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:48.577662 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/745baec5-931e-48b1-bfec-8b95a571359b-console-config\") pod \"745baec5-931e-48b1-bfec-8b95a571359b\" (UID: \"745baec5-931e-48b1-bfec-8b95a571359b\") " Jun 11 23:11:48.578053 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:48.578013 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/745baec5-931e-48b1-bfec-8b95a571359b-service-ca" (OuterVolumeSpecName: "service-ca") pod "745baec5-931e-48b1-bfec-8b95a571359b" (UID: "745baec5-931e-48b1-bfec-8b95a571359b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:11:48.578276 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:48.578148 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/745baec5-931e-48b1-bfec-8b95a571359b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "745baec5-931e-48b1-bfec-8b95a571359b" (UID: "745baec5-931e-48b1-bfec-8b95a571359b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:11:48.578276 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:48.578216 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/745baec5-931e-48b1-bfec-8b95a571359b-console-config" (OuterVolumeSpecName: "console-config") pod "745baec5-931e-48b1-bfec-8b95a571359b" (UID: "745baec5-931e-48b1-bfec-8b95a571359b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:11:48.580254 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:48.580181 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/745baec5-931e-48b1-bfec-8b95a571359b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "745baec5-931e-48b1-bfec-8b95a571359b" (UID: "745baec5-931e-48b1-bfec-8b95a571359b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:11:48.580585 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:48.580562 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/745baec5-931e-48b1-bfec-8b95a571359b-kube-api-access-6kp6n" (OuterVolumeSpecName: "kube-api-access-6kp6n") pod "745baec5-931e-48b1-bfec-8b95a571359b" (UID: "745baec5-931e-48b1-bfec-8b95a571359b"). InnerVolumeSpecName "kube-api-access-6kp6n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:11:48.580890 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:48.580866 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/745baec5-931e-48b1-bfec-8b95a571359b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "745baec5-931e-48b1-bfec-8b95a571359b" (UID: "745baec5-931e-48b1-bfec-8b95a571359b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:11:48.678724 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:48.678686 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/745baec5-931e-48b1-bfec-8b95a571359b-console-serving-cert\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:11:48.678724 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:48.678719 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/745baec5-931e-48b1-bfec-8b95a571359b-console-oauth-config\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:11:48.678724 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:48.678732 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/745baec5-931e-48b1-bfec-8b95a571359b-oauth-serving-cert\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:11:48.679006 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:48.678746 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/745baec5-931e-48b1-bfec-8b95a571359b-console-config\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:11:48.679006 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:48.678759 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kp6n\" (UniqueName: \"kubernetes.io/projected/745baec5-931e-48b1-bfec-8b95a571359b-kube-api-access-6kp6n\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:11:48.679006 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:48.678770 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/745baec5-931e-48b1-bfec-8b95a571359b-service-ca\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:11:49.491608 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:49.491578 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6b4848f5-7zncs" Jun 11 23:11:49.491608 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:49.491589 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6b4848f5-7zncs" event={"ID":"745baec5-931e-48b1-bfec-8b95a571359b","Type":"ContainerDied","Data":"e8d127f577bf64f5ef7dec34fa10e0848fbd603144faabd2134d49283820b55c"} Jun 11 23:11:49.492080 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:49.491643 2563 scope.go:117] "RemoveContainer" containerID="de5675c0da437a72d62392c7f274b607e4b481071741f7668327fc10d3677e24" Jun 11 23:11:49.508769 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:49.508742 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b6b4848f5-7zncs"] Jun 11 23:11:49.514821 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:49.514796 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b6b4848f5-7zncs"] Jun 11 23:11:51.004076 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:51.004045 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="745baec5-931e-48b1-bfec-8b95a571359b" path="/var/lib/kubelet/pods/745baec5-931e-48b1-bfec-8b95a571359b/volumes" Jun 11 23:11:59.604262 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:59.604198 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7fdf5fcd74-ccvmr" podUID="08265be8-968c-4081-867c-65662529deea" containerName="console" containerID="cri-o://3a29cf14330638ef3212d7e45d61c3dad3348f96a096c4d9a4b23985e01bc782" gracePeriod=15 Jun 11 23:11:59.875521 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:59.875489 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fdf5fcd74-ccvmr" Jun 11 23:11:59.979930 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:59.979900 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08265be8-968c-4081-867c-65662529deea-oauth-serving-cert\") pod \"08265be8-968c-4081-867c-65662529deea\" (UID: \"08265be8-968c-4081-867c-65662529deea\") " Jun 11 23:11:59.980125 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:59.979937 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08265be8-968c-4081-867c-65662529deea-service-ca\") pod \"08265be8-968c-4081-867c-65662529deea\" (UID: \"08265be8-968c-4081-867c-65662529deea\") " Jun 11 23:11:59.980125 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:59.979965 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08265be8-968c-4081-867c-65662529deea-trusted-ca-bundle\") pod \"08265be8-968c-4081-867c-65662529deea\" (UID: \"08265be8-968c-4081-867c-65662529deea\") " Jun 11 23:11:59.980125 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:59.980013 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08265be8-968c-4081-867c-65662529deea-console-config\") pod \"08265be8-968c-4081-867c-65662529deea\" (UID: \"08265be8-968c-4081-867c-65662529deea\") " Jun 11 23:11:59.980125 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:59.980072 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08265be8-968c-4081-867c-65662529deea-console-oauth-config\") pod \"08265be8-968c-4081-867c-65662529deea\" (UID: \"08265be8-968c-4081-867c-65662529deea\") " Jun 11 23:11:59.980125 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:59.980091 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08265be8-968c-4081-867c-65662529deea-console-serving-cert\") pod \"08265be8-968c-4081-867c-65662529deea\" (UID: \"08265be8-968c-4081-867c-65662529deea\") " Jun 11 23:11:59.980363 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:59.980150 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvwvk\" (UniqueName: \"kubernetes.io/projected/08265be8-968c-4081-867c-65662529deea-kube-api-access-lvwvk\") pod \"08265be8-968c-4081-867c-65662529deea\" (UID: \"08265be8-968c-4081-867c-65662529deea\") " Jun 11 23:11:59.980500 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:59.980466 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08265be8-968c-4081-867c-65662529deea-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "08265be8-968c-4081-867c-65662529deea" (UID: "08265be8-968c-4081-867c-65662529deea"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:11:59.980500 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:59.980489 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08265be8-968c-4081-867c-65662529deea-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "08265be8-968c-4081-867c-65662529deea" (UID: "08265be8-968c-4081-867c-65662529deea"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:11:59.980643 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:59.980511 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08265be8-968c-4081-867c-65662529deea-console-config" (OuterVolumeSpecName: "console-config") pod "08265be8-968c-4081-867c-65662529deea" (UID: "08265be8-968c-4081-867c-65662529deea"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:11:59.980643 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:59.980580 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08265be8-968c-4081-867c-65662529deea-service-ca" (OuterVolumeSpecName: "service-ca") pod "08265be8-968c-4081-867c-65662529deea" (UID: "08265be8-968c-4081-867c-65662529deea"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:11:59.982404 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:59.982375 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08265be8-968c-4081-867c-65662529deea-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "08265be8-968c-4081-867c-65662529deea" (UID: "08265be8-968c-4081-867c-65662529deea"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:11:59.982491 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:59.982414 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08265be8-968c-4081-867c-65662529deea-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "08265be8-968c-4081-867c-65662529deea" (UID: "08265be8-968c-4081-867c-65662529deea"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:11:59.982491 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:11:59.982427 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08265be8-968c-4081-867c-65662529deea-kube-api-access-lvwvk" (OuterVolumeSpecName: "kube-api-access-lvwvk") pod "08265be8-968c-4081-867c-65662529deea" (UID: "08265be8-968c-4081-867c-65662529deea"). InnerVolumeSpecName "kube-api-access-lvwvk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:12:00.081336 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:00.081295 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08265be8-968c-4081-867c-65662529deea-trusted-ca-bundle\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:00.081336 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:00.081327 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08265be8-968c-4081-867c-65662529deea-console-config\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:00.081336 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:00.081336 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08265be8-968c-4081-867c-65662529deea-console-oauth-config\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:00.081336 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:00.081347 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08265be8-968c-4081-867c-65662529deea-console-serving-cert\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:00.081588 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:00.081356 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvwvk\" (UniqueName: \"kubernetes.io/projected/08265be8-968c-4081-867c-65662529deea-kube-api-access-lvwvk\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:00.081588 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:00.081364 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08265be8-968c-4081-867c-65662529deea-oauth-serving-cert\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:00.081588 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:00.081373 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08265be8-968c-4081-867c-65662529deea-service-ca\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:00.544892 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:00.544856 2563 generic.go:356] "Generic (PLEG): container finished" podID="08265be8-968c-4081-867c-65662529deea" containerID="3a29cf14330638ef3212d7e45d61c3dad3348f96a096c4d9a4b23985e01bc782" exitCode=0 Jun 11 23:12:00.545053 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:00.544905 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fdf5fcd74-ccvmr" Jun 11 23:12:00.545053 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:00.544943 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fdf5fcd74-ccvmr" event={"ID":"08265be8-968c-4081-867c-65662529deea","Type":"ContainerDied","Data":"3a29cf14330638ef3212d7e45d61c3dad3348f96a096c4d9a4b23985e01bc782"} Jun 11 23:12:00.545053 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:00.545015 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fdf5fcd74-ccvmr" event={"ID":"08265be8-968c-4081-867c-65662529deea","Type":"ContainerDied","Data":"284c18eb92a54deb1b73c0c1d8ff237984728dd500bd69d093e06ba6c9e80033"} Jun 11 23:12:00.545053 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:00.545037 2563 scope.go:117] "RemoveContainer" containerID="3a29cf14330638ef3212d7e45d61c3dad3348f96a096c4d9a4b23985e01bc782" Jun 11 23:12:00.553619 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:00.553602 2563 scope.go:117] "RemoveContainer" containerID="3a29cf14330638ef3212d7e45d61c3dad3348f96a096c4d9a4b23985e01bc782" Jun 11 23:12:00.553860 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:12:00.553837 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a29cf14330638ef3212d7e45d61c3dad3348f96a096c4d9a4b23985e01bc782\": container with ID starting with 3a29cf14330638ef3212d7e45d61c3dad3348f96a096c4d9a4b23985e01bc782 not found: ID does not exist" containerID="3a29cf14330638ef3212d7e45d61c3dad3348f96a096c4d9a4b23985e01bc782" Jun 11 23:12:00.553955 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:00.553865 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a29cf14330638ef3212d7e45d61c3dad3348f96a096c4d9a4b23985e01bc782"} err="failed to get container status \"3a29cf14330638ef3212d7e45d61c3dad3348f96a096c4d9a4b23985e01bc782\": rpc error: code = NotFound desc = could not find container \"3a29cf14330638ef3212d7e45d61c3dad3348f96a096c4d9a4b23985e01bc782\": container with ID starting with 3a29cf14330638ef3212d7e45d61c3dad3348f96a096c4d9a4b23985e01bc782 not found: ID does not exist" Jun 11 23:12:00.569028 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:00.569002 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fdf5fcd74-ccvmr"] Jun 11 23:12:00.574012 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:00.573971 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7fdf5fcd74-ccvmr"] Jun 11 23:12:01.007086 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:01.007054 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08265be8-968c-4081-867c-65662529deea" path="/var/lib/kubelet/pods/08265be8-968c-4081-867c-65662529deea/volumes" Jun 11 23:12:03.529963 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:03.529933 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5bdd4d99bf-h8kgz" Jun 11 23:12:03.533887 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:03.533864 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5bdd4d99bf-h8kgz" Jun 11 23:12:08.551261 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:08.551227 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 23:12:08.551679 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:08.551565 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" containerName="alertmanager" containerID="cri-o://f87af97e17268e4ef3f9f63ec5679bacab79a4bcd9d8685978ad00b04ef6b8c5" gracePeriod=120 Jun 11 23:12:08.551679 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:08.551637 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" containerName="kube-rbac-proxy-metric" containerID="cri-o://c1e2faf0f1df5ce24441a190e28099f2972df91f2f2c70b30683dcc7a559fbfc" gracePeriod=120 Jun 11 23:12:08.551816 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:08.551660 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" containerName="kube-rbac-proxy" containerID="cri-o://bf6d6f87ecd42bc249a7872820f22aee3842a9a4d177bacd8a91ea41006983a0" gracePeriod=120 Jun 11 23:12:08.551816 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:08.551679 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" containerName="config-reloader" containerID="cri-o://c64d0e4a5bf959aab699dd515f5fbdef27ce19beba563a367dc57676dcbd035b" gracePeriod=120 Jun 11 23:12:08.551816 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:08.551754 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" containerName="prom-label-proxy" containerID="cri-o://2cce1f5dc03c75e14d7be48c80b6aa2bd1cc3b712f71cdf5fde4ea6eecc8f5aa" gracePeriod=120 Jun 11 23:12:08.551816 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:08.551651 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" containerName="kube-rbac-proxy-web" containerID="cri-o://feedf5d3176106bae96ba2e43a9ce6396a9eefe94c7d96af1fa07ddf05acc0df" gracePeriod=120 Jun 11 23:12:09.444615 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.444574 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qrcp9" Jun 11 23:12:09.588590 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.588560 2563 generic.go:356] "Generic (PLEG): container finished" podID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" containerID="2cce1f5dc03c75e14d7be48c80b6aa2bd1cc3b712f71cdf5fde4ea6eecc8f5aa" exitCode=0 Jun 11 23:12:09.588590 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.588583 2563 generic.go:356] "Generic (PLEG): container finished" podID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" containerID="c1e2faf0f1df5ce24441a190e28099f2972df91f2f2c70b30683dcc7a559fbfc" exitCode=0 Jun 11 23:12:09.588590 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.588590 2563 generic.go:356] "Generic (PLEG): container finished" podID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" containerID="bf6d6f87ecd42bc249a7872820f22aee3842a9a4d177bacd8a91ea41006983a0" exitCode=0 Jun 11 23:12:09.588590 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.588596 2563 generic.go:356] "Generic (PLEG): container finished" podID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" containerID="c64d0e4a5bf959aab699dd515f5fbdef27ce19beba563a367dc57676dcbd035b" exitCode=0 Jun 11 23:12:09.588590 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.588601 2563 generic.go:356] "Generic (PLEG): container finished" podID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" containerID="f87af97e17268e4ef3f9f63ec5679bacab79a4bcd9d8685978ad00b04ef6b8c5" exitCode=0 Jun 11 23:12:09.589085 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.588627 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6af73598-b3a0-4eeb-85b2-170cb4cdc210","Type":"ContainerDied","Data":"2cce1f5dc03c75e14d7be48c80b6aa2bd1cc3b712f71cdf5fde4ea6eecc8f5aa"} Jun 11 23:12:09.589085 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.588689 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6af73598-b3a0-4eeb-85b2-170cb4cdc210","Type":"ContainerDied","Data":"c1e2faf0f1df5ce24441a190e28099f2972df91f2f2c70b30683dcc7a559fbfc"} Jun 11 23:12:09.589085 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.588715 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6af73598-b3a0-4eeb-85b2-170cb4cdc210","Type":"ContainerDied","Data":"bf6d6f87ecd42bc249a7872820f22aee3842a9a4d177bacd8a91ea41006983a0"} Jun 11 23:12:09.589085 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.588740 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6af73598-b3a0-4eeb-85b2-170cb4cdc210","Type":"ContainerDied","Data":"c64d0e4a5bf959aab699dd515f5fbdef27ce19beba563a367dc57676dcbd035b"} Jun 11 23:12:09.589085 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.588764 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6af73598-b3a0-4eeb-85b2-170cb4cdc210","Type":"ContainerDied","Data":"f87af97e17268e4ef3f9f63ec5679bacab79a4bcd9d8685978ad00b04ef6b8c5"} Jun 11 23:12:09.820338 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.820312 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:09.968506 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.968476 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6af73598-b3a0-4eeb-85b2-170cb4cdc210-tls-assets\") pod \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " Jun 11 23:12:09.968679 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.968523 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6af73598-b3a0-4eeb-85b2-170cb4cdc210-metrics-client-ca\") pod \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " Jun 11 23:12:09.968679 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.968547 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-web-config\") pod \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " Jun 11 23:12:09.968679 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.968571 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6af73598-b3a0-4eeb-85b2-170cb4cdc210-alertmanager-main-db\") pod \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " Jun 11 23:12:09.968679 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.968633 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctpmb\" (UniqueName: \"kubernetes.io/projected/6af73598-b3a0-4eeb-85b2-170cb4cdc210-kube-api-access-ctpmb\") pod \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " Jun 11 23:12:09.968679 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.968677 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-config-volume\") pod \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " Jun 11 23:12:09.968954 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.968721 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-secret-alertmanager-kube-rbac-proxy-metric\") pod \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " Jun 11 23:12:09.968954 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.968748 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6af73598-b3a0-4eeb-85b2-170cb4cdc210-alertmanager-trusted-ca-bundle\") pod \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " Jun 11 23:12:09.968954 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.968771 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-secret-alertmanager-main-tls\") pod \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " Jun 11 23:12:09.968954 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.968799 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6af73598-b3a0-4eeb-85b2-170cb4cdc210-config-out\") pod \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " Jun 11 23:12:09.968954 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.968823 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-secret-alertmanager-kube-rbac-proxy\") pod \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " Jun 11 23:12:09.968954 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.968864 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-cluster-tls-config\") pod \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " Jun 11 23:12:09.968954 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.968905 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-secret-alertmanager-kube-rbac-proxy-web\") pod \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\" (UID: \"6af73598-b3a0-4eeb-85b2-170cb4cdc210\") " Jun 11 23:12:09.968954 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.968950 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6af73598-b3a0-4eeb-85b2-170cb4cdc210-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "6af73598-b3a0-4eeb-85b2-170cb4cdc210" (UID: "6af73598-b3a0-4eeb-85b2-170cb4cdc210"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:12:09.969374 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.969003 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6af73598-b3a0-4eeb-85b2-170cb4cdc210-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "6af73598-b3a0-4eeb-85b2-170cb4cdc210" (UID: "6af73598-b3a0-4eeb-85b2-170cb4cdc210"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:12:09.969374 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.969259 2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6af73598-b3a0-4eeb-85b2-170cb4cdc210-metrics-client-ca\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:09.969374 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.969280 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6af73598-b3a0-4eeb-85b2-170cb4cdc210-alertmanager-main-db\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:09.969374 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.969301 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6af73598-b3a0-4eeb-85b2-170cb4cdc210-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "6af73598-b3a0-4eeb-85b2-170cb4cdc210" (UID: "6af73598-b3a0-4eeb-85b2-170cb4cdc210"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:12:09.972116 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.971881 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "6af73598-b3a0-4eeb-85b2-170cb4cdc210" (UID: "6af73598-b3a0-4eeb-85b2-170cb4cdc210"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:12:09.972116 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.971923 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6af73598-b3a0-4eeb-85b2-170cb4cdc210-kube-api-access-ctpmb" (OuterVolumeSpecName: "kube-api-access-ctpmb") pod "6af73598-b3a0-4eeb-85b2-170cb4cdc210" (UID: "6af73598-b3a0-4eeb-85b2-170cb4cdc210"). InnerVolumeSpecName "kube-api-access-ctpmb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:12:09.972116 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.972061 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-config-volume" (OuterVolumeSpecName: "config-volume") pod "6af73598-b3a0-4eeb-85b2-170cb4cdc210" (UID: "6af73598-b3a0-4eeb-85b2-170cb4cdc210"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:12:09.972362 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.972243 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6af73598-b3a0-4eeb-85b2-170cb4cdc210-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6af73598-b3a0-4eeb-85b2-170cb4cdc210" (UID: "6af73598-b3a0-4eeb-85b2-170cb4cdc210"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:12:09.972362 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.972276 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6af73598-b3a0-4eeb-85b2-170cb4cdc210-config-out" (OuterVolumeSpecName: "config-out") pod "6af73598-b3a0-4eeb-85b2-170cb4cdc210" (UID: "6af73598-b3a0-4eeb-85b2-170cb4cdc210"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:12:09.972362 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.972276 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "6af73598-b3a0-4eeb-85b2-170cb4cdc210" (UID: "6af73598-b3a0-4eeb-85b2-170cb4cdc210"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:12:09.972731 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.972701 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "6af73598-b3a0-4eeb-85b2-170cb4cdc210" (UID: "6af73598-b3a0-4eeb-85b2-170cb4cdc210"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:12:09.974004 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.973970 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "6af73598-b3a0-4eeb-85b2-170cb4cdc210" (UID: "6af73598-b3a0-4eeb-85b2-170cb4cdc210"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:12:09.977556 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.977501 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "6af73598-b3a0-4eeb-85b2-170cb4cdc210" (UID: "6af73598-b3a0-4eeb-85b2-170cb4cdc210"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:12:09.983252 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:09.983231 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-web-config" (OuterVolumeSpecName: "web-config") pod "6af73598-b3a0-4eeb-85b2-170cb4cdc210" (UID: "6af73598-b3a0-4eeb-85b2-170cb4cdc210"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:12:10.070447 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.070415 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6af73598-b3a0-4eeb-85b2-170cb4cdc210-tls-assets\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:10.070447 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.070447 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-web-config\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:10.070680 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.070461 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctpmb\" (UniqueName: \"kubernetes.io/projected/6af73598-b3a0-4eeb-85b2-170cb4cdc210-kube-api-access-ctpmb\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:10.070680 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.070476 2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-config-volume\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:10.070680 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.070490 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:10.070680 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.070583 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6af73598-b3a0-4eeb-85b2-170cb4cdc210-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:10.070680 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.070601 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-secret-alertmanager-main-tls\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:10.070680 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.070617 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6af73598-b3a0-4eeb-85b2-170cb4cdc210-config-out\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:10.070680 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.070632 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:10.070680 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.070648 2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-cluster-tls-config\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:10.070680 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.070664 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6af73598-b3a0-4eeb-85b2-170cb4cdc210-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:10.595858 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.595818 2563 generic.go:356] "Generic (PLEG): container finished" podID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" containerID="feedf5d3176106bae96ba2e43a9ce6396a9eefe94c7d96af1fa07ddf05acc0df" exitCode=0 Jun 11 23:12:10.596342 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.595904 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6af73598-b3a0-4eeb-85b2-170cb4cdc210","Type":"ContainerDied","Data":"feedf5d3176106bae96ba2e43a9ce6396a9eefe94c7d96af1fa07ddf05acc0df"} Jun 11 23:12:10.596342 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.595971 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6af73598-b3a0-4eeb-85b2-170cb4cdc210","Type":"ContainerDied","Data":"c9798f1e710ec5b08a7ec230ad612ba95d88bfa3ffe9516dc2fcbeadf0cd7006"} Jun 11 23:12:10.596342 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.595912 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.596342 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.596023 2563 scope.go:117] "RemoveContainer" containerID="2cce1f5dc03c75e14d7be48c80b6aa2bd1cc3b712f71cdf5fde4ea6eecc8f5aa" Jun 11 23:12:10.603879 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.603812 2563 scope.go:117] "RemoveContainer" containerID="c1e2faf0f1df5ce24441a190e28099f2972df91f2f2c70b30683dcc7a559fbfc" Jun 11 23:12:10.610584 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.610568 2563 scope.go:117] "RemoveContainer" containerID="bf6d6f87ecd42bc249a7872820f22aee3842a9a4d177bacd8a91ea41006983a0" Jun 11 23:12:10.617148 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.617132 2563 scope.go:117] "RemoveContainer" containerID="feedf5d3176106bae96ba2e43a9ce6396a9eefe94c7d96af1fa07ddf05acc0df" Jun 11 23:12:10.621180 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.621157 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 23:12:10.624970 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.624948 2563 scope.go:117] "RemoveContainer" containerID="c64d0e4a5bf959aab699dd515f5fbdef27ce19beba563a367dc57676dcbd035b" Jun 11 23:12:10.625527 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.625505 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 23:12:10.633063 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.633044 2563 scope.go:117] "RemoveContainer" containerID="f87af97e17268e4ef3f9f63ec5679bacab79a4bcd9d8685978ad00b04ef6b8c5" Jun 11 23:12:10.639598 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.639579 2563 scope.go:117] "RemoveContainer" containerID="1dc55552968bddab86f072b98de797f83e149225fd4ca43fe29c2f898bf0f631" Jun 11 23:12:10.646773 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.646754 2563 scope.go:117] "RemoveContainer" containerID="2cce1f5dc03c75e14d7be48c80b6aa2bd1cc3b712f71cdf5fde4ea6eecc8f5aa" Jun 11 23:12:10.647039 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:12:10.647019 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cce1f5dc03c75e14d7be48c80b6aa2bd1cc3b712f71cdf5fde4ea6eecc8f5aa\": container with ID starting with 2cce1f5dc03c75e14d7be48c80b6aa2bd1cc3b712f71cdf5fde4ea6eecc8f5aa not found: ID does not exist" containerID="2cce1f5dc03c75e14d7be48c80b6aa2bd1cc3b712f71cdf5fde4ea6eecc8f5aa" Jun 11 23:12:10.647090 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.647047 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cce1f5dc03c75e14d7be48c80b6aa2bd1cc3b712f71cdf5fde4ea6eecc8f5aa"} err="failed to get container status \"2cce1f5dc03c75e14d7be48c80b6aa2bd1cc3b712f71cdf5fde4ea6eecc8f5aa\": rpc error: code = NotFound desc = could not find container \"2cce1f5dc03c75e14d7be48c80b6aa2bd1cc3b712f71cdf5fde4ea6eecc8f5aa\": container with ID starting with 2cce1f5dc03c75e14d7be48c80b6aa2bd1cc3b712f71cdf5fde4ea6eecc8f5aa not found: ID does not exist" Jun 11 23:12:10.647090 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.647065 2563 scope.go:117] "RemoveContainer" containerID="c1e2faf0f1df5ce24441a190e28099f2972df91f2f2c70b30683dcc7a559fbfc" Jun 11 23:12:10.647309 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:12:10.647294 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1e2faf0f1df5ce24441a190e28099f2972df91f2f2c70b30683dcc7a559fbfc\": container with ID starting with c1e2faf0f1df5ce24441a190e28099f2972df91f2f2c70b30683dcc7a559fbfc not found: ID does not exist" containerID="c1e2faf0f1df5ce24441a190e28099f2972df91f2f2c70b30683dcc7a559fbfc" Jun 11 23:12:10.647358 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.647315 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1e2faf0f1df5ce24441a190e28099f2972df91f2f2c70b30683dcc7a559fbfc"} err="failed to get container status \"c1e2faf0f1df5ce24441a190e28099f2972df91f2f2c70b30683dcc7a559fbfc\": rpc error: code = NotFound desc = could not find container \"c1e2faf0f1df5ce24441a190e28099f2972df91f2f2c70b30683dcc7a559fbfc\": container with ID starting with c1e2faf0f1df5ce24441a190e28099f2972df91f2f2c70b30683dcc7a559fbfc not found: ID does not exist" Jun 11 23:12:10.647358 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.647330 2563 scope.go:117] "RemoveContainer" containerID="bf6d6f87ecd42bc249a7872820f22aee3842a9a4d177bacd8a91ea41006983a0" Jun 11 23:12:10.647566 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:12:10.647550 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf6d6f87ecd42bc249a7872820f22aee3842a9a4d177bacd8a91ea41006983a0\": container with ID starting with bf6d6f87ecd42bc249a7872820f22aee3842a9a4d177bacd8a91ea41006983a0 not found: ID does not exist" containerID="bf6d6f87ecd42bc249a7872820f22aee3842a9a4d177bacd8a91ea41006983a0" Jun 11 23:12:10.647605 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.647572 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf6d6f87ecd42bc249a7872820f22aee3842a9a4d177bacd8a91ea41006983a0"} err="failed to get container status \"bf6d6f87ecd42bc249a7872820f22aee3842a9a4d177bacd8a91ea41006983a0\": rpc error: code = NotFound desc = could not find container \"bf6d6f87ecd42bc249a7872820f22aee3842a9a4d177bacd8a91ea41006983a0\": container with ID starting with bf6d6f87ecd42bc249a7872820f22aee3842a9a4d177bacd8a91ea41006983a0 not found: ID does not exist" Jun 11 23:12:10.647605 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.647586 2563 scope.go:117] "RemoveContainer" containerID="feedf5d3176106bae96ba2e43a9ce6396a9eefe94c7d96af1fa07ddf05acc0df" Jun 11 23:12:10.647827 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:12:10.647809 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"feedf5d3176106bae96ba2e43a9ce6396a9eefe94c7d96af1fa07ddf05acc0df\": container with ID starting with feedf5d3176106bae96ba2e43a9ce6396a9eefe94c7d96af1fa07ddf05acc0df not found: ID does not exist" containerID="feedf5d3176106bae96ba2e43a9ce6396a9eefe94c7d96af1fa07ddf05acc0df" Jun 11 23:12:10.647875 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.647830 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"feedf5d3176106bae96ba2e43a9ce6396a9eefe94c7d96af1fa07ddf05acc0df"} err="failed to get container status \"feedf5d3176106bae96ba2e43a9ce6396a9eefe94c7d96af1fa07ddf05acc0df\": rpc error: code = NotFound desc = could not find container \"feedf5d3176106bae96ba2e43a9ce6396a9eefe94c7d96af1fa07ddf05acc0df\": container with ID starting with feedf5d3176106bae96ba2e43a9ce6396a9eefe94c7d96af1fa07ddf05acc0df not found: ID does not exist" Jun 11 23:12:10.647875 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.647843 2563 scope.go:117] "RemoveContainer" containerID="c64d0e4a5bf959aab699dd515f5fbdef27ce19beba563a367dc57676dcbd035b" Jun 11 23:12:10.648104 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:12:10.648088 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c64d0e4a5bf959aab699dd515f5fbdef27ce19beba563a367dc57676dcbd035b\": container with ID starting with c64d0e4a5bf959aab699dd515f5fbdef27ce19beba563a367dc57676dcbd035b not found: ID does not exist" containerID="c64d0e4a5bf959aab699dd515f5fbdef27ce19beba563a367dc57676dcbd035b" Jun 11 23:12:10.648155 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.648109 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c64d0e4a5bf959aab699dd515f5fbdef27ce19beba563a367dc57676dcbd035b"} err="failed to get container status \"c64d0e4a5bf959aab699dd515f5fbdef27ce19beba563a367dc57676dcbd035b\": rpc error: code = NotFound desc = could not find container \"c64d0e4a5bf959aab699dd515f5fbdef27ce19beba563a367dc57676dcbd035b\": container with ID starting with c64d0e4a5bf959aab699dd515f5fbdef27ce19beba563a367dc57676dcbd035b not found: ID does not exist" Jun 11 23:12:10.648155 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.648127 2563 scope.go:117] "RemoveContainer" containerID="f87af97e17268e4ef3f9f63ec5679bacab79a4bcd9d8685978ad00b04ef6b8c5" Jun 11 23:12:10.648398 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:12:10.648381 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f87af97e17268e4ef3f9f63ec5679bacab79a4bcd9d8685978ad00b04ef6b8c5\": container with ID starting with f87af97e17268e4ef3f9f63ec5679bacab79a4bcd9d8685978ad00b04ef6b8c5 not found: ID does not exist" containerID="f87af97e17268e4ef3f9f63ec5679bacab79a4bcd9d8685978ad00b04ef6b8c5" Jun 11 23:12:10.648452 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.648400 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f87af97e17268e4ef3f9f63ec5679bacab79a4bcd9d8685978ad00b04ef6b8c5"} err="failed to get container status \"f87af97e17268e4ef3f9f63ec5679bacab79a4bcd9d8685978ad00b04ef6b8c5\": rpc error: code = NotFound desc = could not find container \"f87af97e17268e4ef3f9f63ec5679bacab79a4bcd9d8685978ad00b04ef6b8c5\": container with ID starting with f87af97e17268e4ef3f9f63ec5679bacab79a4bcd9d8685978ad00b04ef6b8c5 not found: ID does not exist" Jun 11 23:12:10.648452 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.648417 2563 scope.go:117] "RemoveContainer" containerID="1dc55552968bddab86f072b98de797f83e149225fd4ca43fe29c2f898bf0f631" Jun 11 23:12:10.648635 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:12:10.648622 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dc55552968bddab86f072b98de797f83e149225fd4ca43fe29c2f898bf0f631\": container with ID starting with 1dc55552968bddab86f072b98de797f83e149225fd4ca43fe29c2f898bf0f631 not found: ID does not exist" containerID="1dc55552968bddab86f072b98de797f83e149225fd4ca43fe29c2f898bf0f631" Jun 11 23:12:10.648672 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.648638 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dc55552968bddab86f072b98de797f83e149225fd4ca43fe29c2f898bf0f631"} err="failed to get container status \"1dc55552968bddab86f072b98de797f83e149225fd4ca43fe29c2f898bf0f631\": rpc error: code = NotFound desc = could not find container \"1dc55552968bddab86f072b98de797f83e149225fd4ca43fe29c2f898bf0f631\": container with ID starting with 1dc55552968bddab86f072b98de797f83e149225fd4ca43fe29c2f898bf0f631 not found: ID does not exist" Jun 11 23:12:10.653181 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.653157 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 23:12:10.653542 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.653523 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" containerName="init-config-reloader" Jun 11 23:12:10.653542 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.653542 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" containerName="init-config-reloader" Jun 11 23:12:10.653691 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.653566 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="745baec5-931e-48b1-bfec-8b95a571359b" containerName="console" Jun 11 23:12:10.653691 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.653575 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="745baec5-931e-48b1-bfec-8b95a571359b" containerName="console" Jun 11 23:12:10.653691 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.653587 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" containerName="prom-label-proxy" Jun 11 23:12:10.653691 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.653597 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" containerName="prom-label-proxy" Jun 11 23:12:10.653691 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.653610 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" containerName="config-reloader" Jun 11 23:12:10.653691 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.653617 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" containerName="config-reloader" Jun 11 23:12:10.653691 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.653627 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" containerName="kube-rbac-proxy" Jun 11 23:12:10.653691 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.653636 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" containerName="kube-rbac-proxy" Jun 11 23:12:10.653691 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.653646 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" containerName="alertmanager" Jun 11 23:12:10.653691 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.653655 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" containerName="alertmanager" Jun 11 23:12:10.653691 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.653666 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" containerName="kube-rbac-proxy-metric" Jun 11 23:12:10.653691 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.653674 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" containerName="kube-rbac-proxy-metric" Jun 11 23:12:10.653691 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.653687 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" containerName="kube-rbac-proxy-web" Jun 11 23:12:10.653691 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.653697 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" containerName="kube-rbac-proxy-web" Jun 11 23:12:10.654378 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.653718 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08265be8-968c-4081-867c-65662529deea" containerName="console" Jun 11 23:12:10.654378 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.653727 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="08265be8-968c-4081-867c-65662529deea" containerName="console" Jun 11 23:12:10.654378 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.653809 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" containerName="kube-rbac-proxy-web" Jun 11 23:12:10.654378 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.653824 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" containerName="kube-rbac-proxy-metric" Jun 11 23:12:10.654378 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.653834 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" containerName="alertmanager" Jun 11 23:12:10.654378 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.653843 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" containerName="kube-rbac-proxy" Jun 11 23:12:10.654378 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.653858 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="08265be8-968c-4081-867c-65662529deea" containerName="console" Jun 11 23:12:10.654378 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.653867 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" containerName="prom-label-proxy" Jun 11 23:12:10.654378 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.653876 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="745baec5-931e-48b1-bfec-8b95a571359b" containerName="console" Jun 11 23:12:10.654378 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.653885 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" containerName="config-reloader" Jun 11 23:12:10.692209 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.692177 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 23:12:10.692342 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.692278 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.695094 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.695073 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 23:12:10.695267 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.695238 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 23:12:10.695322 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.695264 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 23:12:10.695473 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.695453 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 23:12:10.695597 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.695548 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 23:12:10.695696 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.695650 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 23:12:10.695767 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.695712 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8l4s5\"" Jun 11 23:12:10.695831 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.695801 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 23:12:10.695909 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.695893 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 23:12:10.701245 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.701224 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 23:12:10.777065 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.777029 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b730f58-e13c-44a2-a55e-b018f3ec31ef-web-config\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.777231 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.777092 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4b730f58-e13c-44a2-a55e-b018f3ec31ef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.777231 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.777130 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b730f58-e13c-44a2-a55e-b018f3ec31ef-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.777231 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.777155 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b730f58-e13c-44a2-a55e-b018f3ec31ef-config-out\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.777231 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.777176 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4b730f58-e13c-44a2-a55e-b018f3ec31ef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.777231 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.777208 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b730f58-e13c-44a2-a55e-b018f3ec31ef-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.777231 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.777226 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4b730f58-e13c-44a2-a55e-b018f3ec31ef-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.777412 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.777248 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b730f58-e13c-44a2-a55e-b018f3ec31ef-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.777412 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.777267 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b730f58-e13c-44a2-a55e-b018f3ec31ef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.777412 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.777292 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b730f58-e13c-44a2-a55e-b018f3ec31ef-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.777412 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.777328 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74zxr\" (UniqueName: \"kubernetes.io/projected/4b730f58-e13c-44a2-a55e-b018f3ec31ef-kube-api-access-74zxr\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.777412 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.777394 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4b730f58-e13c-44a2-a55e-b018f3ec31ef-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.777553 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.777430 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4b730f58-e13c-44a2-a55e-b018f3ec31ef-config-volume\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.878342 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.878312 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74zxr\" (UniqueName: \"kubernetes.io/projected/4b730f58-e13c-44a2-a55e-b018f3ec31ef-kube-api-access-74zxr\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.878476 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.878350 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4b730f58-e13c-44a2-a55e-b018f3ec31ef-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.878476 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.878370 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4b730f58-e13c-44a2-a55e-b018f3ec31ef-config-volume\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.878476 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.878404 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b730f58-e13c-44a2-a55e-b018f3ec31ef-web-config\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.878476 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.878442 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4b730f58-e13c-44a2-a55e-b018f3ec31ef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.878660 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.878476 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b730f58-e13c-44a2-a55e-b018f3ec31ef-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.878660 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.878619 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b730f58-e13c-44a2-a55e-b018f3ec31ef-config-out\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.878785 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.878660 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4b730f58-e13c-44a2-a55e-b018f3ec31ef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.878785 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.878693 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b730f58-e13c-44a2-a55e-b018f3ec31ef-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.878785 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.878721 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4b730f58-e13c-44a2-a55e-b018f3ec31ef-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.878785 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.878758 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b730f58-e13c-44a2-a55e-b018f3ec31ef-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.879029 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.878786 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b730f58-e13c-44a2-a55e-b018f3ec31ef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.879029 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.878826 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b730f58-e13c-44a2-a55e-b018f3ec31ef-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.880003 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.879952 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4b730f58-e13c-44a2-a55e-b018f3ec31ef-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.882769 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.881528 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b730f58-e13c-44a2-a55e-b018f3ec31ef-web-config\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.882769 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.881956 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4b730f58-e13c-44a2-a55e-b018f3ec31ef-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.882769 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.882424 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b730f58-e13c-44a2-a55e-b018f3ec31ef-config-out\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.882769 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.882643 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b730f58-e13c-44a2-a55e-b018f3ec31ef-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.887325 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.883109 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b730f58-e13c-44a2-a55e-b018f3ec31ef-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.887325 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.883366 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b730f58-e13c-44a2-a55e-b018f3ec31ef-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.887325 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.883467 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b730f58-e13c-44a2-a55e-b018f3ec31ef-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.887325 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.883658 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4b730f58-e13c-44a2-a55e-b018f3ec31ef-config-volume\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.887325 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.883735 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4b730f58-e13c-44a2-a55e-b018f3ec31ef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.887325 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.885589 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b730f58-e13c-44a2-a55e-b018f3ec31ef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.887647 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.887521 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74zxr\" (UniqueName: \"kubernetes.io/projected/4b730f58-e13c-44a2-a55e-b018f3ec31ef-kube-api-access-74zxr\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:10.888299 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:10.888278 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4b730f58-e13c-44a2-a55e-b018f3ec31ef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4b730f58-e13c-44a2-a55e-b018f3ec31ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:11.000940 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:11.000894 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:12:11.004806 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:11.004785 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6af73598-b3a0-4eeb-85b2-170cb4cdc210" path="/var/lib/kubelet/pods/6af73598-b3a0-4eeb-85b2-170cb4cdc210/volumes" Jun 11 23:12:11.141268 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:11.141181 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 23:12:11.144135 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:12:11.144111 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b730f58_e13c_44a2_a55e_b018f3ec31ef.slice/crio-e36ef2d58b8ce5f88cbd8acc3bf7da4055c9e51db5c2ee43ff6f985ae626c09b WatchSource:0}: Error finding container e36ef2d58b8ce5f88cbd8acc3bf7da4055c9e51db5c2ee43ff6f985ae626c09b: Status 404 returned error can't find the container with id e36ef2d58b8ce5f88cbd8acc3bf7da4055c9e51db5c2ee43ff6f985ae626c09b Jun 11 23:12:11.602008 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:11.601900 2563 generic.go:356] "Generic (PLEG): container finished" podID="4b730f58-e13c-44a2-a55e-b018f3ec31ef" containerID="831721e5cd92ebbf1c49fb9b872f2fb5e996b9565cba66eb20fc36e03a59ef56" exitCode=0 Jun 11 23:12:11.602008 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:11.601940 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b730f58-e13c-44a2-a55e-b018f3ec31ef","Type":"ContainerDied","Data":"831721e5cd92ebbf1c49fb9b872f2fb5e996b9565cba66eb20fc36e03a59ef56"} Jun 11 23:12:11.602416 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:11.602023 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b730f58-e13c-44a2-a55e-b018f3ec31ef","Type":"ContainerStarted","Data":"e36ef2d58b8ce5f88cbd8acc3bf7da4055c9e51db5c2ee43ff6f985ae626c09b"} Jun 11 23:12:12.551222 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.551189 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-564d9bf697-s59ps"] Jun 11 23:12:12.554153 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.554133 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-564d9bf697-s59ps" Jun 11 23:12:12.557528 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.557497 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 11 23:12:12.557910 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.557887 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 11 23:12:12.558236 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.558217 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 11 23:12:12.558426 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.558406 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 11 23:12:12.558953 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.558933 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-5hbxr\"" Jun 11 23:12:12.559995 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.559954 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 11 23:12:12.563704 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.563683 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 11 23:12:12.574388 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.574349 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-564d9bf697-s59ps"] Jun 11 23:12:12.611122 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.611092 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b730f58-e13c-44a2-a55e-b018f3ec31ef","Type":"ContainerStarted","Data":"4a2b66a29bb30ebdccada7eff712b36e69dc9ddee2024e519ebe294650cece6c"} Jun 11 23:12:12.611544 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.611153 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b730f58-e13c-44a2-a55e-b018f3ec31ef","Type":"ContainerStarted","Data":"cd1c2274bbaa4c509ca30e7f77e1ff35404e88a9165278e58ddf67aa65e29e59"} Jun 11 23:12:12.611544 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.611179 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b730f58-e13c-44a2-a55e-b018f3ec31ef","Type":"ContainerStarted","Data":"c7cc64cab7b0a24f5bb9acfd0901922caa5ba3f47854aa1571acaa6997e1ff8f"} Jun 11 23:12:12.611544 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.611203 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b730f58-e13c-44a2-a55e-b018f3ec31ef","Type":"ContainerStarted","Data":"bd648b57b8f91bf62fcd7c40f9d28af369233763616aa4fe948a79a4a7a5a8ac"} Jun 11 23:12:12.611544 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.611228 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b730f58-e13c-44a2-a55e-b018f3ec31ef","Type":"ContainerStarted","Data":"f715ffb8daa45f0555f4b5ea8e4ad3f89b91e145ce0c354dc41e1731053af0f5"} Jun 11 23:12:12.611544 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.611255 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b730f58-e13c-44a2-a55e-b018f3ec31ef","Type":"ContainerStarted","Data":"795de2566398984480c52a11c76f480c65e70329dbe301d97b7706842890c56b"} Jun 11 23:12:12.639652 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.639601 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.62451981 podStartE2EDuration="2.639579339s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.059529ms" isStatefulPod=false podCreationTimestamp="2026-06-11 23:12:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:12:12.63769475 +0000 UTC m=+106.060479717" watchObservedRunningTime="2026-06-11 23:12:12.639579339 +0000 UTC m=+106.062364307" Jun 11 23:12:12.696527 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.696491 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a70b0c3e-a04f-448b-a89e-19116475728e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-564d9bf697-s59ps\" (UID: \"a70b0c3e-a04f-448b-a89e-19116475728e\") " pod="openshift-monitoring/telemeter-client-564d9bf697-s59ps" Jun 11 23:12:12.696683 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.696596 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a70b0c3e-a04f-448b-a89e-19116475728e-secret-telemeter-client\") pod \"telemeter-client-564d9bf697-s59ps\" (UID: \"a70b0c3e-a04f-448b-a89e-19116475728e\") " pod="openshift-monitoring/telemeter-client-564d9bf697-s59ps" Jun 11 23:12:12.696683 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.696639 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a70b0c3e-a04f-448b-a89e-19116475728e-telemeter-client-tls\") pod \"telemeter-client-564d9bf697-s59ps\" (UID: \"a70b0c3e-a04f-448b-a89e-19116475728e\") " pod="openshift-monitoring/telemeter-client-564d9bf697-s59ps" Jun 11 23:12:12.696767 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.696701 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a70b0c3e-a04f-448b-a89e-19116475728e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-564d9bf697-s59ps\" (UID: \"a70b0c3e-a04f-448b-a89e-19116475728e\") " pod="openshift-monitoring/telemeter-client-564d9bf697-s59ps" Jun 11 23:12:12.696874 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.696855 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kksbl\" (UniqueName: \"kubernetes.io/projected/a70b0c3e-a04f-448b-a89e-19116475728e-kube-api-access-kksbl\") pod \"telemeter-client-564d9bf697-s59ps\" (UID: \"a70b0c3e-a04f-448b-a89e-19116475728e\") " pod="openshift-monitoring/telemeter-client-564d9bf697-s59ps" Jun 11 23:12:12.696995 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.696960 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a70b0c3e-a04f-448b-a89e-19116475728e-metrics-client-ca\") pod \"telemeter-client-564d9bf697-s59ps\" (UID: \"a70b0c3e-a04f-448b-a89e-19116475728e\") " pod="openshift-monitoring/telemeter-client-564d9bf697-s59ps" Jun 11 23:12:12.697077 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.697060 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a70b0c3e-a04f-448b-a89e-19116475728e-serving-certs-ca-bundle\") pod \"telemeter-client-564d9bf697-s59ps\" (UID: \"a70b0c3e-a04f-448b-a89e-19116475728e\") " pod="openshift-monitoring/telemeter-client-564d9bf697-s59ps" Jun 11 23:12:12.697172 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.697156 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a70b0c3e-a04f-448b-a89e-19116475728e-federate-client-tls\") pod \"telemeter-client-564d9bf697-s59ps\" (UID: \"a70b0c3e-a04f-448b-a89e-19116475728e\") " pod="openshift-monitoring/telemeter-client-564d9bf697-s59ps" Jun 11 23:12:12.797805 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.797761 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a70b0c3e-a04f-448b-a89e-19116475728e-metrics-client-ca\") pod \"telemeter-client-564d9bf697-s59ps\" (UID: \"a70b0c3e-a04f-448b-a89e-19116475728e\") " pod="openshift-monitoring/telemeter-client-564d9bf697-s59ps" Jun 11 23:12:12.798059 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.797813 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a70b0c3e-a04f-448b-a89e-19116475728e-serving-certs-ca-bundle\") pod \"telemeter-client-564d9bf697-s59ps\" (UID: \"a70b0c3e-a04f-448b-a89e-19116475728e\") " pod="openshift-monitoring/telemeter-client-564d9bf697-s59ps" Jun 11 23:12:12.798059 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.797843 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a70b0c3e-a04f-448b-a89e-19116475728e-federate-client-tls\") pod \"telemeter-client-564d9bf697-s59ps\" (UID: \"a70b0c3e-a04f-448b-a89e-19116475728e\") " pod="openshift-monitoring/telemeter-client-564d9bf697-s59ps" Jun 11 23:12:12.798059 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.797863 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a70b0c3e-a04f-448b-a89e-19116475728e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-564d9bf697-s59ps\" (UID: \"a70b0c3e-a04f-448b-a89e-19116475728e\") " pod="openshift-monitoring/telemeter-client-564d9bf697-s59ps" Jun 11 23:12:12.798059 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.797897 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a70b0c3e-a04f-448b-a89e-19116475728e-secret-telemeter-client\") pod \"telemeter-client-564d9bf697-s59ps\" (UID: \"a70b0c3e-a04f-448b-a89e-19116475728e\") " pod="openshift-monitoring/telemeter-client-564d9bf697-s59ps" Jun 11 23:12:12.798059 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.798043 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a70b0c3e-a04f-448b-a89e-19116475728e-telemeter-client-tls\") pod \"telemeter-client-564d9bf697-s59ps\" (UID: \"a70b0c3e-a04f-448b-a89e-19116475728e\") " pod="openshift-monitoring/telemeter-client-564d9bf697-s59ps" Jun 11 23:12:12.798335 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.798108 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a70b0c3e-a04f-448b-a89e-19116475728e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-564d9bf697-s59ps\" (UID: \"a70b0c3e-a04f-448b-a89e-19116475728e\") " pod="openshift-monitoring/telemeter-client-564d9bf697-s59ps" Jun 11 23:12:12.798335 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.798185 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kksbl\" (UniqueName: \"kubernetes.io/projected/a70b0c3e-a04f-448b-a89e-19116475728e-kube-api-access-kksbl\") pod \"telemeter-client-564d9bf697-s59ps\" (UID: \"a70b0c3e-a04f-448b-a89e-19116475728e\") " pod="openshift-monitoring/telemeter-client-564d9bf697-s59ps" Jun 11 23:12:12.798634 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.798608 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a70b0c3e-a04f-448b-a89e-19116475728e-metrics-client-ca\") pod \"telemeter-client-564d9bf697-s59ps\" (UID: \"a70b0c3e-a04f-448b-a89e-19116475728e\") " pod="openshift-monitoring/telemeter-client-564d9bf697-s59ps" Jun 11 23:12:12.798746 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.798681 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a70b0c3e-a04f-448b-a89e-19116475728e-serving-certs-ca-bundle\") pod \"telemeter-client-564d9bf697-s59ps\" (UID: \"a70b0c3e-a04f-448b-a89e-19116475728e\") " pod="openshift-monitoring/telemeter-client-564d9bf697-s59ps" Jun 11 23:12:12.798854 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.798833 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a70b0c3e-a04f-448b-a89e-19116475728e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-564d9bf697-s59ps\" (UID: \"a70b0c3e-a04f-448b-a89e-19116475728e\") " pod="openshift-monitoring/telemeter-client-564d9bf697-s59ps" Jun 11 23:12:12.800520 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.800478 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a70b0c3e-a04f-448b-a89e-19116475728e-telemeter-client-tls\") pod \"telemeter-client-564d9bf697-s59ps\" (UID: \"a70b0c3e-a04f-448b-a89e-19116475728e\") " pod="openshift-monitoring/telemeter-client-564d9bf697-s59ps" Jun 11 23:12:12.800623 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.800555 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a70b0c3e-a04f-448b-a89e-19116475728e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-564d9bf697-s59ps\" (UID: \"a70b0c3e-a04f-448b-a89e-19116475728e\") " pod="openshift-monitoring/telemeter-client-564d9bf697-s59ps" Jun 11 23:12:12.800866 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.800843 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a70b0c3e-a04f-448b-a89e-19116475728e-federate-client-tls\") pod \"telemeter-client-564d9bf697-s59ps\" (UID: \"a70b0c3e-a04f-448b-a89e-19116475728e\") " pod="openshift-monitoring/telemeter-client-564d9bf697-s59ps" Jun 11 23:12:12.800971 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.800944 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a70b0c3e-a04f-448b-a89e-19116475728e-secret-telemeter-client\") pod \"telemeter-client-564d9bf697-s59ps\" (UID: \"a70b0c3e-a04f-448b-a89e-19116475728e\") " pod="openshift-monitoring/telemeter-client-564d9bf697-s59ps" Jun 11 23:12:12.806607 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.806564 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kksbl\" (UniqueName: \"kubernetes.io/projected/a70b0c3e-a04f-448b-a89e-19116475728e-kube-api-access-kksbl\") pod \"telemeter-client-564d9bf697-s59ps\" (UID: \"a70b0c3e-a04f-448b-a89e-19116475728e\") " pod="openshift-monitoring/telemeter-client-564d9bf697-s59ps" Jun 11 23:12:12.865218 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:12.865185 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-564d9bf697-s59ps" Jun 11 23:12:13.004808 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:12:13.004778 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda70b0c3e_a04f_448b_a89e_19116475728e.slice/crio-abcb36f2b6e65c457a2e9121802de3a1fcdf3d7ff4b296a3f4934593afbbaea8 WatchSource:0}: Error finding container abcb36f2b6e65c457a2e9121802de3a1fcdf3d7ff4b296a3f4934593afbbaea8: Status 404 returned error can't find the container with id abcb36f2b6e65c457a2e9121802de3a1fcdf3d7ff4b296a3f4934593afbbaea8 Jun 11 23:12:13.005505 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:13.005483 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-564d9bf697-s59ps"] Jun 11 23:12:13.616718 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:13.616686 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-564d9bf697-s59ps" event={"ID":"a70b0c3e-a04f-448b-a89e-19116475728e","Type":"ContainerStarted","Data":"abcb36f2b6e65c457a2e9121802de3a1fcdf3d7ff4b296a3f4934593afbbaea8"} Jun 11 23:12:15.629100 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:15.629066 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-564d9bf697-s59ps" event={"ID":"a70b0c3e-a04f-448b-a89e-19116475728e","Type":"ContainerStarted","Data":"128d79e3d8ec9e8463b0185494f3f8151dd555f3a28aa83af9ef7ad10a684e4f"} Jun 11 23:12:15.629451 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:15.629126 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-564d9bf697-s59ps" event={"ID":"a70b0c3e-a04f-448b-a89e-19116475728e","Type":"ContainerStarted","Data":"38482789e7d5da5a45ad866b476f4f44522080adf7dbd0991558a632bad4246c"} Jun 11 23:12:15.629451 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:15.629153 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-564d9bf697-s59ps" event={"ID":"a70b0c3e-a04f-448b-a89e-19116475728e","Type":"ContainerStarted","Data":"58baef51a1fb18f4d5f70a4a006d264b721ddd70595bebdc99b7880b1406372b"} Jun 11 23:12:15.654375 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:15.652467 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-564d9bf697-s59ps" podStartSLOduration=1.440137933 podStartE2EDuration="3.652446185s" totalImagesPullingTime="2.212308252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:12:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:12:15.650689267 +0000 UTC m=+109.073474235" watchObservedRunningTime="2026-06-11 23:12:15.652446185 +0000 UTC m=+109.075231153" Jun 11 23:12:16.468240 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:16.468203 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65dfdf47f7-c42pj"] Jun 11 23:12:16.471586 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:16.471566 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65dfdf47f7-c42pj" Jun 11 23:12:16.482667 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:16.482641 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65dfdf47f7-c42pj"] Jun 11 23:12:16.636623 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:16.636576 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlxs6\" (UniqueName: \"kubernetes.io/projected/4f3cb5cc-9231-456f-99c4-8890127bf5e4-kube-api-access-nlxs6\") pod \"console-65dfdf47f7-c42pj\" (UID: \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\") " pod="openshift-console/console-65dfdf47f7-c42pj" Jun 11 23:12:16.637061 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:16.636632 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f3cb5cc-9231-456f-99c4-8890127bf5e4-service-ca\") pod \"console-65dfdf47f7-c42pj\" (UID: \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\") " pod="openshift-console/console-65dfdf47f7-c42pj" Jun 11 23:12:16.637061 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:16.636677 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f3cb5cc-9231-456f-99c4-8890127bf5e4-oauth-serving-cert\") pod \"console-65dfdf47f7-c42pj\" (UID: \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\") " pod="openshift-console/console-65dfdf47f7-c42pj" Jun 11 23:12:16.637061 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:16.636713 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3cb5cc-9231-456f-99c4-8890127bf5e4-trusted-ca-bundle\") pod \"console-65dfdf47f7-c42pj\" (UID: \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\") " pod="openshift-console/console-65dfdf47f7-c42pj" Jun 11 23:12:16.637061 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:16.636736 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f3cb5cc-9231-456f-99c4-8890127bf5e4-console-config\") pod \"console-65dfdf47f7-c42pj\" (UID: \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\") " pod="openshift-console/console-65dfdf47f7-c42pj" Jun 11 23:12:16.637061 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:16.636837 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f3cb5cc-9231-456f-99c4-8890127bf5e4-console-serving-cert\") pod \"console-65dfdf47f7-c42pj\" (UID: \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\") " pod="openshift-console/console-65dfdf47f7-c42pj" Jun 11 23:12:16.637061 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:16.636870 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f3cb5cc-9231-456f-99c4-8890127bf5e4-console-oauth-config\") pod \"console-65dfdf47f7-c42pj\" (UID: \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\") " pod="openshift-console/console-65dfdf47f7-c42pj" Jun 11 23:12:16.737933 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:16.737835 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlxs6\" (UniqueName: \"kubernetes.io/projected/4f3cb5cc-9231-456f-99c4-8890127bf5e4-kube-api-access-nlxs6\") pod \"console-65dfdf47f7-c42pj\" (UID: \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\") " pod="openshift-console/console-65dfdf47f7-c42pj" Jun 11 23:12:16.738117 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:16.738026 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f3cb5cc-9231-456f-99c4-8890127bf5e4-service-ca\") pod \"console-65dfdf47f7-c42pj\" (UID: \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\") " pod="openshift-console/console-65dfdf47f7-c42pj" Jun 11 23:12:16.738117 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:16.738108 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f3cb5cc-9231-456f-99c4-8890127bf5e4-oauth-serving-cert\") pod \"console-65dfdf47f7-c42pj\" (UID: \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\") " pod="openshift-console/console-65dfdf47f7-c42pj" Jun 11 23:12:16.738224 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:16.738177 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3cb5cc-9231-456f-99c4-8890127bf5e4-trusted-ca-bundle\") pod \"console-65dfdf47f7-c42pj\" (UID: \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\") " pod="openshift-console/console-65dfdf47f7-c42pj" Jun 11 23:12:16.738224 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:16.738215 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f3cb5cc-9231-456f-99c4-8890127bf5e4-console-config\") pod \"console-65dfdf47f7-c42pj\" (UID: \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\") " pod="openshift-console/console-65dfdf47f7-c42pj" Jun 11 23:12:16.738698 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:16.738505 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f3cb5cc-9231-456f-99c4-8890127bf5e4-console-serving-cert\") pod \"console-65dfdf47f7-c42pj\" (UID: \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\") " pod="openshift-console/console-65dfdf47f7-c42pj" Jun 11 23:12:16.738698 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:16.738565 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f3cb5cc-9231-456f-99c4-8890127bf5e4-console-oauth-config\") pod \"console-65dfdf47f7-c42pj\" (UID: \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\") " pod="openshift-console/console-65dfdf47f7-c42pj" Jun 11 23:12:16.738893 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:16.738799 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f3cb5cc-9231-456f-99c4-8890127bf5e4-oauth-serving-cert\") pod \"console-65dfdf47f7-c42pj\" (UID: \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\") " pod="openshift-console/console-65dfdf47f7-c42pj" Jun 11 23:12:16.738893 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:16.738866 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f3cb5cc-9231-456f-99c4-8890127bf5e4-service-ca\") pod \"console-65dfdf47f7-c42pj\" (UID: \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\") " pod="openshift-console/console-65dfdf47f7-c42pj" Jun 11 23:12:16.739050 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:16.738959 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f3cb5cc-9231-456f-99c4-8890127bf5e4-console-config\") pod \"console-65dfdf47f7-c42pj\" (UID: \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\") " pod="openshift-console/console-65dfdf47f7-c42pj" Jun 11 23:12:16.739050 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:16.738971 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3cb5cc-9231-456f-99c4-8890127bf5e4-trusted-ca-bundle\") pod \"console-65dfdf47f7-c42pj\" (UID: \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\") " pod="openshift-console/console-65dfdf47f7-c42pj" Jun 11 23:12:16.740931 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:16.740908 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f3cb5cc-9231-456f-99c4-8890127bf5e4-console-oauth-config\") pod \"console-65dfdf47f7-c42pj\" (UID: \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\") " pod="openshift-console/console-65dfdf47f7-c42pj" Jun 11 23:12:16.741052 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:16.741033 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f3cb5cc-9231-456f-99c4-8890127bf5e4-console-serving-cert\") pod \"console-65dfdf47f7-c42pj\" (UID: \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\") " pod="openshift-console/console-65dfdf47f7-c42pj" Jun 11 23:12:16.748217 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:16.748192 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlxs6\" (UniqueName: \"kubernetes.io/projected/4f3cb5cc-9231-456f-99c4-8890127bf5e4-kube-api-access-nlxs6\") pod \"console-65dfdf47f7-c42pj\" (UID: \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\") " pod="openshift-console/console-65dfdf47f7-c42pj" Jun 11 23:12:16.781144 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:16.781107 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65dfdf47f7-c42pj" Jun 11 23:12:16.935259 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:16.935223 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65dfdf47f7-c42pj"] Jun 11 23:12:16.938252 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:12:16.938219 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f3cb5cc_9231_456f_99c4_8890127bf5e4.slice/crio-7b15737ce958127ed9f12c3de50fdd05ed9abb81207c894623d42153c33dbc94 WatchSource:0}: Error finding container 7b15737ce958127ed9f12c3de50fdd05ed9abb81207c894623d42153c33dbc94: Status 404 returned error can't find the container with id 7b15737ce958127ed9f12c3de50fdd05ed9abb81207c894623d42153c33dbc94 Jun 11 23:12:17.639922 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:17.639887 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65dfdf47f7-c42pj" event={"ID":"4f3cb5cc-9231-456f-99c4-8890127bf5e4","Type":"ContainerStarted","Data":"efc926c21b0bcb67cc1e3bb0195fb4eda6b88035910b502bfdadf9402e0073dd"} Jun 11 23:12:17.640304 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:17.639937 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65dfdf47f7-c42pj" event={"ID":"4f3cb5cc-9231-456f-99c4-8890127bf5e4","Type":"ContainerStarted","Data":"7b15737ce958127ed9f12c3de50fdd05ed9abb81207c894623d42153c33dbc94"} Jun 11 23:12:17.662278 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:17.662207 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65dfdf47f7-c42pj" podStartSLOduration=1.6621906709999998 podStartE2EDuration="1.662190671s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:12:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:12:17.659621024 +0000 UTC m=+111.082405992" watchObservedRunningTime="2026-06-11 23:12:17.662190671 +0000 UTC m=+111.084975673" Jun 11 23:12:26.782243 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:26.782207 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65dfdf47f7-c42pj" Jun 11 23:12:26.782631 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:26.782503 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65dfdf47f7-c42pj" Jun 11 23:12:26.787118 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:26.787093 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65dfdf47f7-c42pj" Jun 11 23:12:27.694897 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:27.694870 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65dfdf47f7-c42pj" Jun 11 23:12:27.754018 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:27.753968 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dfbf98945-xm8g2"] Jun 11 23:12:31.350442 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:31.350404 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 23:12:31.350970 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:31.350703 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" containerName="prometheus" containerID="cri-o://7260cec0c10221f4bfda3533acdb9bf19fcbc094ce686b180db83ca782d0e9a0" gracePeriod=600 Jun 11 23:12:31.350970 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:31.350730 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" containerName="kube-rbac-proxy" containerID="cri-o://eb73d732a141843ef88c7b1d504d519a9daceb0b02fbd942de401b57b921315b" gracePeriod=600 Jun 11 23:12:31.350970 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:31.350791 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" containerName="kube-rbac-proxy-thanos" containerID="cri-o://348bbfa78600b11c00dc0c651cb8abfda2508d07df1a14499c81c24337b87cdc" gracePeriod=600 Jun 11 23:12:31.350970 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:31.350737 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" containerName="thanos-sidecar" containerID="cri-o://29017d26c0fe6335eebbc4d367984e4187db3ae1dde072bb1a80e37c897ca277" gracePeriod=600 Jun 11 23:12:31.350970 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:31.350757 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" containerName="kube-rbac-proxy-web" containerID="cri-o://b5b48d88bf7e81085e0093824bb980f9edc0ac02506a5e35324c460a498086a5" gracePeriod=600 Jun 11 23:12:31.350970 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:31.350780 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" containerName="config-reloader" containerID="cri-o://2d5f45ec30d8151c71a4b40c19465b450f41efa6b32641bc90e4725136d38f54" gracePeriod=600 Jun 11 23:12:31.714763 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:31.714733 2563 generic.go:356] "Generic (PLEG): container finished" podID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" containerID="348bbfa78600b11c00dc0c651cb8abfda2508d07df1a14499c81c24337b87cdc" exitCode=0 Jun 11 23:12:31.714763 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:31.714757 2563 generic.go:356] "Generic (PLEG): container finished" podID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" containerID="eb73d732a141843ef88c7b1d504d519a9daceb0b02fbd942de401b57b921315b" exitCode=0 Jun 11 23:12:31.714763 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:31.714766 2563 generic.go:356] "Generic (PLEG): container finished" podID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" containerID="29017d26c0fe6335eebbc4d367984e4187db3ae1dde072bb1a80e37c897ca277" exitCode=0 Jun 11 23:12:31.714763 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:31.714773 2563 generic.go:356] "Generic (PLEG): container finished" podID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" containerID="2d5f45ec30d8151c71a4b40c19465b450f41efa6b32641bc90e4725136d38f54" exitCode=0 Jun 11 23:12:31.715060 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:31.714784 2563 generic.go:356] "Generic (PLEG): container finished" podID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" containerID="7260cec0c10221f4bfda3533acdb9bf19fcbc094ce686b180db83ca782d0e9a0" exitCode=0 Jun 11 23:12:31.715060 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:31.714807 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"376d9ba1-6c0e-4c3c-9b01-510de93b6caa","Type":"ContainerDied","Data":"348bbfa78600b11c00dc0c651cb8abfda2508d07df1a14499c81c24337b87cdc"} Jun 11 23:12:31.715060 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:31.714893 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"376d9ba1-6c0e-4c3c-9b01-510de93b6caa","Type":"ContainerDied","Data":"eb73d732a141843ef88c7b1d504d519a9daceb0b02fbd942de401b57b921315b"} Jun 11 23:12:31.715060 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:31.714921 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"376d9ba1-6c0e-4c3c-9b01-510de93b6caa","Type":"ContainerDied","Data":"29017d26c0fe6335eebbc4d367984e4187db3ae1dde072bb1a80e37c897ca277"} Jun 11 23:12:31.715060 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:31.714946 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"376d9ba1-6c0e-4c3c-9b01-510de93b6caa","Type":"ContainerDied","Data":"2d5f45ec30d8151c71a4b40c19465b450f41efa6b32641bc90e4725136d38f54"} Jun 11 23:12:31.715060 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:31.714969 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"376d9ba1-6c0e-4c3c-9b01-510de93b6caa","Type":"ContainerDied","Data":"7260cec0c10221f4bfda3533acdb9bf19fcbc094ce686b180db83ca782d0e9a0"} Jun 11 23:12:32.611919 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.611894 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.676494 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.676391 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " Jun 11 23:12:32.676494 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.676452 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-prometheus-k8s-rulefiles-0\") pod \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " Jun 11 23:12:32.676494 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.676481 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-configmap-kubelet-serving-ca-bundle\") pod \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " Jun 11 23:12:32.676765 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.676510 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-metrics-client-certs\") pod \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " Jun 11 23:12:32.676765 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.676536 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-prometheus-k8s-tls\") pod \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " Jun 11 23:12:32.676765 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.676577 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-config\") pod \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " Jun 11 23:12:32.676765 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.676610 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-configmap-metrics-client-ca\") pod \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " Jun 11 23:12:32.676765 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.676634 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-thanos-prometheus-http-client-file\") pod \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " Jun 11 23:12:32.676765 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.676657 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-prometheus-k8s-rulefiles-1\") pod \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " Jun 11 23:12:32.676765 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.676685 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-web-config\") pod \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " Jun 11 23:12:32.676765 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.676737 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-tls-assets\") pod \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " Jun 11 23:12:32.677177 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.677000 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "376d9ba1-6c0e-4c3c-9b01-510de93b6caa" (UID: "376d9ba1-6c0e-4c3c-9b01-510de93b6caa"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:12:32.677257 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.677226 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "376d9ba1-6c0e-4c3c-9b01-510de93b6caa" (UID: "376d9ba1-6c0e-4c3c-9b01-510de93b6caa"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:12:32.677318 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.677291 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-prometheus-k8s-rulefiles-2\") pod \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " Jun 11 23:12:32.677366 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.677334 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-config-out\") pod \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " Jun 11 23:12:32.677421 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.677367 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dsj56\" (UniqueName: \"kubernetes.io/projected/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-kube-api-access-dsj56\") pod \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " Jun 11 23:12:32.677421 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.677395 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-configmap-serving-certs-ca-bundle\") pod \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " Jun 11 23:12:32.677523 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.677421 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-prometheus-k8s-db\") pod \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " Jun 11 23:12:32.677523 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.677480 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-kube-rbac-proxy\") pod \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " Jun 11 23:12:32.677628 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.677532 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-grpc-tls\") pod \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " Jun 11 23:12:32.677628 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.677561 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-prometheus-trusted-ca-bundle\") pod \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " Jun 11 23:12:32.677628 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.677588 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\" (UID: \"376d9ba1-6c0e-4c3c-9b01-510de93b6caa\") " Jun 11 23:12:32.677932 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.677912 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:32.678070 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.677940 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:32.679011 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.678472 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "376d9ba1-6c0e-4c3c-9b01-510de93b6caa" (UID: "376d9ba1-6c0e-4c3c-9b01-510de93b6caa"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:12:32.679011 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.678506 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "376d9ba1-6c0e-4c3c-9b01-510de93b6caa" (UID: "376d9ba1-6c0e-4c3c-9b01-510de93b6caa"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:12:32.679011 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.678590 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "376d9ba1-6c0e-4c3c-9b01-510de93b6caa" (UID: "376d9ba1-6c0e-4c3c-9b01-510de93b6caa"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:12:32.679011 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.678885 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "376d9ba1-6c0e-4c3c-9b01-510de93b6caa" (UID: "376d9ba1-6c0e-4c3c-9b01-510de93b6caa"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:12:32.679659 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.679638 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "376d9ba1-6c0e-4c3c-9b01-510de93b6caa" (UID: "376d9ba1-6c0e-4c3c-9b01-510de93b6caa"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:12:32.679818 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.679664 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "376d9ba1-6c0e-4c3c-9b01-510de93b6caa" (UID: "376d9ba1-6c0e-4c3c-9b01-510de93b6caa"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:12:32.679818 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.679677 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "376d9ba1-6c0e-4c3c-9b01-510de93b6caa" (UID: "376d9ba1-6c0e-4c3c-9b01-510de93b6caa"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:12:32.680419 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.680378 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "376d9ba1-6c0e-4c3c-9b01-510de93b6caa" (UID: "376d9ba1-6c0e-4c3c-9b01-510de93b6caa"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:12:32.682688 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.682644 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "376d9ba1-6c0e-4c3c-9b01-510de93b6caa" (UID: "376d9ba1-6c0e-4c3c-9b01-510de93b6caa"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:12:32.683123 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.683097 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "376d9ba1-6c0e-4c3c-9b01-510de93b6caa" (UID: "376d9ba1-6c0e-4c3c-9b01-510de93b6caa"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:12:32.683315 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.683287 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "376d9ba1-6c0e-4c3c-9b01-510de93b6caa" (UID: "376d9ba1-6c0e-4c3c-9b01-510de93b6caa"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:12:32.683562 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.683429 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "376d9ba1-6c0e-4c3c-9b01-510de93b6caa" (UID: "376d9ba1-6c0e-4c3c-9b01-510de93b6caa"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:12:32.683562 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.683503 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-kube-api-access-dsj56" (OuterVolumeSpecName: "kube-api-access-dsj56") pod "376d9ba1-6c0e-4c3c-9b01-510de93b6caa" (UID: "376d9ba1-6c0e-4c3c-9b01-510de93b6caa"). InnerVolumeSpecName "kube-api-access-dsj56". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:12:32.683709 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.683622 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "376d9ba1-6c0e-4c3c-9b01-510de93b6caa" (UID: "376d9ba1-6c0e-4c3c-9b01-510de93b6caa"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:12:32.683812 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.683783 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-config-out" (OuterVolumeSpecName: "config-out") pod "376d9ba1-6c0e-4c3c-9b01-510de93b6caa" (UID: "376d9ba1-6c0e-4c3c-9b01-510de93b6caa"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:12:32.684537 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.684508 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-config" (OuterVolumeSpecName: "config") pod "376d9ba1-6c0e-4c3c-9b01-510de93b6caa" (UID: "376d9ba1-6c0e-4c3c-9b01-510de93b6caa"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:12:32.685302 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.685281 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "376d9ba1-6c0e-4c3c-9b01-510de93b6caa" (UID: "376d9ba1-6c0e-4c3c-9b01-510de93b6caa"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:12:32.694620 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.694593 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-web-config" (OuterVolumeSpecName: "web-config") pod "376d9ba1-6c0e-4c3c-9b01-510de93b6caa" (UID: "376d9ba1-6c0e-4c3c-9b01-510de93b6caa"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:12:32.722746 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.722714 2563 generic.go:356] "Generic (PLEG): container finished" podID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" containerID="b5b48d88bf7e81085e0093824bb980f9edc0ac02506a5e35324c460a498086a5" exitCode=0 Jun 11 23:12:32.722899 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.722790 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.722899 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.722789 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"376d9ba1-6c0e-4c3c-9b01-510de93b6caa","Type":"ContainerDied","Data":"b5b48d88bf7e81085e0093824bb980f9edc0ac02506a5e35324c460a498086a5"} Jun 11 23:12:32.722899 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.722855 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"376d9ba1-6c0e-4c3c-9b01-510de93b6caa","Type":"ContainerDied","Data":"fa90d371a8ba8f76798e3094eec7c8099229203c5ff7398426b2d1d30711e5f4"} Jun 11 23:12:32.722899 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.722890 2563 scope.go:117] "RemoveContainer" containerID="348bbfa78600b11c00dc0c651cb8abfda2508d07df1a14499c81c24337b87cdc" Jun 11 23:12:32.734536 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.734515 2563 scope.go:117] "RemoveContainer" containerID="eb73d732a141843ef88c7b1d504d519a9daceb0b02fbd942de401b57b921315b" Jun 11 23:12:32.742053 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.742035 2563 scope.go:117] "RemoveContainer" containerID="b5b48d88bf7e81085e0093824bb980f9edc0ac02506a5e35324c460a498086a5" Jun 11 23:12:32.749562 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.749541 2563 scope.go:117] "RemoveContainer" containerID="29017d26c0fe6335eebbc4d367984e4187db3ae1dde072bb1a80e37c897ca277" Jun 11 23:12:32.750304 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.750281 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 23:12:32.755310 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.755288 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 23:12:32.757249 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.757224 2563 scope.go:117] "RemoveContainer" containerID="2d5f45ec30d8151c71a4b40c19465b450f41efa6b32641bc90e4725136d38f54" Jun 11 23:12:32.766534 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.766517 2563 scope.go:117] "RemoveContainer" containerID="7260cec0c10221f4bfda3533acdb9bf19fcbc094ce686b180db83ca782d0e9a0" Jun 11 23:12:32.773927 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.773912 2563 scope.go:117] "RemoveContainer" containerID="f7756ddca2a222579242331af6a84e33ae9e00a5e082401f82cf27845e7e4b92" Jun 11 23:12:32.779362 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.779336 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-tls-assets\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:32.779468 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.779395 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:32.779468 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.779414 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-config-out\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:32.779468 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.779430 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dsj56\" (UniqueName: \"kubernetes.io/projected/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-kube-api-access-dsj56\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:32.779468 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.779445 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:32.779468 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.779462 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-prometheus-k8s-db\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:32.779620 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.779478 2563 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-kube-rbac-proxy\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:32.779620 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.779491 2563 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-grpc-tls\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:32.779620 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.779504 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:32.779620 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.779518 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:32.779620 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.779533 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:32.779620 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.779548 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:32.779620 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.779563 2563 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-metrics-client-certs\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:32.779620 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.779578 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:32.779620 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.779592 2563 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-config\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:32.779620 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.779607 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-configmap-metrics-client-ca\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:32.779894 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.779623 2563 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:32.779894 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.779661 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/376d9ba1-6c0e-4c3c-9b01-510de93b6caa-web-config\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:32.781338 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.781320 2563 scope.go:117] "RemoveContainer" containerID="348bbfa78600b11c00dc0c651cb8abfda2508d07df1a14499c81c24337b87cdc" Jun 11 23:12:32.781658 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:12:32.781636 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"348bbfa78600b11c00dc0c651cb8abfda2508d07df1a14499c81c24337b87cdc\": container with ID starting with 348bbfa78600b11c00dc0c651cb8abfda2508d07df1a14499c81c24337b87cdc not found: ID does not exist" containerID="348bbfa78600b11c00dc0c651cb8abfda2508d07df1a14499c81c24337b87cdc" Jun 11 23:12:32.781720 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.781670 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"348bbfa78600b11c00dc0c651cb8abfda2508d07df1a14499c81c24337b87cdc"} err="failed to get container status \"348bbfa78600b11c00dc0c651cb8abfda2508d07df1a14499c81c24337b87cdc\": rpc error: code = NotFound desc = could not find container \"348bbfa78600b11c00dc0c651cb8abfda2508d07df1a14499c81c24337b87cdc\": container with ID starting with 348bbfa78600b11c00dc0c651cb8abfda2508d07df1a14499c81c24337b87cdc not found: ID does not exist" Jun 11 23:12:32.781720 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.781701 2563 scope.go:117] "RemoveContainer" containerID="eb73d732a141843ef88c7b1d504d519a9daceb0b02fbd942de401b57b921315b" Jun 11 23:12:32.781999 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:12:32.781969 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb73d732a141843ef88c7b1d504d519a9daceb0b02fbd942de401b57b921315b\": container with ID starting with eb73d732a141843ef88c7b1d504d519a9daceb0b02fbd942de401b57b921315b not found: ID does not exist" containerID="eb73d732a141843ef88c7b1d504d519a9daceb0b02fbd942de401b57b921315b" Jun 11 23:12:32.782045 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.782005 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb73d732a141843ef88c7b1d504d519a9daceb0b02fbd942de401b57b921315b"} err="failed to get container status \"eb73d732a141843ef88c7b1d504d519a9daceb0b02fbd942de401b57b921315b\": rpc error: code = NotFound desc = could not find container \"eb73d732a141843ef88c7b1d504d519a9daceb0b02fbd942de401b57b921315b\": container with ID starting with eb73d732a141843ef88c7b1d504d519a9daceb0b02fbd942de401b57b921315b not found: ID does not exist" Jun 11 23:12:32.782045 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.782021 2563 scope.go:117] "RemoveContainer" containerID="b5b48d88bf7e81085e0093824bb980f9edc0ac02506a5e35324c460a498086a5" Jun 11 23:12:32.782249 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:12:32.782233 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5b48d88bf7e81085e0093824bb980f9edc0ac02506a5e35324c460a498086a5\": container with ID starting with b5b48d88bf7e81085e0093824bb980f9edc0ac02506a5e35324c460a498086a5 not found: ID does not exist" containerID="b5b48d88bf7e81085e0093824bb980f9edc0ac02506a5e35324c460a498086a5" Jun 11 23:12:32.782286 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.782252 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5b48d88bf7e81085e0093824bb980f9edc0ac02506a5e35324c460a498086a5"} err="failed to get container status \"b5b48d88bf7e81085e0093824bb980f9edc0ac02506a5e35324c460a498086a5\": rpc error: code = NotFound desc = could not find container \"b5b48d88bf7e81085e0093824bb980f9edc0ac02506a5e35324c460a498086a5\": container with ID starting with b5b48d88bf7e81085e0093824bb980f9edc0ac02506a5e35324c460a498086a5 not found: ID does not exist" Jun 11 23:12:32.782286 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.782265 2563 scope.go:117] "RemoveContainer" containerID="29017d26c0fe6335eebbc4d367984e4187db3ae1dde072bb1a80e37c897ca277" Jun 11 23:12:32.782449 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:12:32.782434 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29017d26c0fe6335eebbc4d367984e4187db3ae1dde072bb1a80e37c897ca277\": container with ID starting with 29017d26c0fe6335eebbc4d367984e4187db3ae1dde072bb1a80e37c897ca277 not found: ID does not exist" containerID="29017d26c0fe6335eebbc4d367984e4187db3ae1dde072bb1a80e37c897ca277" Jun 11 23:12:32.782490 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.782455 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29017d26c0fe6335eebbc4d367984e4187db3ae1dde072bb1a80e37c897ca277"} err="failed to get container status \"29017d26c0fe6335eebbc4d367984e4187db3ae1dde072bb1a80e37c897ca277\": rpc error: code = NotFound desc = could not find container \"29017d26c0fe6335eebbc4d367984e4187db3ae1dde072bb1a80e37c897ca277\": container with ID starting with 29017d26c0fe6335eebbc4d367984e4187db3ae1dde072bb1a80e37c897ca277 not found: ID does not exist" Jun 11 23:12:32.782490 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.782469 2563 scope.go:117] "RemoveContainer" containerID="2d5f45ec30d8151c71a4b40c19465b450f41efa6b32641bc90e4725136d38f54" Jun 11 23:12:32.782683 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:12:32.782669 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d5f45ec30d8151c71a4b40c19465b450f41efa6b32641bc90e4725136d38f54\": container with ID starting with 2d5f45ec30d8151c71a4b40c19465b450f41efa6b32641bc90e4725136d38f54 not found: ID does not exist" containerID="2d5f45ec30d8151c71a4b40c19465b450f41efa6b32641bc90e4725136d38f54" Jun 11 23:12:32.782729 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.782688 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d5f45ec30d8151c71a4b40c19465b450f41efa6b32641bc90e4725136d38f54"} err="failed to get container status \"2d5f45ec30d8151c71a4b40c19465b450f41efa6b32641bc90e4725136d38f54\": rpc error: code = NotFound desc = could not find container \"2d5f45ec30d8151c71a4b40c19465b450f41efa6b32641bc90e4725136d38f54\": container with ID starting with 2d5f45ec30d8151c71a4b40c19465b450f41efa6b32641bc90e4725136d38f54 not found: ID does not exist" Jun 11 23:12:32.782729 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.782700 2563 scope.go:117] "RemoveContainer" containerID="7260cec0c10221f4bfda3533acdb9bf19fcbc094ce686b180db83ca782d0e9a0" Jun 11 23:12:32.782912 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:12:32.782898 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7260cec0c10221f4bfda3533acdb9bf19fcbc094ce686b180db83ca782d0e9a0\": container with ID starting with 7260cec0c10221f4bfda3533acdb9bf19fcbc094ce686b180db83ca782d0e9a0 not found: ID does not exist" containerID="7260cec0c10221f4bfda3533acdb9bf19fcbc094ce686b180db83ca782d0e9a0" Jun 11 23:12:32.782957 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.782914 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7260cec0c10221f4bfda3533acdb9bf19fcbc094ce686b180db83ca782d0e9a0"} err="failed to get container status \"7260cec0c10221f4bfda3533acdb9bf19fcbc094ce686b180db83ca782d0e9a0\": rpc error: code = NotFound desc = could not find container \"7260cec0c10221f4bfda3533acdb9bf19fcbc094ce686b180db83ca782d0e9a0\": container with ID starting with 7260cec0c10221f4bfda3533acdb9bf19fcbc094ce686b180db83ca782d0e9a0 not found: ID does not exist" Jun 11 23:12:32.782957 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.782925 2563 scope.go:117] "RemoveContainer" containerID="f7756ddca2a222579242331af6a84e33ae9e00a5e082401f82cf27845e7e4b92" Jun 11 23:12:32.783440 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:12:32.783421 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7756ddca2a222579242331af6a84e33ae9e00a5e082401f82cf27845e7e4b92\": container with ID starting with f7756ddca2a222579242331af6a84e33ae9e00a5e082401f82cf27845e7e4b92 not found: ID does not exist" containerID="f7756ddca2a222579242331af6a84e33ae9e00a5e082401f82cf27845e7e4b92" Jun 11 23:12:32.783487 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.783444 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7756ddca2a222579242331af6a84e33ae9e00a5e082401f82cf27845e7e4b92"} err="failed to get container status \"f7756ddca2a222579242331af6a84e33ae9e00a5e082401f82cf27845e7e4b92\": rpc error: code = NotFound desc = could not find container \"f7756ddca2a222579242331af6a84e33ae9e00a5e082401f82cf27845e7e4b92\": container with ID starting with f7756ddca2a222579242331af6a84e33ae9e00a5e082401f82cf27845e7e4b92 not found: ID does not exist" Jun 11 23:12:32.786335 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.786313 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 23:12:32.786622 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.786611 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" containerName="config-reloader" Jun 11 23:12:32.786659 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.786624 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" containerName="config-reloader" Jun 11 23:12:32.786659 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.786635 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" containerName="init-config-reloader" Jun 11 23:12:32.786659 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.786641 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" containerName="init-config-reloader" Jun 11 23:12:32.786659 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.786653 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" containerName="kube-rbac-proxy" Jun 11 23:12:32.786659 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.786658 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" containerName="kube-rbac-proxy" Jun 11 23:12:32.786805 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.786670 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" containerName="prometheus" Jun 11 23:12:32.786805 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.786676 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" containerName="prometheus" Jun 11 23:12:32.786805 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.786684 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" containerName="kube-rbac-proxy-thanos" Jun 11 23:12:32.786805 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.786689 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" containerName="kube-rbac-proxy-thanos" Jun 11 23:12:32.786805 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.786696 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" containerName="kube-rbac-proxy-web" Jun 11 23:12:32.786805 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.786701 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" containerName="kube-rbac-proxy-web" Jun 11 23:12:32.786805 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.786710 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" containerName="thanos-sidecar" Jun 11 23:12:32.786805 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.786715 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" containerName="thanos-sidecar" Jun 11 23:12:32.786805 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.786763 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" containerName="prometheus" Jun 11 23:12:32.786805 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.786770 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" containerName="kube-rbac-proxy-web" Jun 11 23:12:32.786805 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.786778 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" containerName="thanos-sidecar" Jun 11 23:12:32.786805 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.786784 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" containerName="kube-rbac-proxy" Jun 11 23:12:32.786805 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.786790 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" containerName="kube-rbac-proxy-thanos" Jun 11 23:12:32.786805 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.786798 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" containerName="config-reloader" Jun 11 23:12:32.791685 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.791665 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.800252 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.800213 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 23:12:32.800252 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.800213 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 23:12:32.800417 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.800258 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 23:12:32.800417 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.800269 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 23:12:32.800538 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.800510 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 23:12:32.800596 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.800550 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 23:12:32.800647 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.800609 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 23:12:32.800647 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.800614 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 23:12:32.800733 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.800689 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 23:12:32.800733 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.800697 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bak9uuu8990dm\"" Jun 11 23:12:32.801191 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.801170 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 23:12:32.801301 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.801239 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-cvrvd\"" Jun 11 23:12:32.801301 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.801177 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 23:12:32.801301 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.801277 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 23:12:32.802760 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.802741 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 23:12:32.805692 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.805673 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 23:12:32.815549 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.815526 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 23:12:32.880098 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.880063 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e2e2a72-afd0-470a-9306-f54e636c1238-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.880098 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.880103 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e2e2a72-afd0-470a-9306-f54e636c1238-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.880335 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.880160 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e2e2a72-afd0-470a-9306-f54e636c1238-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.880335 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.880182 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e2e2a72-afd0-470a-9306-f54e636c1238-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.880335 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.880208 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e2e2a72-afd0-470a-9306-f54e636c1238-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.880335 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.880250 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e2e2a72-afd0-470a-9306-f54e636c1238-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.880335 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.880286 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e2e2a72-afd0-470a-9306-f54e636c1238-config\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.880335 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.880304 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e2e2a72-afd0-470a-9306-f54e636c1238-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.880335 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.880321 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e2e2a72-afd0-470a-9306-f54e636c1238-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.880335 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.880336 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e2e2a72-afd0-470a-9306-f54e636c1238-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.880619 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.880354 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e2e2a72-afd0-470a-9306-f54e636c1238-web-config\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.880619 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.880426 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e2e2a72-afd0-470a-9306-f54e636c1238-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.880619 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.880457 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47885\" (UniqueName: \"kubernetes.io/projected/0e2e2a72-afd0-470a-9306-f54e636c1238-kube-api-access-47885\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.880619 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.880478 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e2e2a72-afd0-470a-9306-f54e636c1238-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.880619 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.880537 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e2e2a72-afd0-470a-9306-f54e636c1238-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.880619 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.880554 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e2e2a72-afd0-470a-9306-f54e636c1238-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.880619 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.880573 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e2e2a72-afd0-470a-9306-f54e636c1238-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.880619 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.880587 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e2e2a72-afd0-470a-9306-f54e636c1238-config-out\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.880908 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.880630 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e2e2a72-afd0-470a-9306-f54e636c1238-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.880908 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.880660 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e2e2a72-afd0-470a-9306-f54e636c1238-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.981756 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.981655 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e2e2a72-afd0-470a-9306-f54e636c1238-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.981756 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.981695 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e2e2a72-afd0-470a-9306-f54e636c1238-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.981756 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.981726 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e2e2a72-afd0-470a-9306-f54e636c1238-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.981756 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.981753 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e2e2a72-afd0-470a-9306-f54e636c1238-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.982139 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.981784 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e2e2a72-afd0-470a-9306-f54e636c1238-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.982139 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.981812 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e2e2a72-afd0-470a-9306-f54e636c1238-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.982139 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.981835 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e2e2a72-afd0-470a-9306-f54e636c1238-config\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.982139 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.981861 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e2e2a72-afd0-470a-9306-f54e636c1238-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.982139 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.981888 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e2e2a72-afd0-470a-9306-f54e636c1238-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.982139 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.981912 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e2e2a72-afd0-470a-9306-f54e636c1238-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.982139 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.981941 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e2e2a72-afd0-470a-9306-f54e636c1238-web-config\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.982139 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.981993 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e2e2a72-afd0-470a-9306-f54e636c1238-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.982139 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.982027 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47885\" (UniqueName: \"kubernetes.io/projected/0e2e2a72-afd0-470a-9306-f54e636c1238-kube-api-access-47885\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.982139 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.982060 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e2e2a72-afd0-470a-9306-f54e636c1238-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.982139 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.982131 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e2e2a72-afd0-470a-9306-f54e636c1238-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.982670 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.982154 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e2e2a72-afd0-470a-9306-f54e636c1238-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.982670 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.982188 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e2e2a72-afd0-470a-9306-f54e636c1238-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.982670 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.982212 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e2e2a72-afd0-470a-9306-f54e636c1238-config-out\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.982670 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.982244 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e2e2a72-afd0-470a-9306-f54e636c1238-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.982670 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.982285 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e2e2a72-afd0-470a-9306-f54e636c1238-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.982670 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.982546 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e2e2a72-afd0-470a-9306-f54e636c1238-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.982973 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.982698 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e2e2a72-afd0-470a-9306-f54e636c1238-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.983213 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.983190 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e2e2a72-afd0-470a-9306-f54e636c1238-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.985799 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.984995 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e2e2a72-afd0-470a-9306-f54e636c1238-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.985799 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.985023 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e2e2a72-afd0-470a-9306-f54e636c1238-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.985799 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.985019 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e2e2a72-afd0-470a-9306-f54e636c1238-web-config\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.985799 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.985106 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e2e2a72-afd0-470a-9306-f54e636c1238-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.985799 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.985275 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e2e2a72-afd0-470a-9306-f54e636c1238-config\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.985799 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.985512 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e2e2a72-afd0-470a-9306-f54e636c1238-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.985799 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.985724 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e2e2a72-afd0-470a-9306-f54e636c1238-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.985799 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.985745 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e2e2a72-afd0-470a-9306-f54e636c1238-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.986316 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.985875 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e2e2a72-afd0-470a-9306-f54e636c1238-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.986316 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.986044 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e2e2a72-afd0-470a-9306-f54e636c1238-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.986316 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.986089 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e2e2a72-afd0-470a-9306-f54e636c1238-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.986685 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.986662 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e2e2a72-afd0-470a-9306-f54e636c1238-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.987255 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.987228 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e2e2a72-afd0-470a-9306-f54e636c1238-config-out\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.987662 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.987643 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e2e2a72-afd0-470a-9306-f54e636c1238-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.987811 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.987793 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e2e2a72-afd0-470a-9306-f54e636c1238-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.988034 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.988006 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e2e2a72-afd0-470a-9306-f54e636c1238-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:32.995864 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:32.995843 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47885\" (UniqueName: \"kubernetes.io/projected/0e2e2a72-afd0-470a-9306-f54e636c1238-kube-api-access-47885\") pod \"prometheus-k8s-0\" (UID: \"0e2e2a72-afd0-470a-9306-f54e636c1238\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:33.004820 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:33.004794 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="376d9ba1-6c0e-4c3c-9b01-510de93b6caa" path="/var/lib/kubelet/pods/376d9ba1-6c0e-4c3c-9b01-510de93b6caa/volumes" Jun 11 23:12:33.103251 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:33.103214 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:33.245724 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:33.245698 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 23:12:33.247489 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:12:33.247465 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e2e2a72_afd0_470a_9306_f54e636c1238.slice/crio-7ecf4c6feb28757d4fd337630d77b9a8bfa39bc947e4f3ed649654ab7190e001 WatchSource:0}: Error finding container 7ecf4c6feb28757d4fd337630d77b9a8bfa39bc947e4f3ed649654ab7190e001: Status 404 returned error can't find the container with id 7ecf4c6feb28757d4fd337630d77b9a8bfa39bc947e4f3ed649654ab7190e001 Jun 11 23:12:33.732757 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:33.732720 2563 generic.go:356] "Generic (PLEG): container finished" podID="0e2e2a72-afd0-470a-9306-f54e636c1238" containerID="50637a4459ca59d4f9544059536227466ddc070b953168671637ea00cb30e091" exitCode=0 Jun 11 23:12:33.733242 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:33.732811 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e2e2a72-afd0-470a-9306-f54e636c1238","Type":"ContainerDied","Data":"50637a4459ca59d4f9544059536227466ddc070b953168671637ea00cb30e091"} Jun 11 23:12:33.733242 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:33.732914 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e2e2a72-afd0-470a-9306-f54e636c1238","Type":"ContainerStarted","Data":"7ecf4c6feb28757d4fd337630d77b9a8bfa39bc947e4f3ed649654ab7190e001"} Jun 11 23:12:34.740924 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:34.740888 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e2e2a72-afd0-470a-9306-f54e636c1238","Type":"ContainerStarted","Data":"4d04c898b988c1f5747ac6ec0020835b9d1eeeb2f7b77296c9e0f8bf5bae4c45"} Jun 11 23:12:34.741383 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:34.740958 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e2e2a72-afd0-470a-9306-f54e636c1238","Type":"ContainerStarted","Data":"47fc733a2a1c1207e0cfdd97e5507aa3a4345b6d7b5def9b9ad2b619aea9721d"} Jun 11 23:12:34.741383 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:34.741012 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e2e2a72-afd0-470a-9306-f54e636c1238","Type":"ContainerStarted","Data":"e4a5db1fb1fa9c69db42395a9c048f0354a6efc15c13f069503d30cf68c243c1"} Jun 11 23:12:34.741383 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:34.741037 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e2e2a72-afd0-470a-9306-f54e636c1238","Type":"ContainerStarted","Data":"6087cf4a3ddd3faa65c9d16332c508dbf19e9f38e7a4b095fa3f6e5ecd3cb0dd"} Jun 11 23:12:34.741383 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:34.741061 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e2e2a72-afd0-470a-9306-f54e636c1238","Type":"ContainerStarted","Data":"6b67e4e1cc0aef253bbc4c7f10b828d6add0f24c963115730406d3508bb398cc"} Jun 11 23:12:34.741383 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:34.741085 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e2e2a72-afd0-470a-9306-f54e636c1238","Type":"ContainerStarted","Data":"eec5b8ec3e80c2aa0fa76db9210fbc675c8a88d0a1164ad0d7c634db9224ea6d"} Jun 11 23:12:34.776856 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:34.776791 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.758628813 podStartE2EDuration="2.776757847s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.129034ms" isStatefulPod=false podCreationTimestamp="2026-06-11 23:12:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:12:34.774605818 +0000 UTC m=+128.197390785" watchObservedRunningTime="2026-06-11 23:12:34.776757847 +0000 UTC m=+128.199542814" Jun 11 23:12:38.103709 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:38.103655 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:12:52.775196 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:52.775135 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6dfbf98945-xm8g2" podUID="69a7f58f-1787-4ceb-b79c-a06688aabbef" containerName="console" containerID="cri-o://26a1bdd0db4521a9d76c9620977e3515733d058fb0a645730703d7457db77c56" gracePeriod=15 Jun 11 23:12:53.040765 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:53.040739 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dfbf98945-xm8g2" Jun 11 23:12:53.163967 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:53.163929 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69a7f58f-1787-4ceb-b79c-a06688aabbef-console-serving-cert\") pod \"69a7f58f-1787-4ceb-b79c-a06688aabbef\" (UID: \"69a7f58f-1787-4ceb-b79c-a06688aabbef\") " Jun 11 23:12:53.163967 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:53.163965 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69a7f58f-1787-4ceb-b79c-a06688aabbef-console-oauth-config\") pod \"69a7f58f-1787-4ceb-b79c-a06688aabbef\" (UID: \"69a7f58f-1787-4ceb-b79c-a06688aabbef\") " Jun 11 23:12:53.164242 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:53.164021 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69a7f58f-1787-4ceb-b79c-a06688aabbef-trusted-ca-bundle\") pod \"69a7f58f-1787-4ceb-b79c-a06688aabbef\" (UID: \"69a7f58f-1787-4ceb-b79c-a06688aabbef\") " Jun 11 23:12:53.164242 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:53.164054 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69a7f58f-1787-4ceb-b79c-a06688aabbef-console-config\") pod \"69a7f58f-1787-4ceb-b79c-a06688aabbef\" (UID: \"69a7f58f-1787-4ceb-b79c-a06688aabbef\") " Jun 11 23:12:53.164242 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:53.164094 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69a7f58f-1787-4ceb-b79c-a06688aabbef-oauth-serving-cert\") pod \"69a7f58f-1787-4ceb-b79c-a06688aabbef\" (UID: \"69a7f58f-1787-4ceb-b79c-a06688aabbef\") " Jun 11 23:12:53.164242 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:53.164120 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69a7f58f-1787-4ceb-b79c-a06688aabbef-service-ca\") pod \"69a7f58f-1787-4ceb-b79c-a06688aabbef\" (UID: \"69a7f58f-1787-4ceb-b79c-a06688aabbef\") " Jun 11 23:12:53.164242 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:53.164177 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7sk7\" (UniqueName: \"kubernetes.io/projected/69a7f58f-1787-4ceb-b79c-a06688aabbef-kube-api-access-x7sk7\") pod \"69a7f58f-1787-4ceb-b79c-a06688aabbef\" (UID: \"69a7f58f-1787-4ceb-b79c-a06688aabbef\") " Jun 11 23:12:53.164567 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:53.164535 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69a7f58f-1787-4ceb-b79c-a06688aabbef-console-config" (OuterVolumeSpecName: "console-config") pod "69a7f58f-1787-4ceb-b79c-a06688aabbef" (UID: "69a7f58f-1787-4ceb-b79c-a06688aabbef"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:12:53.164669 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:53.164557 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69a7f58f-1787-4ceb-b79c-a06688aabbef-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "69a7f58f-1787-4ceb-b79c-a06688aabbef" (UID: "69a7f58f-1787-4ceb-b79c-a06688aabbef"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:12:53.164669 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:53.164538 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69a7f58f-1787-4ceb-b79c-a06688aabbef-service-ca" (OuterVolumeSpecName: "service-ca") pod "69a7f58f-1787-4ceb-b79c-a06688aabbef" (UID: "69a7f58f-1787-4ceb-b79c-a06688aabbef"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:12:53.164669 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:53.164551 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69a7f58f-1787-4ceb-b79c-a06688aabbef-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "69a7f58f-1787-4ceb-b79c-a06688aabbef" (UID: "69a7f58f-1787-4ceb-b79c-a06688aabbef"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:12:53.164798 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:53.164749 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69a7f58f-1787-4ceb-b79c-a06688aabbef-oauth-serving-cert\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:53.164798 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:53.164769 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69a7f58f-1787-4ceb-b79c-a06688aabbef-service-ca\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:53.164798 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:53.164783 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69a7f58f-1787-4ceb-b79c-a06688aabbef-trusted-ca-bundle\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:53.164798 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:53.164792 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69a7f58f-1787-4ceb-b79c-a06688aabbef-console-config\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:53.166374 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:53.166349 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69a7f58f-1787-4ceb-b79c-a06688aabbef-kube-api-access-x7sk7" (OuterVolumeSpecName: "kube-api-access-x7sk7") pod "69a7f58f-1787-4ceb-b79c-a06688aabbef" (UID: "69a7f58f-1787-4ceb-b79c-a06688aabbef"). InnerVolumeSpecName "kube-api-access-x7sk7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:12:53.166673 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:53.166644 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69a7f58f-1787-4ceb-b79c-a06688aabbef-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "69a7f58f-1787-4ceb-b79c-a06688aabbef" (UID: "69a7f58f-1787-4ceb-b79c-a06688aabbef"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:12:53.166749 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:53.166682 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69a7f58f-1787-4ceb-b79c-a06688aabbef-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "69a7f58f-1787-4ceb-b79c-a06688aabbef" (UID: "69a7f58f-1787-4ceb-b79c-a06688aabbef"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:12:53.266238 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:53.266204 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7sk7\" (UniqueName: \"kubernetes.io/projected/69a7f58f-1787-4ceb-b79c-a06688aabbef-kube-api-access-x7sk7\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:53.266238 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:53.266233 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69a7f58f-1787-4ceb-b79c-a06688aabbef-console-serving-cert\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:53.266238 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:53.266245 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69a7f58f-1787-4ceb-b79c-a06688aabbef-console-oauth-config\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:12:53.822595 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:53.822558 2563 generic.go:356] "Generic (PLEG): container finished" podID="69a7f58f-1787-4ceb-b79c-a06688aabbef" containerID="26a1bdd0db4521a9d76c9620977e3515733d058fb0a645730703d7457db77c56" exitCode=0 Jun 11 23:12:53.822997 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:53.822606 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dfbf98945-xm8g2" Jun 11 23:12:53.822997 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:53.822649 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dfbf98945-xm8g2" event={"ID":"69a7f58f-1787-4ceb-b79c-a06688aabbef","Type":"ContainerDied","Data":"26a1bdd0db4521a9d76c9620977e3515733d058fb0a645730703d7457db77c56"} Jun 11 23:12:53.822997 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:53.822703 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dfbf98945-xm8g2" event={"ID":"69a7f58f-1787-4ceb-b79c-a06688aabbef","Type":"ContainerDied","Data":"604f81fbfa04600c6e3531b26555e8bf999e700fb84703f536ec3140576b17ed"} Jun 11 23:12:53.822997 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:53.822729 2563 scope.go:117] "RemoveContainer" containerID="26a1bdd0db4521a9d76c9620977e3515733d058fb0a645730703d7457db77c56" Jun 11 23:12:53.831163 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:53.831145 2563 scope.go:117] "RemoveContainer" containerID="26a1bdd0db4521a9d76c9620977e3515733d058fb0a645730703d7457db77c56" Jun 11 23:12:53.831416 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:12:53.831397 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26a1bdd0db4521a9d76c9620977e3515733d058fb0a645730703d7457db77c56\": container with ID starting with 26a1bdd0db4521a9d76c9620977e3515733d058fb0a645730703d7457db77c56 not found: ID does not exist" containerID="26a1bdd0db4521a9d76c9620977e3515733d058fb0a645730703d7457db77c56" Jun 11 23:12:53.831458 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:53.831425 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26a1bdd0db4521a9d76c9620977e3515733d058fb0a645730703d7457db77c56"} err="failed to get container status \"26a1bdd0db4521a9d76c9620977e3515733d058fb0a645730703d7457db77c56\": rpc error: code = NotFound desc = could not find container \"26a1bdd0db4521a9d76c9620977e3515733d058fb0a645730703d7457db77c56\": container with ID starting with 26a1bdd0db4521a9d76c9620977e3515733d058fb0a645730703d7457db77c56 not found: ID does not exist" Jun 11 23:12:53.845129 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:53.845104 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dfbf98945-xm8g2"] Jun 11 23:12:53.849522 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:53.849497 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6dfbf98945-xm8g2"] Jun 11 23:12:55.005314 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:12:55.005282 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69a7f58f-1787-4ceb-b79c-a06688aabbef" path="/var/lib/kubelet/pods/69a7f58f-1787-4ceb-b79c-a06688aabbef/volumes" Jun 11 23:13:33.103525 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:33.103477 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:13:33.118918 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:33.118894 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:13:34.004971 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:34.004941 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 23:13:53.191068 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:53.191034 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55fd47b54f-v829j"] Jun 11 23:13:53.191520 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:53.191442 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69a7f58f-1787-4ceb-b79c-a06688aabbef" containerName="console" Jun 11 23:13:53.191520 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:53.191456 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="69a7f58f-1787-4ceb-b79c-a06688aabbef" containerName="console" Jun 11 23:13:53.191596 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:53.191521 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="69a7f58f-1787-4ceb-b79c-a06688aabbef" containerName="console" Jun 11 23:13:53.194822 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:53.194805 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55fd47b54f-v829j" Jun 11 23:13:53.206787 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:53.206762 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55fd47b54f-v829j"] Jun 11 23:13:53.304441 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:53.304398 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78fa6479-ef37-46e1-a8ee-8f2afc15684b-oauth-serving-cert\") pod \"console-55fd47b54f-v829j\" (UID: \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\") " pod="openshift-console/console-55fd47b54f-v829j" Jun 11 23:13:53.304626 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:53.304460 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78fa6479-ef37-46e1-a8ee-8f2afc15684b-console-config\") pod \"console-55fd47b54f-v829j\" (UID: \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\") " pod="openshift-console/console-55fd47b54f-v829j" Jun 11 23:13:53.304626 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:53.304531 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxlkb\" (UniqueName: \"kubernetes.io/projected/78fa6479-ef37-46e1-a8ee-8f2afc15684b-kube-api-access-vxlkb\") pod \"console-55fd47b54f-v829j\" (UID: \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\") " pod="openshift-console/console-55fd47b54f-v829j" Jun 11 23:13:53.304626 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:53.304568 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78fa6479-ef37-46e1-a8ee-8f2afc15684b-console-oauth-config\") pod \"console-55fd47b54f-v829j\" (UID: \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\") " pod="openshift-console/console-55fd47b54f-v829j" Jun 11 23:13:53.304626 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:53.304588 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78fa6479-ef37-46e1-a8ee-8f2afc15684b-service-ca\") pod \"console-55fd47b54f-v829j\" (UID: \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\") " pod="openshift-console/console-55fd47b54f-v829j" Jun 11 23:13:53.304776 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:53.304632 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78fa6479-ef37-46e1-a8ee-8f2afc15684b-console-serving-cert\") pod \"console-55fd47b54f-v829j\" (UID: \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\") " pod="openshift-console/console-55fd47b54f-v829j" Jun 11 23:13:53.304776 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:53.304656 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78fa6479-ef37-46e1-a8ee-8f2afc15684b-trusted-ca-bundle\") pod \"console-55fd47b54f-v829j\" (UID: \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\") " pod="openshift-console/console-55fd47b54f-v829j" Jun 11 23:13:53.405729 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:53.405693 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxlkb\" (UniqueName: \"kubernetes.io/projected/78fa6479-ef37-46e1-a8ee-8f2afc15684b-kube-api-access-vxlkb\") pod \"console-55fd47b54f-v829j\" (UID: \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\") " pod="openshift-console/console-55fd47b54f-v829j" Jun 11 23:13:53.405729 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:53.405735 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78fa6479-ef37-46e1-a8ee-8f2afc15684b-console-oauth-config\") pod \"console-55fd47b54f-v829j\" (UID: \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\") " pod="openshift-console/console-55fd47b54f-v829j" Jun 11 23:13:53.405936 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:53.405751 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78fa6479-ef37-46e1-a8ee-8f2afc15684b-service-ca\") pod \"console-55fd47b54f-v829j\" (UID: \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\") " pod="openshift-console/console-55fd47b54f-v829j" Jun 11 23:13:53.405936 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:53.405768 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78fa6479-ef37-46e1-a8ee-8f2afc15684b-console-serving-cert\") pod \"console-55fd47b54f-v829j\" (UID: \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\") " pod="openshift-console/console-55fd47b54f-v829j" Jun 11 23:13:53.405936 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:53.405793 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78fa6479-ef37-46e1-a8ee-8f2afc15684b-trusted-ca-bundle\") pod \"console-55fd47b54f-v829j\" (UID: \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\") " pod="openshift-console/console-55fd47b54f-v829j" Jun 11 23:13:53.405936 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:53.405857 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78fa6479-ef37-46e1-a8ee-8f2afc15684b-oauth-serving-cert\") pod \"console-55fd47b54f-v829j\" (UID: \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\") " pod="openshift-console/console-55fd47b54f-v829j" Jun 11 23:13:53.405936 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:53.405923 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78fa6479-ef37-46e1-a8ee-8f2afc15684b-console-config\") pod \"console-55fd47b54f-v829j\" (UID: \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\") " pod="openshift-console/console-55fd47b54f-v829j" Jun 11 23:13:53.406604 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:53.406575 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78fa6479-ef37-46e1-a8ee-8f2afc15684b-service-ca\") pod \"console-55fd47b54f-v829j\" (UID: \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\") " pod="openshift-console/console-55fd47b54f-v829j" Jun 11 23:13:53.406604 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:53.406598 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78fa6479-ef37-46e1-a8ee-8f2afc15684b-console-config\") pod \"console-55fd47b54f-v829j\" (UID: \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\") " pod="openshift-console/console-55fd47b54f-v829j" Jun 11 23:13:53.406769 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:53.406647 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78fa6479-ef37-46e1-a8ee-8f2afc15684b-trusted-ca-bundle\") pod \"console-55fd47b54f-v829j\" (UID: \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\") " pod="openshift-console/console-55fd47b54f-v829j" Jun 11 23:13:53.406769 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:53.406686 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78fa6479-ef37-46e1-a8ee-8f2afc15684b-oauth-serving-cert\") pod \"console-55fd47b54f-v829j\" (UID: \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\") " pod="openshift-console/console-55fd47b54f-v829j" Jun 11 23:13:53.408315 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:53.408294 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78fa6479-ef37-46e1-a8ee-8f2afc15684b-console-oauth-config\") pod \"console-55fd47b54f-v829j\" (UID: \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\") " pod="openshift-console/console-55fd47b54f-v829j" Jun 11 23:13:53.408419 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:53.408394 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78fa6479-ef37-46e1-a8ee-8f2afc15684b-console-serving-cert\") pod \"console-55fd47b54f-v829j\" (UID: \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\") " pod="openshift-console/console-55fd47b54f-v829j" Jun 11 23:13:53.415179 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:53.415155 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxlkb\" (UniqueName: \"kubernetes.io/projected/78fa6479-ef37-46e1-a8ee-8f2afc15684b-kube-api-access-vxlkb\") pod \"console-55fd47b54f-v829j\" (UID: \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\") " pod="openshift-console/console-55fd47b54f-v829j" Jun 11 23:13:53.504017 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:53.503924 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55fd47b54f-v829j" Jun 11 23:13:53.641417 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:53.641386 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55fd47b54f-v829j"] Jun 11 23:13:53.644313 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:13:53.644288 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78fa6479_ef37_46e1_a8ee_8f2afc15684b.slice/crio-0fea64ca9be60d702b70e4fdd3741a9528ba7864f9166049d7e2e58f30ef2c73 WatchSource:0}: Error finding container 0fea64ca9be60d702b70e4fdd3741a9528ba7864f9166049d7e2e58f30ef2c73: Status 404 returned error can't find the container with id 0fea64ca9be60d702b70e4fdd3741a9528ba7864f9166049d7e2e58f30ef2c73 Jun 11 23:13:54.069289 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:54.069254 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55fd47b54f-v829j" event={"ID":"78fa6479-ef37-46e1-a8ee-8f2afc15684b","Type":"ContainerStarted","Data":"e5ca7a14a285143717997f9468c8ad17485829c384da781e9019e07a635e4d16"} Jun 11 23:13:54.069450 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:54.069308 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55fd47b54f-v829j" event={"ID":"78fa6479-ef37-46e1-a8ee-8f2afc15684b","Type":"ContainerStarted","Data":"0fea64ca9be60d702b70e4fdd3741a9528ba7864f9166049d7e2e58f30ef2c73"} Jun 11 23:13:54.093237 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:13:54.093180 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55fd47b54f-v829j" podStartSLOduration=1.093159921 podStartE2EDuration="1.093159921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:13:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:13:54.091772486 +0000 UTC m=+207.514557452" watchObservedRunningTime="2026-06-11 23:13:54.093159921 +0000 UTC m=+207.515944894" Jun 11 23:14:03.505122 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:03.505086 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55fd47b54f-v829j" Jun 11 23:14:03.505603 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:03.505144 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55fd47b54f-v829j" Jun 11 23:14:03.510020 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:03.509997 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55fd47b54f-v829j" Jun 11 23:14:04.114845 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:04.114811 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55fd47b54f-v829j" Jun 11 23:14:04.173550 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:04.173523 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65dfdf47f7-c42pj"] Jun 11 23:14:29.193817 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:29.193775 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-65dfdf47f7-c42pj" podUID="4f3cb5cc-9231-456f-99c4-8890127bf5e4" containerName="console" containerID="cri-o://efc926c21b0bcb67cc1e3bb0195fb4eda6b88035910b502bfdadf9402e0073dd" gracePeriod=15 Jun 11 23:14:29.429242 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:29.429218 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65dfdf47f7-c42pj" Jun 11 23:14:29.527770 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:29.527668 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3cb5cc-9231-456f-99c4-8890127bf5e4-trusted-ca-bundle\") pod \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\" (UID: \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\") " Jun 11 23:14:29.527770 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:29.527719 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f3cb5cc-9231-456f-99c4-8890127bf5e4-oauth-serving-cert\") pod \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\" (UID: \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\") " Jun 11 23:14:29.527770 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:29.527747 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlxs6\" (UniqueName: \"kubernetes.io/projected/4f3cb5cc-9231-456f-99c4-8890127bf5e4-kube-api-access-nlxs6\") pod \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\" (UID: \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\") " Jun 11 23:14:29.527770 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:29.527771 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f3cb5cc-9231-456f-99c4-8890127bf5e4-console-serving-cert\") pod \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\" (UID: \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\") " Jun 11 23:14:29.528102 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:29.527799 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f3cb5cc-9231-456f-99c4-8890127bf5e4-console-oauth-config\") pod \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\" (UID: \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\") " Jun 11 23:14:29.528102 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:29.527828 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f3cb5cc-9231-456f-99c4-8890127bf5e4-console-config\") pod \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\" (UID: \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\") " Jun 11 23:14:29.528102 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:29.527867 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f3cb5cc-9231-456f-99c4-8890127bf5e4-service-ca\") pod \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\" (UID: \"4f3cb5cc-9231-456f-99c4-8890127bf5e4\") " Jun 11 23:14:29.528253 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:29.528121 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f3cb5cc-9231-456f-99c4-8890127bf5e4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4f3cb5cc-9231-456f-99c4-8890127bf5e4" (UID: "4f3cb5cc-9231-456f-99c4-8890127bf5e4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:14:29.528253 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:29.528200 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f3cb5cc-9231-456f-99c4-8890127bf5e4-oauth-serving-cert\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:14:29.528359 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:29.528299 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f3cb5cc-9231-456f-99c4-8890127bf5e4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4f3cb5cc-9231-456f-99c4-8890127bf5e4" (UID: "4f3cb5cc-9231-456f-99c4-8890127bf5e4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:14:29.528430 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:29.528402 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f3cb5cc-9231-456f-99c4-8890127bf5e4-service-ca" (OuterVolumeSpecName: "service-ca") pod "4f3cb5cc-9231-456f-99c4-8890127bf5e4" (UID: "4f3cb5cc-9231-456f-99c4-8890127bf5e4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:14:29.528546 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:29.528506 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f3cb5cc-9231-456f-99c4-8890127bf5e4-console-config" (OuterVolumeSpecName: "console-config") pod "4f3cb5cc-9231-456f-99c4-8890127bf5e4" (UID: "4f3cb5cc-9231-456f-99c4-8890127bf5e4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:14:29.530086 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:29.530057 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f3cb5cc-9231-456f-99c4-8890127bf5e4-kube-api-access-nlxs6" (OuterVolumeSpecName: "kube-api-access-nlxs6") pod "4f3cb5cc-9231-456f-99c4-8890127bf5e4" (UID: "4f3cb5cc-9231-456f-99c4-8890127bf5e4"). InnerVolumeSpecName "kube-api-access-nlxs6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:14:29.530536 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:29.530508 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f3cb5cc-9231-456f-99c4-8890127bf5e4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4f3cb5cc-9231-456f-99c4-8890127bf5e4" (UID: "4f3cb5cc-9231-456f-99c4-8890127bf5e4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:14:29.530536 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:29.530517 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f3cb5cc-9231-456f-99c4-8890127bf5e4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4f3cb5cc-9231-456f-99c4-8890127bf5e4" (UID: "4f3cb5cc-9231-456f-99c4-8890127bf5e4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:14:29.629180 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:29.629131 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlxs6\" (UniqueName: \"kubernetes.io/projected/4f3cb5cc-9231-456f-99c4-8890127bf5e4-kube-api-access-nlxs6\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:14:29.629180 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:29.629175 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f3cb5cc-9231-456f-99c4-8890127bf5e4-console-serving-cert\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:14:29.629180 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:29.629184 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f3cb5cc-9231-456f-99c4-8890127bf5e4-console-oauth-config\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:14:29.629180 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:29.629194 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f3cb5cc-9231-456f-99c4-8890127bf5e4-console-config\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:14:29.629180 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:29.629203 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f3cb5cc-9231-456f-99c4-8890127bf5e4-service-ca\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:14:29.629481 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:29.629211 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3cb5cc-9231-456f-99c4-8890127bf5e4-trusted-ca-bundle\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:14:30.218362 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:30.218325 2563 generic.go:356] "Generic (PLEG): container finished" podID="4f3cb5cc-9231-456f-99c4-8890127bf5e4" containerID="efc926c21b0bcb67cc1e3bb0195fb4eda6b88035910b502bfdadf9402e0073dd" exitCode=0 Jun 11 23:14:30.218753 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:30.218369 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65dfdf47f7-c42pj" Jun 11 23:14:30.218753 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:30.218409 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65dfdf47f7-c42pj" event={"ID":"4f3cb5cc-9231-456f-99c4-8890127bf5e4","Type":"ContainerDied","Data":"efc926c21b0bcb67cc1e3bb0195fb4eda6b88035910b502bfdadf9402e0073dd"} Jun 11 23:14:30.218753 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:30.218460 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65dfdf47f7-c42pj" event={"ID":"4f3cb5cc-9231-456f-99c4-8890127bf5e4","Type":"ContainerDied","Data":"7b15737ce958127ed9f12c3de50fdd05ed9abb81207c894623d42153c33dbc94"} Jun 11 23:14:30.218753 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:30.218479 2563 scope.go:117] "RemoveContainer" containerID="efc926c21b0bcb67cc1e3bb0195fb4eda6b88035910b502bfdadf9402e0073dd" Jun 11 23:14:30.227111 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:30.227095 2563 scope.go:117] "RemoveContainer" containerID="efc926c21b0bcb67cc1e3bb0195fb4eda6b88035910b502bfdadf9402e0073dd" Jun 11 23:14:30.227370 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:14:30.227349 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efc926c21b0bcb67cc1e3bb0195fb4eda6b88035910b502bfdadf9402e0073dd\": container with ID starting with efc926c21b0bcb67cc1e3bb0195fb4eda6b88035910b502bfdadf9402e0073dd not found: ID does not exist" containerID="efc926c21b0bcb67cc1e3bb0195fb4eda6b88035910b502bfdadf9402e0073dd" Jun 11 23:14:30.227423 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:30.227378 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efc926c21b0bcb67cc1e3bb0195fb4eda6b88035910b502bfdadf9402e0073dd"} err="failed to get container status \"efc926c21b0bcb67cc1e3bb0195fb4eda6b88035910b502bfdadf9402e0073dd\": rpc error: code = NotFound desc = could not find container \"efc926c21b0bcb67cc1e3bb0195fb4eda6b88035910b502bfdadf9402e0073dd\": container with ID starting with efc926c21b0bcb67cc1e3bb0195fb4eda6b88035910b502bfdadf9402e0073dd not found: ID does not exist" Jun 11 23:14:30.242027 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:30.242000 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65dfdf47f7-c42pj"] Jun 11 23:14:30.244667 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:30.244644 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65dfdf47f7-c42pj"] Jun 11 23:14:31.004987 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:14:31.004953 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f3cb5cc-9231-456f-99c4-8890127bf5e4" path="/var/lib/kubelet/pods/4f3cb5cc-9231-456f-99c4-8890127bf5e4/volumes" Jun 11 23:15:26.959757 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:26.959723 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lrmgd_243ee797-2187-41bc-ad0c-116ec1a4888f/ovn-acl-logging/0.log" Jun 11 23:15:26.960248 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:26.960199 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lrmgd_243ee797-2187-41bc-ad0c-116ec1a4888f/ovn-acl-logging/0.log" Jun 11 23:15:26.962549 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:26.962527 2563 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 23:15:29.347595 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:29.347557 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-mntft"] Jun 11 23:15:29.349904 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:29.347885 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f3cb5cc-9231-456f-99c4-8890127bf5e4" containerName="console" Jun 11 23:15:29.349904 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:29.347898 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f3cb5cc-9231-456f-99c4-8890127bf5e4" containerName="console" Jun 11 23:15:29.349904 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:29.347990 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f3cb5cc-9231-456f-99c4-8890127bf5e4" containerName="console" Jun 11 23:15:29.350812 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:29.350795 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-mntft" Jun 11 23:15:29.354927 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:29.354903 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 23:15:29.355081 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:29.354904 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-v66wh\"" Jun 11 23:15:29.355081 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:29.354937 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 23:15:29.359151 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:29.359123 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-mntft"] Jun 11 23:15:29.464286 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:29.464248 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d99d493b-c03a-4fef-b1c3-0537bcb1635f-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-mntft\" (UID: \"d99d493b-c03a-4fef-b1c3-0537bcb1635f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-mntft" Jun 11 23:15:29.464461 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:29.464351 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg7gp\" (UniqueName: \"kubernetes.io/projected/d99d493b-c03a-4fef-b1c3-0537bcb1635f-kube-api-access-sg7gp\") pod \"cert-manager-cainjector-5d99449ffd-mntft\" (UID: \"d99d493b-c03a-4fef-b1c3-0537bcb1635f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-mntft" Jun 11 23:15:29.565608 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:29.565566 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg7gp\" (UniqueName: \"kubernetes.io/projected/d99d493b-c03a-4fef-b1c3-0537bcb1635f-kube-api-access-sg7gp\") pod \"cert-manager-cainjector-5d99449ffd-mntft\" (UID: \"d99d493b-c03a-4fef-b1c3-0537bcb1635f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-mntft" Jun 11 23:15:29.565784 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:29.565617 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d99d493b-c03a-4fef-b1c3-0537bcb1635f-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-mntft\" (UID: \"d99d493b-c03a-4fef-b1c3-0537bcb1635f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-mntft" Jun 11 23:15:29.573894 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:29.573861 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg7gp\" (UniqueName: \"kubernetes.io/projected/d99d493b-c03a-4fef-b1c3-0537bcb1635f-kube-api-access-sg7gp\") pod \"cert-manager-cainjector-5d99449ffd-mntft\" (UID: \"d99d493b-c03a-4fef-b1c3-0537bcb1635f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-mntft" Jun 11 23:15:29.573894 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:29.573883 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d99d493b-c03a-4fef-b1c3-0537bcb1635f-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-mntft\" (UID: \"d99d493b-c03a-4fef-b1c3-0537bcb1635f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-mntft" Jun 11 23:15:29.670630 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:29.670600 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-mntft" Jun 11 23:15:29.801043 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:29.801017 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-mntft"] Jun 11 23:15:29.802813 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:15:29.802786 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd99d493b_c03a_4fef_b1c3_0537bcb1635f.slice/crio-536f48d4950950d0d20a3d947529db02778faea27274ed1cfd0ef6c1fd818725 WatchSource:0}: Error finding container 536f48d4950950d0d20a3d947529db02778faea27274ed1cfd0ef6c1fd818725: Status 404 returned error can't find the container with id 536f48d4950950d0d20a3d947529db02778faea27274ed1cfd0ef6c1fd818725 Jun 11 23:15:29.804915 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:29.804899 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 23:15:30.461949 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:30.461919 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-mntft" event={"ID":"d99d493b-c03a-4fef-b1c3-0537bcb1635f","Type":"ContainerStarted","Data":"536f48d4950950d0d20a3d947529db02778faea27274ed1cfd0ef6c1fd818725"} Jun 11 23:15:33.480184 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:33.480145 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-mntft" event={"ID":"d99d493b-c03a-4fef-b1c3-0537bcb1635f","Type":"ContainerStarted","Data":"af9d882dd3ada0f10227d72cb8c8c261fefc0cfa24027abd4636d1aa1c686279"} Jun 11 23:15:33.501258 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:33.501206 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-mntft" podStartSLOduration=1.348301551 podStartE2EDuration="4.501190573s" totalImagesPullingTime="3.152889022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:15:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:15:33.499652504 +0000 UTC m=+306.922437475" watchObservedRunningTime="2026-06-11 23:15:33.501190573 +0000 UTC m=+306.923975539" Jun 11 23:15:34.812560 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:34.812518 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-2sqzs"] Jun 11 23:15:34.816246 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:34.816221 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-2sqzs" Jun 11 23:15:34.819150 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:34.819117 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-2d9x5\"" Jun 11 23:15:34.826406 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:34.826384 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-2sqzs"] Jun 11 23:15:34.914770 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:34.914729 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b5f3ca81-a698-4bba-993b-ddf01cbca30c-bound-sa-token\") pod \"cert-manager-59c77684cc-2sqzs\" (UID: \"b5f3ca81-a698-4bba-993b-ddf01cbca30c\") " pod="cert-manager/cert-manager-59c77684cc-2sqzs" Jun 11 23:15:34.914770 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:34.914777 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhf5x\" (UniqueName: \"kubernetes.io/projected/b5f3ca81-a698-4bba-993b-ddf01cbca30c-kube-api-access-lhf5x\") pod \"cert-manager-59c77684cc-2sqzs\" (UID: \"b5f3ca81-a698-4bba-993b-ddf01cbca30c\") " pod="cert-manager/cert-manager-59c77684cc-2sqzs" Jun 11 23:15:35.015591 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:35.015558 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b5f3ca81-a698-4bba-993b-ddf01cbca30c-bound-sa-token\") pod \"cert-manager-59c77684cc-2sqzs\" (UID: \"b5f3ca81-a698-4bba-993b-ddf01cbca30c\") " pod="cert-manager/cert-manager-59c77684cc-2sqzs" Jun 11 23:15:35.015591 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:35.015597 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhf5x\" (UniqueName: \"kubernetes.io/projected/b5f3ca81-a698-4bba-993b-ddf01cbca30c-kube-api-access-lhf5x\") pod \"cert-manager-59c77684cc-2sqzs\" (UID: \"b5f3ca81-a698-4bba-993b-ddf01cbca30c\") " pod="cert-manager/cert-manager-59c77684cc-2sqzs" Jun 11 23:15:35.026946 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:35.026914 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b5f3ca81-a698-4bba-993b-ddf01cbca30c-bound-sa-token\") pod \"cert-manager-59c77684cc-2sqzs\" (UID: \"b5f3ca81-a698-4bba-993b-ddf01cbca30c\") " pod="cert-manager/cert-manager-59c77684cc-2sqzs" Jun 11 23:15:35.027290 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:35.027124 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhf5x\" (UniqueName: \"kubernetes.io/projected/b5f3ca81-a698-4bba-993b-ddf01cbca30c-kube-api-access-lhf5x\") pod \"cert-manager-59c77684cc-2sqzs\" (UID: \"b5f3ca81-a698-4bba-993b-ddf01cbca30c\") " pod="cert-manager/cert-manager-59c77684cc-2sqzs" Jun 11 23:15:35.125449 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:35.125414 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-2sqzs" Jun 11 23:15:35.257243 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:35.257222 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-2sqzs"] Jun 11 23:15:35.259174 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:15:35.259148 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb5f3ca81_a698_4bba_993b_ddf01cbca30c.slice/crio-e79170740a2de5e752b078dcf8ac48d58809088fdd3d736028d2c1ea7b2c79c2 WatchSource:0}: Error finding container e79170740a2de5e752b078dcf8ac48d58809088fdd3d736028d2c1ea7b2c79c2: Status 404 returned error can't find the container with id e79170740a2de5e752b078dcf8ac48d58809088fdd3d736028d2c1ea7b2c79c2 Jun 11 23:15:35.488921 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:35.488833 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-2sqzs" event={"ID":"b5f3ca81-a698-4bba-993b-ddf01cbca30c","Type":"ContainerStarted","Data":"7bc703295e257f4257589b7f192d5d89955f6975a443c569b587a642d6f075e4"} Jun 11 23:15:35.488921 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:35.488881 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-2sqzs" event={"ID":"b5f3ca81-a698-4bba-993b-ddf01cbca30c","Type":"ContainerStarted","Data":"e79170740a2de5e752b078dcf8ac48d58809088fdd3d736028d2c1ea7b2c79c2"} Jun 11 23:15:35.505630 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:35.505580 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-2sqzs" podStartSLOduration=1.505564395 podStartE2EDuration="1.505564395s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:15:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:15:35.503746329 +0000 UTC m=+308.926531295" watchObservedRunningTime="2026-06-11 23:15:35.505564395 +0000 UTC m=+308.928349362" Jun 11 23:15:57.404173 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:57.404139 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-vvt4x"] Jun 11 23:15:57.407635 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:57.407616 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-vvt4x" Jun 11 23:15:57.411034 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:57.411005 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 23:15:57.411259 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:57.411238 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-srt9d\"" Jun 11 23:15:57.411366 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:57.411281 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 23:15:57.411741 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:57.411723 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 23:15:57.412117 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:57.412099 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 23:15:57.426290 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:57.426268 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-vvt4x"] Jun 11 23:15:57.510597 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:57.510567 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8e1a89ab-7a03-4afb-960f-44925fecd664-webhook-cert\") pod \"opendatahub-operator-controller-manager-6545b9fcc6-vvt4x\" (UID: \"8e1a89ab-7a03-4afb-960f-44925fecd664\") " pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-vvt4x" Jun 11 23:15:57.510770 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:57.510612 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8e1a89ab-7a03-4afb-960f-44925fecd664-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6545b9fcc6-vvt4x\" (UID: \"8e1a89ab-7a03-4afb-960f-44925fecd664\") " pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-vvt4x" Jun 11 23:15:57.510770 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:57.510650 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e1a89ab-7a03-4afb-960f-44925fecd664-tmp\") pod \"opendatahub-operator-controller-manager-6545b9fcc6-vvt4x\" (UID: \"8e1a89ab-7a03-4afb-960f-44925fecd664\") " pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-vvt4x" Jun 11 23:15:57.510770 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:57.510713 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8e1a89ab-7a03-4afb-960f-44925fecd664-manifests\") pod \"opendatahub-operator-controller-manager-6545b9fcc6-vvt4x\" (UID: \"8e1a89ab-7a03-4afb-960f-44925fecd664\") " pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-vvt4x" Jun 11 23:15:57.510874 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:57.510766 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg6wq\" (UniqueName: \"kubernetes.io/projected/8e1a89ab-7a03-4afb-960f-44925fecd664-kube-api-access-jg6wq\") pod \"opendatahub-operator-controller-manager-6545b9fcc6-vvt4x\" (UID: \"8e1a89ab-7a03-4afb-960f-44925fecd664\") " pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-vvt4x" Jun 11 23:15:57.611175 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:57.611139 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg6wq\" (UniqueName: \"kubernetes.io/projected/8e1a89ab-7a03-4afb-960f-44925fecd664-kube-api-access-jg6wq\") pod \"opendatahub-operator-controller-manager-6545b9fcc6-vvt4x\" (UID: \"8e1a89ab-7a03-4afb-960f-44925fecd664\") " pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-vvt4x" Jun 11 23:15:57.611175 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:57.611181 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8e1a89ab-7a03-4afb-960f-44925fecd664-webhook-cert\") pod \"opendatahub-operator-controller-manager-6545b9fcc6-vvt4x\" (UID: \"8e1a89ab-7a03-4afb-960f-44925fecd664\") " pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-vvt4x" Jun 11 23:15:57.611424 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:57.611215 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8e1a89ab-7a03-4afb-960f-44925fecd664-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6545b9fcc6-vvt4x\" (UID: \"8e1a89ab-7a03-4afb-960f-44925fecd664\") " pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-vvt4x" Jun 11 23:15:57.611424 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:57.611251 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e1a89ab-7a03-4afb-960f-44925fecd664-tmp\") pod \"opendatahub-operator-controller-manager-6545b9fcc6-vvt4x\" (UID: \"8e1a89ab-7a03-4afb-960f-44925fecd664\") " pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-vvt4x" Jun 11 23:15:57.611424 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:57.611325 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8e1a89ab-7a03-4afb-960f-44925fecd664-manifests\") pod \"opendatahub-operator-controller-manager-6545b9fcc6-vvt4x\" (UID: \"8e1a89ab-7a03-4afb-960f-44925fecd664\") " pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-vvt4x" Jun 11 23:15:57.611699 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:57.611671 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8e1a89ab-7a03-4afb-960f-44925fecd664-manifests\") pod \"opendatahub-operator-controller-manager-6545b9fcc6-vvt4x\" (UID: \"8e1a89ab-7a03-4afb-960f-44925fecd664\") " pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-vvt4x" Jun 11 23:15:57.613561 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:57.613522 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e1a89ab-7a03-4afb-960f-44925fecd664-tmp\") pod \"opendatahub-operator-controller-manager-6545b9fcc6-vvt4x\" (UID: \"8e1a89ab-7a03-4afb-960f-44925fecd664\") " pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-vvt4x" Jun 11 23:15:57.613698 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:57.613683 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8e1a89ab-7a03-4afb-960f-44925fecd664-webhook-cert\") pod \"opendatahub-operator-controller-manager-6545b9fcc6-vvt4x\" (UID: \"8e1a89ab-7a03-4afb-960f-44925fecd664\") " pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-vvt4x" Jun 11 23:15:57.613745 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:57.613681 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8e1a89ab-7a03-4afb-960f-44925fecd664-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6545b9fcc6-vvt4x\" (UID: \"8e1a89ab-7a03-4afb-960f-44925fecd664\") " pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-vvt4x" Jun 11 23:15:57.620754 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:57.620727 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg6wq\" (UniqueName: \"kubernetes.io/projected/8e1a89ab-7a03-4afb-960f-44925fecd664-kube-api-access-jg6wq\") pod \"opendatahub-operator-controller-manager-6545b9fcc6-vvt4x\" (UID: \"8e1a89ab-7a03-4afb-960f-44925fecd664\") " pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-vvt4x" Jun 11 23:15:57.718466 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:57.718385 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-vvt4x" Jun 11 23:15:57.863898 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:57.863874 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-vvt4x"] Jun 11 23:15:57.865589 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:15:57.865561 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e1a89ab_7a03_4afb_960f_44925fecd664.slice/crio-972a9348454fa464c86f3f6035ef9a5972353acad7f69118fddbe943681aa59b WatchSource:0}: Error finding container 972a9348454fa464c86f3f6035ef9a5972353acad7f69118fddbe943681aa59b: Status 404 returned error can't find the container with id 972a9348454fa464c86f3f6035ef9a5972353acad7f69118fddbe943681aa59b Jun 11 23:15:58.592280 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:15:58.592240 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-vvt4x" event={"ID":"8e1a89ab-7a03-4afb-960f-44925fecd664","Type":"ContainerStarted","Data":"972a9348454fa464c86f3f6035ef9a5972353acad7f69118fddbe943681aa59b"} Jun 11 23:16:01.608170 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:01.608135 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-vvt4x" event={"ID":"8e1a89ab-7a03-4afb-960f-44925fecd664","Type":"ContainerStarted","Data":"232cbc174e44f730948d44c9c889b1cccb61ef961d13d1c48f08c375c19f1df0"} Jun 11 23:16:02.613853 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:02.613817 2563 generic.go:356] "Generic (PLEG): container finished" podID="8e1a89ab-7a03-4afb-960f-44925fecd664" containerID="232cbc174e44f730948d44c9c889b1cccb61ef961d13d1c48f08c375c19f1df0" exitCode=0 Jun 11 23:16:02.614328 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:02.613898 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-vvt4x" event={"ID":"8e1a89ab-7a03-4afb-960f-44925fecd664","Type":"ContainerDied","Data":"232cbc174e44f730948d44c9c889b1cccb61ef961d13d1c48f08c375c19f1df0"} Jun 11 23:16:03.620044 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:03.620007 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-vvt4x" event={"ID":"8e1a89ab-7a03-4afb-960f-44925fecd664","Type":"ContainerStarted","Data":"c0ee6b5bc2fa8c4e476125d3612dd31e94b5e5735e0ec03ca0ffd320d6a3ae1d"} Jun 11 23:16:03.620440 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:03.620132 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-vvt4x" Jun 11 23:16:03.643244 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:03.643193 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-vvt4x" podStartSLOduration=2.485508105 podStartE2EDuration="6.643173726s" totalImagesPullingTime="3.159674547s" totalInitContainerRuntime="997.991074ms" isStatefulPod=false podCreationTimestamp="2026-06-11 23:15:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:16:03.641238559 +0000 UTC m=+337.064023519" watchObservedRunningTime="2026-06-11 23:16:03.643173726 +0000 UTC m=+337.065958694" Jun 11 23:16:14.630126 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:14.630096 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6545b9fcc6-vvt4x" Jun 11 23:16:14.709653 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:14.709622 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-64f6c9fd9c-jck7t"] Jun 11 23:16:14.711945 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:14.711923 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-64f6c9fd9c-jck7t" Jun 11 23:16:14.715309 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:14.715289 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qtmqr\"" Jun 11 23:16:14.715437 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:14.715333 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 23:16:14.715593 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:14.715573 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 23:16:14.715651 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:14.715609 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 23:16:14.715715 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:14.715664 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 23:16:14.715871 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:14.715852 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 23:16:14.724872 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:14.724850 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-64f6c9fd9c-jck7t"] Jun 11 23:16:14.753328 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:14.753296 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f942ad5-ec71-4db9-9b19-2a1d78dea708-cert\") pod \"lws-controller-manager-64f6c9fd9c-jck7t\" (UID: \"8f942ad5-ec71-4db9-9b19-2a1d78dea708\") " pod="openshift-lws-operator/lws-controller-manager-64f6c9fd9c-jck7t" Jun 11 23:16:14.753471 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:14.753363 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f942ad5-ec71-4db9-9b19-2a1d78dea708-metrics-cert\") pod \"lws-controller-manager-64f6c9fd9c-jck7t\" (UID: \"8f942ad5-ec71-4db9-9b19-2a1d78dea708\") " pod="openshift-lws-operator/lws-controller-manager-64f6c9fd9c-jck7t" Jun 11 23:16:14.753471 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:14.753383 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6t25\" (UniqueName: \"kubernetes.io/projected/8f942ad5-ec71-4db9-9b19-2a1d78dea708-kube-api-access-n6t25\") pod \"lws-controller-manager-64f6c9fd9c-jck7t\" (UID: \"8f942ad5-ec71-4db9-9b19-2a1d78dea708\") " pod="openshift-lws-operator/lws-controller-manager-64f6c9fd9c-jck7t" Jun 11 23:16:14.753471 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:14.753433 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8f942ad5-ec71-4db9-9b19-2a1d78dea708-manager-config\") pod \"lws-controller-manager-64f6c9fd9c-jck7t\" (UID: \"8f942ad5-ec71-4db9-9b19-2a1d78dea708\") " pod="openshift-lws-operator/lws-controller-manager-64f6c9fd9c-jck7t" Jun 11 23:16:14.854803 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:14.854760 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f942ad5-ec71-4db9-9b19-2a1d78dea708-metrics-cert\") pod \"lws-controller-manager-64f6c9fd9c-jck7t\" (UID: \"8f942ad5-ec71-4db9-9b19-2a1d78dea708\") " pod="openshift-lws-operator/lws-controller-manager-64f6c9fd9c-jck7t" Jun 11 23:16:14.854803 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:14.854802 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6t25\" (UniqueName: \"kubernetes.io/projected/8f942ad5-ec71-4db9-9b19-2a1d78dea708-kube-api-access-n6t25\") pod \"lws-controller-manager-64f6c9fd9c-jck7t\" (UID: \"8f942ad5-ec71-4db9-9b19-2a1d78dea708\") " pod="openshift-lws-operator/lws-controller-manager-64f6c9fd9c-jck7t" Jun 11 23:16:14.855037 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:14.854848 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8f942ad5-ec71-4db9-9b19-2a1d78dea708-manager-config\") pod \"lws-controller-manager-64f6c9fd9c-jck7t\" (UID: \"8f942ad5-ec71-4db9-9b19-2a1d78dea708\") " pod="openshift-lws-operator/lws-controller-manager-64f6c9fd9c-jck7t" Jun 11 23:16:14.855037 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:14.854877 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f942ad5-ec71-4db9-9b19-2a1d78dea708-cert\") pod \"lws-controller-manager-64f6c9fd9c-jck7t\" (UID: \"8f942ad5-ec71-4db9-9b19-2a1d78dea708\") " pod="openshift-lws-operator/lws-controller-manager-64f6c9fd9c-jck7t" Jun 11 23:16:14.855622 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:14.855599 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8f942ad5-ec71-4db9-9b19-2a1d78dea708-manager-config\") pod \"lws-controller-manager-64f6c9fd9c-jck7t\" (UID: \"8f942ad5-ec71-4db9-9b19-2a1d78dea708\") " pod="openshift-lws-operator/lws-controller-manager-64f6c9fd9c-jck7t" Jun 11 23:16:14.857273 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:14.857244 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f942ad5-ec71-4db9-9b19-2a1d78dea708-metrics-cert\") pod \"lws-controller-manager-64f6c9fd9c-jck7t\" (UID: \"8f942ad5-ec71-4db9-9b19-2a1d78dea708\") " pod="openshift-lws-operator/lws-controller-manager-64f6c9fd9c-jck7t" Jun 11 23:16:14.857371 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:14.857349 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f942ad5-ec71-4db9-9b19-2a1d78dea708-cert\") pod \"lws-controller-manager-64f6c9fd9c-jck7t\" (UID: \"8f942ad5-ec71-4db9-9b19-2a1d78dea708\") " pod="openshift-lws-operator/lws-controller-manager-64f6c9fd9c-jck7t" Jun 11 23:16:14.864904 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:14.864880 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6t25\" (UniqueName: \"kubernetes.io/projected/8f942ad5-ec71-4db9-9b19-2a1d78dea708-kube-api-access-n6t25\") pod \"lws-controller-manager-64f6c9fd9c-jck7t\" (UID: \"8f942ad5-ec71-4db9-9b19-2a1d78dea708\") " pod="openshift-lws-operator/lws-controller-manager-64f6c9fd9c-jck7t" Jun 11 23:16:15.021598 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:15.021516 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-64f6c9fd9c-jck7t" Jun 11 23:16:15.150633 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:15.150607 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-64f6c9fd9c-jck7t"] Jun 11 23:16:15.153430 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:16:15.153403 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f942ad5_ec71_4db9_9b19_2a1d78dea708.slice/crio-61a1af5ea3270095270d58a3d4a66c6943cd5fc8dd734fd4d13e8495c0cc20e1 WatchSource:0}: Error finding container 61a1af5ea3270095270d58a3d4a66c6943cd5fc8dd734fd4d13e8495c0cc20e1: Status 404 returned error can't find the container with id 61a1af5ea3270095270d58a3d4a66c6943cd5fc8dd734fd4d13e8495c0cc20e1 Jun 11 23:16:15.683828 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:15.683792 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-64f6c9fd9c-jck7t" event={"ID":"8f942ad5-ec71-4db9-9b19-2a1d78dea708","Type":"ContainerStarted","Data":"61a1af5ea3270095270d58a3d4a66c6943cd5fc8dd734fd4d13e8495c0cc20e1"} Jun 11 23:16:16.879391 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:16.879012 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-747776d6d8-6mt64"] Jun 11 23:16:16.886931 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:16.886902 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-747776d6d8-6mt64" Jun 11 23:16:16.890188 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:16.890128 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 23:16:16.890188 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:16.890138 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 23:16:16.890188 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:16.890183 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 23:16:16.890651 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:16.890540 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 23:16:16.892103 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:16.892050 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-z2vks\"" Jun 11 23:16:16.903806 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:16.903740 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-747776d6d8-6mt64"] Jun 11 23:16:16.977361 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:16.977249 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgkgl\" (UniqueName: \"kubernetes.io/projected/0ddd2572-ff83-4a6f-bc20-af6dabdec412-kube-api-access-pgkgl\") pod \"kube-auth-proxy-747776d6d8-6mt64\" (UID: \"0ddd2572-ff83-4a6f-bc20-af6dabdec412\") " pod="openshift-ingress/kube-auth-proxy-747776d6d8-6mt64" Jun 11 23:16:16.977361 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:16.977311 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ddd2572-ff83-4a6f-bc20-af6dabdec412-tls-certs\") pod \"kube-auth-proxy-747776d6d8-6mt64\" (UID: \"0ddd2572-ff83-4a6f-bc20-af6dabdec412\") " pod="openshift-ingress/kube-auth-proxy-747776d6d8-6mt64" Jun 11 23:16:16.977361 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:16.977335 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ddd2572-ff83-4a6f-bc20-af6dabdec412-tmp\") pod \"kube-auth-proxy-747776d6d8-6mt64\" (UID: \"0ddd2572-ff83-4a6f-bc20-af6dabdec412\") " pod="openshift-ingress/kube-auth-proxy-747776d6d8-6mt64" Jun 11 23:16:17.078219 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:17.078111 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgkgl\" (UniqueName: \"kubernetes.io/projected/0ddd2572-ff83-4a6f-bc20-af6dabdec412-kube-api-access-pgkgl\") pod \"kube-auth-proxy-747776d6d8-6mt64\" (UID: \"0ddd2572-ff83-4a6f-bc20-af6dabdec412\") " pod="openshift-ingress/kube-auth-proxy-747776d6d8-6mt64" Jun 11 23:16:17.078418 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:17.078328 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ddd2572-ff83-4a6f-bc20-af6dabdec412-tls-certs\") pod \"kube-auth-proxy-747776d6d8-6mt64\" (UID: \"0ddd2572-ff83-4a6f-bc20-af6dabdec412\") " pod="openshift-ingress/kube-auth-proxy-747776d6d8-6mt64" Jun 11 23:16:17.078418 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:17.078399 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ddd2572-ff83-4a6f-bc20-af6dabdec412-tmp\") pod \"kube-auth-proxy-747776d6d8-6mt64\" (UID: \"0ddd2572-ff83-4a6f-bc20-af6dabdec412\") " pod="openshift-ingress/kube-auth-proxy-747776d6d8-6mt64" Jun 11 23:16:17.081237 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:17.081213 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ddd2572-ff83-4a6f-bc20-af6dabdec412-tmp\") pod \"kube-auth-proxy-747776d6d8-6mt64\" (UID: \"0ddd2572-ff83-4a6f-bc20-af6dabdec412\") " pod="openshift-ingress/kube-auth-proxy-747776d6d8-6mt64" Jun 11 23:16:17.081707 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:17.081658 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ddd2572-ff83-4a6f-bc20-af6dabdec412-tls-certs\") pod \"kube-auth-proxy-747776d6d8-6mt64\" (UID: \"0ddd2572-ff83-4a6f-bc20-af6dabdec412\") " pod="openshift-ingress/kube-auth-proxy-747776d6d8-6mt64" Jun 11 23:16:17.117844 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:17.117806 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgkgl\" (UniqueName: \"kubernetes.io/projected/0ddd2572-ff83-4a6f-bc20-af6dabdec412-kube-api-access-pgkgl\") pod \"kube-auth-proxy-747776d6d8-6mt64\" (UID: \"0ddd2572-ff83-4a6f-bc20-af6dabdec412\") " pod="openshift-ingress/kube-auth-proxy-747776d6d8-6mt64" Jun 11 23:16:17.201303 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:17.201219 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-747776d6d8-6mt64" Jun 11 23:16:17.628772 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:16:17.628739 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ddd2572_ff83_4a6f_bc20_af6dabdec412.slice/crio-1cb7053e447b97c68135c6560f82dfbd23d1bc2ef3457acb0825126751ebe7b0 WatchSource:0}: Error finding container 1cb7053e447b97c68135c6560f82dfbd23d1bc2ef3457acb0825126751ebe7b0: Status 404 returned error can't find the container with id 1cb7053e447b97c68135c6560f82dfbd23d1bc2ef3457acb0825126751ebe7b0 Jun 11 23:16:17.630150 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:17.630119 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-747776d6d8-6mt64"] Jun 11 23:16:17.695317 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:17.695280 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-64f6c9fd9c-jck7t" event={"ID":"8f942ad5-ec71-4db9-9b19-2a1d78dea708","Type":"ContainerStarted","Data":"cd2c163f149acda06355d3e473556f3b6f1c65c5261fdff3411e45e8a197fd18"} Jun 11 23:16:17.695517 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:17.695432 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-64f6c9fd9c-jck7t" Jun 11 23:16:17.696622 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:17.696591 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-747776d6d8-6mt64" event={"ID":"0ddd2572-ff83-4a6f-bc20-af6dabdec412","Type":"ContainerStarted","Data":"1cb7053e447b97c68135c6560f82dfbd23d1bc2ef3457acb0825126751ebe7b0"} Jun 11 23:16:17.743373 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:17.743274 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-64f6c9fd9c-jck7t" podStartSLOduration=1.379376339 podStartE2EDuration="3.743259618s" totalImagesPullingTime="2.363883279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:16:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:16:17.740585896 +0000 UTC m=+351.163370862" watchObservedRunningTime="2026-06-11 23:16:17.743259618 +0000 UTC m=+351.166044586" Jun 11 23:16:20.713990 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:20.713878 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-747776d6d8-6mt64" event={"ID":"0ddd2572-ff83-4a6f-bc20-af6dabdec412","Type":"ContainerStarted","Data":"94f5c579d92e10c0450e4731efc254dd52ed1fee55d6b119555722c1733de49b"} Jun 11 23:16:20.730653 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:20.730594 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-747776d6d8-6mt64" podStartSLOduration=1.937480766 podStartE2EDuration="4.730575371s" totalImagesPullingTime="2.793094605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:16:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:16:20.729610317 +0000 UTC m=+354.152395285" watchObservedRunningTime="2026-06-11 23:16:20.730575371 +0000 UTC m=+354.153360340" Jun 11 23:16:28.704323 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:16:28.704289 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-64f6c9fd9c-jck7t" Jun 11 23:17:22.355178 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:22.355140 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76748c45b8-jc6fx"] Jun 11 23:17:22.357495 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:22.357476 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76748c45b8-jc6fx" Jun 11 23:17:22.373523 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:22.373495 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76748c45b8-jc6fx"] Jun 11 23:17:22.472991 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:22.472955 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6085ef50-3f07-4ef1-aa50-bf7a5b63aff8-service-ca\") pod \"console-76748c45b8-jc6fx\" (UID: \"6085ef50-3f07-4ef1-aa50-bf7a5b63aff8\") " pod="openshift-console/console-76748c45b8-jc6fx" Jun 11 23:17:22.473158 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:22.473015 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6085ef50-3f07-4ef1-aa50-bf7a5b63aff8-oauth-serving-cert\") pod \"console-76748c45b8-jc6fx\" (UID: \"6085ef50-3f07-4ef1-aa50-bf7a5b63aff8\") " pod="openshift-console/console-76748c45b8-jc6fx" Jun 11 23:17:22.473158 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:22.473050 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6085ef50-3f07-4ef1-aa50-bf7a5b63aff8-console-oauth-config\") pod \"console-76748c45b8-jc6fx\" (UID: \"6085ef50-3f07-4ef1-aa50-bf7a5b63aff8\") " pod="openshift-console/console-76748c45b8-jc6fx" Jun 11 23:17:22.473158 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:22.473089 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6085ef50-3f07-4ef1-aa50-bf7a5b63aff8-console-serving-cert\") pod \"console-76748c45b8-jc6fx\" (UID: \"6085ef50-3f07-4ef1-aa50-bf7a5b63aff8\") " pod="openshift-console/console-76748c45b8-jc6fx" Jun 11 23:17:22.473158 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:22.473137 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shbq6\" (UniqueName: \"kubernetes.io/projected/6085ef50-3f07-4ef1-aa50-bf7a5b63aff8-kube-api-access-shbq6\") pod \"console-76748c45b8-jc6fx\" (UID: \"6085ef50-3f07-4ef1-aa50-bf7a5b63aff8\") " pod="openshift-console/console-76748c45b8-jc6fx" Jun 11 23:17:22.473356 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:22.473158 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6085ef50-3f07-4ef1-aa50-bf7a5b63aff8-trusted-ca-bundle\") pod \"console-76748c45b8-jc6fx\" (UID: \"6085ef50-3f07-4ef1-aa50-bf7a5b63aff8\") " pod="openshift-console/console-76748c45b8-jc6fx" Jun 11 23:17:22.473356 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:22.473271 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6085ef50-3f07-4ef1-aa50-bf7a5b63aff8-console-config\") pod \"console-76748c45b8-jc6fx\" (UID: \"6085ef50-3f07-4ef1-aa50-bf7a5b63aff8\") " pod="openshift-console/console-76748c45b8-jc6fx" Jun 11 23:17:22.574099 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:22.574060 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6085ef50-3f07-4ef1-aa50-bf7a5b63aff8-console-oauth-config\") pod \"console-76748c45b8-jc6fx\" (UID: \"6085ef50-3f07-4ef1-aa50-bf7a5b63aff8\") " pod="openshift-console/console-76748c45b8-jc6fx" Jun 11 23:17:22.574099 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:22.574108 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6085ef50-3f07-4ef1-aa50-bf7a5b63aff8-console-serving-cert\") pod \"console-76748c45b8-jc6fx\" (UID: \"6085ef50-3f07-4ef1-aa50-bf7a5b63aff8\") " pod="openshift-console/console-76748c45b8-jc6fx" Jun 11 23:17:22.574356 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:22.574154 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shbq6\" (UniqueName: \"kubernetes.io/projected/6085ef50-3f07-4ef1-aa50-bf7a5b63aff8-kube-api-access-shbq6\") pod \"console-76748c45b8-jc6fx\" (UID: \"6085ef50-3f07-4ef1-aa50-bf7a5b63aff8\") " pod="openshift-console/console-76748c45b8-jc6fx" Jun 11 23:17:22.574356 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:22.574177 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6085ef50-3f07-4ef1-aa50-bf7a5b63aff8-trusted-ca-bundle\") pod \"console-76748c45b8-jc6fx\" (UID: \"6085ef50-3f07-4ef1-aa50-bf7a5b63aff8\") " pod="openshift-console/console-76748c45b8-jc6fx" Jun 11 23:17:22.574356 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:22.574205 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6085ef50-3f07-4ef1-aa50-bf7a5b63aff8-console-config\") pod \"console-76748c45b8-jc6fx\" (UID: \"6085ef50-3f07-4ef1-aa50-bf7a5b63aff8\") " pod="openshift-console/console-76748c45b8-jc6fx" Jun 11 23:17:22.574356 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:22.574257 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6085ef50-3f07-4ef1-aa50-bf7a5b63aff8-service-ca\") pod \"console-76748c45b8-jc6fx\" (UID: \"6085ef50-3f07-4ef1-aa50-bf7a5b63aff8\") " pod="openshift-console/console-76748c45b8-jc6fx" Jun 11 23:17:22.574356 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:22.574284 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6085ef50-3f07-4ef1-aa50-bf7a5b63aff8-oauth-serving-cert\") pod \"console-76748c45b8-jc6fx\" (UID: \"6085ef50-3f07-4ef1-aa50-bf7a5b63aff8\") " pod="openshift-console/console-76748c45b8-jc6fx" Jun 11 23:17:22.575069 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:22.575041 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6085ef50-3f07-4ef1-aa50-bf7a5b63aff8-console-config\") pod \"console-76748c45b8-jc6fx\" (UID: \"6085ef50-3f07-4ef1-aa50-bf7a5b63aff8\") " pod="openshift-console/console-76748c45b8-jc6fx" Jun 11 23:17:22.575166 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:22.575043 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6085ef50-3f07-4ef1-aa50-bf7a5b63aff8-service-ca\") pod \"console-76748c45b8-jc6fx\" (UID: \"6085ef50-3f07-4ef1-aa50-bf7a5b63aff8\") " pod="openshift-console/console-76748c45b8-jc6fx" Jun 11 23:17:22.575166 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:22.575116 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6085ef50-3f07-4ef1-aa50-bf7a5b63aff8-oauth-serving-cert\") pod \"console-76748c45b8-jc6fx\" (UID: \"6085ef50-3f07-4ef1-aa50-bf7a5b63aff8\") " pod="openshift-console/console-76748c45b8-jc6fx" Jun 11 23:17:22.575285 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:22.575206 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6085ef50-3f07-4ef1-aa50-bf7a5b63aff8-trusted-ca-bundle\") pod \"console-76748c45b8-jc6fx\" (UID: \"6085ef50-3f07-4ef1-aa50-bf7a5b63aff8\") " pod="openshift-console/console-76748c45b8-jc6fx" Jun 11 23:17:22.576792 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:22.576767 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6085ef50-3f07-4ef1-aa50-bf7a5b63aff8-console-serving-cert\") pod \"console-76748c45b8-jc6fx\" (UID: \"6085ef50-3f07-4ef1-aa50-bf7a5b63aff8\") " pod="openshift-console/console-76748c45b8-jc6fx" Jun 11 23:17:22.576882 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:22.576767 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6085ef50-3f07-4ef1-aa50-bf7a5b63aff8-console-oauth-config\") pod \"console-76748c45b8-jc6fx\" (UID: \"6085ef50-3f07-4ef1-aa50-bf7a5b63aff8\") " pod="openshift-console/console-76748c45b8-jc6fx" Jun 11 23:17:22.584137 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:22.584114 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shbq6\" (UniqueName: \"kubernetes.io/projected/6085ef50-3f07-4ef1-aa50-bf7a5b63aff8-kube-api-access-shbq6\") pod \"console-76748c45b8-jc6fx\" (UID: \"6085ef50-3f07-4ef1-aa50-bf7a5b63aff8\") " pod="openshift-console/console-76748c45b8-jc6fx" Jun 11 23:17:22.666395 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:22.666358 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76748c45b8-jc6fx" Jun 11 23:17:22.812252 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:22.812227 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76748c45b8-jc6fx"] Jun 11 23:17:22.814859 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:17:22.814830 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6085ef50_3f07_4ef1_aa50_bf7a5b63aff8.slice/crio-de3e178766452cdd47dbb2be58bf03043e12cc12b400f86004ff123b772b52b8 WatchSource:0}: Error finding container de3e178766452cdd47dbb2be58bf03043e12cc12b400f86004ff123b772b52b8: Status 404 returned error can't find the container with id de3e178766452cdd47dbb2be58bf03043e12cc12b400f86004ff123b772b52b8 Jun 11 23:17:23.005843 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:23.005736 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76748c45b8-jc6fx" event={"ID":"6085ef50-3f07-4ef1-aa50-bf7a5b63aff8","Type":"ContainerStarted","Data":"d4aef67db03f76116d492a8745cf141348b51e6c31573e8f95be864f7d5f1d3c"} Jun 11 23:17:23.005843 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:23.005812 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76748c45b8-jc6fx" event={"ID":"6085ef50-3f07-4ef1-aa50-bf7a5b63aff8","Type":"ContainerStarted","Data":"de3e178766452cdd47dbb2be58bf03043e12cc12b400f86004ff123b772b52b8"} Jun 11 23:17:23.022799 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:23.022731 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76748c45b8-jc6fx" podStartSLOduration=1.022716695 podStartE2EDuration="1.022716695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:17:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:17:23.02157696 +0000 UTC m=+416.444361932" watchObservedRunningTime="2026-06-11 23:17:23.022716695 +0000 UTC m=+416.445501662" Jun 11 23:17:32.666832 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:32.666785 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76748c45b8-jc6fx" Jun 11 23:17:32.667259 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:32.666854 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76748c45b8-jc6fx" Jun 11 23:17:32.671531 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:32.671509 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76748c45b8-jc6fx" Jun 11 23:17:33.047934 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:33.047857 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76748c45b8-jc6fx" Jun 11 23:17:33.093145 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:33.093107 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55fd47b54f-v829j"] Jun 11 23:17:58.082861 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.082824 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r96qn"] Jun 11 23:17:58.085435 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.085412 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r96qn" Jun 11 23:17:58.089318 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.089291 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 23:17:58.089420 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.089328 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 23:17:58.089590 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.089573 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7ddwd\"" Jun 11 23:17:58.103180 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.103160 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r96qn"] Jun 11 23:17:58.113781 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.113723 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-55fd47b54f-v829j" podUID="78fa6479-ef37-46e1-a8ee-8f2afc15684b" containerName="console" containerID="cri-o://e5ca7a14a285143717997f9468c8ad17485829c384da781e9019e07a635e4d16" gracePeriod=15 Jun 11 23:17:58.208432 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.208397 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r96qn\" (UID: \"2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r96qn" Jun 11 23:17:58.208623 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.208576 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4m9t\" (UniqueName: \"kubernetes.io/projected/2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e-kube-api-access-p4m9t\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r96qn\" (UID: \"2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r96qn" Jun 11 23:17:58.309562 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.309519 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4m9t\" (UniqueName: \"kubernetes.io/projected/2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e-kube-api-access-p4m9t\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r96qn\" (UID: \"2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r96qn" Jun 11 23:17:58.309562 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.309563 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r96qn\" (UID: \"2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r96qn" Jun 11 23:17:58.309992 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.309953 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r96qn\" (UID: \"2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r96qn" Jun 11 23:17:58.320645 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.320621 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4m9t\" (UniqueName: \"kubernetes.io/projected/2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e-kube-api-access-p4m9t\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r96qn\" (UID: \"2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r96qn" Jun 11 23:17:58.354539 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.354517 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55fd47b54f-v829j" Jun 11 23:17:58.395603 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.395573 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r96qn" Jun 11 23:17:58.511521 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.511494 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78fa6479-ef37-46e1-a8ee-8f2afc15684b-trusted-ca-bundle\") pod \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\" (UID: \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\") " Jun 11 23:17:58.511691 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.511550 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78fa6479-ef37-46e1-a8ee-8f2afc15684b-oauth-serving-cert\") pod \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\" (UID: \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\") " Jun 11 23:17:58.511691 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.511583 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78fa6479-ef37-46e1-a8ee-8f2afc15684b-service-ca\") pod \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\" (UID: \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\") " Jun 11 23:17:58.511691 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.511602 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78fa6479-ef37-46e1-a8ee-8f2afc15684b-console-config\") pod \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\" (UID: \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\") " Jun 11 23:17:58.511691 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.511625 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78fa6479-ef37-46e1-a8ee-8f2afc15684b-console-oauth-config\") pod \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\" (UID: \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\") " Jun 11 23:17:58.511691 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.511644 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78fa6479-ef37-46e1-a8ee-8f2afc15684b-console-serving-cert\") pod \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\" (UID: \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\") " Jun 11 23:17:58.511691 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.511685 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxlkb\" (UniqueName: \"kubernetes.io/projected/78fa6479-ef37-46e1-a8ee-8f2afc15684b-kube-api-access-vxlkb\") pod \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\" (UID: \"78fa6479-ef37-46e1-a8ee-8f2afc15684b\") " Jun 11 23:17:58.512025 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.512000 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78fa6479-ef37-46e1-a8ee-8f2afc15684b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "78fa6479-ef37-46e1-a8ee-8f2afc15684b" (UID: "78fa6479-ef37-46e1-a8ee-8f2afc15684b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:17:58.512086 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.512045 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78fa6479-ef37-46e1-a8ee-8f2afc15684b-console-config" (OuterVolumeSpecName: "console-config") pod "78fa6479-ef37-46e1-a8ee-8f2afc15684b" (UID: "78fa6479-ef37-46e1-a8ee-8f2afc15684b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:17:58.512086 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.512059 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78fa6479-ef37-46e1-a8ee-8f2afc15684b-service-ca" (OuterVolumeSpecName: "service-ca") pod "78fa6479-ef37-46e1-a8ee-8f2afc15684b" (UID: "78fa6479-ef37-46e1-a8ee-8f2afc15684b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:17:58.512086 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.512074 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78fa6479-ef37-46e1-a8ee-8f2afc15684b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "78fa6479-ef37-46e1-a8ee-8f2afc15684b" (UID: "78fa6479-ef37-46e1-a8ee-8f2afc15684b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:17:58.513810 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.513783 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78fa6479-ef37-46e1-a8ee-8f2afc15684b-kube-api-access-vxlkb" (OuterVolumeSpecName: "kube-api-access-vxlkb") pod "78fa6479-ef37-46e1-a8ee-8f2afc15684b" (UID: "78fa6479-ef37-46e1-a8ee-8f2afc15684b"). InnerVolumeSpecName "kube-api-access-vxlkb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:17:58.513810 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.513798 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78fa6479-ef37-46e1-a8ee-8f2afc15684b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "78fa6479-ef37-46e1-a8ee-8f2afc15684b" (UID: "78fa6479-ef37-46e1-a8ee-8f2afc15684b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:17:58.513938 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.513784 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78fa6479-ef37-46e1-a8ee-8f2afc15684b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "78fa6479-ef37-46e1-a8ee-8f2afc15684b" (UID: "78fa6479-ef37-46e1-a8ee-8f2afc15684b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:17:58.529727 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.529707 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r96qn"] Jun 11 23:17:58.531964 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:17:58.531942 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f6c810c_4189_4d52_8b35_9ddcc1e7bc3e.slice/crio-a3e875efd917fe238dccee029062e938a1110d248f0d15962f2c6e4c13c37c4b WatchSource:0}: Error finding container a3e875efd917fe238dccee029062e938a1110d248f0d15962f2c6e4c13c37c4b: Status 404 returned error can't find the container with id a3e875efd917fe238dccee029062e938a1110d248f0d15962f2c6e4c13c37c4b Jun 11 23:17:58.612895 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.612863 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78fa6479-ef37-46e1-a8ee-8f2afc15684b-trusted-ca-bundle\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:17:58.612895 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.612893 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78fa6479-ef37-46e1-a8ee-8f2afc15684b-oauth-serving-cert\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:17:58.613121 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.612905 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78fa6479-ef37-46e1-a8ee-8f2afc15684b-service-ca\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:17:58.613121 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.612915 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78fa6479-ef37-46e1-a8ee-8f2afc15684b-console-config\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:17:58.613121 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.612923 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78fa6479-ef37-46e1-a8ee-8f2afc15684b-console-oauth-config\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:17:58.613121 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.612934 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78fa6479-ef37-46e1-a8ee-8f2afc15684b-console-serving-cert\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:17:58.613121 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:58.612942 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxlkb\" (UniqueName: \"kubernetes.io/projected/78fa6479-ef37-46e1-a8ee-8f2afc15684b-kube-api-access-vxlkb\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:17:59.170604 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:59.170563 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r96qn" event={"ID":"2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e","Type":"ContainerStarted","Data":"a3e875efd917fe238dccee029062e938a1110d248f0d15962f2c6e4c13c37c4b"} Jun 11 23:17:59.171914 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:59.171891 2563 generic.go:356] "Generic (PLEG): container finished" podID="78fa6479-ef37-46e1-a8ee-8f2afc15684b" containerID="e5ca7a14a285143717997f9468c8ad17485829c384da781e9019e07a635e4d16" exitCode=0 Jun 11 23:17:59.172056 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:59.171970 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55fd47b54f-v829j" Jun 11 23:17:59.172056 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:59.171994 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55fd47b54f-v829j" event={"ID":"78fa6479-ef37-46e1-a8ee-8f2afc15684b","Type":"ContainerDied","Data":"e5ca7a14a285143717997f9468c8ad17485829c384da781e9019e07a635e4d16"} Jun 11 23:17:59.172056 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:59.172038 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55fd47b54f-v829j" event={"ID":"78fa6479-ef37-46e1-a8ee-8f2afc15684b","Type":"ContainerDied","Data":"0fea64ca9be60d702b70e4fdd3741a9528ba7864f9166049d7e2e58f30ef2c73"} Jun 11 23:17:59.172224 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:59.172062 2563 scope.go:117] "RemoveContainer" containerID="e5ca7a14a285143717997f9468c8ad17485829c384da781e9019e07a635e4d16" Jun 11 23:17:59.200011 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:59.199963 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55fd47b54f-v829j"] Jun 11 23:17:59.205196 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:59.205162 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55fd47b54f-v829j"] Jun 11 23:17:59.228832 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:59.228805 2563 scope.go:117] "RemoveContainer" containerID="e5ca7a14a285143717997f9468c8ad17485829c384da781e9019e07a635e4d16" Jun 11 23:17:59.229178 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:17:59.229157 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5ca7a14a285143717997f9468c8ad17485829c384da781e9019e07a635e4d16\": container with ID starting with e5ca7a14a285143717997f9468c8ad17485829c384da781e9019e07a635e4d16 not found: ID does not exist" containerID="e5ca7a14a285143717997f9468c8ad17485829c384da781e9019e07a635e4d16" Jun 11 23:17:59.229231 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:17:59.229190 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5ca7a14a285143717997f9468c8ad17485829c384da781e9019e07a635e4d16"} err="failed to get container status \"e5ca7a14a285143717997f9468c8ad17485829c384da781e9019e07a635e4d16\": rpc error: code = NotFound desc = could not find container \"e5ca7a14a285143717997f9468c8ad17485829c384da781e9019e07a635e4d16\": container with ID starting with e5ca7a14a285143717997f9468c8ad17485829c384da781e9019e07a635e4d16 not found: ID does not exist" Jun 11 23:18:01.006915 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:01.006879 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78fa6479-ef37-46e1-a8ee-8f2afc15684b" path="/var/lib/kubelet/pods/78fa6479-ef37-46e1-a8ee-8f2afc15684b/volumes" Jun 11 23:18:05.205144 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:05.205110 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r96qn" event={"ID":"2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e","Type":"ContainerStarted","Data":"f451f915d251494af64240f9051fd8c1e206360ee5085cad14cded1f171e32ac"} Jun 11 23:18:05.205593 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:05.205190 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r96qn" Jun 11 23:18:16.212654 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:16.212614 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r96qn" Jun 11 23:18:16.238506 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:16.238451 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r96qn" podStartSLOduration=12.357302583 podStartE2EDuration="18.238432192s" totalImagesPullingTime="5.881129609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:17:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:18:05.228572251 +0000 UTC m=+458.651357221" watchObservedRunningTime="2026-06-11 23:18:16.238432192 +0000 UTC m=+469.661217159" Jun 11 23:18:18.141038 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:18.141007 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r96qn"] Jun 11 23:18:18.141660 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:18.141193 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r96qn" podUID="2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e" containerName="manager" containerID="cri-o://f451f915d251494af64240f9051fd8c1e206360ee5085cad14cded1f171e32ac" gracePeriod=2 Jun 11 23:18:18.151748 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:18.151718 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r96qn"] Jun 11 23:18:18.169763 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:18.169734 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wxlm"] Jun 11 23:18:18.170318 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:18.170299 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e" containerName="manager" Jun 11 23:18:18.170367 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:18.170324 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e" containerName="manager" Jun 11 23:18:18.170367 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:18.170357 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78fa6479-ef37-46e1-a8ee-8f2afc15684b" containerName="console" Jun 11 23:18:18.170434 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:18.170366 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="78fa6479-ef37-46e1-a8ee-8f2afc15684b" containerName="console" Jun 11 23:18:18.170498 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:18.170486 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e" containerName="manager" Jun 11 23:18:18.170531 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:18.170506 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="78fa6479-ef37-46e1-a8ee-8f2afc15684b" containerName="console" Jun 11 23:18:18.173186 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:18.173165 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wxlm" Jun 11 23:18:18.175680 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:18:18.175655 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r96qn\" is forbidden: User \"system:node:ip-10-0-130-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-215.ec2.internal' and this object" podUID="2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r96qn" Jun 11 23:18:18.188284 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:18.188248 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wxlm"] Jun 11 23:18:18.188608 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:18.188582 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4wxlm\" (UID: \"1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wxlm" Jun 11 23:18:18.188723 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:18.188702 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nqtj\" (UniqueName: \"kubernetes.io/projected/1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75-kube-api-access-6nqtj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4wxlm\" (UID: \"1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wxlm" Jun 11 23:18:18.266639 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:18.266605 2563 generic.go:356] "Generic (PLEG): container finished" podID="2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e" containerID="f451f915d251494af64240f9051fd8c1e206360ee5085cad14cded1f171e32ac" exitCode=0 Jun 11 23:18:18.289382 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:18.289341 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nqtj\" (UniqueName: \"kubernetes.io/projected/1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75-kube-api-access-6nqtj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4wxlm\" (UID: \"1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wxlm" Jun 11 23:18:18.289573 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:18.289489 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4wxlm\" (UID: \"1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wxlm" Jun 11 23:18:18.289813 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:18.289796 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4wxlm\" (UID: \"1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wxlm" Jun 11 23:18:18.300062 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:18.300028 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nqtj\" (UniqueName: \"kubernetes.io/projected/1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75-kube-api-access-6nqtj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4wxlm\" (UID: \"1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wxlm" Jun 11 23:18:18.380015 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:18.379968 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r96qn" Jun 11 23:18:18.382662 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:18:18.382634 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r96qn\" is forbidden: User \"system:node:ip-10-0-130-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-215.ec2.internal' and this object" podUID="2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r96qn" Jun 11 23:18:18.390024 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:18.390003 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4m9t\" (UniqueName: \"kubernetes.io/projected/2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e-kube-api-access-p4m9t\") pod \"2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e\" (UID: \"2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e\") " Jun 11 23:18:18.390126 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:18.390116 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e-extensions-socket-volume\") pod \"2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e\" (UID: \"2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e\") " Jun 11 23:18:18.390524 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:18.390498 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e" (UID: "2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:18:18.392245 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:18.392190 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e-kube-api-access-p4m9t" (OuterVolumeSpecName: "kube-api-access-p4m9t") pod "2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e" (UID: "2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e"). InnerVolumeSpecName "kube-api-access-p4m9t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:18:18.491381 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:18.491346 2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e-extensions-socket-volume\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:18:18.491381 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:18.491376 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4m9t\" (UniqueName: \"kubernetes.io/projected/2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e-kube-api-access-p4m9t\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:18:18.533302 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:18.533267 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wxlm" Jun 11 23:18:18.671572 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:18.671550 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wxlm"] Jun 11 23:18:18.673909 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:18:18.673887 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1faa41f2_f704_4a7f_98f0_c9f4c7f3ad75.slice/crio-b1d242380e8992d74b6dedfb816997c2ed26e5ef25dbd2f6b17df1cfc5e10a97 WatchSource:0}: Error finding container b1d242380e8992d74b6dedfb816997c2ed26e5ef25dbd2f6b17df1cfc5e10a97: Status 404 returned error can't find the container with id b1d242380e8992d74b6dedfb816997c2ed26e5ef25dbd2f6b17df1cfc5e10a97 Jun 11 23:18:19.006043 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:19.005943 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e" path="/var/lib/kubelet/pods/2f6c810c-4189-4d52-8b35-9ddcc1e7bc3e/volumes" Jun 11 23:18:19.272850 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:19.272758 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r96qn" Jun 11 23:18:19.272850 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:19.272782 2563 scope.go:117] "RemoveContainer" containerID="f451f915d251494af64240f9051fd8c1e206360ee5085cad14cded1f171e32ac" Jun 11 23:18:19.274460 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:19.274428 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wxlm" event={"ID":"1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75","Type":"ContainerStarted","Data":"aa764683a396122e3651f6d0f826fe42bd49d626e3495f0ec2d9fae3814ba707"} Jun 11 23:18:19.274574 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:19.274479 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wxlm" event={"ID":"1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75","Type":"ContainerStarted","Data":"b1d242380e8992d74b6dedfb816997c2ed26e5ef25dbd2f6b17df1cfc5e10a97"} Jun 11 23:18:19.274645 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:19.274595 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wxlm" Jun 11 23:18:19.302778 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:19.302723 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wxlm" podStartSLOduration=1.302710047 podStartE2EDuration="1.302710047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:18:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:18:19.299723489 +0000 UTC m=+472.722508454" watchObservedRunningTime="2026-06-11 23:18:19.302710047 +0000 UTC m=+472.725495014" Jun 11 23:18:30.283200 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:30.283167 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wxlm" Jun 11 23:18:46.523507 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:46.523473 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wxlm"] Jun 11 23:18:46.523909 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:46.523673 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wxlm" podUID="1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75" containerName="manager" containerID="cri-o://aa764683a396122e3651f6d0f826fe42bd49d626e3495f0ec2d9fae3814ba707" gracePeriod=10 Jun 11 23:18:46.772841 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:46.772813 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wxlm" Jun 11 23:18:46.852323 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:46.852234 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75-extensions-socket-volume\") pod \"1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75\" (UID: \"1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75\") " Jun 11 23:18:46.852468 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:46.852364 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nqtj\" (UniqueName: \"kubernetes.io/projected/1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75-kube-api-access-6nqtj\") pod \"1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75\" (UID: \"1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75\") " Jun 11 23:18:46.852649 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:46.852622 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75" (UID: "1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:18:46.854370 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:46.854346 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75-kube-api-access-6nqtj" (OuterVolumeSpecName: "kube-api-access-6nqtj") pod "1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75" (UID: "1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75"). InnerVolumeSpecName "kube-api-access-6nqtj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:18:46.953789 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:46.953749 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nqtj\" (UniqueName: \"kubernetes.io/projected/1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75-kube-api-access-6nqtj\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:18:46.953789 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:46.953786 2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75-extensions-socket-volume\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:18:47.408183 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:47.408145 2563 generic.go:356] "Generic (PLEG): container finished" podID="1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75" containerID="aa764683a396122e3651f6d0f826fe42bd49d626e3495f0ec2d9fae3814ba707" exitCode=0 Jun 11 23:18:47.408380 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:47.408208 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wxlm" Jun 11 23:18:47.408380 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:47.408234 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wxlm" event={"ID":"1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75","Type":"ContainerDied","Data":"aa764683a396122e3651f6d0f826fe42bd49d626e3495f0ec2d9fae3814ba707"} Jun 11 23:18:47.408380 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:47.408300 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wxlm" event={"ID":"1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75","Type":"ContainerDied","Data":"b1d242380e8992d74b6dedfb816997c2ed26e5ef25dbd2f6b17df1cfc5e10a97"} Jun 11 23:18:47.408380 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:47.408330 2563 scope.go:117] "RemoveContainer" containerID="aa764683a396122e3651f6d0f826fe42bd49d626e3495f0ec2d9fae3814ba707" Jun 11 23:18:47.417281 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:47.417263 2563 scope.go:117] "RemoveContainer" containerID="aa764683a396122e3651f6d0f826fe42bd49d626e3495f0ec2d9fae3814ba707" Jun 11 23:18:47.417547 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:18:47.417520 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa764683a396122e3651f6d0f826fe42bd49d626e3495f0ec2d9fae3814ba707\": container with ID starting with aa764683a396122e3651f6d0f826fe42bd49d626e3495f0ec2d9fae3814ba707 not found: ID does not exist" containerID="aa764683a396122e3651f6d0f826fe42bd49d626e3495f0ec2d9fae3814ba707" Jun 11 23:18:47.417646 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:47.417553 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa764683a396122e3651f6d0f826fe42bd49d626e3495f0ec2d9fae3814ba707"} err="failed to get container status \"aa764683a396122e3651f6d0f826fe42bd49d626e3495f0ec2d9fae3814ba707\": rpc error: code = NotFound desc = could not find container \"aa764683a396122e3651f6d0f826fe42bd49d626e3495f0ec2d9fae3814ba707\": container with ID starting with aa764683a396122e3651f6d0f826fe42bd49d626e3495f0ec2d9fae3814ba707 not found: ID does not exist" Jun 11 23:18:47.442728 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:47.442701 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wxlm"] Jun 11 23:18:47.446757 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:47.446732 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wxlm"] Jun 11 23:18:49.005123 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:18:49.005090 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75" path="/var/lib/kubelet/pods/1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75/volumes" Jun 11 23:19:06.382363 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:06.382328 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lj7kl"] Jun 11 23:19:06.382822 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:06.382673 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75" containerName="manager" Jun 11 23:19:06.382822 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:06.382683 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75" containerName="manager" Jun 11 23:19:06.382822 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:06.382777 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1faa41f2-f704-4a7f-98f0-c9f4c7f3ad75" containerName="manager" Jun 11 23:19:06.387204 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:06.387184 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lj7kl" Jun 11 23:19:06.390142 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:06.390118 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 23:19:06.390284 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:06.390186 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 23:19:06.390284 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:06.390200 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dw8hd\"" Jun 11 23:19:06.390284 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:06.390236 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 23:19:06.397261 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:06.397234 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lj7kl"] Jun 11 23:19:06.420582 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:06.420554 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntxwk\" (UniqueName: \"kubernetes.io/projected/8746b834-9453-4c0b-ae52-d22e69c09d9c-kube-api-access-ntxwk\") pod \"limitador-limitador-64c94fd64f-lj7kl\" (UID: \"8746b834-9453-4c0b-ae52-d22e69c09d9c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lj7kl" Jun 11 23:19:06.420728 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:06.420589 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8746b834-9453-4c0b-ae52-d22e69c09d9c-config-file\") pod \"limitador-limitador-64c94fd64f-lj7kl\" (UID: \"8746b834-9453-4c0b-ae52-d22e69c09d9c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lj7kl" Jun 11 23:19:06.476989 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:06.476934 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lj7kl"] Jun 11 23:19:06.521069 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:06.521035 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntxwk\" (UniqueName: \"kubernetes.io/projected/8746b834-9453-4c0b-ae52-d22e69c09d9c-kube-api-access-ntxwk\") pod \"limitador-limitador-64c94fd64f-lj7kl\" (UID: \"8746b834-9453-4c0b-ae52-d22e69c09d9c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lj7kl" Jun 11 23:19:06.521236 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:06.521078 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8746b834-9453-4c0b-ae52-d22e69c09d9c-config-file\") pod \"limitador-limitador-64c94fd64f-lj7kl\" (UID: \"8746b834-9453-4c0b-ae52-d22e69c09d9c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lj7kl" Jun 11 23:19:06.521647 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:06.521627 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8746b834-9453-4c0b-ae52-d22e69c09d9c-config-file\") pod \"limitador-limitador-64c94fd64f-lj7kl\" (UID: \"8746b834-9453-4c0b-ae52-d22e69c09d9c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lj7kl" Jun 11 23:19:06.529050 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:06.529019 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntxwk\" (UniqueName: \"kubernetes.io/projected/8746b834-9453-4c0b-ae52-d22e69c09d9c-kube-api-access-ntxwk\") pod \"limitador-limitador-64c94fd64f-lj7kl\" (UID: \"8746b834-9453-4c0b-ae52-d22e69c09d9c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lj7kl" Jun 11 23:19:06.699137 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:06.699049 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lj7kl" Jun 11 23:19:06.827153 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:06.827128 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lj7kl"] Jun 11 23:19:06.829034 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:19:06.829009 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8746b834_9453_4c0b_ae52_d22e69c09d9c.slice/crio-75aeb0a4550e9260e3b0fa87b2bf2b5030ea4f42066c17b0aa35ee4f63813127 WatchSource:0}: Error finding container 75aeb0a4550e9260e3b0fa87b2bf2b5030ea4f42066c17b0aa35ee4f63813127: Status 404 returned error can't find the container with id 75aeb0a4550e9260e3b0fa87b2bf2b5030ea4f42066c17b0aa35ee4f63813127 Jun 11 23:19:07.163143 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:07.163108 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-9kzbr"] Jun 11 23:19:07.167535 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:07.167518 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9kzbr" Jun 11 23:19:07.170711 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:07.170691 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bppcf\"" Jun 11 23:19:07.175490 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:07.175469 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-9kzbr"] Jun 11 23:19:07.226292 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:07.226261 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6zqz\" (UniqueName: \"kubernetes.io/projected/081a02da-0ffb-4b81-8abf-25e3931a0409-kube-api-access-q6zqz\") pod \"authorino-58cd955675-9kzbr\" (UID: \"081a02da-0ffb-4b81-8abf-25e3931a0409\") " pod="kuadrant-system/authorino-58cd955675-9kzbr" Jun 11 23:19:07.327351 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:07.327302 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6zqz\" (UniqueName: \"kubernetes.io/projected/081a02da-0ffb-4b81-8abf-25e3931a0409-kube-api-access-q6zqz\") pod \"authorino-58cd955675-9kzbr\" (UID: \"081a02da-0ffb-4b81-8abf-25e3931a0409\") " pod="kuadrant-system/authorino-58cd955675-9kzbr" Jun 11 23:19:07.335953 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:07.335925 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6zqz\" (UniqueName: \"kubernetes.io/projected/081a02da-0ffb-4b81-8abf-25e3931a0409-kube-api-access-q6zqz\") pod \"authorino-58cd955675-9kzbr\" (UID: \"081a02da-0ffb-4b81-8abf-25e3931a0409\") " pod="kuadrant-system/authorino-58cd955675-9kzbr" Jun 11 23:19:07.398427 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:07.398395 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-bnxdn"] Jun 11 23:19:07.401613 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:07.401594 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bnxdn" Jun 11 23:19:07.408194 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:07.408167 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bnxdn"] Jun 11 23:19:07.428501 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:07.428406 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxpnl\" (UniqueName: \"kubernetes.io/projected/42ee058d-5978-491d-a2e9-72fac30f44c3-kube-api-access-zxpnl\") pod \"authorino-75d556bd77-bnxdn\" (UID: \"42ee058d-5978-491d-a2e9-72fac30f44c3\") " pod="kuadrant-system/authorino-75d556bd77-bnxdn" Jun 11 23:19:07.478509 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:07.478293 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9kzbr" Jun 11 23:19:07.502942 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:07.502863 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lj7kl" event={"ID":"8746b834-9453-4c0b-ae52-d22e69c09d9c","Type":"ContainerStarted","Data":"75aeb0a4550e9260e3b0fa87b2bf2b5030ea4f42066c17b0aa35ee4f63813127"} Jun 11 23:19:07.529847 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:07.529388 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxpnl\" (UniqueName: \"kubernetes.io/projected/42ee058d-5978-491d-a2e9-72fac30f44c3-kube-api-access-zxpnl\") pod \"authorino-75d556bd77-bnxdn\" (UID: \"42ee058d-5978-491d-a2e9-72fac30f44c3\") " pod="kuadrant-system/authorino-75d556bd77-bnxdn" Jun 11 23:19:07.544458 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:07.544424 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxpnl\" (UniqueName: \"kubernetes.io/projected/42ee058d-5978-491d-a2e9-72fac30f44c3-kube-api-access-zxpnl\") pod \"authorino-75d556bd77-bnxdn\" (UID: \"42ee058d-5978-491d-a2e9-72fac30f44c3\") " pod="kuadrant-system/authorino-75d556bd77-bnxdn" Jun 11 23:19:07.660842 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:07.660813 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-9kzbr"] Jun 11 23:19:07.714854 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:07.714596 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bnxdn" Jun 11 23:19:07.879453 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:07.879399 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bnxdn"] Jun 11 23:19:07.881856 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:19:07.881801 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42ee058d_5978_491d_a2e9_72fac30f44c3.slice/crio-a589db174606049106851ae3face688902af7111c20318ff1df5af89a4f1446e WatchSource:0}: Error finding container a589db174606049106851ae3face688902af7111c20318ff1df5af89a4f1446e: Status 404 returned error can't find the container with id a589db174606049106851ae3face688902af7111c20318ff1df5af89a4f1446e Jun 11 23:19:08.511868 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:08.511805 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9kzbr" event={"ID":"081a02da-0ffb-4b81-8abf-25e3931a0409","Type":"ContainerStarted","Data":"e605853141eae68dec4dbb55b3539258b1940593aef08cc6bfb97aefba332ea7"} Jun 11 23:19:08.514165 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:08.514107 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bnxdn" event={"ID":"42ee058d-5978-491d-a2e9-72fac30f44c3","Type":"ContainerStarted","Data":"a589db174606049106851ae3face688902af7111c20318ff1df5af89a4f1446e"} Jun 11 23:19:11.532923 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:11.532887 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9kzbr" event={"ID":"081a02da-0ffb-4b81-8abf-25e3931a0409","Type":"ContainerStarted","Data":"7f42afb96fa32a31f1cf717077878fae69964f73f7af366484fb0aff539712ae"} Jun 11 23:19:11.534582 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:11.534556 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lj7kl" event={"ID":"8746b834-9453-4c0b-ae52-d22e69c09d9c","Type":"ContainerStarted","Data":"f37a8654bac191c63ee74ae60b218df87296925e98d7d5857f8172bf98bf1f4d"} Jun 11 23:19:11.534693 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:11.534626 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-lj7kl" Jun 11 23:19:11.536080 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:11.536055 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bnxdn" event={"ID":"42ee058d-5978-491d-a2e9-72fac30f44c3","Type":"ContainerStarted","Data":"ffcdabf771aeb8c2d766b48e005573c557473b1f958f00844a8f0dc64920c8fc"} Jun 11 23:19:11.549109 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:11.549065 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-9kzbr" podStartSLOduration=0.808336479 podStartE2EDuration="4.549050271s" totalImagesPullingTime="3.740713792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:19:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:19:11.548244581 +0000 UTC m=+524.971029549" watchObservedRunningTime="2026-06-11 23:19:11.549050271 +0000 UTC m=+524.971835238" Jun 11 23:19:11.567246 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:11.567178 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-lj7kl" podStartSLOduration=1.002828325 podStartE2EDuration="5.567157677s" totalImagesPullingTime="4.564329352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:19:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:19:11.566847599 +0000 UTC m=+524.989632567" watchObservedRunningTime="2026-06-11 23:19:11.567157677 +0000 UTC m=+524.989942638" Jun 11 23:19:11.584999 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:11.584072 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-bnxdn" podStartSLOduration=1.066540317 podStartE2EDuration="4.584047909s" totalImagesPullingTime="3.517507592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:19:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:19:11.583134018 +0000 UTC m=+525.005918986" watchObservedRunningTime="2026-06-11 23:19:11.584047909 +0000 UTC m=+525.006832878" Jun 11 23:19:11.605077 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:11.605045 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-9kzbr"] Jun 11 23:19:13.545735 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:13.545696 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-9kzbr" podUID="081a02da-0ffb-4b81-8abf-25e3931a0409" containerName="authorino" containerID="cri-o://7f42afb96fa32a31f1cf717077878fae69964f73f7af366484fb0aff539712ae" gracePeriod=30 Jun 11 23:19:13.786597 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:13.786573 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9kzbr" Jun 11 23:19:13.891492 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:13.891461 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6zqz\" (UniqueName: \"kubernetes.io/projected/081a02da-0ffb-4b81-8abf-25e3931a0409-kube-api-access-q6zqz\") pod \"081a02da-0ffb-4b81-8abf-25e3931a0409\" (UID: \"081a02da-0ffb-4b81-8abf-25e3931a0409\") " Jun 11 23:19:13.893634 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:13.893604 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/081a02da-0ffb-4b81-8abf-25e3931a0409-kube-api-access-q6zqz" (OuterVolumeSpecName: "kube-api-access-q6zqz") pod "081a02da-0ffb-4b81-8abf-25e3931a0409" (UID: "081a02da-0ffb-4b81-8abf-25e3931a0409"). InnerVolumeSpecName "kube-api-access-q6zqz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:19:13.992387 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:13.992349 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6zqz\" (UniqueName: \"kubernetes.io/projected/081a02da-0ffb-4b81-8abf-25e3931a0409-kube-api-access-q6zqz\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:19:14.551456 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:14.551427 2563 generic.go:356] "Generic (PLEG): container finished" podID="081a02da-0ffb-4b81-8abf-25e3931a0409" containerID="7f42afb96fa32a31f1cf717077878fae69964f73f7af366484fb0aff539712ae" exitCode=0 Jun 11 23:19:14.551860 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:14.551469 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9kzbr" Jun 11 23:19:14.551860 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:14.551516 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9kzbr" event={"ID":"081a02da-0ffb-4b81-8abf-25e3931a0409","Type":"ContainerDied","Data":"7f42afb96fa32a31f1cf717077878fae69964f73f7af366484fb0aff539712ae"} Jun 11 23:19:14.551860 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:14.551562 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9kzbr" event={"ID":"081a02da-0ffb-4b81-8abf-25e3931a0409","Type":"ContainerDied","Data":"e605853141eae68dec4dbb55b3539258b1940593aef08cc6bfb97aefba332ea7"} Jun 11 23:19:14.551860 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:14.551578 2563 scope.go:117] "RemoveContainer" containerID="7f42afb96fa32a31f1cf717077878fae69964f73f7af366484fb0aff539712ae" Jun 11 23:19:14.560267 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:14.560249 2563 scope.go:117] "RemoveContainer" containerID="7f42afb96fa32a31f1cf717077878fae69964f73f7af366484fb0aff539712ae" Jun 11 23:19:14.560510 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:19:14.560494 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f42afb96fa32a31f1cf717077878fae69964f73f7af366484fb0aff539712ae\": container with ID starting with 7f42afb96fa32a31f1cf717077878fae69964f73f7af366484fb0aff539712ae not found: ID does not exist" containerID="7f42afb96fa32a31f1cf717077878fae69964f73f7af366484fb0aff539712ae" Jun 11 23:19:14.560561 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:14.560520 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f42afb96fa32a31f1cf717077878fae69964f73f7af366484fb0aff539712ae"} err="failed to get container status \"7f42afb96fa32a31f1cf717077878fae69964f73f7af366484fb0aff539712ae\": rpc error: code = NotFound desc = could not find container \"7f42afb96fa32a31f1cf717077878fae69964f73f7af366484fb0aff539712ae\": container with ID starting with 7f42afb96fa32a31f1cf717077878fae69964f73f7af366484fb0aff539712ae not found: ID does not exist" Jun 11 23:19:14.571730 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:14.571705 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-9kzbr"] Jun 11 23:19:14.573731 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:14.573710 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-9kzbr"] Jun 11 23:19:15.004900 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:15.004866 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="081a02da-0ffb-4b81-8abf-25e3931a0409" path="/var/lib/kubelet/pods/081a02da-0ffb-4b81-8abf-25e3931a0409/volumes" Jun 11 23:19:21.730324 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:21.730281 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lj7kl"] Jun 11 23:19:21.730815 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:21.730506 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-lj7kl" podUID="8746b834-9453-4c0b-ae52-d22e69c09d9c" containerName="limitador" containerID="cri-o://f37a8654bac191c63ee74ae60b218df87296925e98d7d5857f8172bf98bf1f4d" gracePeriod=30 Jun 11 23:19:21.731271 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:21.731248 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-lj7kl" Jun 11 23:19:22.590577 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:22.590544 2563 generic.go:356] "Generic (PLEG): container finished" podID="8746b834-9453-4c0b-ae52-d22e69c09d9c" containerID="f37a8654bac191c63ee74ae60b218df87296925e98d7d5857f8172bf98bf1f4d" exitCode=0 Jun 11 23:19:22.590577 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:22.590590 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lj7kl" event={"ID":"8746b834-9453-4c0b-ae52-d22e69c09d9c","Type":"ContainerDied","Data":"f37a8654bac191c63ee74ae60b218df87296925e98d7d5857f8172bf98bf1f4d"} Jun 11 23:19:22.671584 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:22.671558 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lj7kl" Jun 11 23:19:22.771949 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:22.771913 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8746b834-9453-4c0b-ae52-d22e69c09d9c-config-file\") pod \"8746b834-9453-4c0b-ae52-d22e69c09d9c\" (UID: \"8746b834-9453-4c0b-ae52-d22e69c09d9c\") " Jun 11 23:19:22.772360 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:22.772005 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntxwk\" (UniqueName: \"kubernetes.io/projected/8746b834-9453-4c0b-ae52-d22e69c09d9c-kube-api-access-ntxwk\") pod \"8746b834-9453-4c0b-ae52-d22e69c09d9c\" (UID: \"8746b834-9453-4c0b-ae52-d22e69c09d9c\") " Jun 11 23:19:22.772360 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:22.772286 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8746b834-9453-4c0b-ae52-d22e69c09d9c-config-file" (OuterVolumeSpecName: "config-file") pod "8746b834-9453-4c0b-ae52-d22e69c09d9c" (UID: "8746b834-9453-4c0b-ae52-d22e69c09d9c"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:19:22.774124 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:22.774097 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8746b834-9453-4c0b-ae52-d22e69c09d9c-kube-api-access-ntxwk" (OuterVolumeSpecName: "kube-api-access-ntxwk") pod "8746b834-9453-4c0b-ae52-d22e69c09d9c" (UID: "8746b834-9453-4c0b-ae52-d22e69c09d9c"). InnerVolumeSpecName "kube-api-access-ntxwk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:19:22.872784 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:22.872746 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntxwk\" (UniqueName: \"kubernetes.io/projected/8746b834-9453-4c0b-ae52-d22e69c09d9c-kube-api-access-ntxwk\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:19:22.872784 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:22.872772 2563 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8746b834-9453-4c0b-ae52-d22e69c09d9c-config-file\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:19:23.597226 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:23.597195 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lj7kl" Jun 11 23:19:23.597423 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:23.597192 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lj7kl" event={"ID":"8746b834-9453-4c0b-ae52-d22e69c09d9c","Type":"ContainerDied","Data":"75aeb0a4550e9260e3b0fa87b2bf2b5030ea4f42066c17b0aa35ee4f63813127"} Jun 11 23:19:23.597423 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:23.597322 2563 scope.go:117] "RemoveContainer" containerID="f37a8654bac191c63ee74ae60b218df87296925e98d7d5857f8172bf98bf1f4d" Jun 11 23:19:23.622958 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:23.622926 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lj7kl"] Jun 11 23:19:23.634167 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:23.634140 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lj7kl"] Jun 11 23:19:25.005094 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:25.005052 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8746b834-9453-4c0b-ae52-d22e69c09d9c" path="/var/lib/kubelet/pods/8746b834-9453-4c0b-ae52-d22e69c09d9c/volumes" Jun 11 23:19:25.853607 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:25.853572 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-skdlv"] Jun 11 23:19:25.854020 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:25.854001 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="081a02da-0ffb-4b81-8abf-25e3931a0409" containerName="authorino" Jun 11 23:19:25.854133 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:25.854021 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="081a02da-0ffb-4b81-8abf-25e3931a0409" containerName="authorino" Jun 11 23:19:25.854133 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:25.854035 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8746b834-9453-4c0b-ae52-d22e69c09d9c" containerName="limitador" Jun 11 23:19:25.854133 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:25.854043 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8746b834-9453-4c0b-ae52-d22e69c09d9c" containerName="limitador" Jun 11 23:19:25.854358 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:25.854148 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8746b834-9453-4c0b-ae52-d22e69c09d9c" containerName="limitador" Jun 11 23:19:25.854358 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:25.854163 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="081a02da-0ffb-4b81-8abf-25e3931a0409" containerName="authorino" Jun 11 23:19:25.857132 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:25.857111 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-skdlv" Jun 11 23:19:25.860037 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:25.860014 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 11 23:19:25.860153 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:25.860022 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7c5bv\"" Jun 11 23:19:25.864282 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:25.864254 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-skdlv"] Jun 11 23:19:25.903300 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:25.903260 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fd5297a6-054d-4259-bc02-c86bee90a83a-data\") pod \"postgres-69fb4594cf-skdlv\" (UID: \"fd5297a6-054d-4259-bc02-c86bee90a83a\") " pod="opendatahub/postgres-69fb4594cf-skdlv" Jun 11 23:19:25.903300 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:25.903303 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc7m5\" (UniqueName: \"kubernetes.io/projected/fd5297a6-054d-4259-bc02-c86bee90a83a-kube-api-access-sc7m5\") pod \"postgres-69fb4594cf-skdlv\" (UID: \"fd5297a6-054d-4259-bc02-c86bee90a83a\") " pod="opendatahub/postgres-69fb4594cf-skdlv" Jun 11 23:19:26.004378 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:26.004342 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fd5297a6-054d-4259-bc02-c86bee90a83a-data\") pod \"postgres-69fb4594cf-skdlv\" (UID: \"fd5297a6-054d-4259-bc02-c86bee90a83a\") " pod="opendatahub/postgres-69fb4594cf-skdlv" Jun 11 23:19:26.004378 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:26.004381 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc7m5\" (UniqueName: \"kubernetes.io/projected/fd5297a6-054d-4259-bc02-c86bee90a83a-kube-api-access-sc7m5\") pod \"postgres-69fb4594cf-skdlv\" (UID: \"fd5297a6-054d-4259-bc02-c86bee90a83a\") " pod="opendatahub/postgres-69fb4594cf-skdlv" Jun 11 23:19:26.004740 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:26.004719 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fd5297a6-054d-4259-bc02-c86bee90a83a-data\") pod \"postgres-69fb4594cf-skdlv\" (UID: \"fd5297a6-054d-4259-bc02-c86bee90a83a\") " pod="opendatahub/postgres-69fb4594cf-skdlv" Jun 11 23:19:26.012920 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:26.012896 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc7m5\" (UniqueName: \"kubernetes.io/projected/fd5297a6-054d-4259-bc02-c86bee90a83a-kube-api-access-sc7m5\") pod \"postgres-69fb4594cf-skdlv\" (UID: \"fd5297a6-054d-4259-bc02-c86bee90a83a\") " pod="opendatahub/postgres-69fb4594cf-skdlv" Jun 11 23:19:26.169105 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:26.169074 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-skdlv" Jun 11 23:19:26.298686 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:26.298660 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-skdlv"] Jun 11 23:19:26.300941 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:19:26.300916 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd5297a6_054d_4259_bc02_c86bee90a83a.slice/crio-c7c3457a235a2fde8cfea906dc1cffb87bcd2cda89bcc1ab5155e81c12233757 WatchSource:0}: Error finding container c7c3457a235a2fde8cfea906dc1cffb87bcd2cda89bcc1ab5155e81c12233757: Status 404 returned error can't find the container with id c7c3457a235a2fde8cfea906dc1cffb87bcd2cda89bcc1ab5155e81c12233757 Jun 11 23:19:26.613386 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:26.613352 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-skdlv" event={"ID":"fd5297a6-054d-4259-bc02-c86bee90a83a","Type":"ContainerStarted","Data":"c7c3457a235a2fde8cfea906dc1cffb87bcd2cda89bcc1ab5155e81c12233757"} Jun 11 23:19:30.550725 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:30.550694 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 11 23:19:30.637036 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:30.637003 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-skdlv" event={"ID":"fd5297a6-054d-4259-bc02-c86bee90a83a","Type":"ContainerStarted","Data":"f47b800ef351fbe0a38ac7e9262a0a245fa594b745ad0c3e517256414b906d0b"} Jun 11 23:19:30.637162 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:30.637107 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-skdlv" Jun 11 23:19:30.657001 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:30.656940 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-skdlv" podStartSLOduration=1.411744641 podStartE2EDuration="5.656920805s" totalImagesPullingTime="4.245176164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:19:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:19:30.655182198 +0000 UTC m=+544.077967166" watchObservedRunningTime="2026-06-11 23:19:30.656920805 +0000 UTC m=+544.079705773" Jun 11 23:19:36.675442 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:36.675414 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-skdlv" Jun 11 23:19:45.761129 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:45.761089 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-bjjhd"] Jun 11 23:19:45.853946 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:45.853892 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-bjjhd"] Jun 11 23:19:45.854167 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:45.854019 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-bjjhd" Jun 11 23:19:45.859779 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:45.859755 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-dtz2x\"" Jun 11 23:19:45.860152 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:45.860124 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 23:19:45.861270 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:45.861253 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 23:19:45.983882 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:45.983844 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6h6x\" (UniqueName: \"kubernetes.io/projected/79e96cfb-f9f2-4623-b9c8-9b83dc17cf25-kube-api-access-b6h6x\") pod \"keycloak-operator-d67dbbb48-bjjhd\" (UID: \"79e96cfb-f9f2-4623-b9c8-9b83dc17cf25\") " pod="keycloak-system/keycloak-operator-d67dbbb48-bjjhd" Jun 11 23:19:46.084434 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:46.084336 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6h6x\" (UniqueName: \"kubernetes.io/projected/79e96cfb-f9f2-4623-b9c8-9b83dc17cf25-kube-api-access-b6h6x\") pod \"keycloak-operator-d67dbbb48-bjjhd\" (UID: \"79e96cfb-f9f2-4623-b9c8-9b83dc17cf25\") " pod="keycloak-system/keycloak-operator-d67dbbb48-bjjhd" Jun 11 23:19:46.092991 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:46.092945 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6h6x\" (UniqueName: \"kubernetes.io/projected/79e96cfb-f9f2-4623-b9c8-9b83dc17cf25-kube-api-access-b6h6x\") pod \"keycloak-operator-d67dbbb48-bjjhd\" (UID: \"79e96cfb-f9f2-4623-b9c8-9b83dc17cf25\") " pod="keycloak-system/keycloak-operator-d67dbbb48-bjjhd" Jun 11 23:19:46.163954 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:46.163913 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-bjjhd" Jun 11 23:19:46.318044 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:46.317916 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-bjjhd"] Jun 11 23:19:46.320331 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:19:46.320303 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79e96cfb_f9f2_4623_b9c8_9b83dc17cf25.slice/crio-eb46328f6c300c0eb31060fe3c26b555229f2ba52f3ddef25ae9a8d68333f92a WatchSource:0}: Error finding container eb46328f6c300c0eb31060fe3c26b555229f2ba52f3ddef25ae9a8d68333f92a: Status 404 returned error can't find the container with id eb46328f6c300c0eb31060fe3c26b555229f2ba52f3ddef25ae9a8d68333f92a Jun 11 23:19:46.715174 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:46.715139 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-bjjhd" event={"ID":"79e96cfb-f9f2-4623-b9c8-9b83dc17cf25","Type":"ContainerStarted","Data":"eb46328f6c300c0eb31060fe3c26b555229f2ba52f3ddef25ae9a8d68333f92a"} Jun 11 23:19:52.750990 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:52.750932 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-bjjhd" event={"ID":"79e96cfb-f9f2-4623-b9c8-9b83dc17cf25","Type":"ContainerStarted","Data":"31bee26708c81c740f86d8acd2d61c34b18fbd1b3a6dd2e2ac15482ca73789f4"} Jun 11 23:19:52.768377 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:19:52.768315 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-bjjhd" podStartSLOduration=2.093112345 podStartE2EDuration="7.768295251s" totalImagesPullingTime="5.675182906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:19:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:19:52.768011241 +0000 UTC m=+566.190796212" watchObservedRunningTime="2026-06-11 23:19:52.768295251 +0000 UTC m=+566.191080218" Jun 11 23:20:26.988836 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:26.988804 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lrmgd_243ee797-2187-41bc-ad0c-116ec1a4888f/ovn-acl-logging/0.log" Jun 11 23:20:26.989435 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:26.988913 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lrmgd_243ee797-2187-41bc-ad0c-116ec1a4888f/ovn-acl-logging/0.log" Jun 11 23:20:31.514527 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:31.514487 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ndpsd"] Jun 11 23:20:31.517022 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:31.517001 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ndpsd" Jun 11 23:20:31.524609 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:31.524585 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ndpsd"] Jun 11 23:20:31.616131 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:31.616092 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g5t2\" (UniqueName: \"kubernetes.io/projected/57adae38-4e6a-461d-9070-1c7c26f2196c-kube-api-access-8g5t2\") pod \"authorino-5d4b67c446-ndpsd\" (UID: \"57adae38-4e6a-461d-9070-1c7c26f2196c\") " pod="kuadrant-system/authorino-5d4b67c446-ndpsd" Jun 11 23:20:31.716668 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:31.716618 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g5t2\" (UniqueName: \"kubernetes.io/projected/57adae38-4e6a-461d-9070-1c7c26f2196c-kube-api-access-8g5t2\") pod \"authorino-5d4b67c446-ndpsd\" (UID: \"57adae38-4e6a-461d-9070-1c7c26f2196c\") " pod="kuadrant-system/authorino-5d4b67c446-ndpsd" Jun 11 23:20:31.726036 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:31.726004 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g5t2\" (UniqueName: \"kubernetes.io/projected/57adae38-4e6a-461d-9070-1c7c26f2196c-kube-api-access-8g5t2\") pod \"authorino-5d4b67c446-ndpsd\" (UID: \"57adae38-4e6a-461d-9070-1c7c26f2196c\") " pod="kuadrant-system/authorino-5d4b67c446-ndpsd" Jun 11 23:20:31.777261 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:31.777172 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ndpsd"] Jun 11 23:20:31.777481 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:31.777467 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ndpsd" Jun 11 23:20:31.809351 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:31.803933 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-556d6bddd-xsvvj"] Jun 11 23:20:31.809351 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:31.808058 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-556d6bddd-xsvvj" Jun 11 23:20:31.814800 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:31.814770 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-556d6bddd-xsvvj"] Jun 11 23:20:31.908774 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:31.908738 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-556d6bddd-xsvvj"] Jun 11 23:20:31.909068 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:20:31.909045 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-bv7ll], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-556d6bddd-xsvvj" podUID="d1144e43-f472-4f55-9cd8-9a4e17f4c8c0" Jun 11 23:20:31.914132 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:31.914079 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ndpsd"] Jun 11 23:20:31.916437 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:20:31.916408 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57adae38_4e6a_461d_9070_1c7c26f2196c.slice/crio-a0674512f5d516b3e6213476baade4ebfac8baabcc810f2a889b825589fd220b WatchSource:0}: Error finding container a0674512f5d516b3e6213476baade4ebfac8baabcc810f2a889b825589fd220b: Status 404 returned error can't find the container with id a0674512f5d516b3e6213476baade4ebfac8baabcc810f2a889b825589fd220b Jun 11 23:20:31.917743 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:31.917719 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv7ll\" (UniqueName: \"kubernetes.io/projected/d1144e43-f472-4f55-9cd8-9a4e17f4c8c0-kube-api-access-bv7ll\") pod \"authorino-556d6bddd-xsvvj\" (UID: \"d1144e43-f472-4f55-9cd8-9a4e17f4c8c0\") " pod="kuadrant-system/authorino-556d6bddd-xsvvj" Jun 11 23:20:31.918041 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:31.918025 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 23:20:31.937186 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:31.937160 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c7979b8d4-lprln"] Jun 11 23:20:31.939929 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:31.939911 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c7979b8d4-lprln" Jun 11 23:20:31.942681 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:31.942663 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 11 23:20:31.943300 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:31.943277 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-556d6bddd-xsvvj" Jun 11 23:20:31.943300 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:31.943278 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ndpsd" event={"ID":"57adae38-4e6a-461d-9070-1c7c26f2196c","Type":"ContainerStarted","Data":"a0674512f5d516b3e6213476baade4ebfac8baabcc810f2a889b825589fd220b"} Jun 11 23:20:31.950387 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:31.950365 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c7979b8d4-lprln"] Jun 11 23:20:31.952994 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:31.952956 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-556d6bddd-xsvvj" Jun 11 23:20:32.019250 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:32.019217 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv7ll\" (UniqueName: \"kubernetes.io/projected/d1144e43-f472-4f55-9cd8-9a4e17f4c8c0-kube-api-access-bv7ll\") pod \"authorino-556d6bddd-xsvvj\" (UID: \"d1144e43-f472-4f55-9cd8-9a4e17f4c8c0\") " pod="kuadrant-system/authorino-556d6bddd-xsvvj" Jun 11 23:20:32.029383 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:32.029312 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv7ll\" (UniqueName: \"kubernetes.io/projected/d1144e43-f472-4f55-9cd8-9a4e17f4c8c0-kube-api-access-bv7ll\") pod \"authorino-556d6bddd-xsvvj\" (UID: \"d1144e43-f472-4f55-9cd8-9a4e17f4c8c0\") " pod="kuadrant-system/authorino-556d6bddd-xsvvj" Jun 11 23:20:32.119639 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:32.119607 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw4xk\" (UniqueName: \"kubernetes.io/projected/9e36109e-0936-449e-9ed2-cc6271b91db5-kube-api-access-rw4xk\") pod \"authorino-7c7979b8d4-lprln\" (UID: \"9e36109e-0936-449e-9ed2-cc6271b91db5\") " pod="kuadrant-system/authorino-7c7979b8d4-lprln" Jun 11 23:20:32.119833 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:32.119655 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9e36109e-0936-449e-9ed2-cc6271b91db5-tls-cert\") pod \"authorino-7c7979b8d4-lprln\" (UID: \"9e36109e-0936-449e-9ed2-cc6271b91db5\") " pod="kuadrant-system/authorino-7c7979b8d4-lprln" Jun 11 23:20:32.220329 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:32.220294 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bv7ll\" (UniqueName: \"kubernetes.io/projected/d1144e43-f472-4f55-9cd8-9a4e17f4c8c0-kube-api-access-bv7ll\") pod \"d1144e43-f472-4f55-9cd8-9a4e17f4c8c0\" (UID: \"d1144e43-f472-4f55-9cd8-9a4e17f4c8c0\") " Jun 11 23:20:32.220523 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:32.220471 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw4xk\" (UniqueName: \"kubernetes.io/projected/9e36109e-0936-449e-9ed2-cc6271b91db5-kube-api-access-rw4xk\") pod \"authorino-7c7979b8d4-lprln\" (UID: \"9e36109e-0936-449e-9ed2-cc6271b91db5\") " pod="kuadrant-system/authorino-7c7979b8d4-lprln" Jun 11 23:20:32.220523 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:32.220502 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9e36109e-0936-449e-9ed2-cc6271b91db5-tls-cert\") pod \"authorino-7c7979b8d4-lprln\" (UID: \"9e36109e-0936-449e-9ed2-cc6271b91db5\") " pod="kuadrant-system/authorino-7c7979b8d4-lprln" Jun 11 23:20:32.222442 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:32.222409 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1144e43-f472-4f55-9cd8-9a4e17f4c8c0-kube-api-access-bv7ll" (OuterVolumeSpecName: "kube-api-access-bv7ll") pod "d1144e43-f472-4f55-9cd8-9a4e17f4c8c0" (UID: "d1144e43-f472-4f55-9cd8-9a4e17f4c8c0"). InnerVolumeSpecName "kube-api-access-bv7ll". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:20:32.222840 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:32.222822 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9e36109e-0936-449e-9ed2-cc6271b91db5-tls-cert\") pod \"authorino-7c7979b8d4-lprln\" (UID: \"9e36109e-0936-449e-9ed2-cc6271b91db5\") " pod="kuadrant-system/authorino-7c7979b8d4-lprln" Jun 11 23:20:32.229262 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:32.229242 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw4xk\" (UniqueName: \"kubernetes.io/projected/9e36109e-0936-449e-9ed2-cc6271b91db5-kube-api-access-rw4xk\") pod \"authorino-7c7979b8d4-lprln\" (UID: \"9e36109e-0936-449e-9ed2-cc6271b91db5\") " pod="kuadrant-system/authorino-7c7979b8d4-lprln" Jun 11 23:20:32.253129 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:32.253085 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c7979b8d4-lprln" Jun 11 23:20:32.321476 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:32.321447 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bv7ll\" (UniqueName: \"kubernetes.io/projected/d1144e43-f472-4f55-9cd8-9a4e17f4c8c0-kube-api-access-bv7ll\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:20:32.388333 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:32.388310 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c7979b8d4-lprln"] Jun 11 23:20:32.389853 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:20:32.389827 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e36109e_0936_449e_9ed2_cc6271b91db5.slice/crio-e63d5cd75184ac35f8b0a5e8f18b725e912dbe4d8b1747ffcaeeb45b2acdd73d WatchSource:0}: Error finding container e63d5cd75184ac35f8b0a5e8f18b725e912dbe4d8b1747ffcaeeb45b2acdd73d: Status 404 returned error can't find the container with id e63d5cd75184ac35f8b0a5e8f18b725e912dbe4d8b1747ffcaeeb45b2acdd73d Jun 11 23:20:32.949579 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:32.949476 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c7979b8d4-lprln" event={"ID":"9e36109e-0936-449e-9ed2-cc6271b91db5","Type":"ContainerStarted","Data":"af9384f089ea7861fbbba5c07c51a8c8f768e3aac3197a38af6b48495c6287b5"} Jun 11 23:20:32.949579 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:32.949528 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c7979b8d4-lprln" event={"ID":"9e36109e-0936-449e-9ed2-cc6271b91db5","Type":"ContainerStarted","Data":"e63d5cd75184ac35f8b0a5e8f18b725e912dbe4d8b1747ffcaeeb45b2acdd73d"} Jun 11 23:20:32.951024 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:32.951003 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-556d6bddd-xsvvj" Jun 11 23:20:32.951159 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:32.951058 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-ndpsd" podUID="57adae38-4e6a-461d-9070-1c7c26f2196c" containerName="authorino" containerID="cri-o://fa5934c5cdcae31fed0f877dbc7002d53b9af30d07785ffa4993326860cbaf92" gracePeriod=30 Jun 11 23:20:32.951159 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:32.951001 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ndpsd" event={"ID":"57adae38-4e6a-461d-9070-1c7c26f2196c","Type":"ContainerStarted","Data":"fa5934c5cdcae31fed0f877dbc7002d53b9af30d07785ffa4993326860cbaf92"} Jun 11 23:20:32.966382 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:32.966343 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7c7979b8d4-lprln" podStartSLOduration=1.691417312 podStartE2EDuration="1.966330023s" totalImagesPullingTime="274.912711ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:20:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:20:32.964060342 +0000 UTC m=+606.386845313" watchObservedRunningTime="2026-06-11 23:20:32.966330023 +0000 UTC m=+606.389115041" Jun 11 23:20:32.987004 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:32.986960 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-556d6bddd-xsvvj"] Jun 11 23:20:32.993652 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:32.993625 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-556d6bddd-xsvvj"] Jun 11 23:20:32.996206 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:32.996180 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bnxdn"] Jun 11 23:20:32.996398 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:32.996375 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-bnxdn" podUID="42ee058d-5978-491d-a2e9-72fac30f44c3" containerName="authorino" containerID="cri-o://ffcdabf771aeb8c2d766b48e005573c557473b1f958f00844a8f0dc64920c8fc" gracePeriod=30 Jun 11 23:20:33.008185 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:33.008152 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1144e43-f472-4f55-9cd8-9a4e17f4c8c0" path="/var/lib/kubelet/pods/d1144e43-f472-4f55-9cd8-9a4e17f4c8c0/volumes" Jun 11 23:20:33.012386 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:33.012340 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-ndpsd" podStartSLOduration=1.608581976 podStartE2EDuration="2.012326143s" totalImagesPullingTime="403.744167ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:20:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:20:33.011423378 +0000 UTC m=+606.434208343" watchObservedRunningTime="2026-06-11 23:20:33.012326143 +0000 UTC m=+606.435111088" Jun 11 23:20:33.251935 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:33.251907 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ndpsd" Jun 11 23:20:33.266812 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:33.266789 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bnxdn" Jun 11 23:20:33.330881 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:33.330842 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxpnl\" (UniqueName: \"kubernetes.io/projected/42ee058d-5978-491d-a2e9-72fac30f44c3-kube-api-access-zxpnl\") pod \"42ee058d-5978-491d-a2e9-72fac30f44c3\" (UID: \"42ee058d-5978-491d-a2e9-72fac30f44c3\") " Jun 11 23:20:33.331092 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:33.330941 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8g5t2\" (UniqueName: \"kubernetes.io/projected/57adae38-4e6a-461d-9070-1c7c26f2196c-kube-api-access-8g5t2\") pod \"57adae38-4e6a-461d-9070-1c7c26f2196c\" (UID: \"57adae38-4e6a-461d-9070-1c7c26f2196c\") " Jun 11 23:20:33.332964 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:33.332940 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42ee058d-5978-491d-a2e9-72fac30f44c3-kube-api-access-zxpnl" (OuterVolumeSpecName: "kube-api-access-zxpnl") pod "42ee058d-5978-491d-a2e9-72fac30f44c3" (UID: "42ee058d-5978-491d-a2e9-72fac30f44c3"). InnerVolumeSpecName "kube-api-access-zxpnl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:20:33.333070 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:33.332997 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57adae38-4e6a-461d-9070-1c7c26f2196c-kube-api-access-8g5t2" (OuterVolumeSpecName: "kube-api-access-8g5t2") pod "57adae38-4e6a-461d-9070-1c7c26f2196c" (UID: "57adae38-4e6a-461d-9070-1c7c26f2196c"). InnerVolumeSpecName "kube-api-access-8g5t2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:20:33.432089 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:33.432051 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8g5t2\" (UniqueName: \"kubernetes.io/projected/57adae38-4e6a-461d-9070-1c7c26f2196c-kube-api-access-8g5t2\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:20:33.432089 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:33.432082 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxpnl\" (UniqueName: \"kubernetes.io/projected/42ee058d-5978-491d-a2e9-72fac30f44c3-kube-api-access-zxpnl\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:20:33.957327 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:33.957289 2563 generic.go:356] "Generic (PLEG): container finished" podID="42ee058d-5978-491d-a2e9-72fac30f44c3" containerID="ffcdabf771aeb8c2d766b48e005573c557473b1f958f00844a8f0dc64920c8fc" exitCode=0 Jun 11 23:20:33.957769 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:33.957334 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bnxdn" Jun 11 23:20:33.957769 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:33.957383 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bnxdn" event={"ID":"42ee058d-5978-491d-a2e9-72fac30f44c3","Type":"ContainerDied","Data":"ffcdabf771aeb8c2d766b48e005573c557473b1f958f00844a8f0dc64920c8fc"} Jun 11 23:20:33.957769 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:33.957428 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bnxdn" event={"ID":"42ee058d-5978-491d-a2e9-72fac30f44c3","Type":"ContainerDied","Data":"a589db174606049106851ae3face688902af7111c20318ff1df5af89a4f1446e"} Jun 11 23:20:33.957769 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:33.957449 2563 scope.go:117] "RemoveContainer" containerID="ffcdabf771aeb8c2d766b48e005573c557473b1f958f00844a8f0dc64920c8fc" Jun 11 23:20:33.958849 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:33.958733 2563 generic.go:356] "Generic (PLEG): container finished" podID="57adae38-4e6a-461d-9070-1c7c26f2196c" containerID="fa5934c5cdcae31fed0f877dbc7002d53b9af30d07785ffa4993326860cbaf92" exitCode=0 Jun 11 23:20:33.958849 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:33.958790 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ndpsd" Jun 11 23:20:33.958849 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:33.958807 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ndpsd" event={"ID":"57adae38-4e6a-461d-9070-1c7c26f2196c","Type":"ContainerDied","Data":"fa5934c5cdcae31fed0f877dbc7002d53b9af30d07785ffa4993326860cbaf92"} Jun 11 23:20:33.959132 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:33.958855 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ndpsd" event={"ID":"57adae38-4e6a-461d-9070-1c7c26f2196c","Type":"ContainerDied","Data":"a0674512f5d516b3e6213476baade4ebfac8baabcc810f2a889b825589fd220b"} Jun 11 23:20:33.966517 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:33.966452 2563 scope.go:117] "RemoveContainer" containerID="ffcdabf771aeb8c2d766b48e005573c557473b1f958f00844a8f0dc64920c8fc" Jun 11 23:20:33.966815 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:20:33.966795 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffcdabf771aeb8c2d766b48e005573c557473b1f958f00844a8f0dc64920c8fc\": container with ID starting with ffcdabf771aeb8c2d766b48e005573c557473b1f958f00844a8f0dc64920c8fc not found: ID does not exist" containerID="ffcdabf771aeb8c2d766b48e005573c557473b1f958f00844a8f0dc64920c8fc" Jun 11 23:20:33.966894 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:33.966824 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffcdabf771aeb8c2d766b48e005573c557473b1f958f00844a8f0dc64920c8fc"} err="failed to get container status \"ffcdabf771aeb8c2d766b48e005573c557473b1f958f00844a8f0dc64920c8fc\": rpc error: code = NotFound desc = could not find container \"ffcdabf771aeb8c2d766b48e005573c557473b1f958f00844a8f0dc64920c8fc\": container with ID starting with ffcdabf771aeb8c2d766b48e005573c557473b1f958f00844a8f0dc64920c8fc not found: ID does not exist" Jun 11 23:20:33.966894 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:33.966840 2563 scope.go:117] "RemoveContainer" containerID="fa5934c5cdcae31fed0f877dbc7002d53b9af30d07785ffa4993326860cbaf92" Jun 11 23:20:33.974740 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:33.974722 2563 scope.go:117] "RemoveContainer" containerID="fa5934c5cdcae31fed0f877dbc7002d53b9af30d07785ffa4993326860cbaf92" Jun 11 23:20:33.975012 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:20:33.974990 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa5934c5cdcae31fed0f877dbc7002d53b9af30d07785ffa4993326860cbaf92\": container with ID starting with fa5934c5cdcae31fed0f877dbc7002d53b9af30d07785ffa4993326860cbaf92 not found: ID does not exist" containerID="fa5934c5cdcae31fed0f877dbc7002d53b9af30d07785ffa4993326860cbaf92" Jun 11 23:20:33.975083 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:33.975024 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa5934c5cdcae31fed0f877dbc7002d53b9af30d07785ffa4993326860cbaf92"} err="failed to get container status \"fa5934c5cdcae31fed0f877dbc7002d53b9af30d07785ffa4993326860cbaf92\": rpc error: code = NotFound desc = could not find container \"fa5934c5cdcae31fed0f877dbc7002d53b9af30d07785ffa4993326860cbaf92\": container with ID starting with fa5934c5cdcae31fed0f877dbc7002d53b9af30d07785ffa4993326860cbaf92 not found: ID does not exist" Jun 11 23:20:33.981141 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:33.981116 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ndpsd"] Jun 11 23:20:33.985050 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:33.984999 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ndpsd"] Jun 11 23:20:33.995545 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:33.995519 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bnxdn"] Jun 11 23:20:33.999399 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:33.999377 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bnxdn"] Jun 11 23:20:35.006399 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:35.006362 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42ee058d-5978-491d-a2e9-72fac30f44c3" path="/var/lib/kubelet/pods/42ee058d-5978-491d-a2e9-72fac30f44c3/volumes" Jun 11 23:20:35.006893 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:20:35.006837 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57adae38-4e6a-461d-9070-1c7c26f2196c" path="/var/lib/kubelet/pods/57adae38-4e6a-461d-9070-1c7c26f2196c/volumes" Jun 11 23:23:59.723466 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:23:59.723425 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57dbf74fb6-khxmb"] Jun 11 23:23:59.723933 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:23:59.723829 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42ee058d-5978-491d-a2e9-72fac30f44c3" containerName="authorino" Jun 11 23:23:59.723933 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:23:59.723841 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="42ee058d-5978-491d-a2e9-72fac30f44c3" containerName="authorino" Jun 11 23:23:59.723933 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:23:59.723853 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57adae38-4e6a-461d-9070-1c7c26f2196c" containerName="authorino" Jun 11 23:23:59.723933 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:23:59.723858 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="57adae38-4e6a-461d-9070-1c7c26f2196c" containerName="authorino" Jun 11 23:23:59.723933 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:23:59.723928 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="57adae38-4e6a-461d-9070-1c7c26f2196c" containerName="authorino" Jun 11 23:23:59.724134 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:23:59.723937 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="42ee058d-5978-491d-a2e9-72fac30f44c3" containerName="authorino" Jun 11 23:23:59.727210 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:23:59.727184 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57dbf74fb6-khxmb" Jun 11 23:23:59.728887 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:23:59.728862 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57dbf74fb6-khxmb"] Jun 11 23:23:59.730246 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:23:59.730221 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 11 23:23:59.825627 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:23:59.825585 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0-oidc-ca\") pod \"authorino-57dbf74fb6-khxmb\" (UID: \"d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0\") " pod="kuadrant-system/authorino-57dbf74fb6-khxmb" Jun 11 23:23:59.825815 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:23:59.825729 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0-tls-cert\") pod \"authorino-57dbf74fb6-khxmb\" (UID: \"d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0\") " pod="kuadrant-system/authorino-57dbf74fb6-khxmb" Jun 11 23:23:59.825815 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:23:59.825771 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gp8j\" (UniqueName: \"kubernetes.io/projected/d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0-kube-api-access-2gp8j\") pod \"authorino-57dbf74fb6-khxmb\" (UID: \"d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0\") " pod="kuadrant-system/authorino-57dbf74fb6-khxmb" Jun 11 23:23:59.926956 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:23:59.926911 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0-tls-cert\") pod \"authorino-57dbf74fb6-khxmb\" (UID: \"d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0\") " pod="kuadrant-system/authorino-57dbf74fb6-khxmb" Jun 11 23:23:59.927188 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:23:59.926971 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gp8j\" (UniqueName: \"kubernetes.io/projected/d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0-kube-api-access-2gp8j\") pod \"authorino-57dbf74fb6-khxmb\" (UID: \"d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0\") " pod="kuadrant-system/authorino-57dbf74fb6-khxmb" Jun 11 23:23:59.927188 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:23:59.927037 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0-oidc-ca\") pod \"authorino-57dbf74fb6-khxmb\" (UID: \"d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0\") " pod="kuadrant-system/authorino-57dbf74fb6-khxmb" Jun 11 23:23:59.927719 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:23:59.927694 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0-oidc-ca\") pod \"authorino-57dbf74fb6-khxmb\" (UID: \"d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0\") " pod="kuadrant-system/authorino-57dbf74fb6-khxmb" Jun 11 23:23:59.929408 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:23:59.929388 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0-tls-cert\") pod \"authorino-57dbf74fb6-khxmb\" (UID: \"d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0\") " pod="kuadrant-system/authorino-57dbf74fb6-khxmb" Jun 11 23:23:59.935873 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:23:59.935844 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gp8j\" (UniqueName: \"kubernetes.io/projected/d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0-kube-api-access-2gp8j\") pod \"authorino-57dbf74fb6-khxmb\" (UID: \"d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0\") " pod="kuadrant-system/authorino-57dbf74fb6-khxmb" Jun 11 23:24:00.036638 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:00.036552 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57dbf74fb6-khxmb" Jun 11 23:24:00.175359 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:00.175323 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57dbf74fb6-khxmb"] Jun 11 23:24:00.177506 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:24:00.177479 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd606ed4c_a173_4ba2_bceb_e7a3c8cdd2b0.slice/crio-85ed2a7de640174cc8a089d7b1570b0c6131fba0354260a5bd79a2ad61351af2 WatchSource:0}: Error finding container 85ed2a7de640174cc8a089d7b1570b0c6131fba0354260a5bd79a2ad61351af2: Status 404 returned error can't find the container with id 85ed2a7de640174cc8a089d7b1570b0c6131fba0354260a5bd79a2ad61351af2 Jun 11 23:24:00.944407 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:00.944366 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57dbf74fb6-khxmb" event={"ID":"d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0","Type":"ContainerStarted","Data":"a4812e8a276cd6ea02f5a09b320e3e0bedc4935146dd46c87d4ab64dd2e3059f"} Jun 11 23:24:00.944767 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:00.944421 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57dbf74fb6-khxmb" event={"ID":"d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0","Type":"ContainerStarted","Data":"85ed2a7de640174cc8a089d7b1570b0c6131fba0354260a5bd79a2ad61351af2"} Jun 11 23:24:00.961348 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:00.961297 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-57dbf74fb6-khxmb" podStartSLOduration=1.6064860140000001 podStartE2EDuration="1.961278199s" totalImagesPullingTime="354.792185ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:23:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:24:00.959544429 +0000 UTC m=+814.382329408" watchObservedRunningTime="2026-06-11 23:24:00.961278199 +0000 UTC m=+814.384063165" Jun 11 23:24:00.986962 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:00.986922 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c7979b8d4-lprln"] Jun 11 23:24:00.987142 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:00.987119 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7c7979b8d4-lprln" podUID="9e36109e-0936-449e-9ed2-cc6271b91db5" containerName="authorino" containerID="cri-o://af9384f089ea7861fbbba5c07c51a8c8f768e3aac3197a38af6b48495c6287b5" gracePeriod=30 Jun 11 23:24:01.247934 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:01.247907 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c7979b8d4-lprln" Jun 11 23:24:01.338667 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:01.338620 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rw4xk\" (UniqueName: \"kubernetes.io/projected/9e36109e-0936-449e-9ed2-cc6271b91db5-kube-api-access-rw4xk\") pod \"9e36109e-0936-449e-9ed2-cc6271b91db5\" (UID: \"9e36109e-0936-449e-9ed2-cc6271b91db5\") " Jun 11 23:24:01.338865 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:01.338684 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9e36109e-0936-449e-9ed2-cc6271b91db5-tls-cert\") pod \"9e36109e-0936-449e-9ed2-cc6271b91db5\" (UID: \"9e36109e-0936-449e-9ed2-cc6271b91db5\") " Jun 11 23:24:01.340761 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:01.340726 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e36109e-0936-449e-9ed2-cc6271b91db5-kube-api-access-rw4xk" (OuterVolumeSpecName: "kube-api-access-rw4xk") pod "9e36109e-0936-449e-9ed2-cc6271b91db5" (UID: "9e36109e-0936-449e-9ed2-cc6271b91db5"). InnerVolumeSpecName "kube-api-access-rw4xk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:24:01.349030 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:01.348950 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e36109e-0936-449e-9ed2-cc6271b91db5-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "9e36109e-0936-449e-9ed2-cc6271b91db5" (UID: "9e36109e-0936-449e-9ed2-cc6271b91db5"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:24:01.440325 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:01.440295 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rw4xk\" (UniqueName: \"kubernetes.io/projected/9e36109e-0936-449e-9ed2-cc6271b91db5-kube-api-access-rw4xk\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:24:01.440325 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:01.440322 2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9e36109e-0936-449e-9ed2-cc6271b91db5-tls-cert\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:24:01.949895 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:01.949864 2563 generic.go:356] "Generic (PLEG): container finished" podID="9e36109e-0936-449e-9ed2-cc6271b91db5" containerID="af9384f089ea7861fbbba5c07c51a8c8f768e3aac3197a38af6b48495c6287b5" exitCode=0 Jun 11 23:24:01.950310 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:01.949905 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c7979b8d4-lprln" Jun 11 23:24:01.950310 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:01.949952 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c7979b8d4-lprln" event={"ID":"9e36109e-0936-449e-9ed2-cc6271b91db5","Type":"ContainerDied","Data":"af9384f089ea7861fbbba5c07c51a8c8f768e3aac3197a38af6b48495c6287b5"} Jun 11 23:24:01.950310 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:01.950012 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c7979b8d4-lprln" event={"ID":"9e36109e-0936-449e-9ed2-cc6271b91db5","Type":"ContainerDied","Data":"e63d5cd75184ac35f8b0a5e8f18b725e912dbe4d8b1747ffcaeeb45b2acdd73d"} Jun 11 23:24:01.950310 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:01.950034 2563 scope.go:117] "RemoveContainer" containerID="af9384f089ea7861fbbba5c07c51a8c8f768e3aac3197a38af6b48495c6287b5" Jun 11 23:24:01.958552 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:01.958536 2563 scope.go:117] "RemoveContainer" containerID="af9384f089ea7861fbbba5c07c51a8c8f768e3aac3197a38af6b48495c6287b5" Jun 11 23:24:01.958797 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:24:01.958781 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af9384f089ea7861fbbba5c07c51a8c8f768e3aac3197a38af6b48495c6287b5\": container with ID starting with af9384f089ea7861fbbba5c07c51a8c8f768e3aac3197a38af6b48495c6287b5 not found: ID does not exist" containerID="af9384f089ea7861fbbba5c07c51a8c8f768e3aac3197a38af6b48495c6287b5" Jun 11 23:24:01.958862 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:01.958804 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af9384f089ea7861fbbba5c07c51a8c8f768e3aac3197a38af6b48495c6287b5"} err="failed to get container status \"af9384f089ea7861fbbba5c07c51a8c8f768e3aac3197a38af6b48495c6287b5\": rpc error: code = NotFound desc = could not find container \"af9384f089ea7861fbbba5c07c51a8c8f768e3aac3197a38af6b48495c6287b5\": container with ID starting with af9384f089ea7861fbbba5c07c51a8c8f768e3aac3197a38af6b48495c6287b5 not found: ID does not exist" Jun 11 23:24:01.972855 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:01.972827 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c7979b8d4-lprln"] Jun 11 23:24:01.977097 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:01.977075 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7c7979b8d4-lprln"] Jun 11 23:24:03.006029 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:03.005971 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e36109e-0936-449e-9ed2-cc6271b91db5" path="/var/lib/kubelet/pods/9e36109e-0936-449e-9ed2-cc6271b91db5/volumes" Jun 11 23:24:28.839862 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:28.839826 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z"] Jun 11 23:24:28.840502 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:28.840479 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e36109e-0936-449e-9ed2-cc6271b91db5" containerName="authorino" Jun 11 23:24:28.840502 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:28.840504 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e36109e-0936-449e-9ed2-cc6271b91db5" containerName="authorino" Jun 11 23:24:28.840727 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:28.840610 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e36109e-0936-449e-9ed2-cc6271b91db5" containerName="authorino" Jun 11 23:24:28.845076 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:28.845056 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z" Jun 11 23:24:28.849426 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:28.849397 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-78rgf\"" Jun 11 23:24:28.849547 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:28.849425 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 23:24:28.849547 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:28.849436 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 23:24:28.849547 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:28.849483 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 11 23:24:28.855776 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:28.855754 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z"] Jun 11 23:24:28.994767 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:28.994737 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff1d8693-0f5c-47ad-843d-a128a789b194-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z\" (UID: \"ff1d8693-0f5c-47ad-843d-a128a789b194\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z" Jun 11 23:24:28.994935 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:28.994777 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g92bx\" (UniqueName: \"kubernetes.io/projected/ff1d8693-0f5c-47ad-843d-a128a789b194-kube-api-access-g92bx\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z\" (UID: \"ff1d8693-0f5c-47ad-843d-a128a789b194\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z" Jun 11 23:24:28.994935 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:28.994796 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff1d8693-0f5c-47ad-843d-a128a789b194-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z\" (UID: \"ff1d8693-0f5c-47ad-843d-a128a789b194\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z" Jun 11 23:24:28.994935 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:28.994906 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ff1d8693-0f5c-47ad-843d-a128a789b194-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z\" (UID: \"ff1d8693-0f5c-47ad-843d-a128a789b194\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z" Jun 11 23:24:28.995149 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:28.994945 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff1d8693-0f5c-47ad-843d-a128a789b194-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z\" (UID: \"ff1d8693-0f5c-47ad-843d-a128a789b194\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z" Jun 11 23:24:28.995149 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:28.995036 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff1d8693-0f5c-47ad-843d-a128a789b194-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z\" (UID: \"ff1d8693-0f5c-47ad-843d-a128a789b194\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z" Jun 11 23:24:29.095929 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:29.095835 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff1d8693-0f5c-47ad-843d-a128a789b194-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z\" (UID: \"ff1d8693-0f5c-47ad-843d-a128a789b194\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z" Jun 11 23:24:29.095929 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:29.095875 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g92bx\" (UniqueName: \"kubernetes.io/projected/ff1d8693-0f5c-47ad-843d-a128a789b194-kube-api-access-g92bx\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z\" (UID: \"ff1d8693-0f5c-47ad-843d-a128a789b194\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z" Jun 11 23:24:29.095929 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:29.095894 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff1d8693-0f5c-47ad-843d-a128a789b194-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z\" (UID: \"ff1d8693-0f5c-47ad-843d-a128a789b194\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z" Jun 11 23:24:29.095929 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:29.095932 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ff1d8693-0f5c-47ad-843d-a128a789b194-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z\" (UID: \"ff1d8693-0f5c-47ad-843d-a128a789b194\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z" Jun 11 23:24:29.096295 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:29.095951 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff1d8693-0f5c-47ad-843d-a128a789b194-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z\" (UID: \"ff1d8693-0f5c-47ad-843d-a128a789b194\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z" Jun 11 23:24:29.096295 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:29.096000 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff1d8693-0f5c-47ad-843d-a128a789b194-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z\" (UID: \"ff1d8693-0f5c-47ad-843d-a128a789b194\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z" Jun 11 23:24:29.096398 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:29.096330 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff1d8693-0f5c-47ad-843d-a128a789b194-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z\" (UID: \"ff1d8693-0f5c-47ad-843d-a128a789b194\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z" Jun 11 23:24:29.096398 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:29.096343 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ff1d8693-0f5c-47ad-843d-a128a789b194-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z\" (UID: \"ff1d8693-0f5c-47ad-843d-a128a789b194\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z" Jun 11 23:24:29.096460 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:29.096398 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff1d8693-0f5c-47ad-843d-a128a789b194-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z\" (UID: \"ff1d8693-0f5c-47ad-843d-a128a789b194\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z" Jun 11 23:24:29.098294 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:29.098277 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff1d8693-0f5c-47ad-843d-a128a789b194-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z\" (UID: \"ff1d8693-0f5c-47ad-843d-a128a789b194\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z" Jun 11 23:24:29.098400 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:29.098383 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff1d8693-0f5c-47ad-843d-a128a789b194-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z\" (UID: \"ff1d8693-0f5c-47ad-843d-a128a789b194\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z" Jun 11 23:24:29.104214 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:29.104187 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g92bx\" (UniqueName: \"kubernetes.io/projected/ff1d8693-0f5c-47ad-843d-a128a789b194-kube-api-access-g92bx\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z\" (UID: \"ff1d8693-0f5c-47ad-843d-a128a789b194\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z" Jun 11 23:24:29.158227 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:29.158176 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z" Jun 11 23:24:29.291190 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:29.291163 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z"] Jun 11 23:24:29.292697 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:24:29.292670 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff1d8693_0f5c_47ad_843d_a128a789b194.slice/crio-42aa030e7d11bce152c02a691a73627e19bf59c704e3233d2c44bee8e8cae2be WatchSource:0}: Error finding container 42aa030e7d11bce152c02a691a73627e19bf59c704e3233d2c44bee8e8cae2be: Status 404 returned error can't find the container with id 42aa030e7d11bce152c02a691a73627e19bf59c704e3233d2c44bee8e8cae2be Jun 11 23:24:30.089548 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:30.089504 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z" event={"ID":"ff1d8693-0f5c-47ad-843d-a128a789b194","Type":"ContainerStarted","Data":"42aa030e7d11bce152c02a691a73627e19bf59c704e3233d2c44bee8e8cae2be"} Jun 11 23:24:33.106625 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:24:33.106584 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z" event={"ID":"ff1d8693-0f5c-47ad-843d-a128a789b194","Type":"ContainerStarted","Data":"502f5f0ad21c76c07608f9cd4396ad3a8ccb214ce9dfed9fe2993dad17bb27db"} Jun 11 23:25:27.019754 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:25:27.019723 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lrmgd_243ee797-2187-41bc-ad0c-116ec1a4888f/ovn-acl-logging/0.log" Jun 11 23:25:27.021445 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:25:27.021424 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lrmgd_243ee797-2187-41bc-ad0c-116ec1a4888f/ovn-acl-logging/0.log" Jun 11 23:26:11.417267 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:11.417230 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76894b9f9f-k2fgh"] Jun 11 23:26:11.425712 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:11.425679 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76894b9f9f-k2fgh" Jun 11 23:26:11.429509 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:11.429484 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76894b9f9f-k2fgh"] Jun 11 23:26:11.447179 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:11.447148 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/15884c9c-3d6b-49ed-b8be-41aa1ab653fb-oidc-ca\") pod \"authorino-76894b9f9f-k2fgh\" (UID: \"15884c9c-3d6b-49ed-b8be-41aa1ab653fb\") " pod="kuadrant-system/authorino-76894b9f9f-k2fgh" Jun 11 23:26:11.447313 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:11.447221 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tnx4\" (UniqueName: \"kubernetes.io/projected/15884c9c-3d6b-49ed-b8be-41aa1ab653fb-kube-api-access-9tnx4\") pod \"authorino-76894b9f9f-k2fgh\" (UID: \"15884c9c-3d6b-49ed-b8be-41aa1ab653fb\") " pod="kuadrant-system/authorino-76894b9f9f-k2fgh" Jun 11 23:26:11.447313 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:11.447263 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/15884c9c-3d6b-49ed-b8be-41aa1ab653fb-tls-cert\") pod \"authorino-76894b9f9f-k2fgh\" (UID: \"15884c9c-3d6b-49ed-b8be-41aa1ab653fb\") " pod="kuadrant-system/authorino-76894b9f9f-k2fgh" Jun 11 23:26:11.548723 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:11.548685 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tnx4\" (UniqueName: \"kubernetes.io/projected/15884c9c-3d6b-49ed-b8be-41aa1ab653fb-kube-api-access-9tnx4\") pod \"authorino-76894b9f9f-k2fgh\" (UID: \"15884c9c-3d6b-49ed-b8be-41aa1ab653fb\") " pod="kuadrant-system/authorino-76894b9f9f-k2fgh" Jun 11 23:26:11.548901 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:11.548745 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/15884c9c-3d6b-49ed-b8be-41aa1ab653fb-tls-cert\") pod \"authorino-76894b9f9f-k2fgh\" (UID: \"15884c9c-3d6b-49ed-b8be-41aa1ab653fb\") " pod="kuadrant-system/authorino-76894b9f9f-k2fgh" Jun 11 23:26:11.548901 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:11.548793 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/15884c9c-3d6b-49ed-b8be-41aa1ab653fb-oidc-ca\") pod \"authorino-76894b9f9f-k2fgh\" (UID: \"15884c9c-3d6b-49ed-b8be-41aa1ab653fb\") " pod="kuadrant-system/authorino-76894b9f9f-k2fgh" Jun 11 23:26:11.549464 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:11.549439 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/15884c9c-3d6b-49ed-b8be-41aa1ab653fb-oidc-ca\") pod \"authorino-76894b9f9f-k2fgh\" (UID: \"15884c9c-3d6b-49ed-b8be-41aa1ab653fb\") " pod="kuadrant-system/authorino-76894b9f9f-k2fgh" Jun 11 23:26:11.551143 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:11.551113 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/15884c9c-3d6b-49ed-b8be-41aa1ab653fb-tls-cert\") pod \"authorino-76894b9f9f-k2fgh\" (UID: \"15884c9c-3d6b-49ed-b8be-41aa1ab653fb\") " pod="kuadrant-system/authorino-76894b9f9f-k2fgh" Jun 11 23:26:11.557890 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:11.557869 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tnx4\" (UniqueName: \"kubernetes.io/projected/15884c9c-3d6b-49ed-b8be-41aa1ab653fb-kube-api-access-9tnx4\") pod \"authorino-76894b9f9f-k2fgh\" (UID: \"15884c9c-3d6b-49ed-b8be-41aa1ab653fb\") " pod="kuadrant-system/authorino-76894b9f9f-k2fgh" Jun 11 23:26:11.736635 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:11.736548 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76894b9f9f-k2fgh" Jun 11 23:26:11.868877 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:11.868849 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76894b9f9f-k2fgh"] Jun 11 23:26:11.870674 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:26:11.870643 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15884c9c_3d6b_49ed_b8be_41aa1ab653fb.slice/crio-653ec7a7b737e1a6eb3be25c515b7357d35d995a0bf2c046e4ba65767f24f8d4 WatchSource:0}: Error finding container 653ec7a7b737e1a6eb3be25c515b7357d35d995a0bf2c046e4ba65767f24f8d4: Status 404 returned error can't find the container with id 653ec7a7b737e1a6eb3be25c515b7357d35d995a0bf2c046e4ba65767f24f8d4 Jun 11 23:26:11.872091 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:11.872073 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 23:26:12.253278 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:26:12.253230 2563 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" image="quay.io/kuadrant/authorino:v0.24.0" Jun 11 23:26:12.253452 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:26:12.253346 2563 kuberuntime_manager.go:1459] "Unhandled Error" err="container authorino start failed in pod authorino-76894b9f9f-k2fgh_kuadrant-system(15884c9c-3d6b-49ed-b8be-41aa1ab653fb): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" logger="UnhandledError" Jun 11 23:26:12.253452 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:26:12.253377 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"authorino\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="kuadrant-system/authorino-76894b9f9f-k2fgh" podUID="15884c9c-3d6b-49ed-b8be-41aa1ab653fb" Jun 11 23:26:12.578515 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:12.578480 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76894b9f9f-k2fgh" event={"ID":"15884c9c-3d6b-49ed-b8be-41aa1ab653fb","Type":"ContainerStarted","Data":"653ec7a7b737e1a6eb3be25c515b7357d35d995a0bf2c046e4ba65767f24f8d4"} Jun 11 23:26:12.579052 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:26:12.579030 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"authorino\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/kuadrant/authorino:v0.24.0\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="kuadrant-system/authorino-76894b9f9f-k2fgh" podUID="15884c9c-3d6b-49ed-b8be-41aa1ab653fb" Jun 11 23:26:13.583329 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:26:13.583284 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"authorino\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/kuadrant/authorino:v0.24.0\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="kuadrant-system/authorino-76894b9f9f-k2fgh" podUID="15884c9c-3d6b-49ed-b8be-41aa1ab653fb" Jun 11 23:26:25.645749 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:25.645654 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76894b9f9f-k2fgh" event={"ID":"15884c9c-3d6b-49ed-b8be-41aa1ab653fb","Type":"ContainerStarted","Data":"70f03d76deb8122a6f63311dd35fda482a5ebc3c29e0ce86dac19409a2061d85"} Jun 11 23:26:25.669181 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:25.669118 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-76894b9f9f-k2fgh" podStartSLOduration=1.153188921 podStartE2EDuration="14.669096235s" totalImagesPullingTime="13.515907314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-06-11 23:26:25.666453478 +0000 UTC m=+959.089238445" watchObservedRunningTime="2026-06-11 23:26:25.669096235 +0000 UTC m=+959.091881214" Jun 11 23:26:25.698748 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:25.698712 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57dbf74fb6-khxmb"] Jun 11 23:26:25.698927 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:25.698904 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-57dbf74fb6-khxmb" podUID="d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0" containerName="authorino" containerID="cri-o://a4812e8a276cd6ea02f5a09b320e3e0bedc4935146dd46c87d4ab64dd2e3059f" gracePeriod=30 Jun 11 23:26:25.961034 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:25.961007 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57dbf74fb6-khxmb" Jun 11 23:26:26.091854 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:26.091809 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0-tls-cert\") pod \"d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0\" (UID: \"d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0\") " Jun 11 23:26:26.092030 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:26.091890 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0-oidc-ca\") pod \"d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0\" (UID: \"d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0\") " Jun 11 23:26:26.092072 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:26.092038 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gp8j\" (UniqueName: \"kubernetes.io/projected/d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0-kube-api-access-2gp8j\") pod \"d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0\" (UID: \"d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0\") " Jun 11 23:26:26.093944 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:26.093908 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0-kube-api-access-2gp8j" (OuterVolumeSpecName: "kube-api-access-2gp8j") pod "d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0" (UID: "d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0"). InnerVolumeSpecName "kube-api-access-2gp8j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:26:26.096821 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:26.096800 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0" (UID: "d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:26:26.102109 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:26.102080 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0" (UID: "d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:26:26.193000 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:26.192938 2563 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0-oidc-ca\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:26:26.193163 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:26.193012 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gp8j\" (UniqueName: \"kubernetes.io/projected/d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0-kube-api-access-2gp8j\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:26:26.193163 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:26.193029 2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0-tls-cert\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:26:26.652843 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:26.652750 2563 generic.go:356] "Generic (PLEG): container finished" podID="d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0" containerID="a4812e8a276cd6ea02f5a09b320e3e0bedc4935146dd46c87d4ab64dd2e3059f" exitCode=0 Jun 11 23:26:26.652843 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:26.652786 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57dbf74fb6-khxmb" Jun 11 23:26:26.652843 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:26.652831 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57dbf74fb6-khxmb" event={"ID":"d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0","Type":"ContainerDied","Data":"a4812e8a276cd6ea02f5a09b320e3e0bedc4935146dd46c87d4ab64dd2e3059f"} Jun 11 23:26:26.653412 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:26.652876 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57dbf74fb6-khxmb" event={"ID":"d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0","Type":"ContainerDied","Data":"85ed2a7de640174cc8a089d7b1570b0c6131fba0354260a5bd79a2ad61351af2"} Jun 11 23:26:26.653412 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:26.652898 2563 scope.go:117] "RemoveContainer" containerID="a4812e8a276cd6ea02f5a09b320e3e0bedc4935146dd46c87d4ab64dd2e3059f" Jun 11 23:26:26.662385 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:26.662350 2563 scope.go:117] "RemoveContainer" containerID="a4812e8a276cd6ea02f5a09b320e3e0bedc4935146dd46c87d4ab64dd2e3059f" Jun 11 23:26:26.662672 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:26:26.662646 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4812e8a276cd6ea02f5a09b320e3e0bedc4935146dd46c87d4ab64dd2e3059f\": container with ID starting with a4812e8a276cd6ea02f5a09b320e3e0bedc4935146dd46c87d4ab64dd2e3059f not found: ID does not exist" containerID="a4812e8a276cd6ea02f5a09b320e3e0bedc4935146dd46c87d4ab64dd2e3059f" Jun 11 23:26:26.662786 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:26.662683 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4812e8a276cd6ea02f5a09b320e3e0bedc4935146dd46c87d4ab64dd2e3059f"} err="failed to get container status \"a4812e8a276cd6ea02f5a09b320e3e0bedc4935146dd46c87d4ab64dd2e3059f\": rpc error: code = NotFound desc = could not find container \"a4812e8a276cd6ea02f5a09b320e3e0bedc4935146dd46c87d4ab64dd2e3059f\": container with ID starting with a4812e8a276cd6ea02f5a09b320e3e0bedc4935146dd46c87d4ab64dd2e3059f not found: ID does not exist" Jun 11 23:26:26.684899 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:26.684870 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57dbf74fb6-khxmb"] Jun 11 23:26:26.688147 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:26.688125 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57dbf74fb6-khxmb"] Jun 11 23:26:27.007900 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:26:27.007819 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0" path="/var/lib/kubelet/pods/d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0/volumes" Jun 11 23:30:00.137675 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:30:00.137638 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29687010-vn6dt"] Jun 11 23:30:00.138194 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:30:00.138036 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0" containerName="authorino" Jun 11 23:30:00.138194 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:30:00.138051 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0" containerName="authorino" Jun 11 23:30:00.138194 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:30:00.138123 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d606ed4c-a173-4ba2-bceb-e7a3c8cdd2b0" containerName="authorino" Jun 11 23:30:00.141146 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:30:00.141130 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29687010-vn6dt" Jun 11 23:30:00.144042 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:30:00.144014 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-vhwzh\"" Jun 11 23:30:00.156506 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:30:00.156478 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29687010-vn6dt"] Jun 11 23:30:00.246231 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:30:00.246195 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57qrc\" (UniqueName: \"kubernetes.io/projected/c3f66e93-b590-4b71-b23e-1561187f74a1-kube-api-access-57qrc\") pod \"maas-api-key-cleanup-29687010-vn6dt\" (UID: \"c3f66e93-b590-4b71-b23e-1561187f74a1\") " pod="opendatahub/maas-api-key-cleanup-29687010-vn6dt" Jun 11 23:30:00.347133 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:30:00.347093 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57qrc\" (UniqueName: \"kubernetes.io/projected/c3f66e93-b590-4b71-b23e-1561187f74a1-kube-api-access-57qrc\") pod \"maas-api-key-cleanup-29687010-vn6dt\" (UID: \"c3f66e93-b590-4b71-b23e-1561187f74a1\") " pod="opendatahub/maas-api-key-cleanup-29687010-vn6dt" Jun 11 23:30:00.356153 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:30:00.356115 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57qrc\" (UniqueName: \"kubernetes.io/projected/c3f66e93-b590-4b71-b23e-1561187f74a1-kube-api-access-57qrc\") pod \"maas-api-key-cleanup-29687010-vn6dt\" (UID: \"c3f66e93-b590-4b71-b23e-1561187f74a1\") " pod="opendatahub/maas-api-key-cleanup-29687010-vn6dt" Jun 11 23:30:00.451569 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:30:00.451477 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29687010-vn6dt" Jun 11 23:30:00.585522 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:30:00.585492 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29687010-vn6dt"] Jun 11 23:30:00.587705 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:30:00.587678 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3f66e93_b590_4b71_b23e_1561187f74a1.slice/crio-0135d8d19e024c530dee4c80011c28fd7f147ab925704e4092e55d0fdb578152 WatchSource:0}: Error finding container 0135d8d19e024c530dee4c80011c28fd7f147ab925704e4092e55d0fdb578152: Status 404 returned error can't find the container with id 0135d8d19e024c530dee4c80011c28fd7f147ab925704e4092e55d0fdb578152 Jun 11 23:30:00.680560 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:30:00.680523 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29687010-vn6dt" event={"ID":"c3f66e93-b590-4b71-b23e-1561187f74a1","Type":"ContainerStarted","Data":"0135d8d19e024c530dee4c80011c28fd7f147ab925704e4092e55d0fdb578152"} Jun 11 23:30:04.703552 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:30:04.703512 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29687010-vn6dt" event={"ID":"c3f66e93-b590-4b71-b23e-1561187f74a1","Type":"ContainerStarted","Data":"8e2ad3ae0d6122806c34bc5ca1bfa4d894a6d4b6f2b5fb986339d7eae0024207"} Jun 11 23:30:04.720225 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:30:04.720175 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29687010-vn6dt" podStartSLOduration=1.475914739 podStartE2EDuration="4.720159935s" totalImagesPullingTime="3.244245196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:30:04.718383806 +0000 UTC m=+1178.141168773" watchObservedRunningTime="2026-06-11 23:30:04.720159935 +0000 UTC m=+1178.142944898" Jun 11 23:30:05.710163 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:30:05.710126 2563 generic.go:356] "Generic (PLEG): container finished" podID="c3f66e93-b590-4b71-b23e-1561187f74a1" containerID="8e2ad3ae0d6122806c34bc5ca1bfa4d894a6d4b6f2b5fb986339d7eae0024207" exitCode=0 Jun 11 23:30:05.710526 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:30:05.710211 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29687010-vn6dt" event={"ID":"c3f66e93-b590-4b71-b23e-1561187f74a1","Type":"ContainerDied","Data":"8e2ad3ae0d6122806c34bc5ca1bfa4d894a6d4b6f2b5fb986339d7eae0024207"} Jun 11 23:30:06.843083 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:30:06.843056 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29687010-vn6dt" Jun 11 23:30:06.905556 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:30:06.905527 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57qrc\" (UniqueName: \"kubernetes.io/projected/c3f66e93-b590-4b71-b23e-1561187f74a1-kube-api-access-57qrc\") pod \"c3f66e93-b590-4b71-b23e-1561187f74a1\" (UID: \"c3f66e93-b590-4b71-b23e-1561187f74a1\") " Jun 11 23:30:06.907598 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:30:06.907572 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3f66e93-b590-4b71-b23e-1561187f74a1-kube-api-access-57qrc" (OuterVolumeSpecName: "kube-api-access-57qrc") pod "c3f66e93-b590-4b71-b23e-1561187f74a1" (UID: "c3f66e93-b590-4b71-b23e-1561187f74a1"). InnerVolumeSpecName "kube-api-access-57qrc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:30:07.006275 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:30:07.006198 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57qrc\" (UniqueName: \"kubernetes.io/projected/c3f66e93-b590-4b71-b23e-1561187f74a1-kube-api-access-57qrc\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:30:07.721313 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:30:07.721280 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29687010-vn6dt" Jun 11 23:30:07.721313 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:30:07.721307 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29687010-vn6dt" event={"ID":"c3f66e93-b590-4b71-b23e-1561187f74a1","Type":"ContainerDied","Data":"0135d8d19e024c530dee4c80011c28fd7f147ab925704e4092e55d0fdb578152"} Jun 11 23:30:07.721524 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:30:07.721352 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0135d8d19e024c530dee4c80011c28fd7f147ab925704e4092e55d0fdb578152" Jun 11 23:30:27.060478 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:30:27.060451 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lrmgd_243ee797-2187-41bc-ad0c-116ec1a4888f/ovn-acl-logging/0.log" Jun 11 23:30:27.062254 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:30:27.062235 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lrmgd_243ee797-2187-41bc-ad0c-116ec1a4888f/ovn-acl-logging/0.log" Jun 11 23:35:27.091623 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:35:27.091592 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lrmgd_243ee797-2187-41bc-ad0c-116ec1a4888f/ovn-acl-logging/0.log" Jun 11 23:35:27.094433 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:35:27.094410 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lrmgd_243ee797-2187-41bc-ad0c-116ec1a4888f/ovn-acl-logging/0.log" Jun 11 23:40:27.128210 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:40:27.128184 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lrmgd_243ee797-2187-41bc-ad0c-116ec1a4888f/ovn-acl-logging/0.log" Jun 11 23:40:27.130101 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:40:27.130083 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lrmgd_243ee797-2187-41bc-ad0c-116ec1a4888f/ovn-acl-logging/0.log" Jun 11 23:45:00.135318 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:45:00.135281 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29687025-bskmn"] Jun 11 23:45:00.135818 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:45:00.135686 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3f66e93-b590-4b71-b23e-1561187f74a1" containerName="cleanup" Jun 11 23:45:00.135818 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:45:00.135697 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3f66e93-b590-4b71-b23e-1561187f74a1" containerName="cleanup" Jun 11 23:45:00.135818 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:45:00.135755 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3f66e93-b590-4b71-b23e-1561187f74a1" containerName="cleanup" Jun 11 23:45:00.137745 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:45:00.137730 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29687025-bskmn" Jun 11 23:45:00.140510 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:45:00.140495 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-vhwzh\"" Jun 11 23:45:00.152916 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:45:00.152887 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29687025-bskmn"] Jun 11 23:45:00.229316 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:45:00.229277 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55xwd\" (UniqueName: \"kubernetes.io/projected/c0651668-1481-4bf2-a3aa-932c7b208a97-kube-api-access-55xwd\") pod \"maas-api-key-cleanup-29687025-bskmn\" (UID: \"c0651668-1481-4bf2-a3aa-932c7b208a97\") " pod="opendatahub/maas-api-key-cleanup-29687025-bskmn" Jun 11 23:45:00.330127 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:45:00.330072 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55xwd\" (UniqueName: \"kubernetes.io/projected/c0651668-1481-4bf2-a3aa-932c7b208a97-kube-api-access-55xwd\") pod \"maas-api-key-cleanup-29687025-bskmn\" (UID: \"c0651668-1481-4bf2-a3aa-932c7b208a97\") " pod="opendatahub/maas-api-key-cleanup-29687025-bskmn" Jun 11 23:45:00.338269 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:45:00.338236 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55xwd\" (UniqueName: \"kubernetes.io/projected/c0651668-1481-4bf2-a3aa-932c7b208a97-kube-api-access-55xwd\") pod \"maas-api-key-cleanup-29687025-bskmn\" (UID: \"c0651668-1481-4bf2-a3aa-932c7b208a97\") " pod="opendatahub/maas-api-key-cleanup-29687025-bskmn" Jun 11 23:45:00.448333 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:45:00.448221 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29687025-bskmn" Jun 11 23:45:00.582958 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:45:00.582925 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29687025-bskmn"] Jun 11 23:45:00.584402 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:45:00.584376 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0651668_1481_4bf2_a3aa_932c7b208a97.slice/crio-3df060d362dff012e76344673eb3a21360ab772f99c212cd9522abadaf1b78c0 WatchSource:0}: Error finding container 3df060d362dff012e76344673eb3a21360ab772f99c212cd9522abadaf1b78c0: Status 404 returned error can't find the container with id 3df060d362dff012e76344673eb3a21360ab772f99c212cd9522abadaf1b78c0 Jun 11 23:45:00.943044 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:45:00.943004 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29687025-bskmn" event={"ID":"c0651668-1481-4bf2-a3aa-932c7b208a97","Type":"ContainerStarted","Data":"ffc7e933c6d3c3fa2d3c0c86d1ddb093cd277304c906dbac26069f9d62324ac7"} Jun 11 23:45:00.943238 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:45:00.943074 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29687025-bskmn" event={"ID":"c0651668-1481-4bf2-a3aa-932c7b208a97","Type":"ContainerStarted","Data":"3df060d362dff012e76344673eb3a21360ab772f99c212cd9522abadaf1b78c0"} Jun 11 23:45:00.958590 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:45:00.958512 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29687025-bskmn" podStartSLOduration=0.958494909 podStartE2EDuration="958.494909ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:45:00.957754849 +0000 UTC m=+2074.380539817" watchObservedRunningTime="2026-06-11 23:45:00.958494909 +0000 UTC m=+2074.381279875" Jun 11 23:45:01.949761 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:45:01.949729 2563 generic.go:356] "Generic (PLEG): container finished" podID="c0651668-1481-4bf2-a3aa-932c7b208a97" containerID="ffc7e933c6d3c3fa2d3c0c86d1ddb093cd277304c906dbac26069f9d62324ac7" exitCode=0 Jun 11 23:45:01.950172 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:45:01.949767 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29687025-bskmn" event={"ID":"c0651668-1481-4bf2-a3aa-932c7b208a97","Type":"ContainerDied","Data":"ffc7e933c6d3c3fa2d3c0c86d1ddb093cd277304c906dbac26069f9d62324ac7"} Jun 11 23:45:03.080988 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:45:03.080950 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29687025-bskmn" Jun 11 23:45:03.159138 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:45:03.159109 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55xwd\" (UniqueName: \"kubernetes.io/projected/c0651668-1481-4bf2-a3aa-932c7b208a97-kube-api-access-55xwd\") pod \"c0651668-1481-4bf2-a3aa-932c7b208a97\" (UID: \"c0651668-1481-4bf2-a3aa-932c7b208a97\") " Jun 11 23:45:03.161166 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:45:03.161144 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0651668-1481-4bf2-a3aa-932c7b208a97-kube-api-access-55xwd" (OuterVolumeSpecName: "kube-api-access-55xwd") pod "c0651668-1481-4bf2-a3aa-932c7b208a97" (UID: "c0651668-1481-4bf2-a3aa-932c7b208a97"). InnerVolumeSpecName "kube-api-access-55xwd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:45:03.260932 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:45:03.260847 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55xwd\" (UniqueName: \"kubernetes.io/projected/c0651668-1481-4bf2-a3aa-932c7b208a97-kube-api-access-55xwd\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:45:03.959842 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:45:03.959808 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29687025-bskmn" Jun 11 23:45:03.959842 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:45:03.959831 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29687025-bskmn" event={"ID":"c0651668-1481-4bf2-a3aa-932c7b208a97","Type":"ContainerDied","Data":"3df060d362dff012e76344673eb3a21360ab772f99c212cd9522abadaf1b78c0"} Jun 11 23:45:03.960095 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:45:03.959883 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3df060d362dff012e76344673eb3a21360ab772f99c212cd9522abadaf1b78c0" Jun 11 23:45:03.981688 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:45:03.981660 2563 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0651668_1481_4bf2_a3aa_932c7b208a97.slice\": RecentStats: unable to find data in memory cache]" Jun 11 23:45:27.160813 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:45:27.160704 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lrmgd_243ee797-2187-41bc-ad0c-116ec1a4888f/ovn-acl-logging/0.log" Jun 11 23:45:27.164244 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:45:27.164226 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lrmgd_243ee797-2187-41bc-ad0c-116ec1a4888f/ovn-acl-logging/0.log" Jun 11 23:46:01.222463 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.222424 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj"] Jun 11 23:46:01.223701 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.223677 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0651668-1481-4bf2-a3aa-932c7b208a97" containerName="cleanup" Jun 11 23:46:01.223829 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.223818 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0651668-1481-4bf2-a3aa-932c7b208a97" containerName="cleanup" Jun 11 23:46:01.224056 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.224043 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0651668-1481-4bf2-a3aa-932c7b208a97" containerName="cleanup" Jun 11 23:46:01.227320 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.227295 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:01.230467 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.230441 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 23:46:01.230888 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.230873 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-64487bd1-openshift-default-dockercfg-2xsz8\"" Jun 11 23:46:01.243628 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.243598 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj"] Jun 11 23:46:01.293966 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.293930 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/543f7aa8-1e9c-40f6-8481-6951c7191adf-istio-podinfo\") pod \"e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:01.294194 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.293973 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/543f7aa8-1e9c-40f6-8481-6951c7191adf-istio-token\") pod \"e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:01.294194 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.294067 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/543f7aa8-1e9c-40f6-8481-6951c7191adf-workload-certs\") pod \"e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:01.294194 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.294103 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/543f7aa8-1e9c-40f6-8481-6951c7191adf-workload-socket\") pod \"e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:01.294194 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.294144 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/543f7aa8-1e9c-40f6-8481-6951c7191adf-istio-envoy\") pod \"e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:01.294194 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.294168 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdjw6\" (UniqueName: \"kubernetes.io/projected/543f7aa8-1e9c-40f6-8481-6951c7191adf-kube-api-access-sdjw6\") pod \"e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:01.294379 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.294214 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/543f7aa8-1e9c-40f6-8481-6951c7191adf-istio-data\") pod \"e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:01.294379 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.294265 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/543f7aa8-1e9c-40f6-8481-6951c7191adf-credential-socket\") pod \"e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:01.294379 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.294283 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/543f7aa8-1e9c-40f6-8481-6951c7191adf-istiod-ca-cert\") pod \"e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:01.395168 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.395130 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/543f7aa8-1e9c-40f6-8481-6951c7191adf-istio-envoy\") pod \"e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:01.395168 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.395169 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdjw6\" (UniqueName: \"kubernetes.io/projected/543f7aa8-1e9c-40f6-8481-6951c7191adf-kube-api-access-sdjw6\") pod \"e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:01.395433 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.395198 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/543f7aa8-1e9c-40f6-8481-6951c7191adf-istio-data\") pod \"e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:01.395433 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.395225 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/543f7aa8-1e9c-40f6-8481-6951c7191adf-credential-socket\") pod \"e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:01.395433 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.395331 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/543f7aa8-1e9c-40f6-8481-6951c7191adf-istiod-ca-cert\") pod \"e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:01.395433 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.395414 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/543f7aa8-1e9c-40f6-8481-6951c7191adf-istio-podinfo\") pod \"e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:01.395645 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.395458 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/543f7aa8-1e9c-40f6-8481-6951c7191adf-istio-token\") pod \"e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:01.395645 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.395494 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/543f7aa8-1e9c-40f6-8481-6951c7191adf-workload-certs\") pod \"e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:01.395645 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.395544 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/543f7aa8-1e9c-40f6-8481-6951c7191adf-workload-socket\") pod \"e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:01.395645 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.395611 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/543f7aa8-1e9c-40f6-8481-6951c7191adf-credential-socket\") pod \"e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:01.395849 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.395726 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/543f7aa8-1e9c-40f6-8481-6951c7191adf-istio-data\") pod \"e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:01.396277 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.396244 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/543f7aa8-1e9c-40f6-8481-6951c7191adf-istiod-ca-cert\") pod \"e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:01.396382 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.396251 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/543f7aa8-1e9c-40f6-8481-6951c7191adf-workload-certs\") pod \"e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:01.396420 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.396376 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/543f7aa8-1e9c-40f6-8481-6951c7191adf-workload-socket\") pod \"e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:01.397732 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.397706 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/543f7aa8-1e9c-40f6-8481-6951c7191adf-istio-envoy\") pod \"e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:01.398027 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.398008 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/543f7aa8-1e9c-40f6-8481-6951c7191adf-istio-podinfo\") pod \"e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:01.404507 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.404485 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdjw6\" (UniqueName: \"kubernetes.io/projected/543f7aa8-1e9c-40f6-8481-6951c7191adf-kube-api-access-sdjw6\") pod \"e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:01.404742 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.404718 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/543f7aa8-1e9c-40f6-8481-6951c7191adf-istio-token\") pod \"e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:01.540334 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.540232 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:01.703374 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.703289 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj"] Jun 11 23:46:01.706593 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:46:01.706559 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod543f7aa8_1e9c_40f6_8481_6951c7191adf.slice/crio-6ddb5d181ba2c44724d1139a680ffdba31947eb308d997b7ae72e0c46bcada21 WatchSource:0}: Error finding container 6ddb5d181ba2c44724d1139a680ffdba31947eb308d997b7ae72e0c46bcada21: Status 404 returned error can't find the container with id 6ddb5d181ba2c44724d1139a680ffdba31947eb308d997b7ae72e0c46bcada21 Jun 11 23:46:01.708849 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:01.708831 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 23:46:02.243374 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:02.243330 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" event={"ID":"543f7aa8-1e9c-40f6-8481-6951c7191adf","Type":"ContainerStarted","Data":"6ddb5d181ba2c44724d1139a680ffdba31947eb308d997b7ae72e0c46bcada21"} Jun 11 23:46:04.439466 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:04.439425 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 23:46:04.439760 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:04.439501 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 23:46:04.439760 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:04.439529 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 23:46:05.260958 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:05.260922 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" event={"ID":"543f7aa8-1e9c-40f6-8481-6951c7191adf","Type":"ContainerStarted","Data":"3ba8bce66d33f691656c94d5f5c2db8b2bb010adb97d674ce615e4ff7b308278"} Jun 11 23:46:05.285799 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:05.285745 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" podStartSLOduration=1.555623109 podStartE2EDuration="4.285728684s" totalImagesPullingTime="2.730105575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:46:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:46:05.283391701 +0000 UTC m=+2138.706176673" watchObservedRunningTime="2026-06-11 23:46:05.285728684 +0000 UTC m=+2138.708513717" Jun 11 23:46:05.541244 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:05.541149 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:05.546016 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:05.545968 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:06.266627 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:06.266597 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:06.267528 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:06.267509 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:07.741621 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:07.741540 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj"] Jun 11 23:46:08.276993 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:08.276948 2563 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" secret="" err="secret \"e2e-ait-64487bd1-openshift-default-dockercfg-2xsz8\" not found" Jun 11 23:46:09.282001 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:09.281943 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" podUID="543f7aa8-1e9c-40f6-8481-6951c7191adf" containerName="istio-proxy" containerID="cri-o://3ba8bce66d33f691656c94d5f5c2db8b2bb010adb97d674ce615e4ff7b308278" gracePeriod=30 Jun 11 23:46:13.646490 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:13.646453 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d"] Jun 11 23:46:13.650896 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:13.650874 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:13.653631 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:13.653604 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-9a9edf26-openshift-default-dockercfg-djhjr\"" Jun 11 23:46:13.662167 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:13.662145 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d"] Jun 11 23:46:13.719203 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:13.719175 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb637005-28c6-4647-8dcb-75fab9a17e7c-istiod-ca-cert\") pod \"e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:13.719379 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:13.719220 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb637005-28c6-4647-8dcb-75fab9a17e7c-istio-podinfo\") pod \"e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:13.719379 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:13.719284 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb637005-28c6-4647-8dcb-75fab9a17e7c-credential-socket\") pod \"e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:13.719379 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:13.719308 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb637005-28c6-4647-8dcb-75fab9a17e7c-istio-envoy\") pod \"e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:13.719379 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:13.719329 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb637005-28c6-4647-8dcb-75fab9a17e7c-istio-token\") pod \"e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:13.719611 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:13.719449 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb637005-28c6-4647-8dcb-75fab9a17e7c-istio-data\") pod \"e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:13.719611 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:13.719493 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb637005-28c6-4647-8dcb-75fab9a17e7c-workload-socket\") pod \"e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:13.719611 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:13.719539 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb637005-28c6-4647-8dcb-75fab9a17e7c-workload-certs\") pod \"e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:13.719611 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:13.719571 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vg5f\" (UniqueName: \"kubernetes.io/projected/eb637005-28c6-4647-8dcb-75fab9a17e7c-kube-api-access-9vg5f\") pod \"e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:13.820827 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:13.820794 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb637005-28c6-4647-8dcb-75fab9a17e7c-istiod-ca-cert\") pod \"e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:13.821030 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:13.820836 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb637005-28c6-4647-8dcb-75fab9a17e7c-istio-podinfo\") pod \"e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:13.821030 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:13.820973 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb637005-28c6-4647-8dcb-75fab9a17e7c-credential-socket\") pod \"e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:13.821136 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:13.821042 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb637005-28c6-4647-8dcb-75fab9a17e7c-istio-envoy\") pod \"e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:13.821136 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:13.821063 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb637005-28c6-4647-8dcb-75fab9a17e7c-istio-token\") pod \"e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:13.821250 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:13.821158 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb637005-28c6-4647-8dcb-75fab9a17e7c-istio-data\") pod \"e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:13.821250 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:13.821199 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb637005-28c6-4647-8dcb-75fab9a17e7c-workload-socket\") pod \"e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:13.821250 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:13.821238 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb637005-28c6-4647-8dcb-75fab9a17e7c-workload-certs\") pod \"e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:13.821406 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:13.821266 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vg5f\" (UniqueName: \"kubernetes.io/projected/eb637005-28c6-4647-8dcb-75fab9a17e7c-kube-api-access-9vg5f\") pod \"e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:13.821406 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:13.821357 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb637005-28c6-4647-8dcb-75fab9a17e7c-credential-socket\") pod \"e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:13.821601 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:13.821565 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb637005-28c6-4647-8dcb-75fab9a17e7c-istio-data\") pod \"e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:13.821601 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:13.821588 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb637005-28c6-4647-8dcb-75fab9a17e7c-istiod-ca-cert\") pod \"e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:13.821799 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:13.821614 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb637005-28c6-4647-8dcb-75fab9a17e7c-workload-certs\") pod \"e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:13.821799 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:13.821758 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb637005-28c6-4647-8dcb-75fab9a17e7c-workload-socket\") pod \"e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:13.823270 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:13.823250 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb637005-28c6-4647-8dcb-75fab9a17e7c-istio-envoy\") pod \"e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:13.823499 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:13.823483 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb637005-28c6-4647-8dcb-75fab9a17e7c-istio-podinfo\") pod \"e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:13.843308 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:13.843281 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vg5f\" (UniqueName: \"kubernetes.io/projected/eb637005-28c6-4647-8dcb-75fab9a17e7c-kube-api-access-9vg5f\") pod \"e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:13.843411 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:13.843316 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb637005-28c6-4647-8dcb-75fab9a17e7c-istio-token\") pod \"e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:13.964897 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:13.964801 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:14.103703 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.103678 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d"] Jun 11 23:46:14.105633 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:46:14.105605 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb637005_28c6_4647_8dcb_75fab9a17e7c.slice/crio-3e18bdfc24f04295fbba82dbd3d9a2eeaba98c1947fabe5b2f60dcdc22e8086d WatchSource:0}: Error finding container 3e18bdfc24f04295fbba82dbd3d9a2eeaba98c1947fabe5b2f60dcdc22e8086d: Status 404 returned error can't find the container with id 3e18bdfc24f04295fbba82dbd3d9a2eeaba98c1947fabe5b2f60dcdc22e8086d Jun 11 23:46:14.108618 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.108586 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 23:46:14.108692 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.108650 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 23:46:14.108692 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.108679 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 23:46:14.308890 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.308860 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" event={"ID":"eb637005-28c6-4647-8dcb-75fab9a17e7c","Type":"ContainerStarted","Data":"7cad9566a100af5af5d36848064a6000d020309a5afc060e7b00287e9339f296"} Jun 11 23:46:14.309089 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.308929 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" event={"ID":"eb637005-28c6-4647-8dcb-75fab9a17e7c","Type":"ContainerStarted","Data":"3e18bdfc24f04295fbba82dbd3d9a2eeaba98c1947fabe5b2f60dcdc22e8086d"} Jun 11 23:46:14.335672 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.335606 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" podStartSLOduration=1.335586226 podStartE2EDuration="1.335586226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:46:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:46:14.328354223 +0000 UTC m=+2147.751139191" watchObservedRunningTime="2026-06-11 23:46:14.335586226 +0000 UTC m=+2147.758371196" Jun 11 23:46:14.522960 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.522936 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:14.627764 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.627730 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/543f7aa8-1e9c-40f6-8481-6951c7191adf-workload-certs\") pod \"543f7aa8-1e9c-40f6-8481-6951c7191adf\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " Jun 11 23:46:14.627970 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.627773 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/543f7aa8-1e9c-40f6-8481-6951c7191adf-workload-socket\") pod \"543f7aa8-1e9c-40f6-8481-6951c7191adf\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " Jun 11 23:46:14.627970 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.627802 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/543f7aa8-1e9c-40f6-8481-6951c7191adf-istio-envoy\") pod \"543f7aa8-1e9c-40f6-8481-6951c7191adf\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " Jun 11 23:46:14.627970 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.627825 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/543f7aa8-1e9c-40f6-8481-6951c7191adf-istiod-ca-cert\") pod \"543f7aa8-1e9c-40f6-8481-6951c7191adf\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " Jun 11 23:46:14.627970 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.627852 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/543f7aa8-1e9c-40f6-8481-6951c7191adf-istio-podinfo\") pod \"543f7aa8-1e9c-40f6-8481-6951c7191adf\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " Jun 11 23:46:14.627970 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.627949 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/543f7aa8-1e9c-40f6-8481-6951c7191adf-istio-data\") pod \"543f7aa8-1e9c-40f6-8481-6951c7191adf\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " Jun 11 23:46:14.628294 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.628000 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/543f7aa8-1e9c-40f6-8481-6951c7191adf-istio-token\") pod \"543f7aa8-1e9c-40f6-8481-6951c7191adf\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " Jun 11 23:46:14.628294 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.628015 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/543f7aa8-1e9c-40f6-8481-6951c7191adf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "543f7aa8-1e9c-40f6-8481-6951c7191adf" (UID: "543f7aa8-1e9c-40f6-8481-6951c7191adf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:46:14.628294 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.628042 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/543f7aa8-1e9c-40f6-8481-6951c7191adf-credential-socket\") pod \"543f7aa8-1e9c-40f6-8481-6951c7191adf\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " Jun 11 23:46:14.628294 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.628100 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdjw6\" (UniqueName: \"kubernetes.io/projected/543f7aa8-1e9c-40f6-8481-6951c7191adf-kube-api-access-sdjw6\") pod \"543f7aa8-1e9c-40f6-8481-6951c7191adf\" (UID: \"543f7aa8-1e9c-40f6-8481-6951c7191adf\") " Jun 11 23:46:14.628294 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.628149 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/543f7aa8-1e9c-40f6-8481-6951c7191adf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "543f7aa8-1e9c-40f6-8481-6951c7191adf" (UID: "543f7aa8-1e9c-40f6-8481-6951c7191adf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:46:14.628294 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.628263 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/543f7aa8-1e9c-40f6-8481-6951c7191adf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "543f7aa8-1e9c-40f6-8481-6951c7191adf" (UID: "543f7aa8-1e9c-40f6-8481-6951c7191adf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:46:14.628598 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.628306 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/543f7aa8-1e9c-40f6-8481-6951c7191adf-istio-data" (OuterVolumeSpecName: "istio-data") pod "543f7aa8-1e9c-40f6-8481-6951c7191adf" (UID: "543f7aa8-1e9c-40f6-8481-6951c7191adf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:46:14.628598 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.628358 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/543f7aa8-1e9c-40f6-8481-6951c7191adf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "543f7aa8-1e9c-40f6-8481-6951c7191adf" (UID: "543f7aa8-1e9c-40f6-8481-6951c7191adf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:46:14.628598 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.628575 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/543f7aa8-1e9c-40f6-8481-6951c7191adf-workload-certs\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:46:14.628750 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.628601 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/543f7aa8-1e9c-40f6-8481-6951c7191adf-workload-socket\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:46:14.628750 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.628616 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/543f7aa8-1e9c-40f6-8481-6951c7191adf-istiod-ca-cert\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:46:14.628750 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.628640 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/543f7aa8-1e9c-40f6-8481-6951c7191adf-istio-data\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:46:14.628750 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.628652 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/543f7aa8-1e9c-40f6-8481-6951c7191adf-credential-socket\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:46:14.630319 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.630296 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/543f7aa8-1e9c-40f6-8481-6951c7191adf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "543f7aa8-1e9c-40f6-8481-6951c7191adf" (UID: "543f7aa8-1e9c-40f6-8481-6951c7191adf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:46:14.630422 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.630347 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/543f7aa8-1e9c-40f6-8481-6951c7191adf-kube-api-access-sdjw6" (OuterVolumeSpecName: "kube-api-access-sdjw6") pod "543f7aa8-1e9c-40f6-8481-6951c7191adf" (UID: "543f7aa8-1e9c-40f6-8481-6951c7191adf"). InnerVolumeSpecName "kube-api-access-sdjw6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:46:14.630587 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.630570 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/543f7aa8-1e9c-40f6-8481-6951c7191adf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "543f7aa8-1e9c-40f6-8481-6951c7191adf" (UID: "543f7aa8-1e9c-40f6-8481-6951c7191adf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 23:46:14.630657 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.630641 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/543f7aa8-1e9c-40f6-8481-6951c7191adf-istio-token" (OuterVolumeSpecName: "istio-token") pod "543f7aa8-1e9c-40f6-8481-6951c7191adf" (UID: "543f7aa8-1e9c-40f6-8481-6951c7191adf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:46:14.729418 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.729381 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdjw6\" (UniqueName: \"kubernetes.io/projected/543f7aa8-1e9c-40f6-8481-6951c7191adf-kube-api-access-sdjw6\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:46:14.729418 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.729410 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/543f7aa8-1e9c-40f6-8481-6951c7191adf-istio-envoy\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:46:14.729418 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.729420 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/543f7aa8-1e9c-40f6-8481-6951c7191adf-istio-podinfo\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:46:14.729418 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.729427 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/543f7aa8-1e9c-40f6-8481-6951c7191adf-istio-token\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:46:14.965299 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:14.965210 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:15.314771 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:15.314679 2563 generic.go:356] "Generic (PLEG): container finished" podID="543f7aa8-1e9c-40f6-8481-6951c7191adf" containerID="3ba8bce66d33f691656c94d5f5c2db8b2bb010adb97d674ce615e4ff7b308278" exitCode=0 Jun 11 23:46:15.314771 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:15.314733 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" Jun 11 23:46:15.314954 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:15.314765 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" event={"ID":"543f7aa8-1e9c-40f6-8481-6951c7191adf","Type":"ContainerDied","Data":"3ba8bce66d33f691656c94d5f5c2db8b2bb010adb97d674ce615e4ff7b308278"} Jun 11 23:46:15.314954 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:15.314822 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj" event={"ID":"543f7aa8-1e9c-40f6-8481-6951c7191adf","Type":"ContainerDied","Data":"6ddb5d181ba2c44724d1139a680ffdba31947eb308d997b7ae72e0c46bcada21"} Jun 11 23:46:15.314954 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:15.314847 2563 scope.go:117] "RemoveContainer" containerID="3ba8bce66d33f691656c94d5f5c2db8b2bb010adb97d674ce615e4ff7b308278" Jun 11 23:46:15.324042 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:15.324023 2563 scope.go:117] "RemoveContainer" containerID="3ba8bce66d33f691656c94d5f5c2db8b2bb010adb97d674ce615e4ff7b308278" Jun 11 23:46:15.324317 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:46:15.324293 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ba8bce66d33f691656c94d5f5c2db8b2bb010adb97d674ce615e4ff7b308278\": container with ID starting with 3ba8bce66d33f691656c94d5f5c2db8b2bb010adb97d674ce615e4ff7b308278 not found: ID does not exist" containerID="3ba8bce66d33f691656c94d5f5c2db8b2bb010adb97d674ce615e4ff7b308278" Jun 11 23:46:15.324400 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:15.324326 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ba8bce66d33f691656c94d5f5c2db8b2bb010adb97d674ce615e4ff7b308278"} err="failed to get container status \"3ba8bce66d33f691656c94d5f5c2db8b2bb010adb97d674ce615e4ff7b308278\": rpc error: code = NotFound desc = could not find container \"3ba8bce66d33f691656c94d5f5c2db8b2bb010adb97d674ce615e4ff7b308278\": container with ID starting with 3ba8bce66d33f691656c94d5f5c2db8b2bb010adb97d674ce615e4ff7b308278 not found: ID does not exist" Jun 11 23:46:15.334775 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:15.334748 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj"] Jun 11 23:46:15.341347 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:15.341326 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-64487bd1-openshift-default-77b4ffc58b-vnpwj"] Jun 11 23:46:15.971411 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:15.971381 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:16.320863 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:16.320782 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:16.321760 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:16.321740 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:17.005791 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:17.005758 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="543f7aa8-1e9c-40f6-8481-6951c7191adf" path="/var/lib/kubelet/pods/543f7aa8-1e9c-40f6-8481-6951c7191adf/volumes" Jun 11 23:46:21.255239 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:21.255202 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d"] Jun 11 23:46:21.255662 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:21.255396 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" podUID="eb637005-28c6-4647-8dcb-75fab9a17e7c" containerName="istio-proxy" containerID="cri-o://7cad9566a100af5af5d36848064a6000d020309a5afc060e7b00287e9339f296" gracePeriod=30 Jun 11 23:46:26.387677 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:26.387645 2563 generic.go:356] "Generic (PLEG): container finished" podID="eb637005-28c6-4647-8dcb-75fab9a17e7c" containerID="7cad9566a100af5af5d36848064a6000d020309a5afc060e7b00287e9339f296" exitCode=0 Jun 11 23:46:26.388031 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:26.387715 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" event={"ID":"eb637005-28c6-4647-8dcb-75fab9a17e7c","Type":"ContainerDied","Data":"7cad9566a100af5af5d36848064a6000d020309a5afc060e7b00287e9339f296"} Jun 11 23:46:26.505883 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:26.505850 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:26.649627 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:26.649600 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vg5f\" (UniqueName: \"kubernetes.io/projected/eb637005-28c6-4647-8dcb-75fab9a17e7c-kube-api-access-9vg5f\") pod \"eb637005-28c6-4647-8dcb-75fab9a17e7c\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " Jun 11 23:46:26.649790 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:26.649653 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb637005-28c6-4647-8dcb-75fab9a17e7c-workload-socket\") pod \"eb637005-28c6-4647-8dcb-75fab9a17e7c\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " Jun 11 23:46:26.649790 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:26.649689 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb637005-28c6-4647-8dcb-75fab9a17e7c-workload-certs\") pod \"eb637005-28c6-4647-8dcb-75fab9a17e7c\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " Jun 11 23:46:26.649790 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:26.649711 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb637005-28c6-4647-8dcb-75fab9a17e7c-istiod-ca-cert\") pod \"eb637005-28c6-4647-8dcb-75fab9a17e7c\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " Jun 11 23:46:26.649790 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:26.649744 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb637005-28c6-4647-8dcb-75fab9a17e7c-istio-token\") pod \"eb637005-28c6-4647-8dcb-75fab9a17e7c\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " Jun 11 23:46:26.649790 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:26.649779 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb637005-28c6-4647-8dcb-75fab9a17e7c-credential-socket\") pod \"eb637005-28c6-4647-8dcb-75fab9a17e7c\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " Jun 11 23:46:26.650029 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:26.649824 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb637005-28c6-4647-8dcb-75fab9a17e7c-istio-envoy\") pod \"eb637005-28c6-4647-8dcb-75fab9a17e7c\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " Jun 11 23:46:26.650029 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:26.649849 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb637005-28c6-4647-8dcb-75fab9a17e7c-istio-data\") pod \"eb637005-28c6-4647-8dcb-75fab9a17e7c\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " Jun 11 23:46:26.650029 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:26.649895 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb637005-28c6-4647-8dcb-75fab9a17e7c-istio-podinfo\") pod \"eb637005-28c6-4647-8dcb-75fab9a17e7c\" (UID: \"eb637005-28c6-4647-8dcb-75fab9a17e7c\") " Jun 11 23:46:26.650184 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:26.650060 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb637005-28c6-4647-8dcb-75fab9a17e7c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eb637005-28c6-4647-8dcb-75fab9a17e7c" (UID: "eb637005-28c6-4647-8dcb-75fab9a17e7c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:46:26.650300 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:26.650186 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb637005-28c6-4647-8dcb-75fab9a17e7c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eb637005-28c6-4647-8dcb-75fab9a17e7c" (UID: "eb637005-28c6-4647-8dcb-75fab9a17e7c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:46:26.650300 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:26.650284 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb637005-28c6-4647-8dcb-75fab9a17e7c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eb637005-28c6-4647-8dcb-75fab9a17e7c" (UID: "eb637005-28c6-4647-8dcb-75fab9a17e7c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:46:26.650427 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:26.650343 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb637005-28c6-4647-8dcb-75fab9a17e7c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eb637005-28c6-4647-8dcb-75fab9a17e7c" (UID: "eb637005-28c6-4647-8dcb-75fab9a17e7c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:46:26.650506 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:26.650475 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb637005-28c6-4647-8dcb-75fab9a17e7c-istio-data" (OuterVolumeSpecName: "istio-data") pod "eb637005-28c6-4647-8dcb-75fab9a17e7c" (UID: "eb637005-28c6-4647-8dcb-75fab9a17e7c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:46:26.650785 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:26.650764 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb637005-28c6-4647-8dcb-75fab9a17e7c-istiod-ca-cert\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:46:26.650785 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:26.650792 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb637005-28c6-4647-8dcb-75fab9a17e7c-credential-socket\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:46:26.650935 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:26.650808 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb637005-28c6-4647-8dcb-75fab9a17e7c-istio-data\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:46:26.650935 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:26.650825 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb637005-28c6-4647-8dcb-75fab9a17e7c-workload-socket\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:46:26.650935 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:26.650839 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb637005-28c6-4647-8dcb-75fab9a17e7c-workload-certs\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:46:26.652180 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:26.652155 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eb637005-28c6-4647-8dcb-75fab9a17e7c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eb637005-28c6-4647-8dcb-75fab9a17e7c" (UID: "eb637005-28c6-4647-8dcb-75fab9a17e7c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 23:46:26.652394 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:26.652364 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb637005-28c6-4647-8dcb-75fab9a17e7c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eb637005-28c6-4647-8dcb-75fab9a17e7c" (UID: "eb637005-28c6-4647-8dcb-75fab9a17e7c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:46:26.652394 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:26.652367 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb637005-28c6-4647-8dcb-75fab9a17e7c-kube-api-access-9vg5f" (OuterVolumeSpecName: "kube-api-access-9vg5f") pod "eb637005-28c6-4647-8dcb-75fab9a17e7c" (UID: "eb637005-28c6-4647-8dcb-75fab9a17e7c"). InnerVolumeSpecName "kube-api-access-9vg5f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:46:26.652542 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:26.652444 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb637005-28c6-4647-8dcb-75fab9a17e7c-istio-token" (OuterVolumeSpecName: "istio-token") pod "eb637005-28c6-4647-8dcb-75fab9a17e7c" (UID: "eb637005-28c6-4647-8dcb-75fab9a17e7c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:46:26.751484 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:26.751447 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vg5f\" (UniqueName: \"kubernetes.io/projected/eb637005-28c6-4647-8dcb-75fab9a17e7c-kube-api-access-9vg5f\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:46:26.751484 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:26.751478 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb637005-28c6-4647-8dcb-75fab9a17e7c-istio-token\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:46:26.751484 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:26.751492 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb637005-28c6-4647-8dcb-75fab9a17e7c-istio-envoy\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:46:26.751726 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:26.751505 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb637005-28c6-4647-8dcb-75fab9a17e7c-istio-podinfo\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:46:27.248605 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.248572 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z"] Jun 11 23:46:27.249238 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.249203 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="543f7aa8-1e9c-40f6-8481-6951c7191adf" containerName="istio-proxy" Jun 11 23:46:27.249238 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.249227 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="543f7aa8-1e9c-40f6-8481-6951c7191adf" containerName="istio-proxy" Jun 11 23:46:27.249445 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.249247 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb637005-28c6-4647-8dcb-75fab9a17e7c" containerName="istio-proxy" Jun 11 23:46:27.249445 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.249256 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb637005-28c6-4647-8dcb-75fab9a17e7c" containerName="istio-proxy" Jun 11 23:46:27.249445 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.249344 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="543f7aa8-1e9c-40f6-8481-6951c7191adf" containerName="istio-proxy" Jun 11 23:46:27.249445 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.249359 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb637005-28c6-4647-8dcb-75fab9a17e7c" containerName="istio-proxy" Jun 11 23:46:27.253117 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.253062 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" Jun 11 23:46:27.256663 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.256643 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-invalid-810bd9e5-openshift-default-dockercfg-vwhdw\"" Jun 11 23:46:27.269915 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.269892 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z"] Jun 11 23:46:27.356432 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.356387 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28ff04d8-16bf-416f-8815-7326679f6a9b-istio-envoy\") pod \"e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" Jun 11 23:46:27.356620 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.356474 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28ff04d8-16bf-416f-8815-7326679f6a9b-credential-socket\") pod \"e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" Jun 11 23:46:27.356620 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.356499 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms5zr\" (UniqueName: \"kubernetes.io/projected/28ff04d8-16bf-416f-8815-7326679f6a9b-kube-api-access-ms5zr\") pod \"e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" Jun 11 23:46:27.356620 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.356524 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28ff04d8-16bf-416f-8815-7326679f6a9b-istio-data\") pod \"e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" Jun 11 23:46:27.356762 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.356639 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28ff04d8-16bf-416f-8815-7326679f6a9b-workload-socket\") pod \"e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" Jun 11 23:46:27.356762 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.356675 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28ff04d8-16bf-416f-8815-7326679f6a9b-workload-certs\") pod \"e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" Jun 11 23:46:27.356762 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.356699 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28ff04d8-16bf-416f-8815-7326679f6a9b-istio-token\") pod \"e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" Jun 11 23:46:27.356882 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.356772 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28ff04d8-16bf-416f-8815-7326679f6a9b-istiod-ca-cert\") pod \"e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" Jun 11 23:46:27.356882 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.356800 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28ff04d8-16bf-416f-8815-7326679f6a9b-istio-podinfo\") pod \"e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" Jun 11 23:46:27.394753 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.394722 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" Jun 11 23:46:27.394753 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.394736 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d" event={"ID":"eb637005-28c6-4647-8dcb-75fab9a17e7c","Type":"ContainerDied","Data":"3e18bdfc24f04295fbba82dbd3d9a2eeaba98c1947fabe5b2f60dcdc22e8086d"} Jun 11 23:46:27.395229 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.394797 2563 scope.go:117] "RemoveContainer" containerID="7cad9566a100af5af5d36848064a6000d020309a5afc060e7b00287e9339f296" Jun 11 23:46:27.414938 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.414905 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d"] Jun 11 23:46:27.417361 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.417334 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-9a9edf26-openshift-default-847c7d9974-8cg8d"] Jun 11 23:46:27.458311 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.458277 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28ff04d8-16bf-416f-8815-7326679f6a9b-credential-socket\") pod \"e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" Jun 11 23:46:27.458311 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.458312 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms5zr\" (UniqueName: \"kubernetes.io/projected/28ff04d8-16bf-416f-8815-7326679f6a9b-kube-api-access-ms5zr\") pod \"e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" Jun 11 23:46:27.458545 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.458343 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28ff04d8-16bf-416f-8815-7326679f6a9b-istio-data\") pod \"e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" Jun 11 23:46:27.458545 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.458384 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28ff04d8-16bf-416f-8815-7326679f6a9b-workload-socket\") pod \"e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" Jun 11 23:46:27.458545 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.458400 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28ff04d8-16bf-416f-8815-7326679f6a9b-workload-certs\") pod \"e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" Jun 11 23:46:27.458545 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.458421 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28ff04d8-16bf-416f-8815-7326679f6a9b-istio-token\") pod \"e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" Jun 11 23:46:27.458545 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.458464 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28ff04d8-16bf-416f-8815-7326679f6a9b-istiod-ca-cert\") pod \"e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" Jun 11 23:46:27.458545 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.458491 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28ff04d8-16bf-416f-8815-7326679f6a9b-istio-podinfo\") pod \"e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" Jun 11 23:46:27.458545 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.458545 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28ff04d8-16bf-416f-8815-7326679f6a9b-istio-envoy\") pod \"e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" Jun 11 23:46:27.458878 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.458784 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28ff04d8-16bf-416f-8815-7326679f6a9b-credential-socket\") pod \"e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" Jun 11 23:46:27.458878 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.458804 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28ff04d8-16bf-416f-8815-7326679f6a9b-istio-data\") pod \"e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" Jun 11 23:46:27.458878 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.458831 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28ff04d8-16bf-416f-8815-7326679f6a9b-workload-socket\") pod \"e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" Jun 11 23:46:27.459172 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.459143 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28ff04d8-16bf-416f-8815-7326679f6a9b-workload-certs\") pod \"e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" Jun 11 23:46:27.459269 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.459241 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28ff04d8-16bf-416f-8815-7326679f6a9b-istiod-ca-cert\") pod \"e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" Jun 11 23:46:27.460853 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.460824 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28ff04d8-16bf-416f-8815-7326679f6a9b-istio-envoy\") pod \"e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" Jun 11 23:46:27.461122 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.461102 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28ff04d8-16bf-416f-8815-7326679f6a9b-istio-podinfo\") pod \"e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" Jun 11 23:46:27.466920 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.466896 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28ff04d8-16bf-416f-8815-7326679f6a9b-istio-token\") pod \"e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" Jun 11 23:46:27.467073 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.467002 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms5zr\" (UniqueName: \"kubernetes.io/projected/28ff04d8-16bf-416f-8815-7326679f6a9b-kube-api-access-ms5zr\") pod \"e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" Jun 11 23:46:27.564796 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.564704 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" Jun 11 23:46:27.707521 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.707489 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z"] Jun 11 23:46:27.708988 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:46:27.708946 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28ff04d8_16bf_416f_8815_7326679f6a9b.slice/crio-eb176671f72c44a450b9b549ab57aad2993ae9f75034c778b4e2b80b15d376b5 WatchSource:0}: Error finding container eb176671f72c44a450b9b549ab57aad2993ae9f75034c778b4e2b80b15d376b5: Status 404 returned error can't find the container with id eb176671f72c44a450b9b549ab57aad2993ae9f75034c778b4e2b80b15d376b5 Jun 11 23:46:27.711135 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.711105 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 23:46:27.711217 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.711168 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 23:46:27.711217 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.711196 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 23:46:27.869553 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:27.869517 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z"] Jun 11 23:46:28.401535 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:28.401502 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" event={"ID":"28ff04d8-16bf-416f-8815-7326679f6a9b","Type":"ContainerStarted","Data":"d79e6192c1c1e65cbf779d7e4a1f34da83fad2a777b62e46965d7c8886613002"} Jun 11 23:46:28.402024 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:28.401558 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" event={"ID":"28ff04d8-16bf-416f-8815-7326679f6a9b","Type":"ContainerStarted","Data":"eb176671f72c44a450b9b549ab57aad2993ae9f75034c778b4e2b80b15d376b5"} Jun 11 23:46:28.402024 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:28.401745 2563 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" secret="" err="secret \"e2e-invalid-810bd9e5-openshift-default-dockercfg-vwhdw\" not found" Jun 11 23:46:28.428851 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:28.428803 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" podStartSLOduration=1.428788154 podStartE2EDuration="1.428788154s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:46:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:46:28.426904958 +0000 UTC m=+2161.849689927" watchObservedRunningTime="2026-06-11 23:46:28.428788154 +0000 UTC m=+2161.851573180" Jun 11 23:46:28.565055 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:28.565022 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" Jun 11 23:46:28.566566 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:28.566541 2563 patch_prober.go:28] interesting pod/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jun 11 23:46:28.566705 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:28.566589 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" podUID="28ff04d8-16bf-416f-8815-7326679f6a9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jun 11 23:46:29.007826 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:29.007793 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb637005-28c6-4647-8dcb-75fab9a17e7c" path="/var/lib/kubelet/pods/eb637005-28c6-4647-8dcb-75fab9a17e7c/volumes" Jun 11 23:46:29.407157 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:29.407121 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" podUID="28ff04d8-16bf-416f-8815-7326679f6a9b" containerName="istio-proxy" containerID="cri-o://d79e6192c1c1e65cbf779d7e4a1f34da83fad2a777b62e46965d7c8886613002" gracePeriod=30 Jun 11 23:46:34.662725 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:34.662698 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" Jun 11 23:46:34.729534 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:34.729446 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28ff04d8-16bf-416f-8815-7326679f6a9b-credential-socket\") pod \"28ff04d8-16bf-416f-8815-7326679f6a9b\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " Jun 11 23:46:34.729534 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:34.729483 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28ff04d8-16bf-416f-8815-7326679f6a9b-istio-data\") pod \"28ff04d8-16bf-416f-8815-7326679f6a9b\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " Jun 11 23:46:34.729534 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:34.729531 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28ff04d8-16bf-416f-8815-7326679f6a9b-istiod-ca-cert\") pod \"28ff04d8-16bf-416f-8815-7326679f6a9b\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " Jun 11 23:46:34.729820 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:34.729577 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28ff04d8-16bf-416f-8815-7326679f6a9b-istio-envoy\") pod \"28ff04d8-16bf-416f-8815-7326679f6a9b\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " Jun 11 23:46:34.729820 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:34.729602 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28ff04d8-16bf-416f-8815-7326679f6a9b-workload-socket\") pod \"28ff04d8-16bf-416f-8815-7326679f6a9b\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " Jun 11 23:46:34.729820 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:34.729624 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28ff04d8-16bf-416f-8815-7326679f6a9b-workload-certs\") pod \"28ff04d8-16bf-416f-8815-7326679f6a9b\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " Jun 11 23:46:34.729820 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:34.729678 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ms5zr\" (UniqueName: \"kubernetes.io/projected/28ff04d8-16bf-416f-8815-7326679f6a9b-kube-api-access-ms5zr\") pod \"28ff04d8-16bf-416f-8815-7326679f6a9b\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " Jun 11 23:46:34.729820 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:34.729746 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28ff04d8-16bf-416f-8815-7326679f6a9b-istio-token\") pod \"28ff04d8-16bf-416f-8815-7326679f6a9b\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " Jun 11 23:46:34.729820 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:34.729757 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28ff04d8-16bf-416f-8815-7326679f6a9b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "28ff04d8-16bf-416f-8815-7326679f6a9b" (UID: "28ff04d8-16bf-416f-8815-7326679f6a9b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:46:34.729820 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:34.729774 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28ff04d8-16bf-416f-8815-7326679f6a9b-istio-podinfo\") pod \"28ff04d8-16bf-416f-8815-7326679f6a9b\" (UID: \"28ff04d8-16bf-416f-8815-7326679f6a9b\") " Jun 11 23:46:34.730209 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:34.729832 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28ff04d8-16bf-416f-8815-7326679f6a9b-istio-data" (OuterVolumeSpecName: "istio-data") pod "28ff04d8-16bf-416f-8815-7326679f6a9b" (UID: "28ff04d8-16bf-416f-8815-7326679f6a9b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:46:34.730209 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:34.730042 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28ff04d8-16bf-416f-8815-7326679f6a9b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "28ff04d8-16bf-416f-8815-7326679f6a9b" (UID: "28ff04d8-16bf-416f-8815-7326679f6a9b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:46:34.730209 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:34.730080 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28ff04d8-16bf-416f-8815-7326679f6a9b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "28ff04d8-16bf-416f-8815-7326679f6a9b" (UID: "28ff04d8-16bf-416f-8815-7326679f6a9b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:46:34.730209 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:34.730205 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28ff04d8-16bf-416f-8815-7326679f6a9b-workload-certs\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:46:34.730396 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:34.730227 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28ff04d8-16bf-416f-8815-7326679f6a9b-credential-socket\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:46:34.730396 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:34.730244 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28ff04d8-16bf-416f-8815-7326679f6a9b-istio-data\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:46:34.730396 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:34.730317 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28ff04d8-16bf-416f-8815-7326679f6a9b-istiod-ca-cert\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:46:34.730396 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:34.730364 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28ff04d8-16bf-416f-8815-7326679f6a9b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "28ff04d8-16bf-416f-8815-7326679f6a9b" (UID: "28ff04d8-16bf-416f-8815-7326679f6a9b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:46:34.731838 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:34.731809 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28ff04d8-16bf-416f-8815-7326679f6a9b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "28ff04d8-16bf-416f-8815-7326679f6a9b" (UID: "28ff04d8-16bf-416f-8815-7326679f6a9b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:46:34.731952 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:34.731895 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/28ff04d8-16bf-416f-8815-7326679f6a9b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "28ff04d8-16bf-416f-8815-7326679f6a9b" (UID: "28ff04d8-16bf-416f-8815-7326679f6a9b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 23:46:34.732282 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:34.732256 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28ff04d8-16bf-416f-8815-7326679f6a9b-kube-api-access-ms5zr" (OuterVolumeSpecName: "kube-api-access-ms5zr") pod "28ff04d8-16bf-416f-8815-7326679f6a9b" (UID: "28ff04d8-16bf-416f-8815-7326679f6a9b"). InnerVolumeSpecName "kube-api-access-ms5zr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:46:34.732282 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:34.732265 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28ff04d8-16bf-416f-8815-7326679f6a9b-istio-token" (OuterVolumeSpecName: "istio-token") pod "28ff04d8-16bf-416f-8815-7326679f6a9b" (UID: "28ff04d8-16bf-416f-8815-7326679f6a9b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:46:34.830836 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:34.830796 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ms5zr\" (UniqueName: \"kubernetes.io/projected/28ff04d8-16bf-416f-8815-7326679f6a9b-kube-api-access-ms5zr\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:46:34.830836 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:34.830829 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28ff04d8-16bf-416f-8815-7326679f6a9b-istio-token\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:46:34.830836 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:34.830838 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28ff04d8-16bf-416f-8815-7326679f6a9b-istio-podinfo\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:46:34.830836 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:34.830846 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28ff04d8-16bf-416f-8815-7326679f6a9b-istio-envoy\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:46:34.831151 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:34.830857 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28ff04d8-16bf-416f-8815-7326679f6a9b-workload-socket\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:46:35.442545 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:35.442508 2563 generic.go:356] "Generic (PLEG): container finished" podID="28ff04d8-16bf-416f-8815-7326679f6a9b" containerID="d79e6192c1c1e65cbf779d7e4a1f34da83fad2a777b62e46965d7c8886613002" exitCode=0 Jun 11 23:46:35.442545 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:35.442549 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" event={"ID":"28ff04d8-16bf-416f-8815-7326679f6a9b","Type":"ContainerDied","Data":"d79e6192c1c1e65cbf779d7e4a1f34da83fad2a777b62e46965d7c8886613002"} Jun 11 23:46:35.442761 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:35.442563 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" Jun 11 23:46:35.442761 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:35.442620 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z" event={"ID":"28ff04d8-16bf-416f-8815-7326679f6a9b","Type":"ContainerDied","Data":"eb176671f72c44a450b9b549ab57aad2993ae9f75034c778b4e2b80b15d376b5"} Jun 11 23:46:35.442761 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:35.442643 2563 scope.go:117] "RemoveContainer" containerID="d79e6192c1c1e65cbf779d7e4a1f34da83fad2a777b62e46965d7c8886613002" Jun 11 23:46:35.451333 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:35.451308 2563 scope.go:117] "RemoveContainer" containerID="d79e6192c1c1e65cbf779d7e4a1f34da83fad2a777b62e46965d7c8886613002" Jun 11 23:46:35.451610 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:46:35.451593 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d79e6192c1c1e65cbf779d7e4a1f34da83fad2a777b62e46965d7c8886613002\": container with ID starting with d79e6192c1c1e65cbf779d7e4a1f34da83fad2a777b62e46965d7c8886613002 not found: ID does not exist" containerID="d79e6192c1c1e65cbf779d7e4a1f34da83fad2a777b62e46965d7c8886613002" Jun 11 23:46:35.451661 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:35.451619 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d79e6192c1c1e65cbf779d7e4a1f34da83fad2a777b62e46965d7c8886613002"} err="failed to get container status \"d79e6192c1c1e65cbf779d7e4a1f34da83fad2a777b62e46965d7c8886613002\": rpc error: code = NotFound desc = could not find container \"d79e6192c1c1e65cbf779d7e4a1f34da83fad2a777b62e46965d7c8886613002\": container with ID starting with d79e6192c1c1e65cbf779d7e4a1f34da83fad2a777b62e46965d7c8886613002 not found: ID does not exist" Jun 11 23:46:35.461234 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:35.461209 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z"] Jun 11 23:46:35.464100 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:35.464078 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-invalid-810bd9e5-openshift-default-575575cd4-r666z"] Jun 11 23:46:37.005579 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:46:37.005549 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28ff04d8-16bf-416f-8815-7326679f6a9b" path="/var/lib/kubelet/pods/28ff04d8-16bf-416f-8815-7326679f6a9b/volumes" Jun 11 23:48:11.492411 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.492380 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f"] Jun 11 23:48:11.492812 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.492761 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28ff04d8-16bf-416f-8815-7326679f6a9b" containerName="istio-proxy" Jun 11 23:48:11.492812 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.492774 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="28ff04d8-16bf-416f-8815-7326679f6a9b" containerName="istio-proxy" Jun 11 23:48:11.492897 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.492848 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="28ff04d8-16bf-416f-8815-7326679f6a9b" containerName="istio-proxy" Jun 11 23:48:11.496024 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.496009 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:11.500410 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.500385 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-7c22f708-openshift-default-dockercfg-45vqv\"" Jun 11 23:48:11.500539 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.500448 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 23:48:11.534684 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.534656 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/025e8623-4c51-4098-a125-dd90f1f29fe8-istiod-ca-cert\") pod \"e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:11.534826 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.534691 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/025e8623-4c51-4098-a125-dd90f1f29fe8-istio-podinfo\") pod \"e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:11.534826 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.534723 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/025e8623-4c51-4098-a125-dd90f1f29fe8-istio-token\") pod \"e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:11.534903 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.534824 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb8kc\" (UniqueName: \"kubernetes.io/projected/025e8623-4c51-4098-a125-dd90f1f29fe8-kube-api-access-wb8kc\") pod \"e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:11.534903 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.534854 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/025e8623-4c51-4098-a125-dd90f1f29fe8-workload-certs\") pod \"e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:11.534903 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.534880 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/025e8623-4c51-4098-a125-dd90f1f29fe8-istio-envoy\") pod \"e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:11.535035 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.534932 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/025e8623-4c51-4098-a125-dd90f1f29fe8-workload-socket\") pod \"e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:11.535035 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.534970 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/025e8623-4c51-4098-a125-dd90f1f29fe8-credential-socket\") pod \"e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:11.535035 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.535017 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/025e8623-4c51-4098-a125-dd90f1f29fe8-istio-data\") pod \"e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:11.603225 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.603188 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f"] Jun 11 23:48:11.636370 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.636334 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/025e8623-4c51-4098-a125-dd90f1f29fe8-istiod-ca-cert\") pod \"e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:11.636370 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.636369 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/025e8623-4c51-4098-a125-dd90f1f29fe8-istio-podinfo\") pod \"e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:11.636602 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.636404 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/025e8623-4c51-4098-a125-dd90f1f29fe8-istio-token\") pod \"e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:11.636602 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.636452 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb8kc\" (UniqueName: \"kubernetes.io/projected/025e8623-4c51-4098-a125-dd90f1f29fe8-kube-api-access-wb8kc\") pod \"e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:11.636602 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.636480 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/025e8623-4c51-4098-a125-dd90f1f29fe8-workload-certs\") pod \"e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:11.636602 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.636507 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/025e8623-4c51-4098-a125-dd90f1f29fe8-istio-envoy\") pod \"e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:11.636602 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.636542 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/025e8623-4c51-4098-a125-dd90f1f29fe8-workload-socket\") pod \"e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:11.636602 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.636575 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/025e8623-4c51-4098-a125-dd90f1f29fe8-credential-socket\") pod \"e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:11.636942 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.636621 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/025e8623-4c51-4098-a125-dd90f1f29fe8-istio-data\") pod \"e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:11.636942 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.636867 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/025e8623-4c51-4098-a125-dd90f1f29fe8-workload-certs\") pod \"e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:11.637104 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.637055 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/025e8623-4c51-4098-a125-dd90f1f29fe8-istio-data\") pod \"e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:11.637157 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.637132 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/025e8623-4c51-4098-a125-dd90f1f29fe8-workload-socket\") pod \"e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:11.637212 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.637153 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/025e8623-4c51-4098-a125-dd90f1f29fe8-istiod-ca-cert\") pod \"e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:11.637212 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.637132 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/025e8623-4c51-4098-a125-dd90f1f29fe8-credential-socket\") pod \"e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:11.638926 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.638900 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/025e8623-4c51-4098-a125-dd90f1f29fe8-istio-envoy\") pod \"e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:11.639110 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.639092 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/025e8623-4c51-4098-a125-dd90f1f29fe8-istio-podinfo\") pod \"e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:11.649449 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.649425 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/025e8623-4c51-4098-a125-dd90f1f29fe8-istio-token\") pod \"e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:11.660024 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.659999 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb8kc\" (UniqueName: \"kubernetes.io/projected/025e8623-4c51-4098-a125-dd90f1f29fe8-kube-api-access-wb8kc\") pod \"e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:11.808083 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.807964 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:11.945100 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.945071 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f"] Jun 11 23:48:11.946870 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:48:11.946841 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod025e8623_4c51_4098_a125_dd90f1f29fe8.slice/crio-c99a6ac3220e595e2f103f83cefd7d0ab292dc40f570b53fe29e9b27ad7dc883 WatchSource:0}: Error finding container c99a6ac3220e595e2f103f83cefd7d0ab292dc40f570b53fe29e9b27ad7dc883: Status 404 returned error can't find the container with id c99a6ac3220e595e2f103f83cefd7d0ab292dc40f570b53fe29e9b27ad7dc883 Jun 11 23:48:11.948904 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.948875 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 23:48:11.948961 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.948941 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 23:48:11.949020 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:11.949002 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 23:48:12.909641 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:12.909604 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" event={"ID":"025e8623-4c51-4098-a125-dd90f1f29fe8","Type":"ContainerStarted","Data":"95b3c2724f331d3c2627f575a548dd3a272897af71d24f2e789ad04a2c11a5db"} Jun 11 23:48:12.910059 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:12.909662 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" event={"ID":"025e8623-4c51-4098-a125-dd90f1f29fe8","Type":"ContainerStarted","Data":"c99a6ac3220e595e2f103f83cefd7d0ab292dc40f570b53fe29e9b27ad7dc883"} Jun 11 23:48:12.931495 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:12.931444 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" podStartSLOduration=1.9314286109999999 podStartE2EDuration="1.931428611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:48:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:48:12.929617444 +0000 UTC m=+2266.352402419" watchObservedRunningTime="2026-06-11 23:48:12.931428611 +0000 UTC m=+2266.354213652" Jun 11 23:48:13.808222 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:13.808189 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:13.813256 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:13.813230 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:13.914554 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:13.914523 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:13.915670 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:13.915647 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:30.826393 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:30.826356 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f"] Jun 11 23:48:30.826812 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:30.826554 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" podUID="025e8623-4c51-4098-a125-dd90f1f29fe8" containerName="istio-proxy" containerID="cri-o://95b3c2724f331d3c2627f575a548dd3a272897af71d24f2e789ad04a2c11a5db" gracePeriod=30 Jun 11 23:48:36.033476 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:36.033444 2563 generic.go:356] "Generic (PLEG): container finished" podID="025e8623-4c51-4098-a125-dd90f1f29fe8" containerID="95b3c2724f331d3c2627f575a548dd3a272897af71d24f2e789ad04a2c11a5db" exitCode=0 Jun 11 23:48:36.033816 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:36.033520 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" event={"ID":"025e8623-4c51-4098-a125-dd90f1f29fe8","Type":"ContainerDied","Data":"95b3c2724f331d3c2627f575a548dd3a272897af71d24f2e789ad04a2c11a5db"} Jun 11 23:48:36.070357 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:36.070331 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:36.175129 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:36.175099 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/025e8623-4c51-4098-a125-dd90f1f29fe8-istio-token\") pod \"025e8623-4c51-4098-a125-dd90f1f29fe8\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " Jun 11 23:48:36.175297 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:36.175173 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/025e8623-4c51-4098-a125-dd90f1f29fe8-credential-socket\") pod \"025e8623-4c51-4098-a125-dd90f1f29fe8\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " Jun 11 23:48:36.175297 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:36.175276 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/025e8623-4c51-4098-a125-dd90f1f29fe8-workload-socket\") pod \"025e8623-4c51-4098-a125-dd90f1f29fe8\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " Jun 11 23:48:36.175498 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:36.175332 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/025e8623-4c51-4098-a125-dd90f1f29fe8-istio-envoy\") pod \"025e8623-4c51-4098-a125-dd90f1f29fe8\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " Jun 11 23:48:36.175498 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:36.175394 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/025e8623-4c51-4098-a125-dd90f1f29fe8-istio-data\") pod \"025e8623-4c51-4098-a125-dd90f1f29fe8\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " Jun 11 23:48:36.175498 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:36.175422 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/025e8623-4c51-4098-a125-dd90f1f29fe8-workload-certs\") pod \"025e8623-4c51-4098-a125-dd90f1f29fe8\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " Jun 11 23:48:36.175498 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:36.175426 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/025e8623-4c51-4098-a125-dd90f1f29fe8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "025e8623-4c51-4098-a125-dd90f1f29fe8" (UID: "025e8623-4c51-4098-a125-dd90f1f29fe8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:48:36.175498 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:36.175449 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/025e8623-4c51-4098-a125-dd90f1f29fe8-istiod-ca-cert\") pod \"025e8623-4c51-4098-a125-dd90f1f29fe8\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " Jun 11 23:48:36.175498 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:36.175476 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wb8kc\" (UniqueName: \"kubernetes.io/projected/025e8623-4c51-4098-a125-dd90f1f29fe8-kube-api-access-wb8kc\") pod \"025e8623-4c51-4098-a125-dd90f1f29fe8\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " Jun 11 23:48:36.175860 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:36.175547 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/025e8623-4c51-4098-a125-dd90f1f29fe8-istio-podinfo\") pod \"025e8623-4c51-4098-a125-dd90f1f29fe8\" (UID: \"025e8623-4c51-4098-a125-dd90f1f29fe8\") " Jun 11 23:48:36.175860 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:36.175613 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/025e8623-4c51-4098-a125-dd90f1f29fe8-istio-data" (OuterVolumeSpecName: "istio-data") pod "025e8623-4c51-4098-a125-dd90f1f29fe8" (UID: "025e8623-4c51-4098-a125-dd90f1f29fe8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:48:36.175860 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:36.175625 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/025e8623-4c51-4098-a125-dd90f1f29fe8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "025e8623-4c51-4098-a125-dd90f1f29fe8" (UID: "025e8623-4c51-4098-a125-dd90f1f29fe8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:48:36.175860 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:36.175662 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/025e8623-4c51-4098-a125-dd90f1f29fe8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "025e8623-4c51-4098-a125-dd90f1f29fe8" (UID: "025e8623-4c51-4098-a125-dd90f1f29fe8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:48:36.176108 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:36.175923 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/025e8623-4c51-4098-a125-dd90f1f29fe8-credential-socket\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:48:36.176108 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:36.175946 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/025e8623-4c51-4098-a125-dd90f1f29fe8-workload-socket\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:48:36.176108 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:36.175961 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/025e8623-4c51-4098-a125-dd90f1f29fe8-istio-data\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:48:36.176108 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:36.175991 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/025e8623-4c51-4098-a125-dd90f1f29fe8-workload-certs\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:48:36.176108 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:36.176034 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/025e8623-4c51-4098-a125-dd90f1f29fe8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "025e8623-4c51-4098-a125-dd90f1f29fe8" (UID: "025e8623-4c51-4098-a125-dd90f1f29fe8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:48:36.177503 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:36.177479 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/025e8623-4c51-4098-a125-dd90f1f29fe8-istio-token" (OuterVolumeSpecName: "istio-token") pod "025e8623-4c51-4098-a125-dd90f1f29fe8" (UID: "025e8623-4c51-4098-a125-dd90f1f29fe8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:48:36.177592 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:36.177479 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/025e8623-4c51-4098-a125-dd90f1f29fe8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "025e8623-4c51-4098-a125-dd90f1f29fe8" (UID: "025e8623-4c51-4098-a125-dd90f1f29fe8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:48:36.177947 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:36.177929 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/025e8623-4c51-4098-a125-dd90f1f29fe8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "025e8623-4c51-4098-a125-dd90f1f29fe8" (UID: "025e8623-4c51-4098-a125-dd90f1f29fe8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 23:48:36.178035 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:36.177945 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/025e8623-4c51-4098-a125-dd90f1f29fe8-kube-api-access-wb8kc" (OuterVolumeSpecName: "kube-api-access-wb8kc") pod "025e8623-4c51-4098-a125-dd90f1f29fe8" (UID: "025e8623-4c51-4098-a125-dd90f1f29fe8"). InnerVolumeSpecName "kube-api-access-wb8kc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:48:36.277412 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:36.277376 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/025e8623-4c51-4098-a125-dd90f1f29fe8-istio-token\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:48:36.277412 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:36.277405 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/025e8623-4c51-4098-a125-dd90f1f29fe8-istio-envoy\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:48:36.277412 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:36.277415 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/025e8623-4c51-4098-a125-dd90f1f29fe8-istiod-ca-cert\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:48:36.277663 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:36.277425 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wb8kc\" (UniqueName: \"kubernetes.io/projected/025e8623-4c51-4098-a125-dd90f1f29fe8-kube-api-access-wb8kc\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:48:36.277663 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:36.277436 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/025e8623-4c51-4098-a125-dd90f1f29fe8-istio-podinfo\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:48:37.039273 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:37.039244 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" Jun 11 23:48:37.039690 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:37.039268 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f" event={"ID":"025e8623-4c51-4098-a125-dd90f1f29fe8","Type":"ContainerDied","Data":"c99a6ac3220e595e2f103f83cefd7d0ab292dc40f570b53fe29e9b27ad7dc883"} Jun 11 23:48:37.039690 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:37.039322 2563 scope.go:117] "RemoveContainer" containerID="95b3c2724f331d3c2627f575a548dd3a272897af71d24f2e789ad04a2c11a5db" Jun 11 23:48:37.070875 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:37.070838 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f"] Jun 11 23:48:37.079091 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:37.079063 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-7c22f708-openshift-default-f9f9789cd-99d6f"] Jun 11 23:48:39.006850 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:39.006816 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="025e8623-4c51-4098-a125-dd90f1f29fe8" path="/var/lib/kubelet/pods/025e8623-4c51-4098-a125-dd90f1f29fe8/volumes" Jun 11 23:48:53.693749 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.693708 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p"] Jun 11 23:48:53.694317 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.694270 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="025e8623-4c51-4098-a125-dd90f1f29fe8" containerName="istio-proxy" Jun 11 23:48:53.694317 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.694292 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="025e8623-4c51-4098-a125-dd90f1f29fe8" containerName="istio-proxy" Jun 11 23:48:53.694442 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.694391 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="025e8623-4c51-4098-a125-dd90f1f29fe8" containerName="istio-proxy" Jun 11 23:48:53.697240 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.697221 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:48:53.700212 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.700191 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-aecf84b0-openshift-default-dockercfg-shg2s\"" Jun 11 23:48:53.700212 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.700200 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 23:48:53.709065 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.708851 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p"] Jun 11 23:48:53.751141 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.751106 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-workload-socket\") pod \"e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:48:53.751141 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.751144 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-istiod-ca-cert\") pod \"e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:48:53.751335 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.751165 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-istio-data\") pod \"e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:48:53.751335 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.751247 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-istio-token\") pod \"e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:48:53.751335 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.751275 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-istio-podinfo\") pod \"e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:48:53.751335 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.751322 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-istio-envoy\") pod \"e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:48:53.751473 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.751342 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scmng\" (UniqueName: \"kubernetes.io/projected/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-kube-api-access-scmng\") pod \"e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:48:53.751473 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.751375 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-workload-certs\") pod \"e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:48:53.751473 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.751449 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-credential-socket\") pod \"e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:48:53.852422 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.852382 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-istio-envoy\") pod \"e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:48:53.852618 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.852429 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scmng\" (UniqueName: \"kubernetes.io/projected/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-kube-api-access-scmng\") pod \"e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:48:53.852618 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.852460 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-workload-certs\") pod \"e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:48:53.852618 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.852502 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-credential-socket\") pod \"e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:48:53.852618 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.852534 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-workload-socket\") pod \"e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:48:53.852830 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.852642 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-istiod-ca-cert\") pod \"e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:48:53.852830 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.852690 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-istio-data\") pod \"e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:48:53.852830 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.852803 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-istio-token\") pod \"e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:48:53.853021 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.852853 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-istio-podinfo\") pod \"e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:48:53.853021 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.852885 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-workload-certs\") pod \"e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:48:53.853021 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.852908 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-credential-socket\") pod \"e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:48:53.853021 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.852958 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-workload-socket\") pod \"e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:48:53.853172 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.853151 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-istio-data\") pod \"e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:48:53.853416 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.853390 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-istiod-ca-cert\") pod \"e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:48:53.854778 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.854755 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-istio-envoy\") pod \"e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:48:53.855230 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.855214 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-istio-podinfo\") pod \"e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:48:53.860556 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.860531 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-istio-token\") pod \"e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:48:53.860890 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:53.860872 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scmng\" (UniqueName: \"kubernetes.io/projected/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-kube-api-access-scmng\") pod \"e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:48:54.008769 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:54.008694 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:48:54.143685 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:54.143659 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p"] Jun 11 23:48:54.145290 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:48:54.145260 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42a9f9ea_60b0_4b3f_ae91_db6c452367e7.slice/crio-d934d02bf19d2500d4926aade4171b2dc8a86dd75720a995ba0eba0d19e5c6f1 WatchSource:0}: Error finding container d934d02bf19d2500d4926aade4171b2dc8a86dd75720a995ba0eba0d19e5c6f1: Status 404 returned error can't find the container with id d934d02bf19d2500d4926aade4171b2dc8a86dd75720a995ba0eba0d19e5c6f1 Jun 11 23:48:54.147615 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:54.147572 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 23:48:54.147726 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:54.147651 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 23:48:54.147726 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:54.147683 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 23:48:55.127556 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:55.127522 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" event={"ID":"42a9f9ea-60b0-4b3f-ae91-db6c452367e7","Type":"ContainerStarted","Data":"da166a58a347ded52fa8392332cbea34db1c1e22b15d05b0896480920ff07d09"} Jun 11 23:48:55.127945 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:55.127578 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" event={"ID":"42a9f9ea-60b0-4b3f-ae91-db6c452367e7","Type":"ContainerStarted","Data":"d934d02bf19d2500d4926aade4171b2dc8a86dd75720a995ba0eba0d19e5c6f1"} Jun 11 23:48:55.150387 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:55.150338 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" podStartSLOduration=2.150322806 podStartE2EDuration="2.150322806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:48:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:48:55.147532044 +0000 UTC m=+2308.570317024" watchObservedRunningTime="2026-06-11 23:48:55.150322806 +0000 UTC m=+2308.573107773" Jun 11 23:48:56.009544 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:56.009512 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:48:56.014183 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:56.014157 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:48:56.132650 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:56.132618 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:48:56.133675 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:48:56.133652 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:50:27.192651 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:50:27.192541 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lrmgd_243ee797-2187-41bc-ad0c-116ec1a4888f/ovn-acl-logging/0.log" Jun 11 23:50:27.196580 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:50:27.195530 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lrmgd_243ee797-2187-41bc-ad0c-116ec1a4888f/ovn-acl-logging/0.log" Jun 11 23:51:10.168562 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:10.168522 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p"] Jun 11 23:51:10.169579 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:10.169543 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" podUID="42a9f9ea-60b0-4b3f-ae91-db6c452367e7" containerName="istio-proxy" containerID="cri-o://da166a58a347ded52fa8392332cbea34db1c1e22b15d05b0896480920ff07d09" gracePeriod=30 Jun 11 23:51:11.135575 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:11.135535 2563 patch_prober.go:28] interesting pod/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 11 23:51:11.135766 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:11.135595 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" podUID="42a9f9ea-60b0-4b3f-ae91-db6c452367e7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 23:51:15.429800 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.429775 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:51:15.507189 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.507155 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-istio-token\") pod \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " Jun 11 23:51:15.507189 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.507201 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-istiod-ca-cert\") pod \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " Jun 11 23:51:15.507449 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.507259 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-istio-envoy\") pod \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " Jun 11 23:51:15.507449 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.507290 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-istio-data\") pod \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " Jun 11 23:51:15.507449 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.507346 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scmng\" (UniqueName: \"kubernetes.io/projected/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-kube-api-access-scmng\") pod \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " Jun 11 23:51:15.507449 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.507389 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-workload-socket\") pod \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " Jun 11 23:51:15.507668 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.507457 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-istio-podinfo\") pod \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " Jun 11 23:51:15.507668 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.507525 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-workload-certs\") pod \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " Jun 11 23:51:15.507668 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.507548 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-credential-socket\") pod \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\" (UID: \"42a9f9ea-60b0-4b3f-ae91-db6c452367e7\") " Jun 11 23:51:15.507668 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.507611 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "42a9f9ea-60b0-4b3f-ae91-db6c452367e7" (UID: "42a9f9ea-60b0-4b3f-ae91-db6c452367e7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:51:15.507886 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.507865 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-istiod-ca-cert\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:51:15.508649 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.508099 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "42a9f9ea-60b0-4b3f-ae91-db6c452367e7" (UID: "42a9f9ea-60b0-4b3f-ae91-db6c452367e7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:51:15.508649 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.508496 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "42a9f9ea-60b0-4b3f-ae91-db6c452367e7" (UID: "42a9f9ea-60b0-4b3f-ae91-db6c452367e7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:51:15.508649 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.508558 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-istio-data" (OuterVolumeSpecName: "istio-data") pod "42a9f9ea-60b0-4b3f-ae91-db6c452367e7" (UID: "42a9f9ea-60b0-4b3f-ae91-db6c452367e7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:51:15.508649 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.508608 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "42a9f9ea-60b0-4b3f-ae91-db6c452367e7" (UID: "42a9f9ea-60b0-4b3f-ae91-db6c452367e7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:51:15.510189 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.510145 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-istio-token" (OuterVolumeSpecName: "istio-token") pod "42a9f9ea-60b0-4b3f-ae91-db6c452367e7" (UID: "42a9f9ea-60b0-4b3f-ae91-db6c452367e7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:51:15.510579 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.510351 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "42a9f9ea-60b0-4b3f-ae91-db6c452367e7" (UID: "42a9f9ea-60b0-4b3f-ae91-db6c452367e7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:51:15.510766 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.510732 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-kube-api-access-scmng" (OuterVolumeSpecName: "kube-api-access-scmng") pod "42a9f9ea-60b0-4b3f-ae91-db6c452367e7" (UID: "42a9f9ea-60b0-4b3f-ae91-db6c452367e7"). InnerVolumeSpecName "kube-api-access-scmng". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:51:15.511090 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.511053 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "42a9f9ea-60b0-4b3f-ae91-db6c452367e7" (UID: "42a9f9ea-60b0-4b3f-ae91-db6c452367e7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 23:51:15.608738 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.608703 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-istio-token\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:51:15.608738 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.608733 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-istio-envoy\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:51:15.608738 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.608742 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-istio-data\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:51:15.608996 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.608752 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-scmng\" (UniqueName: \"kubernetes.io/projected/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-kube-api-access-scmng\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:51:15.608996 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.608761 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-workload-socket\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:51:15.608996 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.608770 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-istio-podinfo\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:51:15.608996 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.608778 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-workload-certs\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:51:15.608996 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.608785 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42a9f9ea-60b0-4b3f-ae91-db6c452367e7-credential-socket\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\"" Jun 11 23:51:15.800116 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.800002 2563 generic.go:356] "Generic (PLEG): container finished" podID="42a9f9ea-60b0-4b3f-ae91-db6c452367e7" containerID="da166a58a347ded52fa8392332cbea34db1c1e22b15d05b0896480920ff07d09" exitCode=0 Jun 11 23:51:15.800116 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.800055 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" Jun 11 23:51:15.800116 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.800084 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" event={"ID":"42a9f9ea-60b0-4b3f-ae91-db6c452367e7","Type":"ContainerDied","Data":"da166a58a347ded52fa8392332cbea34db1c1e22b15d05b0896480920ff07d09"} Jun 11 23:51:15.800416 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.800140 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p" event={"ID":"42a9f9ea-60b0-4b3f-ae91-db6c452367e7","Type":"ContainerDied","Data":"d934d02bf19d2500d4926aade4171b2dc8a86dd75720a995ba0eba0d19e5c6f1"} Jun 11 23:51:15.800416 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.800172 2563 scope.go:117] "RemoveContainer" containerID="da166a58a347ded52fa8392332cbea34db1c1e22b15d05b0896480920ff07d09" Jun 11 23:51:15.810518 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.810497 2563 scope.go:117] "RemoveContainer" containerID="da166a58a347ded52fa8392332cbea34db1c1e22b15d05b0896480920ff07d09" Jun 11 23:51:15.810836 ip-10-0-130-215 kubenswrapper[2563]: E0611 23:51:15.810814 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da166a58a347ded52fa8392332cbea34db1c1e22b15d05b0896480920ff07d09\": container with ID starting with da166a58a347ded52fa8392332cbea34db1c1e22b15d05b0896480920ff07d09 not found: ID does not exist" containerID="da166a58a347ded52fa8392332cbea34db1c1e22b15d05b0896480920ff07d09" Jun 11 23:51:15.810940 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.810843 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da166a58a347ded52fa8392332cbea34db1c1e22b15d05b0896480920ff07d09"} err="failed to get container status \"da166a58a347ded52fa8392332cbea34db1c1e22b15d05b0896480920ff07d09\": rpc error: code = NotFound desc = could not find container \"da166a58a347ded52fa8392332cbea34db1c1e22b15d05b0896480920ff07d09\": container with ID starting with da166a58a347ded52fa8392332cbea34db1c1e22b15d05b0896480920ff07d09 not found: ID does not exist" Jun 11 23:51:15.831447 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.831407 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p"] Jun 11 23:51:15.837992 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:15.837944 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-aecf84b0-openshift-default-5ffdcb4c74-ccg7p"] Jun 11 23:51:17.005455 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:51:17.005421 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42a9f9ea-60b0-4b3f-ae91-db6c452367e7" path="/var/lib/kubelet/pods/42a9f9ea-60b0-4b3f-ae91-db6c452367e7/volumes" Jun 11 23:54:52.451879 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:54:52.451849 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-76894b9f9f-k2fgh_15884c9c-3d6b-49ed-b8be-41aa1ab653fb/authorino/0.log" Jun 11 23:54:57.630375 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:54:57.630338 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29687010-vn6dt_c3f66e93-b590-4b71-b23e-1561187f74a1/cleanup/0.log" Jun 11 23:54:57.741937 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:54:57.741909 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29687025-bskmn_c0651668-1481-4bf2-a3aa-932c7b208a97/cleanup/0.log" Jun 11 23:54:58.209705 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:54:58.209676 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6545b9fcc6-vvt4x_8e1a89ab-7a03-4afb-960f-44925fecd664/copy-manifests/0.log" Jun 11 23:54:58.215853 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:54:58.215835 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6545b9fcc6-vvt4x_8e1a89ab-7a03-4afb-960f-44925fecd664/manager/0.log" Jun 11 23:54:58.584839 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:54:58.584759 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-skdlv_fd5297a6-054d-4259-bc02-c86bee90a83a/postgres/0.log" Jun 11 23:54:59.861010 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:54:59.860966 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-76894b9f9f-k2fgh_15884c9c-3d6b-49ed-b8be-41aa1ab653fb/authorino/0.log" Jun 11 23:55:01.341080 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:01.341049 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-747776d6d8-6mt64_0ddd2572-ff83-4a6f-bc20-af6dabdec412/kube-auth-proxy/0.log" Jun 11 23:55:02.539037 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:02.539008 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-6248z_ff1d8693-0f5c-47ad-843d-a128a789b194/storage-initializer/0.log" Jun 11 23:55:07.020368 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:07.020288 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-k62db/must-gather-t5ltg"] Jun 11 23:55:07.020882 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:07.020863 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42a9f9ea-60b0-4b3f-ae91-db6c452367e7" containerName="istio-proxy" Jun 11 23:55:07.020932 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:07.020884 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="42a9f9ea-60b0-4b3f-ae91-db6c452367e7" containerName="istio-proxy" Jun 11 23:55:07.021003 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:07.020973 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="42a9f9ea-60b0-4b3f-ae91-db6c452367e7" containerName="istio-proxy" Jun 11 23:55:07.024154 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:07.024136 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k62db/must-gather-t5ltg" Jun 11 23:55:07.027472 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:07.027447 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k62db\"/\"openshift-service-ca.crt\"" Jun 11 23:55:07.027577 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:07.027545 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k62db\"/\"kube-root-ca.crt\"" Jun 11 23:55:07.028349 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:07.028332 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-k62db\"/\"default-dockercfg-xddgz\"" Jun 11 23:55:07.041903 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:07.041880 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k62db/must-gather-t5ltg"] Jun 11 23:55:07.178278 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:07.178241 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh698\" (UniqueName: \"kubernetes.io/projected/e16b1bb3-04bf-4b57-85a0-e76effd6302a-kube-api-access-nh698\") pod \"must-gather-t5ltg\" (UID: \"e16b1bb3-04bf-4b57-85a0-e76effd6302a\") " pod="openshift-must-gather-k62db/must-gather-t5ltg" Jun 11 23:55:07.178453 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:07.178362 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e16b1bb3-04bf-4b57-85a0-e76effd6302a-must-gather-output\") pod \"must-gather-t5ltg\" (UID: \"e16b1bb3-04bf-4b57-85a0-e76effd6302a\") " pod="openshift-must-gather-k62db/must-gather-t5ltg" Jun 11 23:55:07.278882 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:07.278812 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh698\" (UniqueName: \"kubernetes.io/projected/e16b1bb3-04bf-4b57-85a0-e76effd6302a-kube-api-access-nh698\") pod \"must-gather-t5ltg\" (UID: \"e16b1bb3-04bf-4b57-85a0-e76effd6302a\") " pod="openshift-must-gather-k62db/must-gather-t5ltg" Jun 11 23:55:07.279025 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:07.278884 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e16b1bb3-04bf-4b57-85a0-e76effd6302a-must-gather-output\") pod \"must-gather-t5ltg\" (UID: \"e16b1bb3-04bf-4b57-85a0-e76effd6302a\") " pod="openshift-must-gather-k62db/must-gather-t5ltg" Jun 11 23:55:07.279211 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:07.279194 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e16b1bb3-04bf-4b57-85a0-e76effd6302a-must-gather-output\") pod \"must-gather-t5ltg\" (UID: \"e16b1bb3-04bf-4b57-85a0-e76effd6302a\") " pod="openshift-must-gather-k62db/must-gather-t5ltg" Jun 11 23:55:07.287528 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:07.287503 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh698\" (UniqueName: \"kubernetes.io/projected/e16b1bb3-04bf-4b57-85a0-e76effd6302a-kube-api-access-nh698\") pod \"must-gather-t5ltg\" (UID: \"e16b1bb3-04bf-4b57-85a0-e76effd6302a\") " pod="openshift-must-gather-k62db/must-gather-t5ltg" Jun 11 23:55:07.333521 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:07.333481 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k62db/must-gather-t5ltg" Jun 11 23:55:07.466037 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:07.466011 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k62db/must-gather-t5ltg"] Jun 11 23:55:07.468180 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:55:07.468150 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode16b1bb3_04bf_4b57_85a0_e76effd6302a.slice/crio-871dc2c02aed4ab6d5061f49a8376b161d3b071f519717e9a37f8e3698de2f25 WatchSource:0}: Error finding container 871dc2c02aed4ab6d5061f49a8376b161d3b071f519717e9a37f8e3698de2f25: Status 404 returned error can't find the container with id 871dc2c02aed4ab6d5061f49a8376b161d3b071f519717e9a37f8e3698de2f25 Jun 11 23:55:07.470017 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:07.470000 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 23:55:07.900591 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:07.900554 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k62db/must-gather-t5ltg" event={"ID":"e16b1bb3-04bf-4b57-85a0-e76effd6302a","Type":"ContainerStarted","Data":"871dc2c02aed4ab6d5061f49a8376b161d3b071f519717e9a37f8e3698de2f25"} Jun 11 23:55:08.911069 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:08.910636 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k62db/must-gather-t5ltg" event={"ID":"e16b1bb3-04bf-4b57-85a0-e76effd6302a","Type":"ContainerStarted","Data":"238145c37cdfe0ef44bbc28fb2f518704bf01b3b47dbc9a1225a97e28c8d183c"} Jun 11 23:55:08.911069 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:08.910688 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k62db/must-gather-t5ltg" event={"ID":"e16b1bb3-04bf-4b57-85a0-e76effd6302a","Type":"ContainerStarted","Data":"7fc8b8ed1570f2cb605d316341fb07360f2b49d7c3946673fe6c6547f4a0c6af"} Jun 11 23:55:08.932054 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:08.930817 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-k62db/must-gather-t5ltg" podStartSLOduration=1.23299354 podStartE2EDuration="1.930795301s" totalImagesPullingTime="697.801761ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:55:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:55:08.926362983 +0000 UTC m=+2682.349147952" watchObservedRunningTime="2026-06-11 23:55:08.930795301 +0000 UTC m=+2682.353580270" Jun 11 23:55:10.031623 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:10.031577 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-n4lnc_8fb03f32-8124-418d-99c4-3c16de6e020d/global-pull-secret-syncer/0.log" Jun 11 23:55:10.193087 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:10.193044 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xzq6f_0997dc48-5058-46f2-b737-e37f618d472a/konnectivity-agent/0.log" Jun 11 23:55:10.217855 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:10.217827 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-215.ec2.internal_14e8d091aa6dad66da2b682cebda410b/haproxy/0.log" Jun 11 23:55:15.164778 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:15.164748 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-76894b9f9f-k2fgh_15884c9c-3d6b-49ed-b8be-41aa1ab653fb/authorino/0.log" Jun 11 23:55:17.174495 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:17.174442 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4b730f58-e13c-44a2-a55e-b018f3ec31ef/alertmanager/0.log" Jun 11 23:55:17.197266 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:17.197232 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4b730f58-e13c-44a2-a55e-b018f3ec31ef/config-reloader/0.log" Jun 11 23:55:17.219328 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:17.219298 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4b730f58-e13c-44a2-a55e-b018f3ec31ef/kube-rbac-proxy-web/0.log" Jun 11 23:55:17.242612 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:17.242532 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4b730f58-e13c-44a2-a55e-b018f3ec31ef/kube-rbac-proxy/0.log" Jun 11 23:55:17.265722 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:17.265688 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4b730f58-e13c-44a2-a55e-b018f3ec31ef/kube-rbac-proxy-metric/0.log" Jun 11 23:55:17.287094 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:17.287058 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4b730f58-e13c-44a2-a55e-b018f3ec31ef/prom-label-proxy/0.log" Jun 11 23:55:17.308449 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:17.308400 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4b730f58-e13c-44a2-a55e-b018f3ec31ef/init-config-reloader/0.log" Jun 11 23:55:17.395581 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:17.395546 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-h6mh9_811341ae-6172-4b68-ada2-858413c24d0f/kube-state-metrics/0.log" Jun 11 23:55:17.420209 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:17.420163 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-h6mh9_811341ae-6172-4b68-ada2-858413c24d0f/kube-rbac-proxy-main/0.log" Jun 11 23:55:17.451417 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:17.451385 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-h6mh9_811341ae-6172-4b68-ada2-858413c24d0f/kube-rbac-proxy-self/0.log" Jun 11 23:55:17.478498 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:17.478471 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5bdd4d99bf-h8kgz_2c80a13b-3c21-4070-99a8-4fa82caba269/metrics-server/0.log" Jun 11 23:55:17.513139 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:17.513036 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-pft7t_e7198ab7-2dbb-45a1-9e52-6f3bee93d2ae/monitoring-plugin/0.log" Jun 11 23:55:17.548631 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:17.548599 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-82tw7_79f147ec-24ff-4190-bdd9-c4552db1c883/node-exporter/0.log" Jun 11 23:55:17.575553 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:17.575514 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-82tw7_79f147ec-24ff-4190-bdd9-c4552db1c883/kube-rbac-proxy/0.log" Jun 11 23:55:17.602744 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:17.602711 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-82tw7_79f147ec-24ff-4190-bdd9-c4552db1c883/init-textfile/0.log" Jun 11 23:55:17.834501 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:17.834405 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-r9dgv_27da07e2-d8e4-4319-962c-5ab1bb12d90b/kube-rbac-proxy-main/0.log" Jun 11 23:55:17.854716 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:17.854684 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-r9dgv_27da07e2-d8e4-4319-962c-5ab1bb12d90b/kube-rbac-proxy-self/0.log" Jun 11 23:55:17.881094 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:17.881052 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-r9dgv_27da07e2-d8e4-4319-962c-5ab1bb12d90b/openshift-state-metrics/0.log" Jun 11 23:55:17.936193 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:17.936163 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e2e2a72-afd0-470a-9306-f54e636c1238/prometheus/0.log" Jun 11 23:55:17.954932 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:17.954897 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e2e2a72-afd0-470a-9306-f54e636c1238/config-reloader/0.log" Jun 11 23:55:17.977471 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:17.977437 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e2e2a72-afd0-470a-9306-f54e636c1238/thanos-sidecar/0.log" Jun 11 23:55:18.004633 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:18.004603 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e2e2a72-afd0-470a-9306-f54e636c1238/kube-rbac-proxy-web/0.log" Jun 11 23:55:18.024805 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:18.024766 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e2e2a72-afd0-470a-9306-f54e636c1238/kube-rbac-proxy/0.log" Jun 11 23:55:18.044696 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:18.044645 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e2e2a72-afd0-470a-9306-f54e636c1238/kube-rbac-proxy-thanos/0.log" Jun 11 23:55:18.070854 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:18.070805 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e2e2a72-afd0-470a-9306-f54e636c1238/init-config-reloader/0.log" Jun 11 23:55:18.109292 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:18.109198 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-lp68n_a0db75ab-e481-478b-aeac-7f91e9610b3a/prometheus-operator/0.log" Jun 11 23:55:18.131929 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:18.131795 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-lp68n_a0db75ab-e481-478b-aeac-7f91e9610b3a/kube-rbac-proxy/0.log" Jun 11 23:55:18.206472 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:18.206445 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-564d9bf697-s59ps_a70b0c3e-a04f-448b-a89e-19116475728e/telemeter-client/0.log" Jun 11 23:55:18.233611 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:18.233583 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-564d9bf697-s59ps_a70b0c3e-a04f-448b-a89e-19116475728e/reload/0.log" Jun 11 23:55:18.257266 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:18.257205 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-564d9bf697-s59ps_a70b0c3e-a04f-448b-a89e-19116475728e/kube-rbac-proxy/0.log" Jun 11 23:55:18.305590 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:18.305557 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-558d8445bd-v8tg9_28561be7-dd09-4680-a505-041bcced174d/thanos-query/0.log" Jun 11 23:55:18.331676 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:18.331632 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-558d8445bd-v8tg9_28561be7-dd09-4680-a505-041bcced174d/kube-rbac-proxy-web/0.log" Jun 11 23:55:18.355946 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:18.355894 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-558d8445bd-v8tg9_28561be7-dd09-4680-a505-041bcced174d/kube-rbac-proxy/0.log" Jun 11 23:55:18.377321 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:18.377283 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-558d8445bd-v8tg9_28561be7-dd09-4680-a505-041bcced174d/prom-label-proxy/0.log" Jun 11 23:55:18.401244 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:18.401209 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-558d8445bd-v8tg9_28561be7-dd09-4680-a505-041bcced174d/kube-rbac-proxy-rules/0.log" Jun 11 23:55:18.430312 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:18.430279 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-558d8445bd-v8tg9_28561be7-dd09-4680-a505-041bcced174d/kube-rbac-proxy-metrics/0.log" Jun 11 23:55:21.084790 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:21.084721 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76748c45b8-jc6fx_6085ef50-3f07-4ef1-aa50-bf7a5b63aff8/console/0.log" Jun 11 23:55:22.015436 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:22.015404 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-k62db/perf-node-gather-daemonset-vqztz"] Jun 11 23:55:22.021548 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:22.021511 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k62db/perf-node-gather-daemonset-vqztz" Jun 11 23:55:22.025686 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:22.025610 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k62db/perf-node-gather-daemonset-vqztz"] Jun 11 23:55:22.153070 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:22.153031 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ffe02a9-9650-48df-b957-29254be1da89-lib-modules\") pod \"perf-node-gather-daemonset-vqztz\" (UID: \"1ffe02a9-9650-48df-b957-29254be1da89\") " pod="openshift-must-gather-k62db/perf-node-gather-daemonset-vqztz" Jun 11 23:55:22.153528 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:22.153094 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn4dj\" (UniqueName: \"kubernetes.io/projected/1ffe02a9-9650-48df-b957-29254be1da89-kube-api-access-hn4dj\") pod \"perf-node-gather-daemonset-vqztz\" (UID: \"1ffe02a9-9650-48df-b957-29254be1da89\") " pod="openshift-must-gather-k62db/perf-node-gather-daemonset-vqztz" Jun 11 23:55:22.153528 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:22.153156 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1ffe02a9-9650-48df-b957-29254be1da89-podres\") pod \"perf-node-gather-daemonset-vqztz\" (UID: \"1ffe02a9-9650-48df-b957-29254be1da89\") " pod="openshift-must-gather-k62db/perf-node-gather-daemonset-vqztz" Jun 11 23:55:22.153528 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:22.153219 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ffe02a9-9650-48df-b957-29254be1da89-sys\") pod \"perf-node-gather-daemonset-vqztz\" (UID: \"1ffe02a9-9650-48df-b957-29254be1da89\") " pod="openshift-must-gather-k62db/perf-node-gather-daemonset-vqztz" Jun 11 23:55:22.153528 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:22.153304 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1ffe02a9-9650-48df-b957-29254be1da89-proc\") pod \"perf-node-gather-daemonset-vqztz\" (UID: \"1ffe02a9-9650-48df-b957-29254be1da89\") " pod="openshift-must-gather-k62db/perf-node-gather-daemonset-vqztz" Jun 11 23:55:22.254307 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:22.254269 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1ffe02a9-9650-48df-b957-29254be1da89-proc\") pod \"perf-node-gather-daemonset-vqztz\" (UID: \"1ffe02a9-9650-48df-b957-29254be1da89\") " pod="openshift-must-gather-k62db/perf-node-gather-daemonset-vqztz" Jun 11 23:55:22.254484 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:22.254355 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ffe02a9-9650-48df-b957-29254be1da89-lib-modules\") pod \"perf-node-gather-daemonset-vqztz\" (UID: \"1ffe02a9-9650-48df-b957-29254be1da89\") " pod="openshift-must-gather-k62db/perf-node-gather-daemonset-vqztz" Jun 11 23:55:22.254484 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:22.254395 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1ffe02a9-9650-48df-b957-29254be1da89-proc\") pod \"perf-node-gather-daemonset-vqztz\" (UID: \"1ffe02a9-9650-48df-b957-29254be1da89\") " pod="openshift-must-gather-k62db/perf-node-gather-daemonset-vqztz" Jun 11 23:55:22.254484 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:22.254400 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn4dj\" (UniqueName: \"kubernetes.io/projected/1ffe02a9-9650-48df-b957-29254be1da89-kube-api-access-hn4dj\") pod \"perf-node-gather-daemonset-vqztz\" (UID: \"1ffe02a9-9650-48df-b957-29254be1da89\") " pod="openshift-must-gather-k62db/perf-node-gather-daemonset-vqztz" Jun 11 23:55:22.254627 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:22.254508 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1ffe02a9-9650-48df-b957-29254be1da89-podres\") pod \"perf-node-gather-daemonset-vqztz\" (UID: \"1ffe02a9-9650-48df-b957-29254be1da89\") " pod="openshift-must-gather-k62db/perf-node-gather-daemonset-vqztz" Jun 11 23:55:22.254627 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:22.254533 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ffe02a9-9650-48df-b957-29254be1da89-lib-modules\") pod \"perf-node-gather-daemonset-vqztz\" (UID: \"1ffe02a9-9650-48df-b957-29254be1da89\") " pod="openshift-must-gather-k62db/perf-node-gather-daemonset-vqztz" Jun 11 23:55:22.254627 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:22.254568 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ffe02a9-9650-48df-b957-29254be1da89-sys\") pod \"perf-node-gather-daemonset-vqztz\" (UID: \"1ffe02a9-9650-48df-b957-29254be1da89\") " pod="openshift-must-gather-k62db/perf-node-gather-daemonset-vqztz" Jun 11 23:55:22.254768 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:22.254673 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1ffe02a9-9650-48df-b957-29254be1da89-podres\") pod \"perf-node-gather-daemonset-vqztz\" (UID: \"1ffe02a9-9650-48df-b957-29254be1da89\") " pod="openshift-must-gather-k62db/perf-node-gather-daemonset-vqztz" Jun 11 23:55:22.254768 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:22.254684 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ffe02a9-9650-48df-b957-29254be1da89-sys\") pod \"perf-node-gather-daemonset-vqztz\" (UID: \"1ffe02a9-9650-48df-b957-29254be1da89\") " pod="openshift-must-gather-k62db/perf-node-gather-daemonset-vqztz" Jun 11 23:55:22.262549 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:22.262516 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn4dj\" (UniqueName: \"kubernetes.io/projected/1ffe02a9-9650-48df-b957-29254be1da89-kube-api-access-hn4dj\") pod \"perf-node-gather-daemonset-vqztz\" (UID: \"1ffe02a9-9650-48df-b957-29254be1da89\") " pod="openshift-must-gather-k62db/perf-node-gather-daemonset-vqztz" Jun 11 23:55:22.334111 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:22.334011 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k62db/perf-node-gather-daemonset-vqztz" Jun 11 23:55:22.530369 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:22.529777 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k62db/perf-node-gather-daemonset-vqztz"] Jun 11 23:55:22.533098 ip-10-0-130-215 kubenswrapper[2563]: W0611 23:55:22.533039 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1ffe02a9_9650_48df_b957_29254be1da89.slice/crio-221deb3f5fd90c029facfc294948a79bdfa7638721943ab431b98341d9351e22 WatchSource:0}: Error finding container 221deb3f5fd90c029facfc294948a79bdfa7638721943ab431b98341d9351e22: Status 404 returned error can't find the container with id 221deb3f5fd90c029facfc294948a79bdfa7638721943ab431b98341d9351e22 Jun 11 23:55:23.027917 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:23.026190 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k62db/perf-node-gather-daemonset-vqztz" event={"ID":"1ffe02a9-9650-48df-b957-29254be1da89","Type":"ContainerStarted","Data":"4f313d23fa794387187d1d1ffb01232131f852a2a9b0f06a475c0dd2064914c5"} Jun 11 23:55:23.027917 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:23.026258 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k62db/perf-node-gather-daemonset-vqztz" event={"ID":"1ffe02a9-9650-48df-b957-29254be1da89","Type":"ContainerStarted","Data":"221deb3f5fd90c029facfc294948a79bdfa7638721943ab431b98341d9351e22"} Jun 11 23:55:23.027917 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:23.027136 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-k62db/perf-node-gather-daemonset-vqztz" Jun 11 23:55:23.045841 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:23.045782 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-k62db/perf-node-gather-daemonset-vqztz" podStartSLOduration=1.04576189 podStartE2EDuration="1.04576189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:55:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:55:23.042564259 +0000 UTC m=+2696.465349226" watchObservedRunningTime="2026-06-11 23:55:23.04576189 +0000 UTC m=+2696.468546859" Jun 11 23:55:23.202745 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:23.202717 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qk2pw_e01b3859-b744-476e-80ff-bfa6a00ada95/dns/0.log" Jun 11 23:55:23.222988 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:23.222947 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qk2pw_e01b3859-b744-476e-80ff-bfa6a00ada95/kube-rbac-proxy/0.log" Jun 11 23:55:23.336710 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:23.336639 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vkn8f_ea89baa6-2814-4cf0-8171-73946de5e446/dns-node-resolver/0.log" Jun 11 23:55:23.885915 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:23.885886 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gqkl4_eeef2be9-5af9-4766-af41-7c89fa431f22/node-ca/0.log" Jun 11 23:55:24.929267 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:24.929237 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-747776d6d8-6mt64_0ddd2572-ff83-4a6f-bc20-af6dabdec412/kube-auth-proxy/0.log" Jun 11 23:55:25.770557 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:25.770529 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dh48l_080f3422-c177-4ce2-9ef2-78f801a2db6b/serve-healthcheck-canary/0.log" Jun 11 23:55:26.327783 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:26.327754 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6b7r7_fe1d7acb-364e-4486-b170-da37b2e68eca/kube-rbac-proxy/0.log" Jun 11 23:55:26.348527 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:26.348498 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6b7r7_fe1d7acb-364e-4486-b170-da37b2e68eca/exporter/0.log" Jun 11 23:55:26.371885 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:26.371859 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6b7r7_fe1d7acb-364e-4486-b170-da37b2e68eca/extractor/0.log" Jun 11 23:55:27.235366 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:27.235232 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lrmgd_243ee797-2187-41bc-ad0c-116ec1a4888f/ovn-acl-logging/0.log" Jun 11 23:55:27.253877 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:27.239304 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lrmgd_243ee797-2187-41bc-ad0c-116ec1a4888f/ovn-acl-logging/0.log" Jun 11 23:55:29.033425 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:29.033388 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29687010-vn6dt_c3f66e93-b590-4b71-b23e-1561187f74a1/cleanup/0.log" Jun 11 23:55:29.057031 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:29.057006 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29687025-bskmn_c0651668-1481-4bf2-a3aa-932c7b208a97/cleanup/0.log" Jun 11 23:55:29.226527 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:29.226499 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6545b9fcc6-vvt4x_8e1a89ab-7a03-4afb-960f-44925fecd664/manager/0.log" Jun 11 23:55:29.246502 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:29.246478 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6545b9fcc6-vvt4x_8e1a89ab-7a03-4afb-960f-44925fecd664/copy-manifests/0.log" Jun 11 23:55:29.430861 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:29.430831 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-skdlv_fd5297a6-054d-4259-bc02-c86bee90a83a/postgres/0.log" Jun 11 23:55:30.055454 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:30.055423 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-k62db/perf-node-gather-daemonset-vqztz" Jun 11 23:55:31.138185 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:31.138151 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-64f6c9fd9c-jck7t_8f942ad5-ec71-4db9-9b19-2a1d78dea708/manager/0.log" Jun 11 23:55:35.265599 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:35.265566 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-747776d6d8-6mt64_0ddd2572-ff83-4a6f-bc20-af6dabdec412/kube-auth-proxy/0.log" Jun 11 23:55:36.652531 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:36.652504 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-747776d6d8-6mt64_0ddd2572-ff83-4a6f-bc20-af6dabdec412/kube-auth-proxy/0.log" Jun 11 23:55:38.306548 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:38.306521 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8lglz_f5b94329-259b-4886-bd03-2205cf371d90/kube-multus-additional-cni-plugins/0.log" Jun 11 23:55:38.325936 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:38.325906 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8lglz_f5b94329-259b-4886-bd03-2205cf371d90/egress-router-binary-copy/0.log" Jun 11 23:55:38.346477 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:38.346443 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8lglz_f5b94329-259b-4886-bd03-2205cf371d90/cni-plugins/0.log" Jun 11 23:55:38.366511 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:38.366486 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8lglz_f5b94329-259b-4886-bd03-2205cf371d90/bond-cni-plugin/0.log" Jun 11 23:55:38.388044 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:38.387998 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8lglz_f5b94329-259b-4886-bd03-2205cf371d90/routeoverride-cni/0.log" Jun 11 23:55:38.407045 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:38.407011 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8lglz_f5b94329-259b-4886-bd03-2205cf371d90/whereabouts-cni-bincopy/0.log" Jun 11 23:55:38.426530 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:38.426503 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8lglz_f5b94329-259b-4886-bd03-2205cf371d90/whereabouts-cni/0.log" Jun 11 23:55:38.543718 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:38.543690 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-747776d6d8-6mt64_0ddd2572-ff83-4a6f-bc20-af6dabdec412/kube-auth-proxy/0.log" Jun 11 23:55:38.879363 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:38.879329 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hrhdl_51a4a947-5f6d-4279-bb6a-0f4122de575a/kube-multus/0.log" Jun 11 23:55:38.928489 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:38.928455 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2pfzs_4e46db09-c19b-4f8b-9eb4-370984f52a4c/network-metrics-daemon/0.log" Jun 11 23:55:38.946612 ip-10-0-130-215 kubenswrapper[2563]: I0611 23:55:38.946583 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2pfzs_4e46db09-c19b-4f8b-9eb4-370984f52a4c/kube-rbac-proxy/0.log"