Jun 11 19:49:59.596408 ip-10-0-137-247 systemd[1]: Starting Kubernetes Kubelet... Jun 11 19:50:00.031779 ip-10-0-137-247 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 19:50:00.031779 ip-10-0-137-247 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 19:50:00.031779 ip-10-0-137-247 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 19:50:00.031779 ip-10-0-137-247 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 19:50:00.031779 ip-10-0-137-247 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 19:50:00.032898 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.032817 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 19:50:00.037876 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037855 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:50:00.037876 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037872 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:50:00.037876 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037876 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:50:00.037876 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037879 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:50:00.037876 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037882 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:50:00.037876 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037885 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:50:00.038134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037891 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:50:00.038134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037896 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:50:00.038134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037899 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:50:00.038134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037902 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:50:00.038134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037905 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:50:00.038134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037908 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:50:00.038134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037911 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:50:00.038134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037913 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:50:00.038134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037916 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:50:00.038134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037918 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:50:00.038134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037921 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:50:00.038134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037924 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:50:00.038134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037926 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:50:00.038134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037929 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:50:00.038134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037932 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:50:00.038134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037934 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:50:00.038134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037937 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:50:00.038134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037940 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:50:00.038134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037942 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:50:00.038134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037945 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:50:00.038620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037947 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:50:00.038620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037950 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:50:00.038620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037953 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:50:00.038620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037955 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:50:00.038620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037958 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:50:00.038620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037960 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:50:00.038620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037966 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:50:00.038620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037969 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:50:00.038620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037972 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:50:00.038620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037974 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:50:00.038620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037977 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:50:00.038620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037979 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:50:00.038620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037982 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:50:00.038620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037986 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:50:00.038620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037988 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:50:00.038620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037991 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:50:00.038620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037994 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:50:00.038620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037997 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:50:00.038620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.037999 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:50:00.038620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038002 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:50:00.039143 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038005 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:50:00.039143 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038007 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:50:00.039143 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038010 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:50:00.039143 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038013 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:50:00.039143 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038016 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:50:00.039143 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038019 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:50:00.039143 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038021 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:50:00.039143 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038024 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:50:00.039143 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038027 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:50:00.039143 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038030 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:50:00.039143 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038032 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:50:00.039143 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038035 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:50:00.039143 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038038 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:50:00.039143 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038041 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:50:00.039143 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038043 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:50:00.039143 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038046 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:50:00.039143 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038048 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:50:00.039143 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038051 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:50:00.039143 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038053 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:50:00.039143 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038056 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:50:00.039620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038059 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:50:00.039620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038062 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:50:00.039620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038065 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:50:00.039620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038068 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:50:00.039620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038070 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:50:00.039620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038075 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:50:00.039620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038078 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:50:00.039620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038082 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:50:00.039620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038085 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:50:00.039620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038088 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:50:00.039620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038091 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:50:00.039620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038093 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:50:00.039620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038096 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:50:00.039620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038100 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:50:00.039620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038104 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:50:00.039620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038106 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:50:00.039620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038109 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:50:00.039620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038113 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:50:00.039620 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038116 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:50:00.040112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038135 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:50:00.040112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038139 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:50:00.040112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038143 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:50:00.040112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038145 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:50:00.040112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038148 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:50:00.040112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038151 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:50:00.040112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038154 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:50:00.040112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038157 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:50:00.040112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038160 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:50:00.040112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038162 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:50:00.040112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038165 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:50:00.040112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038167 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:50:00.040112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038170 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:50:00.040112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038172 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:50:00.040112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038849 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:50:00.040112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038856 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:50:00.040112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038858 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:50:00.040112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038861 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:50:00.040112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038864 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:50:00.040587 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038867 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:50:00.040587 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038870 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:50:00.040587 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038873 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:50:00.040587 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038875 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:50:00.040587 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038878 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:50:00.040587 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038880 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:50:00.040587 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038883 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:50:00.040587 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038885 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:50:00.040587 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038888 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:50:00.040587 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038891 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:50:00.040587 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038894 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:50:00.040587 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038896 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:50:00.040587 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038900 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:50:00.040587 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038902 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:50:00.040587 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038905 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:50:00.040587 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038907 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:50:00.040587 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038910 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:50:00.040587 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038913 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:50:00.040587 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038915 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:50:00.040587 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038918 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:50:00.041115 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038922 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:50:00.041115 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038926 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:50:00.041115 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038929 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:50:00.041115 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038932 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:50:00.041115 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038935 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:50:00.041115 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038938 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:50:00.041115 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038940 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:50:00.041115 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038943 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:50:00.041115 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038946 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:50:00.041115 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038948 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:50:00.041115 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038951 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:50:00.041115 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038954 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:50:00.041115 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038957 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:50:00.041115 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038959 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:50:00.041115 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038962 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:50:00.041115 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038964 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:50:00.041115 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038968 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:50:00.041115 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038971 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:50:00.041115 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038974 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:50:00.041677 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038978 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:50:00.041677 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038980 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:50:00.041677 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038983 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:50:00.041677 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038986 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:50:00.041677 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038989 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:50:00.041677 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038991 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:50:00.041677 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038994 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:50:00.041677 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038997 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:50:00.041677 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.038999 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:50:00.041677 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039003 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:50:00.041677 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039007 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:50:00.041677 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039010 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:50:00.041677 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039013 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:50:00.041677 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039016 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:50:00.041677 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039019 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:50:00.041677 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039021 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:50:00.041677 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039024 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:50:00.041677 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039026 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:50:00.041677 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039029 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:50:00.042152 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039031 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:50:00.042152 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039034 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:50:00.042152 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039037 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:50:00.042152 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039040 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:50:00.042152 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039043 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:50:00.042152 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039046 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:50:00.042152 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039049 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:50:00.042152 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039052 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:50:00.042152 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039054 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:50:00.042152 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039056 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:50:00.042152 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039059 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:50:00.042152 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039062 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:50:00.042152 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039064 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:50:00.042152 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039067 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:50:00.042152 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039069 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:50:00.042152 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039072 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:50:00.042152 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039074 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:50:00.042152 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039077 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:50:00.042152 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039079 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:50:00.042152 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039082 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:50:00.042647 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039085 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:50:00.042647 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039087 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:50:00.042647 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039090 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:50:00.042647 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039092 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:50:00.042647 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039095 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:50:00.042647 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039097 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:50:00.042647 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039100 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:50:00.042647 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039103 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:50:00.042647 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039105 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:50:00.042647 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039108 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:50:00.042647 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039110 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:50:00.042647 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039113 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:50:00.042647 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039116 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:50:00.042647 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039134 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:50:00.042647 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039138 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:50:00.042647 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039142 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:50:00.042647 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039558 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:50:00.042647 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039564 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:50:00.042647 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039568 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:50:00.042647 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039571 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:50:00.043146 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039573 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:50:00.043146 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039576 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:50:00.043146 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039579 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:50:00.043146 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039582 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:50:00.043146 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039584 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:50:00.043146 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039587 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:50:00.043146 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039589 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:50:00.043146 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039592 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:50:00.043146 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039595 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:50:00.043146 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039597 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:50:00.043146 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039601 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:50:00.043146 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039605 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:50:00.043146 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039608 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:50:00.043146 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039611 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:50:00.043146 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039614 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:50:00.043146 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039617 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:50:00.043146 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039619 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:50:00.043146 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039626 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:50:00.043146 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039629 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:50:00.043146 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039632 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:50:00.043625 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039635 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:50:00.043625 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039639 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:50:00.043625 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039642 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:50:00.043625 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039645 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:50:00.043625 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039648 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:50:00.043625 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039651 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:50:00.043625 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039655 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:50:00.043625 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039657 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:50:00.043625 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039661 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:50:00.043625 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039664 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:50:00.043625 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039667 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:50:00.043625 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039669 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:50:00.043625 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039672 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:50:00.043625 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039675 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:50:00.043625 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039677 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:50:00.043625 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039680 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:50:00.043625 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039682 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:50:00.043625 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039686 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:50:00.043625 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039688 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:50:00.044093 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039690 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:50:00.044093 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039693 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:50:00.044093 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039695 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:50:00.044093 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039698 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:50:00.044093 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039701 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:50:00.044093 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039703 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:50:00.044093 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039709 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:50:00.044093 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039713 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:50:00.044093 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039715 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:50:00.044093 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039717 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:50:00.044093 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039721 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:50:00.044093 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039723 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:50:00.044093 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039726 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:50:00.044093 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039728 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:50:00.044093 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039730 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:50:00.044093 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039733 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:50:00.044093 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039735 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:50:00.044093 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039738 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:50:00.044093 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039740 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:50:00.044565 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039743 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:50:00.044565 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039745 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:50:00.044565 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039748 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:50:00.044565 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039750 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:50:00.044565 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039752 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:50:00.044565 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039755 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:50:00.044565 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039758 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:50:00.044565 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039760 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:50:00.044565 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039762 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:50:00.044565 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039765 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:50:00.044565 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039767 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:50:00.044565 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039770 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:50:00.044565 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039773 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:50:00.044565 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039775 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:50:00.044565 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039778 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:50:00.044565 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039781 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:50:00.044565 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039784 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:50:00.044565 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039786 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:50:00.044565 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039788 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:50:00.045033 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039791 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:50:00.045033 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039794 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:50:00.045033 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039797 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:50:00.045033 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039800 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:50:00.045033 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039803 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:50:00.045033 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039805 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:50:00.045033 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039808 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:50:00.045033 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039810 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:50:00.045033 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039813 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:50:00.045033 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039815 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:50:00.045033 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039818 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:50:00.045033 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039820 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:50:00.045033 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039823 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:50:00.045033 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039827 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:50:00.045033 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039830 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:50:00.045033 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039832 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:50:00.045033 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039835 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:50:00.045033 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.039838 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:50:00.045033 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.039906 2576 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 19:50:00.045033 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.039913 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 19:50:00.045542 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.039919 2576 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 19:50:00.045542 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.039923 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 19:50:00.045542 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.039927 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 19:50:00.045542 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.039930 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 19:50:00.045542 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.039942 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 19:50:00.045542 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.039946 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 19:50:00.045542 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.039949 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 19:50:00.045542 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.039952 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 19:50:00.045542 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.039955 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 19:50:00.045542 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.039959 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 19:50:00.045542 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.039962 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 19:50:00.045542 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.039965 2576 flags.go:64] FLAG: --cgroup-root="" Jun 11 19:50:00.045542 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.039968 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 19:50:00.045542 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.039971 2576 flags.go:64] FLAG: --client-ca-file="" Jun 11 19:50:00.045542 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.039976 2576 flags.go:64] FLAG: --cloud-provider="external" Jun 11 19:50:00.045542 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.039979 2576 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 19:50:00.045542 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.039983 2576 flags.go:64] FLAG: --cluster-domain="" Jun 11 19:50:00.045542 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.039986 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 19:50:00.045542 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.039989 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 19:50:00.045542 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.039992 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 19:50:00.045542 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.039995 2576 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 19:50:00.045542 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040000 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 19:50:00.045542 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040003 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 19:50:00.046138 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040006 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 19:50:00.046138 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040009 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 19:50:00.046138 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040012 2576 flags.go:64] FLAG: --contention-profiling="false" Jun 11 19:50:00.046138 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040015 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 19:50:00.046138 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040018 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 19:50:00.046138 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040021 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 19:50:00.046138 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040024 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 19:50:00.046138 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040027 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 19:50:00.046138 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040030 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 19:50:00.046138 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040033 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 19:50:00.046138 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040036 2576 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 19:50:00.046138 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040039 2576 flags.go:64] FLAG: --enable-server="true" Jun 11 19:50:00.046138 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040042 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 19:50:00.046138 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040046 2576 flags.go:64] FLAG: --event-burst="100" Jun 11 19:50:00.046138 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040049 2576 flags.go:64] FLAG: --event-qps="50" Jun 11 19:50:00.046138 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040052 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 19:50:00.046138 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040055 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 19:50:00.046138 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040058 2576 flags.go:64] FLAG: --eviction-hard="" Jun 11 19:50:00.046138 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040062 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 19:50:00.046138 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040065 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 19:50:00.046138 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040068 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 19:50:00.046138 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040071 2576 flags.go:64] FLAG: --eviction-soft="" Jun 11 19:50:00.046138 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040082 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 19:50:00.046138 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040086 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 19:50:00.046138 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040090 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 19:50:00.046757 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040093 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 19:50:00.046757 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040095 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 19:50:00.046757 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040098 2576 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 19:50:00.046757 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040101 2576 flags.go:64] FLAG: --feature-gates="" Jun 11 19:50:00.046757 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040105 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 19:50:00.046757 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040107 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 19:50:00.046757 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040110 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 19:50:00.046757 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040113 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 19:50:00.046757 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040116 2576 flags.go:64] FLAG: --healthz-port="10248" Jun 11 19:50:00.046757 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040134 2576 flags.go:64] FLAG: --help="false" Jun 11 19:50:00.046757 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040137 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-137-247.ec2.internal" Jun 11 19:50:00.046757 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040140 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 19:50:00.046757 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040143 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 19:50:00.046757 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040146 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 19:50:00.046757 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040149 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 19:50:00.046757 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040153 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 19:50:00.046757 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040156 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 19:50:00.046757 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040158 2576 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 19:50:00.046757 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040161 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 19:50:00.046757 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040164 2576 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 19:50:00.046757 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040166 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 19:50:00.046757 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040169 2576 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 19:50:00.046757 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040172 2576 flags.go:64] FLAG: --kube-reserved="" Jun 11 19:50:00.046757 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040175 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 19:50:00.047352 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040177 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 19:50:00.047352 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040180 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 19:50:00.047352 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040183 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 19:50:00.047352 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040186 2576 flags.go:64] FLAG: --lock-file="" Jun 11 19:50:00.047352 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040188 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 19:50:00.047352 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040193 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 19:50:00.047352 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040197 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 19:50:00.047352 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040203 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 19:50:00.047352 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040206 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 19:50:00.047352 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040209 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 19:50:00.047352 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040212 2576 flags.go:64] FLAG: --logging-format="text" Jun 11 19:50:00.047352 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040215 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 19:50:00.047352 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040218 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 19:50:00.047352 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040221 2576 flags.go:64] FLAG: --manifest-url="" Jun 11 19:50:00.047352 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040224 2576 flags.go:64] FLAG: --manifest-url-header="" Jun 11 19:50:00.047352 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040228 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 19:50:00.047352 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040231 2576 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 19:50:00.047352 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040234 2576 flags.go:64] FLAG: --max-pods="110" Jun 11 19:50:00.047352 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040237 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 19:50:00.047352 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040240 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 19:50:00.047352 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040243 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 19:50:00.047352 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040246 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 19:50:00.047352 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040249 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 19:50:00.047352 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040252 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 19:50:00.047352 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040255 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 19:50:00.047978 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040271 2576 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 19:50:00.047978 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040274 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 19:50:00.047978 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040277 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 19:50:00.047978 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040280 2576 flags.go:64] FLAG: --pod-cidr="" Jun 11 19:50:00.047978 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040283 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 11 19:50:00.047978 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040289 2576 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 19:50:00.047978 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040292 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 19:50:00.047978 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040295 2576 flags.go:64] FLAG: --pods-per-core="0" Jun 11 19:50:00.047978 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040297 2576 flags.go:64] FLAG: --port="10250" Jun 11 19:50:00.047978 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040300 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 19:50:00.047978 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040303 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fd90228684567248" Jun 11 19:50:00.047978 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040306 2576 flags.go:64] FLAG: --qos-reserved="" Jun 11 19:50:00.047978 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040315 2576 flags.go:64] FLAG: --read-only-port="10255" Jun 11 19:50:00.047978 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040318 2576 flags.go:64] FLAG: --register-node="true" Jun 11 19:50:00.047978 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040323 2576 flags.go:64] FLAG: --register-with-taints="" Jun 11 19:50:00.047978 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040326 2576 flags.go:64] FLAG: --registry-burst="10" Jun 11 19:50:00.047978 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040329 2576 flags.go:64] FLAG: --registry-qps="5" Jun 11 19:50:00.047978 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040332 2576 flags.go:64] FLAG: --reserved-cpus="" Jun 11 19:50:00.047978 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040335 2576 flags.go:64] FLAG: --reserved-memory="" Jun 11 19:50:00.047978 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040339 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 19:50:00.047978 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040342 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 19:50:00.047978 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040345 2576 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 19:50:00.047978 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040348 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 19:50:00.047978 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040350 2576 flags.go:64] FLAG: --runonce="false" Jun 11 19:50:00.047978 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040353 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 19:50:00.048613 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040356 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 19:50:00.048613 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040359 2576 flags.go:64] FLAG: --seccomp-default="false" Jun 11 19:50:00.048613 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040362 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 19:50:00.048613 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040364 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 19:50:00.048613 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040367 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 19:50:00.048613 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040371 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 19:50:00.048613 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040374 2576 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 19:50:00.048613 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040377 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 19:50:00.048613 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040379 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 19:50:00.048613 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040382 2576 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 19:50:00.048613 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040385 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 19:50:00.048613 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040388 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 19:50:00.048613 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040391 2576 flags.go:64] FLAG: --system-cgroups="" Jun 11 19:50:00.048613 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040393 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 19:50:00.048613 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040398 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 19:50:00.048613 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040401 2576 flags.go:64] FLAG: --tls-cert-file="" Jun 11 19:50:00.048613 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040404 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 19:50:00.048613 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040408 2576 flags.go:64] FLAG: --tls-min-version="" Jun 11 19:50:00.048613 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040410 2576 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 19:50:00.048613 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040415 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 19:50:00.048613 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040417 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 19:50:00.048613 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040422 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 19:50:00.048613 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040425 2576 flags.go:64] FLAG: --v="2" Jun 11 19:50:00.048613 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040429 2576 flags.go:64] FLAG: --version="false" Jun 11 19:50:00.048613 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040433 2576 flags.go:64] FLAG: --vmodule="" Jun 11 19:50:00.049320 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040436 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 19:50:00.049320 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.040440 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 19:50:00.049320 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040560 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:50:00.049320 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040563 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:50:00.049320 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040567 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:50:00.049320 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040571 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:50:00.049320 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040575 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:50:00.049320 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040578 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:50:00.049320 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040581 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:50:00.049320 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040583 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:50:00.049320 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040586 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:50:00.049320 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040588 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:50:00.049320 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040591 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:50:00.049320 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040594 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:50:00.049320 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040597 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:50:00.049320 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040599 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:50:00.049320 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040604 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:50:00.049320 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040607 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:50:00.049320 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040611 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:50:00.049805 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040614 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:50:00.049805 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040617 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:50:00.049805 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040620 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:50:00.049805 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040622 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:50:00.049805 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040625 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:50:00.049805 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040628 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:50:00.049805 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040630 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:50:00.049805 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040635 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:50:00.049805 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040637 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:50:00.049805 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040641 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:50:00.049805 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040644 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:50:00.049805 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040646 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:50:00.049805 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040649 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:50:00.049805 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040652 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:50:00.049805 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040655 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:50:00.049805 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040657 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:50:00.049805 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040660 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:50:00.049805 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040662 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:50:00.049805 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040665 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:50:00.050276 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040667 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:50:00.050276 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040670 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:50:00.050276 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040672 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:50:00.050276 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040675 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:50:00.050276 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040678 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:50:00.050276 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040680 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:50:00.050276 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040683 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:50:00.050276 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040685 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:50:00.050276 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040688 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:50:00.050276 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040690 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:50:00.050276 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040693 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:50:00.050276 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040695 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:50:00.050276 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040698 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:50:00.050276 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040701 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:50:00.050276 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040705 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:50:00.050276 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040708 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:50:00.050276 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040710 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:50:00.050276 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040713 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:50:00.050276 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040716 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:50:00.050738 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040719 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:50:00.050738 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040723 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:50:00.050738 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040726 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:50:00.050738 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040730 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:50:00.050738 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040733 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:50:00.050738 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040736 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:50:00.050738 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040738 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:50:00.050738 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040741 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:50:00.050738 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040744 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:50:00.050738 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040747 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:50:00.050738 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040749 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:50:00.050738 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040752 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:50:00.050738 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040754 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:50:00.050738 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040756 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:50:00.050738 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040759 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:50:00.050738 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040762 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:50:00.050738 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040764 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:50:00.050738 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040767 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:50:00.050738 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040770 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:50:00.050738 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040772 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:50:00.051250 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040775 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:50:00.051250 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040777 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:50:00.051250 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040779 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:50:00.051250 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040782 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:50:00.051250 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040784 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:50:00.051250 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040787 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:50:00.051250 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040789 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:50:00.051250 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040792 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:50:00.051250 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040794 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:50:00.051250 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040797 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:50:00.051250 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040799 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:50:00.051250 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040802 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:50:00.051250 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040804 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:50:00.051250 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040808 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:50:00.051250 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040810 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:50:00.051250 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040815 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:50:00.051250 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040818 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:50:00.051250 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040820 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:50:00.051250 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040823 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:50:00.051250 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040825 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:50:00.051747 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040828 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:50:00.051747 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040831 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:50:00.051747 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040834 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:50:00.051747 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.040837 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:50:00.051747 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.041742 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 19:50:00.051747 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.048906 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 19:50:00.051747 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.049008 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 19:50:00.051747 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.049028 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 19:50:00.051747 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.049033 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 19:50:00.051747 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049090 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:50:00.051747 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049095 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:50:00.051747 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049098 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:50:00.051747 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049101 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:50:00.051747 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049104 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:50:00.052112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049107 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:50:00.052112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049110 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:50:00.052112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049113 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:50:00.052112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049115 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:50:00.052112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049118 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:50:00.052112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049134 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:50:00.052112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049137 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:50:00.052112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049140 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:50:00.052112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049142 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:50:00.052112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049145 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:50:00.052112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049148 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:50:00.052112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049152 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:50:00.052112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049156 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:50:00.052112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049159 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:50:00.052112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049162 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:50:00.052112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049165 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:50:00.052112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049169 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:50:00.052112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049173 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:50:00.052112 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049176 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:50:00.052618 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049180 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:50:00.052618 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049182 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:50:00.052618 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049185 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:50:00.052618 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049187 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:50:00.052618 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049190 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:50:00.052618 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049194 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:50:00.052618 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049196 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:50:00.052618 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049199 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:50:00.052618 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049202 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:50:00.052618 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049205 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:50:00.052618 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049208 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:50:00.052618 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049210 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:50:00.052618 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049213 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:50:00.052618 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049215 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:50:00.052618 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049218 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:50:00.052618 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049221 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:50:00.052618 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049223 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:50:00.052618 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049226 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:50:00.052618 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049229 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:50:00.052618 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049232 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:50:00.053107 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049236 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:50:00.053107 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049239 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:50:00.053107 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049241 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:50:00.053107 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049244 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:50:00.053107 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049246 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:50:00.053107 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049249 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:50:00.053107 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049251 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:50:00.053107 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049254 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:50:00.053107 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049256 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:50:00.053107 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049259 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:50:00.053107 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049261 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:50:00.053107 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049264 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:50:00.053107 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049266 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:50:00.053107 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049269 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:50:00.053107 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049272 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:50:00.053107 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049274 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:50:00.053107 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049277 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:50:00.053107 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049281 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:50:00.053107 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049283 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:50:00.053107 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049286 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:50:00.053607 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049289 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:50:00.053607 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049291 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:50:00.053607 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049294 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:50:00.053607 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049296 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:50:00.053607 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049299 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:50:00.053607 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049302 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:50:00.053607 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049304 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:50:00.053607 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049307 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:50:00.053607 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049310 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:50:00.053607 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049312 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:50:00.053607 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049315 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:50:00.053607 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049317 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:50:00.053607 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049320 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:50:00.053607 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049323 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:50:00.053607 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049326 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:50:00.053607 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049329 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:50:00.053607 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049332 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:50:00.053607 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049334 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:50:00.053607 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049337 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:50:00.053607 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049340 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:50:00.053607 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049342 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:50:00.054254 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049345 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:50:00.054254 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049348 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:50:00.054254 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049350 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:50:00.054254 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049353 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:50:00.054254 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049356 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:50:00.054254 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049359 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:50:00.054254 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049362 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:50:00.054254 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049365 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:50:00.054254 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049368 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:50:00.054254 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049371 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:50:00.054254 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049374 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:50:00.054254 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049377 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:50:00.054254 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049379 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:50:00.054254 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049382 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:50:00.054254 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.049387 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 19:50:00.054649 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049520 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:50:00.054649 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049525 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:50:00.054649 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049528 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:50:00.054649 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049531 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:50:00.054649 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049533 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:50:00.054649 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049536 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:50:00.054649 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049539 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:50:00.054649 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049541 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:50:00.054649 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049544 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:50:00.054649 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049546 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:50:00.054649 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049549 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:50:00.054649 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049552 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:50:00.054649 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049554 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:50:00.054649 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049557 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:50:00.054649 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049559 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:50:00.054649 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049562 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:50:00.054649 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049564 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:50:00.054649 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049567 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:50:00.054649 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049569 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:50:00.054649 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049572 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:50:00.055134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049574 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:50:00.055134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049577 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:50:00.055134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049579 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:50:00.055134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049582 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:50:00.055134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049585 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:50:00.055134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049589 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:50:00.055134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049593 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:50:00.055134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049596 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:50:00.055134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049598 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:50:00.055134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049601 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:50:00.055134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049604 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:50:00.055134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049606 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:50:00.055134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049608 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:50:00.055134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049611 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:50:00.055134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049613 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:50:00.055134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049616 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:50:00.055134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049618 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:50:00.055134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049621 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:50:00.055134 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049623 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:50:00.055692 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049626 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:50:00.055692 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049628 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:50:00.055692 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049630 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:50:00.055692 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049633 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:50:00.055692 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049635 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:50:00.055692 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049638 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:50:00.055692 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049640 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:50:00.055692 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049643 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:50:00.055692 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049645 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:50:00.055692 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049648 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:50:00.055692 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049651 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:50:00.055692 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049653 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:50:00.055692 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049656 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:50:00.055692 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049659 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:50:00.055692 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049661 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:50:00.055692 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049663 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:50:00.055692 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049666 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:50:00.055692 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049675 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:50:00.055692 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049678 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:50:00.056222 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049681 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:50:00.056222 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049683 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:50:00.056222 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049686 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:50:00.056222 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049688 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:50:00.056222 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049691 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:50:00.056222 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049693 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:50:00.056222 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049696 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:50:00.056222 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049699 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:50:00.056222 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049701 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:50:00.056222 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049703 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:50:00.056222 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049706 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:50:00.056222 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049709 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:50:00.056222 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049711 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:50:00.056222 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049713 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:50:00.056222 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049716 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:50:00.056222 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049719 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:50:00.056222 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049721 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:50:00.056222 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049723 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:50:00.056222 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049726 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:50:00.056222 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049728 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:50:00.057046 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049731 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:50:00.057046 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049733 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:50:00.057046 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049736 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:50:00.057046 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049738 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:50:00.057046 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049741 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:50:00.057046 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049744 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:50:00.057046 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049746 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:50:00.057046 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049749 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:50:00.057046 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049751 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:50:00.057046 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049754 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:50:00.057046 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049758 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:50:00.057046 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049767 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:50:00.057046 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049770 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:50:00.057046 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049775 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:50:00.057046 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049778 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:50:00.057046 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049780 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:50:00.057046 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049783 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:50:00.057046 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049786 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:50:00.057046 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049788 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:50:00.057594 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049791 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:50:00.057594 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:00.049793 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:50:00.057594 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.049797 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 19:50:00.057594 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.049891 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 19:50:00.057594 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.052324 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 19:50:00.057594 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.054012 2576 server.go:1019] "Starting client certificate rotation" Jun 11 19:50:00.057594 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.054145 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 19:50:00.057594 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.054184 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 19:50:00.057594 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.056767 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 19:50:00.057865 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.057847 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 19:50:00.070762 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.070733 2576 log.go:25] "Validated CRI v1 runtime API" Jun 11 19:50:00.076908 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.076893 2576 log.go:25] "Validated CRI v1 image API" Jun 11 19:50:00.078690 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.078673 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 19:50:00.081995 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.081972 2576 fs.go:135] Filesystem UUIDs: map[27588cce-7f08-4753-90ba-8f5057ba39dd:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e473771d-c08b-4fd9-a6b6-7404d3887a66:/dev/nvme0n1p3] Jun 11 19:50:00.082058 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.081993 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 19:50:00.084908 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.084891 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 19:50:00.088138 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.088013 2576 manager.go:216] Machine: {Timestamp:2026-06-11 19:50:00.085536009 +0000 UTC m=+0.363296758 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098730 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec218589586b372e9785a401d2c592d1 SystemUUID:ec218589-586b-372e-9785-a401d2c592d1 BootID:04dee54f-6de6-4d7b-bc9f-5594e5a26679 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3e:59:06:4c:99 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3e:59:06:4c:99 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:03:b2:1d:77:75 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 19:50:00.088138 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.088133 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 19:50:00.088239 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.088207 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 19:50:00.091756 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.091732 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 19:50:00.091875 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.091759 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-247.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 19:50:00.092601 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.092590 2576 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 19:50:00.092640 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.092603 2576 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 19:50:00.092640 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.092610 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 19:50:00.092640 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.092624 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 19:50:00.094624 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.094614 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 19:50:00.099302 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.099291 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 11 19:50:00.099419 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.099409 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 19:50:00.099452 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.099437 2576 kubelet.go:486] "Attempting to sync node with API server" Jun 11 19:50:00.099452 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.099451 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 19:50:00.099511 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.099465 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 19:50:00.099511 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.099475 2576 kubelet.go:398] "Adding apiserver pod source" Jun 11 19:50:00.099511 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.099483 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 19:50:00.099780 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.099760 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 19:50:00.099780 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.099779 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 19:50:00.102138 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.102104 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 19:50:00.103849 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.103833 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 19:50:00.103926 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.103873 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 19:50:00.104068 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.104055 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 19:50:00.104153 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.104083 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 19:50:00.104153 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.104094 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 19:50:00.104153 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.104102 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 19:50:00.104153 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.104114 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 19:50:00.104153 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.104140 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 19:50:00.104700 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.104690 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 19:50:00.104752 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.104703 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 19:50:00.104752 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.104715 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 19:50:00.104752 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.104724 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 19:50:00.104752 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.104744 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 19:50:00.104876 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.104757 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 19:50:00.105632 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.105621 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 19:50:00.105700 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.105634 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 19:50:00.108572 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.108556 2576 server.go:1268] "Started kubelet" Jun 11 19:50:00.108986 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.108816 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 19:50:00.109152 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.108742 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 19:50:00.109335 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.109320 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 19:50:00.109558 ip-10-0-137-247 systemd[1]: Started Kubernetes Kubelet. Jun 11 19:50:00.114330 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:00.114292 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 19:50:00.114444 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.114400 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 19:50:00.114545 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:00.114517 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-247.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 19:50:00.114545 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.114543 2576 server.go:310] "Adding debug handlers to kubelet server" Jun 11 19:50:00.114687 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.114608 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-247.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 19:50:00.117403 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:00.117157 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 19:50:00.120655 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.120637 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 19:50:00.120655 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.120651 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 19:50:00.120783 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:00.120727 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-247.ec2.internal\" not found" Jun 11 19:50:00.121328 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.121295 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 19:50:00.121328 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.121297 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 19:50:00.121328 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.121312 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 19:50:00.121560 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.121463 2576 factory.go:55] Registering systemd factory Jun 11 19:50:00.121560 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.121485 2576 factory.go:223] Registration of the systemd container factory successfully Jun 11 19:50:00.121560 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.121507 2576 reconstruct.go:97] "Volume reconstruction finished" Jun 11 19:50:00.121560 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.121536 2576 reconciler.go:29] "Reconciler: start to sync state" Jun 11 19:50:00.121560 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:00.120319 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-247.ec2.internal.18b81eb172c4319a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-247.ec2.internal,UID:ip-10-0-137-247.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-247.ec2.internal,},FirstTimestamp:2026-06-11 19:50:00.108536218 +0000 UTC m=+0.386296967,LastTimestamp:2026-06-11 19:50:00.108536218 +0000 UTC m=+0.386296967,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-247.ec2.internal,}" Jun 11 19:50:00.121786 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.121691 2576 factory.go:153] Registering CRI-O factory Jun 11 19:50:00.121786 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.121702 2576 factory.go:223] Registration of the crio container factory successfully Jun 11 19:50:00.121786 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.121749 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 19:50:00.121786 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.121772 2576 factory.go:103] Registering Raw factory Jun 11 19:50:00.121786 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.121788 2576 manager.go:1196] Started watching for new ooms in manager Jun 11 19:50:00.122192 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.122179 2576 manager.go:349] Starting recovery of all containers Jun 11 19:50:00.132487 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.132468 2576 manager.go:354] Recovery completed Jun 11 19:50:00.132487 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:00.132474 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-247.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 19:50:00.132616 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:00.132498 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 19:50:00.136707 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.136694 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:50:00.138813 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.138795 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:50:00.138897 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.138826 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:50:00.138897 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.138837 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:50:00.139355 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.139341 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 19:50:00.139422 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.139356 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 19:50:00.139422 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.139369 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:50:00.139492 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.139374 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 11 19:50:00.140269 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.140251 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:50:00.140342 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.140278 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:50:00.140342 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.140288 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:50:00.141694 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.141679 2576 policy_none.go:49] "None policy: Start" Jun 11 19:50:00.141768 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.141698 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 19:50:00.141768 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.141713 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 19:50:00.143732 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.143718 2576 policy_none.go:47] "Start" Jun 11 19:50:00.144043 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.144024 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7b4c7" Jun 11 19:50:00.150322 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:00.150265 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-247.ec2.internal.18b81eb174922c74 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-247.ec2.internal,UID:ip-10-0-137-247.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-247.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-247.ec2.internal,},FirstTimestamp:2026-06-11 19:50:00.138812532 +0000 UTC m=+0.416573280,LastTimestamp:2026-06-11 19:50:00.138812532 +0000 UTC m=+0.416573280,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-247.ec2.internal,}" Jun 11 19:50:00.153010 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.152996 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7b4c7" Jun 11 19:50:00.158880 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:00.158787 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-247.ec2.internal.18b81eb1749273ff default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-247.ec2.internal,UID:ip-10-0-137-247.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-247.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-247.ec2.internal,},FirstTimestamp:2026-06-11 19:50:00.138830847 +0000 UTC m=+0.416591595,LastTimestamp:2026-06-11 19:50:00.138830847 +0000 UTC m=+0.416591595,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-247.ec2.internal,}" Jun 11 19:50:00.187728 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.187710 2576 manager.go:337] "Starting Device Plugin manager" Jun 11 19:50:00.202964 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:00.187762 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 19:50:00.202964 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.187776 2576 server.go:87] "Starting device plugin registration server" Jun 11 19:50:00.202964 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.188025 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 19:50:00.202964 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.188037 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 19:50:00.202964 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.188142 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 19:50:00.202964 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.188237 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 19:50:00.202964 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.188250 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 19:50:00.202964 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:00.189049 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 19:50:00.202964 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:00.189090 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-247.ec2.internal\" not found" Jun 11 19:50:00.202964 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.189431 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 19:50:00.202964 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.190563 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 19:50:00.202964 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.190606 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 19:50:00.202964 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.190626 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 19:50:00.202964 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:00.190693 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 19:50:00.202964 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.192551 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:50:00.288954 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.288870 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:50:00.289899 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.289879 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:50:00.289986 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.289912 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:50:00.289986 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.289922 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:50:00.289986 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.289947 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-247.ec2.internal" Jun 11 19:50:00.290953 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.290935 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-247.ec2.internal"] Jun 11 19:50:00.291014 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.291006 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:50:00.291796 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.291781 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:50:00.291871 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.291811 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:50:00.291871 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.291825 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:50:00.294181 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.294169 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:50:00.294314 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.294289 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal" Jun 11 19:50:00.294349 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.294332 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:50:00.294862 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.294847 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:50:00.294942 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.294876 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:50:00.294942 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.294890 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:50:00.294942 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.294849 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:50:00.294942 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.294943 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:50:00.295116 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.294958 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:50:00.296905 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.296890 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-247.ec2.internal" Jun 11 19:50:00.297004 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:00.296907 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-247.ec2.internal\": node \"ip-10-0-137-247.ec2.internal\" not found" Jun 11 19:50:00.297271 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.297257 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-247.ec2.internal" Jun 11 19:50:00.297354 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.297279 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:50:00.297943 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.297929 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:50:00.297943 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.297952 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:50:00.298064 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.297965 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:50:00.317663 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:00.317644 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-247.ec2.internal\" not found" node="ip-10-0-137-247.ec2.internal" Jun 11 19:50:00.320962 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:00.320944 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-247.ec2.internal\" not found" Jun 11 19:50:00.321509 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:00.321495 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-247.ec2.internal\" not found" node="ip-10-0-137-247.ec2.internal" Jun 11 19:50:00.322540 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.322526 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fbb096cc08e0623b4ecaeee81385785b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal\" (UID: \"fbb096cc08e0623b4ecaeee81385785b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal" Jun 11 19:50:00.322589 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.322547 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbb096cc08e0623b4ecaeee81385785b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal\" (UID: \"fbb096cc08e0623b4ecaeee81385785b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal" Jun 11 19:50:00.322589 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.322563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e15e0f7f81589bcd73e7fe66f326b60b-config\") pod \"kube-apiserver-proxy-ip-10-0-137-247.ec2.internal\" (UID: \"e15e0f7f81589bcd73e7fe66f326b60b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-247.ec2.internal" Jun 11 19:50:00.421572 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:00.421546 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-247.ec2.internal\" not found" Jun 11 19:50:00.422676 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.422655 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fbb096cc08e0623b4ecaeee81385785b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal\" (UID: \"fbb096cc08e0623b4ecaeee81385785b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal" Jun 11 19:50:00.422798 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.422680 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbb096cc08e0623b4ecaeee81385785b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal\" (UID: \"fbb096cc08e0623b4ecaeee81385785b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal" Jun 11 19:50:00.422798 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.422698 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e15e0f7f81589bcd73e7fe66f326b60b-config\") pod \"kube-apiserver-proxy-ip-10-0-137-247.ec2.internal\" (UID: \"e15e0f7f81589bcd73e7fe66f326b60b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-247.ec2.internal" Jun 11 19:50:00.422798 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.422737 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e15e0f7f81589bcd73e7fe66f326b60b-config\") pod \"kube-apiserver-proxy-ip-10-0-137-247.ec2.internal\" (UID: \"e15e0f7f81589bcd73e7fe66f326b60b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-247.ec2.internal" Jun 11 19:50:00.422798 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.422768 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbb096cc08e0623b4ecaeee81385785b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal\" (UID: \"fbb096cc08e0623b4ecaeee81385785b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal" Jun 11 19:50:00.422798 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.422768 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fbb096cc08e0623b4ecaeee81385785b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal\" (UID: \"fbb096cc08e0623b4ecaeee81385785b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal" Jun 11 19:50:00.521859 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:00.521821 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-247.ec2.internal\" not found" Jun 11 19:50:00.620338 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.620301 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal" Jun 11 19:50:00.622465 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:00.622447 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-247.ec2.internal\" not found" Jun 11 19:50:00.626602 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.626577 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-247.ec2.internal" Jun 11 19:50:00.723386 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:00.723352 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-247.ec2.internal\" not found" Jun 11 19:50:00.823712 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:00.823684 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-247.ec2.internal\" not found" Jun 11 19:50:00.924170 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:00.924086 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-247.ec2.internal\" not found" Jun 11 19:50:00.972924 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:00.972903 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:50:01.025146 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:01.025112 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-247.ec2.internal\" not found" Jun 11 19:50:01.053294 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:01.053267 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 19:50:01.053841 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:01.053424 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 19:50:01.053841 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:01.053451 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 19:50:01.125885 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:01.125857 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-247.ec2.internal\" not found" Jun 11 19:50:01.145202 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:01.145166 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbb096cc08e0623b4ecaeee81385785b.slice/crio-8dfe9e43c791b4fc0a4164193f682db8e926a52e53a976fbee0423404f39d707 WatchSource:0}: Error finding container 8dfe9e43c791b4fc0a4164193f682db8e926a52e53a976fbee0423404f39d707: Status 404 returned error can't find the container with id 8dfe9e43c791b4fc0a4164193f682db8e926a52e53a976fbee0423404f39d707 Jun 11 19:50:01.145510 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:01.145491 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode15e0f7f81589bcd73e7fe66f326b60b.slice/crio-a3ee2b1ebc89fe217c22e75bfe4c405c875d2caf7353a41b140c6d0422a179a3 WatchSource:0}: Error finding container a3ee2b1ebc89fe217c22e75bfe4c405c875d2caf7353a41b140c6d0422a179a3: Status 404 returned error can't find the container with id a3ee2b1ebc89fe217c22e75bfe4c405c875d2caf7353a41b140c6d0422a179a3 Jun 11 19:50:01.149712 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:01.149695 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 19:50:01.159108 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:01.159075 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 19:45:00 +0000 UTC" deadline="2028-03-21 12:24:20.226460298 +0000 UTC" Jun 11 19:50:01.159200 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:01.159109 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15568h34m19.067355111s" Jun 11 19:50:01.194291 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:01.194202 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-247.ec2.internal" event={"ID":"e15e0f7f81589bcd73e7fe66f326b60b","Type":"ContainerStarted","Data":"a3ee2b1ebc89fe217c22e75bfe4c405c875d2caf7353a41b140c6d0422a179a3"} Jun 11 19:50:01.195213 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:01.195193 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal" event={"ID":"fbb096cc08e0623b4ecaeee81385785b","Type":"ContainerStarted","Data":"8dfe9e43c791b4fc0a4164193f682db8e926a52e53a976fbee0423404f39d707"} Jun 11 19:50:01.226589 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:01.226562 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-247.ec2.internal\" not found" Jun 11 19:50:01.273746 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:01.273723 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:50:01.274652 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:01.274633 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:50:01.274727 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:01.274660 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:50:01.274727 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:01.274670 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:50:01.327651 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:01.327627 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-247.ec2.internal\" not found" Jun 11 19:50:01.427988 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:01.427963 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-247.ec2.internal\" not found" Jun 11 19:50:01.526437 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:01.526365 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:50:01.621357 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:01.621151 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal" Jun 11 19:50:01.636674 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:01.636653 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 19:50:01.638737 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:01.638704 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-247.ec2.internal" Jun 11 19:50:01.650566 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:01.650548 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 19:50:01.667355 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:01.667330 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:50:02.100759 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.100729 2576 apiserver.go:52] "Watching apiserver" Jun 11 19:50:02.110849 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.110818 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 19:50:02.111904 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.111883 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-rgjlh","openshift-image-registry/node-ca-mc6x6","openshift-multus/multus-2trvq","openshift-network-operator/iptables-alerter-dhc6t","openshift-ovn-kubernetes/ovnkube-node-hrb9t","kube-system/global-pull-secret-syncer-jddtw","kube-system/kube-apiserver-proxy-ip-10-0-137-247.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7r7h","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal","openshift-multus/multus-additional-cni-plugins-5d69r","openshift-multus/network-metrics-daemon-lrgwp","openshift-network-diagnostics/network-check-target-2rn74","kube-system/konnectivity-agent-jm7ml","openshift-cluster-node-tuning-operator/tuned-wgbgr"] Jun 11 19:50:02.114700 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.114679 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5d69r" Jun 11 19:50:02.116788 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.116767 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jm7ml" Jun 11 19:50:02.117695 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.117487 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 19:50:02.117792 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.117494 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 19:50:02.117853 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.117536 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-x9sdq\"" Jun 11 19:50:02.117853 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.117540 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 19:50:02.117853 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.117584 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 19:50:02.117999 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.117599 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 19:50:02.118952 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.118931 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.119145 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.119113 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 19:50:02.119482 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.119438 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 19:50:02.119482 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.119464 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nr5wz\"" Jun 11 19:50:02.121388 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.121000 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 19:50:02.121388 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.121233 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dhc6t" Jun 11 19:50:02.121388 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.121312 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-w4dkx\"" Jun 11 19:50:02.121606 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.121588 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 19:50:02.123477 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.123459 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.123704 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.123465 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 19:50:02.123844 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.123827 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 19:50:02.123978 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.123957 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 19:50:02.124081 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.123983 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-swjx7\"" Jun 11 19:50:02.125992 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.125774 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:50:02.125992 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:02.125850 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jddtw" podUID="f6a5da50-2b05-42de-8aa9-a23e838da830" Jun 11 19:50:02.125992 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.125883 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 19:50:02.125992 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.125888 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 19:50:02.126249 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.126105 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 19:50:02.127184 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.127168 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gjqmw\"" Jun 11 19:50:02.127302 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.127212 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 19:50:02.127370 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.127229 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 19:50:02.127370 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.127234 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 19:50:02.128212 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.128185 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.130549 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.130531 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kz8fb\"" Jun 11 19:50:02.130667 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.130652 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7r7h" Jun 11 19:50:02.131038 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.131020 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 19:50:02.131147 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.131070 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 19:50:02.131567 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.131549 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-run-ovn\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.131643 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.131601 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-host-run-ovn-kubernetes\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.131643 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.131630 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/85a48db4-30bf-47f2-9668-8b0a67c26fe4-ovnkube-script-lib\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.131746 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.131654 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/143be408-3d56-48e6-87d3-3e2746001044-cni-binary-copy\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.131746 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.131679 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbvfj\" (UniqueName: \"kubernetes.io/projected/5bb1879c-50b2-47e1-a3f6-95e8b36ca724-kube-api-access-fbvfj\") pod \"iptables-alerter-dhc6t\" (UID: \"5bb1879c-50b2-47e1-a3f6-95e8b36ca724\") " pod="openshift-network-operator/iptables-alerter-dhc6t" Jun 11 19:50:02.131746 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.131733 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-host-slash\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.131859 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.131776 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-var-lib-openvswitch\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.131859 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.131805 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/02067c5b-4d64-4458-ab32-b005f9546ec9-cnibin\") pod \"multus-additional-cni-plugins-5d69r\" (UID: \"02067c5b-4d64-4458-ab32-b005f9546ec9\") " pod="openshift-multus/multus-additional-cni-plugins-5d69r" Jun 11 19:50:02.131859 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.131830 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1faca528-a502-4643-9533-a66900535be2-konnectivity-ca\") pod \"konnectivity-agent-jm7ml\" (UID: \"1faca528-a502-4643-9533-a66900535be2\") " pod="kube-system/konnectivity-agent-jm7ml" Jun 11 19:50:02.131859 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.131853 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-cnibin\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.132014 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.131875 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-os-release\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.132014 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.131897 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5bb1879c-50b2-47e1-a3f6-95e8b36ca724-host-slash\") pod \"iptables-alerter-dhc6t\" (UID: \"5bb1879c-50b2-47e1-a3f6-95e8b36ca724\") " pod="openshift-network-operator/iptables-alerter-dhc6t" Jun 11 19:50:02.132014 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.131919 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-host-run-netns\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.132014 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.131942 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-node-log\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.132014 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.131984 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/02067c5b-4d64-4458-ab32-b005f9546ec9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5d69r\" (UID: \"02067c5b-4d64-4458-ab32-b005f9546ec9\") " pod="openshift-multus/multus-additional-cni-plugins-5d69r" Jun 11 19:50:02.132313 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132018 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-host-var-lib-kubelet\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.132313 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132050 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-multus-conf-dir\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.132313 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132106 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk2gq\" (UniqueName: \"kubernetes.io/projected/143be408-3d56-48e6-87d3-3e2746001044-kube-api-access-rk2gq\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.132313 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132164 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/02067c5b-4d64-4458-ab32-b005f9546ec9-os-release\") pod \"multus-additional-cni-plugins-5d69r\" (UID: \"02067c5b-4d64-4458-ab32-b005f9546ec9\") " pod="openshift-multus/multus-additional-cni-plugins-5d69r" Jun 11 19:50:02.132313 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132201 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/02067c5b-4d64-4458-ab32-b005f9546ec9-cni-binary-copy\") pod \"multus-additional-cni-plugins-5d69r\" (UID: \"02067c5b-4d64-4458-ab32-b005f9546ec9\") " pod="openshift-multus/multus-additional-cni-plugins-5d69r" Jun 11 19:50:02.132313 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132256 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-run-systemd\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.132313 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132278 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/85a48db4-30bf-47f2-9668-8b0a67c26fe4-env-overrides\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.132313 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132303 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/85a48db4-30bf-47f2-9668-8b0a67c26fe4-ovn-node-metrics-cert\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.132644 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132327 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/02067c5b-4d64-4458-ab32-b005f9546ec9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5d69r\" (UID: \"02067c5b-4d64-4458-ab32-b005f9546ec9\") " pod="openshift-multus/multus-additional-cni-plugins-5d69r" Jun 11 19:50:02.132644 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132343 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/02067c5b-4d64-4458-ab32-b005f9546ec9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5d69r\" (UID: \"02067c5b-4d64-4458-ab32-b005f9546ec9\") " pod="openshift-multus/multus-additional-cni-plugins-5d69r" Jun 11 19:50:02.132644 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132372 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sdmv\" (UniqueName: \"kubernetes.io/projected/02067c5b-4d64-4458-ab32-b005f9546ec9-kube-api-access-8sdmv\") pod \"multus-additional-cni-plugins-5d69r\" (UID: \"02067c5b-4d64-4458-ab32-b005f9546ec9\") " pod="openshift-multus/multus-additional-cni-plugins-5d69r" Jun 11 19:50:02.132644 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132410 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-etc-openvswitch\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.132644 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132437 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-system-cni-dir\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.132644 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132460 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-multus-cni-dir\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.132644 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132484 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-host-run-k8s-cni-cncf-io\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.132644 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132509 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-host-var-lib-cni-bin\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.132644 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132545 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-etc-kubernetes\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.132644 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132567 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5bb1879c-50b2-47e1-a3f6-95e8b36ca724-iptables-alerter-script\") pod \"iptables-alerter-dhc6t\" (UID: \"5bb1879c-50b2-47e1-a3f6-95e8b36ca724\") " pod="openshift-network-operator/iptables-alerter-dhc6t" Jun 11 19:50:02.132644 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132589 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-log-socket\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.132644 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132613 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-host-cni-bin\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.132644 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132636 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1faca528-a502-4643-9533-a66900535be2-agent-certs\") pod \"konnectivity-agent-jm7ml\" (UID: \"1faca528-a502-4643-9533-a66900535be2\") " pod="kube-system/konnectivity-agent-jm7ml" Jun 11 19:50:02.133284 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132657 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-host-run-netns\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.133284 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132680 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-host-var-lib-cni-multus\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.133284 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132703 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-hostroot\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.133284 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132731 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-host-run-multus-certs\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.133284 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132753 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02067c5b-4d64-4458-ab32-b005f9546ec9-system-cni-dir\") pod \"multus-additional-cni-plugins-5d69r\" (UID: \"02067c5b-4d64-4458-ab32-b005f9546ec9\") " pod="openshift-multus/multus-additional-cni-plugins-5d69r" Jun 11 19:50:02.133284 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132777 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-multus-socket-dir-parent\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.133284 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132799 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-272hb\" (UniqueName: \"kubernetes.io/projected/85a48db4-30bf-47f2-9668-8b0a67c26fe4-kube-api-access-272hb\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.133284 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132824 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-run-openvswitch\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.133284 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132843 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 19:50:02.133284 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132847 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-host-cni-netd\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.133284 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132918 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.133284 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132956 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/85a48db4-30bf-47f2-9668-8b0a67c26fe4-ovnkube-config\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.133284 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.132980 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/143be408-3d56-48e6-87d3-3e2746001044-multus-daemon-config\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.133284 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.133032 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-host-kubelet\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.133284 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.133059 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-systemd-units\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.133284 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.133060 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 19:50:02.133284 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.133074 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-t47h4\"" Jun 11 19:50:02.133888 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.133454 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 19:50:02.134398 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.134376 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mc6x6" Jun 11 19:50:02.134512 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.134480 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 19:50:02.136981 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.136774 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dm6ct\"" Jun 11 19:50:02.136981 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.136874 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 19:50:02.137116 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.137061 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 19:50:02.137190 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.137161 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 19:50:02.137586 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.137366 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rgjlh" Jun 11 19:50:02.139993 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.139976 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 19:50:02.140090 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.139980 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 19:50:02.140206 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.140190 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:50:02.140275 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.140248 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-687pg\"" Jun 11 19:50:02.140275 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:02.140256 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrgwp" podUID="ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99" Jun 11 19:50:02.142349 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.142332 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rn74" Jun 11 19:50:02.142440 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:02.142419 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rn74" podUID="d798bbe1-8647-4ec6-88da-24514bca83d1" Jun 11 19:50:02.166089 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.166069 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7mt96" Jun 11 19:50:02.174425 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.174404 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7mt96" Jun 11 19:50:02.222503 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.222479 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 19:50:02.233372 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.233345 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/02067c5b-4d64-4458-ab32-b005f9546ec9-cnibin\") pod \"multus-additional-cni-plugins-5d69r\" (UID: \"02067c5b-4d64-4458-ab32-b005f9546ec9\") " pod="openshift-multus/multus-additional-cni-plugins-5d69r" Jun 11 19:50:02.233502 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.233382 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1faca528-a502-4643-9533-a66900535be2-konnectivity-ca\") pod \"konnectivity-agent-jm7ml\" (UID: \"1faca528-a502-4643-9533-a66900535be2\") " pod="kube-system/konnectivity-agent-jm7ml" Jun 11 19:50:02.233502 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.233408 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-os-release\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.233502 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.233443 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/02067c5b-4d64-4458-ab32-b005f9546ec9-cnibin\") pod \"multus-additional-cni-plugins-5d69r\" (UID: \"02067c5b-4d64-4458-ab32-b005f9546ec9\") " pod="openshift-multus/multus-additional-cni-plugins-5d69r" Jun 11 19:50:02.233502 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.233466 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/abe83f4b-2288-46d2-8b25-4de9e634ff5b-registration-dir\") pod \"aws-ebs-csi-driver-node-m7r7h\" (UID: \"abe83f4b-2288-46d2-8b25-4de9e634ff5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7r7h" Jun 11 19:50:02.233502 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.233490 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-os-release\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.233746 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.233494 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-host-run-netns\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.233746 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.233538 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-host-run-netns\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.233746 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.233572 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-node-log\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.233746 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.233629 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/02067c5b-4d64-4458-ab32-b005f9546ec9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5d69r\" (UID: \"02067c5b-4d64-4458-ab32-b005f9546ec9\") " pod="openshift-multus/multus-additional-cni-plugins-5d69r" Jun 11 19:50:02.233746 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.233635 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-node-log\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.233746 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.233672 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-host-var-lib-kubelet\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.233746 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.233706 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f6a5da50-2b05-42de-8aa9-a23e838da830-dbus\") pod \"global-pull-secret-syncer-jddtw\" (UID: \"f6a5da50-2b05-42de-8aa9-a23e838da830\") " pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:50:02.233746 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.233728 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/548d858f-2ed3-4a90-b197-693ef3bfa7e9-tmp\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.234059 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.233752 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/02067c5b-4d64-4458-ab32-b005f9546ec9-cni-binary-copy\") pod \"multus-additional-cni-plugins-5d69r\" (UID: \"02067c5b-4d64-4458-ab32-b005f9546ec9\") " pod="openshift-multus/multus-additional-cni-plugins-5d69r" Jun 11 19:50:02.234059 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.233776 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/85a48db4-30bf-47f2-9668-8b0a67c26fe4-env-overrides\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.234059 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.233792 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-host-var-lib-kubelet\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.234059 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.233808 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/02067c5b-4d64-4458-ab32-b005f9546ec9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5d69r\" (UID: \"02067c5b-4d64-4458-ab32-b005f9546ec9\") " pod="openshift-multus/multus-additional-cni-plugins-5d69r" Jun 11 19:50:02.234059 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.233855 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/85a48db4-30bf-47f2-9668-8b0a67c26fe4-ovn-node-metrics-cert\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.234308 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234104 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1faca528-a502-4643-9533-a66900535be2-konnectivity-ca\") pod \"konnectivity-agent-jm7ml\" (UID: \"1faca528-a502-4643-9533-a66900535be2\") " pod="kube-system/konnectivity-agent-jm7ml" Jun 11 19:50:02.234308 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234182 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/02067c5b-4d64-4458-ab32-b005f9546ec9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5d69r\" (UID: \"02067c5b-4d64-4458-ab32-b005f9546ec9\") " pod="openshift-multus/multus-additional-cni-plugins-5d69r" Jun 11 19:50:02.234308 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234226 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/85a48db4-30bf-47f2-9668-8b0a67c26fe4-env-overrides\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.234308 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234232 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sdmv\" (UniqueName: \"kubernetes.io/projected/02067c5b-4d64-4458-ab32-b005f9546ec9-kube-api-access-8sdmv\") pod \"multus-additional-cni-plugins-5d69r\" (UID: \"02067c5b-4d64-4458-ab32-b005f9546ec9\") " pod="openshift-multus/multus-additional-cni-plugins-5d69r" Jun 11 19:50:02.234308 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234259 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-multus-cni-dir\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.234308 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234263 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 19:50:02.234308 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234285 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5bb1879c-50b2-47e1-a3f6-95e8b36ca724-iptables-alerter-script\") pod \"iptables-alerter-dhc6t\" (UID: \"5bb1879c-50b2-47e1-a3f6-95e8b36ca724\") " pod="openshift-network-operator/iptables-alerter-dhc6t" Jun 11 19:50:02.234308 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234298 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/02067c5b-4d64-4458-ab32-b005f9546ec9-cni-binary-copy\") pod \"multus-additional-cni-plugins-5d69r\" (UID: \"02067c5b-4d64-4458-ab32-b005f9546ec9\") " pod="openshift-multus/multus-additional-cni-plugins-5d69r" Jun 11 19:50:02.234671 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234360 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-multus-cni-dir\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.234671 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234459 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/02067c5b-4d64-4458-ab32-b005f9546ec9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5d69r\" (UID: \"02067c5b-4d64-4458-ab32-b005f9546ec9\") " pod="openshift-multus/multus-additional-cni-plugins-5d69r" Jun 11 19:50:02.234671 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234470 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99-metrics-certs\") pod \"network-metrics-daemon-lrgwp\" (UID: \"ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99\") " pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:50:02.234671 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234501 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-etc-openvswitch\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.234671 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234541 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-etc-openvswitch\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.234671 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234584 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-system-cni-dir\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.234671 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234651 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-host-var-lib-cni-bin\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.234983 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234682 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-etc-kubernetes\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.234983 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234688 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-system-cni-dir\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.234983 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234708 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/548d858f-2ed3-4a90-b197-693ef3bfa7e9-etc-sysctl-d\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.234983 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234731 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/548d858f-2ed3-4a90-b197-693ef3bfa7e9-run\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.234983 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234733 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-host-var-lib-cni-bin\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.234983 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234754 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/548d858f-2ed3-4a90-b197-693ef3bfa7e9-sys\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.234983 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234797 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/548d858f-2ed3-4a90-b197-693ef3bfa7e9-lib-modules\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.234983 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234799 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5bb1879c-50b2-47e1-a3f6-95e8b36ca724-iptables-alerter-script\") pod \"iptables-alerter-dhc6t\" (UID: \"5bb1879c-50b2-47e1-a3f6-95e8b36ca724\") " pod="openshift-network-operator/iptables-alerter-dhc6t" Jun 11 19:50:02.234983 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234823 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-log-socket\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.234983 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234767 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-etc-kubernetes\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.234983 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234849 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1faca528-a502-4643-9533-a66900535be2-agent-certs\") pod \"konnectivity-agent-jm7ml\" (UID: \"1faca528-a502-4643-9533-a66900535be2\") " pod="kube-system/konnectivity-agent-jm7ml" Jun 11 19:50:02.234983 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234867 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-log-socket\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.234983 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234872 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-host-run-netns\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.234983 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234915 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-hostroot\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.234983 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234929 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-host-run-netns\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.234983 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234938 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/abe83f4b-2288-46d2-8b25-4de9e634ff5b-device-dir\") pod \"aws-ebs-csi-driver-node-m7r7h\" (UID: \"abe83f4b-2288-46d2-8b25-4de9e634ff5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7r7h" Jun 11 19:50:02.234983 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234963 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6a5da50-2b05-42de-8aa9-a23e838da830-original-pull-secret\") pod \"global-pull-secret-syncer-jddtw\" (UID: \"f6a5da50-2b05-42de-8aa9-a23e838da830\") " pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:50:02.234983 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234969 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-hostroot\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.235816 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.234993 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/548d858f-2ed3-4a90-b197-693ef3bfa7e9-etc-modprobe-d\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.235816 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235021 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ft9h\" (UniqueName: \"kubernetes.io/projected/98cc5ec8-4790-4b36-a80d-df6d5d1e8bf6-kube-api-access-2ft9h\") pod \"node-ca-mc6x6\" (UID: \"98cc5ec8-4790-4b36-a80d-df6d5d1e8bf6\") " pod="openshift-image-registry/node-ca-mc6x6" Jun 11 19:50:02.235816 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235046 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/226f79e5-5702-495b-8ffd-d60cd1e68f19-hosts-file\") pod \"node-resolver-rgjlh\" (UID: \"226f79e5-5702-495b-8ffd-d60cd1e68f19\") " pod="openshift-dns/node-resolver-rgjlh" Jun 11 19:50:02.235816 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235072 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/226f79e5-5702-495b-8ffd-d60cd1e68f19-tmp-dir\") pod \"node-resolver-rgjlh\" (UID: \"226f79e5-5702-495b-8ffd-d60cd1e68f19\") " pod="openshift-dns/node-resolver-rgjlh" Jun 11 19:50:02.235816 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235134 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-run-openvswitch\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.235816 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235166 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-run-openvswitch\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.235816 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235166 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-host-cni-netd\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.235816 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235204 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-host-cni-netd\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.235816 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235233 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbvfj\" (UniqueName: \"kubernetes.io/projected/5bb1879c-50b2-47e1-a3f6-95e8b36ca724-kube-api-access-fbvfj\") pod \"iptables-alerter-dhc6t\" (UID: \"5bb1879c-50b2-47e1-a3f6-95e8b36ca724\") " pod="openshift-network-operator/iptables-alerter-dhc6t" Jun 11 19:50:02.235816 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235266 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/abe83f4b-2288-46d2-8b25-4de9e634ff5b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m7r7h\" (UID: \"abe83f4b-2288-46d2-8b25-4de9e634ff5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7r7h" Jun 11 19:50:02.235816 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235317 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-systemd-units\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.235816 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235356 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-host-run-ovn-kubernetes\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.235816 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235392 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/143be408-3d56-48e6-87d3-3e2746001044-cni-binary-copy\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.235816 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235416 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/98cc5ec8-4790-4b36-a80d-df6d5d1e8bf6-host\") pod \"node-ca-mc6x6\" (UID: \"98cc5ec8-4790-4b36-a80d-df6d5d1e8bf6\") " pod="openshift-image-registry/node-ca-mc6x6" Jun 11 19:50:02.235816 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235440 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/98cc5ec8-4790-4b36-a80d-df6d5d1e8bf6-serviceca\") pod \"node-ca-mc6x6\" (UID: \"98cc5ec8-4790-4b36-a80d-df6d5d1e8bf6\") " pod="openshift-image-registry/node-ca-mc6x6" Jun 11 19:50:02.235816 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235446 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-systemd-units\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.235816 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235463 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-host-slash\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.236645 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235474 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-host-run-ovn-kubernetes\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.236645 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235486 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-var-lib-openvswitch\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.236645 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235512 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-cnibin\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.236645 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235541 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5bb1879c-50b2-47e1-a3f6-95e8b36ca724-host-slash\") pod \"iptables-alerter-dhc6t\" (UID: \"5bb1879c-50b2-47e1-a3f6-95e8b36ca724\") " pod="openshift-network-operator/iptables-alerter-dhc6t" Jun 11 19:50:02.236645 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235517 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-host-slash\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.236645 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/548d858f-2ed3-4a90-b197-693ef3bfa7e9-host\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.236645 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235606 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-multus-conf-dir\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.236645 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235622 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-cnibin\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.236645 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235629 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5bb1879c-50b2-47e1-a3f6-95e8b36ca724-host-slash\") pod \"iptables-alerter-dhc6t\" (UID: \"5bb1879c-50b2-47e1-a3f6-95e8b36ca724\") " pod="openshift-network-operator/iptables-alerter-dhc6t" Jun 11 19:50:02.236645 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235631 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk2gq\" (UniqueName: \"kubernetes.io/projected/143be408-3d56-48e6-87d3-3e2746001044-kube-api-access-rk2gq\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.236645 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235672 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/abe83f4b-2288-46d2-8b25-4de9e634ff5b-socket-dir\") pod \"aws-ebs-csi-driver-node-m7r7h\" (UID: \"abe83f4b-2288-46d2-8b25-4de9e634ff5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7r7h" Jun 11 19:50:02.236645 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235687 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-multus-conf-dir\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.236645 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235696 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g78vl\" (UniqueName: \"kubernetes.io/projected/ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99-kube-api-access-g78vl\") pod \"network-metrics-daemon-lrgwp\" (UID: \"ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99\") " pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:50:02.236645 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235724 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f6a5da50-2b05-42de-8aa9-a23e838da830-kubelet-config\") pod \"global-pull-secret-syncer-jddtw\" (UID: \"f6a5da50-2b05-42de-8aa9-a23e838da830\") " pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:50:02.236645 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235747 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/548d858f-2ed3-4a90-b197-693ef3bfa7e9-var-lib-kubelet\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.236645 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235770 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/548d858f-2ed3-4a90-b197-693ef3bfa7e9-etc-tuned\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.236645 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235796 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/02067c5b-4d64-4458-ab32-b005f9546ec9-os-release\") pod \"multus-additional-cni-plugins-5d69r\" (UID: \"02067c5b-4d64-4458-ab32-b005f9546ec9\") " pod="openshift-multus/multus-additional-cni-plugins-5d69r" Jun 11 19:50:02.237507 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235803 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-var-lib-openvswitch\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.237507 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235828 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-run-systemd\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.237507 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235877 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-run-systemd\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.237507 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235893 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/02067c5b-4d64-4458-ab32-b005f9546ec9-os-release\") pod \"multus-additional-cni-plugins-5d69r\" (UID: \"02067c5b-4d64-4458-ab32-b005f9546ec9\") " pod="openshift-multus/multus-additional-cni-plugins-5d69r" Jun 11 19:50:02.237507 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235916 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/02067c5b-4d64-4458-ab32-b005f9546ec9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5d69r\" (UID: \"02067c5b-4d64-4458-ab32-b005f9546ec9\") " pod="openshift-multus/multus-additional-cni-plugins-5d69r" Jun 11 19:50:02.237507 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235931 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/143be408-3d56-48e6-87d3-3e2746001044-cni-binary-copy\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.237507 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235947 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/548d858f-2ed3-4a90-b197-693ef3bfa7e9-etc-sysconfig\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.237507 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.235985 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/548d858f-2ed3-4a90-b197-693ef3bfa7e9-etc-kubernetes\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.237507 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.236013 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/548d858f-2ed3-4a90-b197-693ef3bfa7e9-etc-systemd\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.237507 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.236035 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-host-run-k8s-cni-cncf-io\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.237507 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.236056 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/548d858f-2ed3-4a90-b197-693ef3bfa7e9-etc-sysctl-conf\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.237507 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.236090 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-host-cni-bin\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.237507 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.236102 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-host-run-k8s-cni-cncf-io\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.237507 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.236109 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-host-var-lib-cni-multus\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.237507 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.236165 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-host-var-lib-cni-multus\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.237507 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.236165 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-host-run-multus-certs\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.237507 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.236175 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-host-cni-bin\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.238153 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.236201 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-host-run-multus-certs\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.238153 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.236208 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n79sh\" (UniqueName: \"kubernetes.io/projected/226f79e5-5702-495b-8ffd-d60cd1e68f19-kube-api-access-n79sh\") pod \"node-resolver-rgjlh\" (UID: \"226f79e5-5702-495b-8ffd-d60cd1e68f19\") " pod="openshift-dns/node-resolver-rgjlh" Jun 11 19:50:02.238153 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.236240 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02067c5b-4d64-4458-ab32-b005f9546ec9-system-cni-dir\") pod \"multus-additional-cni-plugins-5d69r\" (UID: \"02067c5b-4d64-4458-ab32-b005f9546ec9\") " pod="openshift-multus/multus-additional-cni-plugins-5d69r" Jun 11 19:50:02.238153 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.236277 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02067c5b-4d64-4458-ab32-b005f9546ec9-system-cni-dir\") pod \"multus-additional-cni-plugins-5d69r\" (UID: \"02067c5b-4d64-4458-ab32-b005f9546ec9\") " pod="openshift-multus/multus-additional-cni-plugins-5d69r" Jun 11 19:50:02.238153 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.236307 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-multus-socket-dir-parent\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.238153 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.236334 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/abe83f4b-2288-46d2-8b25-4de9e634ff5b-etc-selinux\") pod \"aws-ebs-csi-driver-node-m7r7h\" (UID: \"abe83f4b-2288-46d2-8b25-4de9e634ff5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7r7h" Jun 11 19:50:02.238153 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.236361 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/abe83f4b-2288-46d2-8b25-4de9e634ff5b-sys-fs\") pod \"aws-ebs-csi-driver-node-m7r7h\" (UID: \"abe83f4b-2288-46d2-8b25-4de9e634ff5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7r7h" Jun 11 19:50:02.238153 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.236387 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxtl8\" (UniqueName: \"kubernetes.io/projected/d798bbe1-8647-4ec6-88da-24514bca83d1-kube-api-access-fxtl8\") pod \"network-check-target-2rn74\" (UID: \"d798bbe1-8647-4ec6-88da-24514bca83d1\") " pod="openshift-network-diagnostics/network-check-target-2rn74" Jun 11 19:50:02.238153 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.236418 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/143be408-3d56-48e6-87d3-3e2746001044-multus-socket-dir-parent\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.238153 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.236428 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-272hb\" (UniqueName: \"kubernetes.io/projected/85a48db4-30bf-47f2-9668-8b0a67c26fe4-kube-api-access-272hb\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.238153 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.236440 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/02067c5b-4d64-4458-ab32-b005f9546ec9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5d69r\" (UID: \"02067c5b-4d64-4458-ab32-b005f9546ec9\") " pod="openshift-multus/multus-additional-cni-plugins-5d69r" Jun 11 19:50:02.238153 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.236460 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.238153 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.236491 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/85a48db4-30bf-47f2-9668-8b0a67c26fe4-ovnkube-config\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.238153 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.236516 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/143be408-3d56-48e6-87d3-3e2746001044-multus-daemon-config\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.238153 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.236526 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.238153 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.236543 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmx67\" (UniqueName: \"kubernetes.io/projected/abe83f4b-2288-46d2-8b25-4de9e634ff5b-kube-api-access-kmx67\") pod \"aws-ebs-csi-driver-node-m7r7h\" (UID: \"abe83f4b-2288-46d2-8b25-4de9e634ff5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7r7h" Jun 11 19:50:02.238693 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.236584 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ppxz\" (UniqueName: \"kubernetes.io/projected/548d858f-2ed3-4a90-b197-693ef3bfa7e9-kube-api-access-4ppxz\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.238693 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.236614 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-host-kubelet\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.238693 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.236639 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-run-ovn\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.238693 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.236660 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/85a48db4-30bf-47f2-9668-8b0a67c26fe4-ovnkube-script-lib\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.238693 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.236676 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-host-kubelet\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.238693 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.236744 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/85a48db4-30bf-47f2-9668-8b0a67c26fe4-run-ovn\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.238693 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.237004 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/85a48db4-30bf-47f2-9668-8b0a67c26fe4-ovnkube-config\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.238693 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.237156 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/143be408-3d56-48e6-87d3-3e2746001044-multus-daemon-config\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.238693 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.237225 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/85a48db4-30bf-47f2-9668-8b0a67c26fe4-ovnkube-script-lib\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.238693 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.237519 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/85a48db4-30bf-47f2-9668-8b0a67c26fe4-ovn-node-metrics-cert\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.238693 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.237599 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1faca528-a502-4643-9533-a66900535be2-agent-certs\") pod \"konnectivity-agent-jm7ml\" (UID: \"1faca528-a502-4643-9533-a66900535be2\") " pod="kube-system/konnectivity-agent-jm7ml" Jun 11 19:50:02.244821 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.244799 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbvfj\" (UniqueName: \"kubernetes.io/projected/5bb1879c-50b2-47e1-a3f6-95e8b36ca724-kube-api-access-fbvfj\") pod \"iptables-alerter-dhc6t\" (UID: \"5bb1879c-50b2-47e1-a3f6-95e8b36ca724\") " pod="openshift-network-operator/iptables-alerter-dhc6t" Jun 11 19:50:02.245041 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.245001 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sdmv\" (UniqueName: \"kubernetes.io/projected/02067c5b-4d64-4458-ab32-b005f9546ec9-kube-api-access-8sdmv\") pod \"multus-additional-cni-plugins-5d69r\" (UID: \"02067c5b-4d64-4458-ab32-b005f9546ec9\") " pod="openshift-multus/multus-additional-cni-plugins-5d69r" Jun 11 19:50:02.245154 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.245117 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk2gq\" (UniqueName: \"kubernetes.io/projected/143be408-3d56-48e6-87d3-3e2746001044-kube-api-access-rk2gq\") pod \"multus-2trvq\" (UID: \"143be408-3d56-48e6-87d3-3e2746001044\") " pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.245781 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.245753 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-272hb\" (UniqueName: \"kubernetes.io/projected/85a48db4-30bf-47f2-9668-8b0a67c26fe4-kube-api-access-272hb\") pod \"ovnkube-node-hrb9t\" (UID: \"85a48db4-30bf-47f2-9668-8b0a67c26fe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.336900 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.336870 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n79sh\" (UniqueName: \"kubernetes.io/projected/226f79e5-5702-495b-8ffd-d60cd1e68f19-kube-api-access-n79sh\") pod \"node-resolver-rgjlh\" (UID: \"226f79e5-5702-495b-8ffd-d60cd1e68f19\") " pod="openshift-dns/node-resolver-rgjlh" Jun 11 19:50:02.337053 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.336912 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/abe83f4b-2288-46d2-8b25-4de9e634ff5b-etc-selinux\") pod \"aws-ebs-csi-driver-node-m7r7h\" (UID: \"abe83f4b-2288-46d2-8b25-4de9e634ff5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7r7h" Jun 11 19:50:02.337053 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.336939 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/abe83f4b-2288-46d2-8b25-4de9e634ff5b-sys-fs\") pod \"aws-ebs-csi-driver-node-m7r7h\" (UID: \"abe83f4b-2288-46d2-8b25-4de9e634ff5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7r7h" Jun 11 19:50:02.337053 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337001 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxtl8\" (UniqueName: \"kubernetes.io/projected/d798bbe1-8647-4ec6-88da-24514bca83d1-kube-api-access-fxtl8\") pod \"network-check-target-2rn74\" (UID: \"d798bbe1-8647-4ec6-88da-24514bca83d1\") " pod="openshift-network-diagnostics/network-check-target-2rn74" Jun 11 19:50:02.337053 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337049 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/abe83f4b-2288-46d2-8b25-4de9e634ff5b-etc-selinux\") pod \"aws-ebs-csi-driver-node-m7r7h\" (UID: \"abe83f4b-2288-46d2-8b25-4de9e634ff5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7r7h" Jun 11 19:50:02.337282 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337048 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmx67\" (UniqueName: \"kubernetes.io/projected/abe83f4b-2288-46d2-8b25-4de9e634ff5b-kube-api-access-kmx67\") pod \"aws-ebs-csi-driver-node-m7r7h\" (UID: \"abe83f4b-2288-46d2-8b25-4de9e634ff5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7r7h" Jun 11 19:50:02.337282 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337083 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ppxz\" (UniqueName: \"kubernetes.io/projected/548d858f-2ed3-4a90-b197-693ef3bfa7e9-kube-api-access-4ppxz\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.337282 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337009 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/abe83f4b-2288-46d2-8b25-4de9e634ff5b-sys-fs\") pod \"aws-ebs-csi-driver-node-m7r7h\" (UID: \"abe83f4b-2288-46d2-8b25-4de9e634ff5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7r7h" Jun 11 19:50:02.337282 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337110 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/abe83f4b-2288-46d2-8b25-4de9e634ff5b-registration-dir\") pod \"aws-ebs-csi-driver-node-m7r7h\" (UID: \"abe83f4b-2288-46d2-8b25-4de9e634ff5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7r7h" Jun 11 19:50:02.337282 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337155 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f6a5da50-2b05-42de-8aa9-a23e838da830-dbus\") pod \"global-pull-secret-syncer-jddtw\" (UID: \"f6a5da50-2b05-42de-8aa9-a23e838da830\") " pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:50:02.337282 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337183 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/abe83f4b-2288-46d2-8b25-4de9e634ff5b-registration-dir\") pod \"aws-ebs-csi-driver-node-m7r7h\" (UID: \"abe83f4b-2288-46d2-8b25-4de9e634ff5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7r7h" Jun 11 19:50:02.337282 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337195 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/548d858f-2ed3-4a90-b197-693ef3bfa7e9-tmp\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.337282 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337297 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f6a5da50-2b05-42de-8aa9-a23e838da830-dbus\") pod \"global-pull-secret-syncer-jddtw\" (UID: \"f6a5da50-2b05-42de-8aa9-a23e838da830\") " pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:50:02.337778 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337337 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99-metrics-certs\") pod \"network-metrics-daemon-lrgwp\" (UID: \"ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99\") " pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:50:02.337778 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337364 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/548d858f-2ed3-4a90-b197-693ef3bfa7e9-etc-sysctl-d\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.337778 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337383 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/548d858f-2ed3-4a90-b197-693ef3bfa7e9-run\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.337778 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:02.337397 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:50:02.337778 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337427 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/548d858f-2ed3-4a90-b197-693ef3bfa7e9-run\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.337778 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337437 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/548d858f-2ed3-4a90-b197-693ef3bfa7e9-sys\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.337778 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:02.337485 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99-metrics-certs podName:ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:02.83744861 +0000 UTC m=+3.115209380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99-metrics-certs") pod "network-metrics-daemon-lrgwp" (UID: "ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:50:02.337778 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337499 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/548d858f-2ed3-4a90-b197-693ef3bfa7e9-sys\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.337778 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337501 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/548d858f-2ed3-4a90-b197-693ef3bfa7e9-etc-sysctl-d\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.337778 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337513 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/548d858f-2ed3-4a90-b197-693ef3bfa7e9-lib-modules\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.337778 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337552 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/abe83f4b-2288-46d2-8b25-4de9e634ff5b-device-dir\") pod \"aws-ebs-csi-driver-node-m7r7h\" (UID: \"abe83f4b-2288-46d2-8b25-4de9e634ff5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7r7h" Jun 11 19:50:02.337778 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337582 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6a5da50-2b05-42de-8aa9-a23e838da830-original-pull-secret\") pod \"global-pull-secret-syncer-jddtw\" (UID: \"f6a5da50-2b05-42de-8aa9-a23e838da830\") " pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:50:02.337778 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337608 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/548d858f-2ed3-4a90-b197-693ef3bfa7e9-lib-modules\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.337778 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337607 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/548d858f-2ed3-4a90-b197-693ef3bfa7e9-etc-modprobe-d\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.337778 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337641 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ft9h\" (UniqueName: \"kubernetes.io/projected/98cc5ec8-4790-4b36-a80d-df6d5d1e8bf6-kube-api-access-2ft9h\") pod \"node-ca-mc6x6\" (UID: \"98cc5ec8-4790-4b36-a80d-df6d5d1e8bf6\") " pod="openshift-image-registry/node-ca-mc6x6" Jun 11 19:50:02.337778 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337667 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/226f79e5-5702-495b-8ffd-d60cd1e68f19-hosts-file\") pod \"node-resolver-rgjlh\" (UID: \"226f79e5-5702-495b-8ffd-d60cd1e68f19\") " pod="openshift-dns/node-resolver-rgjlh" Jun 11 19:50:02.337778 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337678 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/548d858f-2ed3-4a90-b197-693ef3bfa7e9-etc-modprobe-d\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.338640 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337692 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/226f79e5-5702-495b-8ffd-d60cd1e68f19-tmp-dir\") pod \"node-resolver-rgjlh\" (UID: \"226f79e5-5702-495b-8ffd-d60cd1e68f19\") " pod="openshift-dns/node-resolver-rgjlh" Jun 11 19:50:02.338640 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337707 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/abe83f4b-2288-46d2-8b25-4de9e634ff5b-device-dir\") pod \"aws-ebs-csi-driver-node-m7r7h\" (UID: \"abe83f4b-2288-46d2-8b25-4de9e634ff5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7r7h" Jun 11 19:50:02.338640 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337721 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/abe83f4b-2288-46d2-8b25-4de9e634ff5b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m7r7h\" (UID: \"abe83f4b-2288-46d2-8b25-4de9e634ff5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7r7h" Jun 11 19:50:02.338640 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337747 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/98cc5ec8-4790-4b36-a80d-df6d5d1e8bf6-host\") pod \"node-ca-mc6x6\" (UID: \"98cc5ec8-4790-4b36-a80d-df6d5d1e8bf6\") " pod="openshift-image-registry/node-ca-mc6x6" Jun 11 19:50:02.338640 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:02.337753 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:50:02.338640 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337772 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/98cc5ec8-4790-4b36-a80d-df6d5d1e8bf6-serviceca\") pod \"node-ca-mc6x6\" (UID: \"98cc5ec8-4790-4b36-a80d-df6d5d1e8bf6\") " pod="openshift-image-registry/node-ca-mc6x6" Jun 11 19:50:02.338640 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337798 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/548d858f-2ed3-4a90-b197-693ef3bfa7e9-host\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.338640 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:02.337810 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6a5da50-2b05-42de-8aa9-a23e838da830-original-pull-secret podName:f6a5da50-2b05-42de-8aa9-a23e838da830 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:02.837793779 +0000 UTC m=+3.115554544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f6a5da50-2b05-42de-8aa9-a23e838da830-original-pull-secret") pod "global-pull-secret-syncer-jddtw" (UID: "f6a5da50-2b05-42de-8aa9-a23e838da830") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:50:02.338640 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337836 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/abe83f4b-2288-46d2-8b25-4de9e634ff5b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m7r7h\" (UID: \"abe83f4b-2288-46d2-8b25-4de9e634ff5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7r7h" Jun 11 19:50:02.338640 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337841 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/548d858f-2ed3-4a90-b197-693ef3bfa7e9-host\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.338640 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337841 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/abe83f4b-2288-46d2-8b25-4de9e634ff5b-socket-dir\") pod \"aws-ebs-csi-driver-node-m7r7h\" (UID: \"abe83f4b-2288-46d2-8b25-4de9e634ff5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7r7h" Jun 11 19:50:02.338640 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337879 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g78vl\" (UniqueName: \"kubernetes.io/projected/ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99-kube-api-access-g78vl\") pod \"network-metrics-daemon-lrgwp\" (UID: \"ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99\") " pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:50:02.338640 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337888 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/98cc5ec8-4790-4b36-a80d-df6d5d1e8bf6-host\") pod \"node-ca-mc6x6\" (UID: \"98cc5ec8-4790-4b36-a80d-df6d5d1e8bf6\") " pod="openshift-image-registry/node-ca-mc6x6" Jun 11 19:50:02.338640 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337906 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f6a5da50-2b05-42de-8aa9-a23e838da830-kubelet-config\") pod \"global-pull-secret-syncer-jddtw\" (UID: \"f6a5da50-2b05-42de-8aa9-a23e838da830\") " pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:50:02.338640 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337931 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/548d858f-2ed3-4a90-b197-693ef3bfa7e9-var-lib-kubelet\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.338640 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337951 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/548d858f-2ed3-4a90-b197-693ef3bfa7e9-etc-tuned\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.338640 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337975 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/548d858f-2ed3-4a90-b197-693ef3bfa7e9-etc-sysconfig\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.339499 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337999 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/548d858f-2ed3-4a90-b197-693ef3bfa7e9-etc-kubernetes\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.339499 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.338024 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/548d858f-2ed3-4a90-b197-693ef3bfa7e9-etc-systemd\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.339499 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.338001 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/abe83f4b-2288-46d2-8b25-4de9e634ff5b-socket-dir\") pod \"aws-ebs-csi-driver-node-m7r7h\" (UID: \"abe83f4b-2288-46d2-8b25-4de9e634ff5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7r7h" Jun 11 19:50:02.339499 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.338049 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/548d858f-2ed3-4a90-b197-693ef3bfa7e9-etc-sysctl-conf\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.339499 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.338049 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/548d858f-2ed3-4a90-b197-693ef3bfa7e9-var-lib-kubelet\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.339499 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.338022 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f6a5da50-2b05-42de-8aa9-a23e838da830-kubelet-config\") pod \"global-pull-secret-syncer-jddtw\" (UID: \"f6a5da50-2b05-42de-8aa9-a23e838da830\") " pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:50:02.339499 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.338090 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/548d858f-2ed3-4a90-b197-693ef3bfa7e9-etc-systemd\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.339499 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.338141 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/548d858f-2ed3-4a90-b197-693ef3bfa7e9-etc-kubernetes\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.339499 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.338156 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/548d858f-2ed3-4a90-b197-693ef3bfa7e9-etc-sysconfig\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.339499 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.338186 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/226f79e5-5702-495b-8ffd-d60cd1e68f19-tmp-dir\") pod \"node-resolver-rgjlh\" (UID: \"226f79e5-5702-495b-8ffd-d60cd1e68f19\") " pod="openshift-dns/node-resolver-rgjlh" Jun 11 19:50:02.339499 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.338251 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/548d858f-2ed3-4a90-b197-693ef3bfa7e9-etc-sysctl-conf\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.339499 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.337771 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/226f79e5-5702-495b-8ffd-d60cd1e68f19-hosts-file\") pod \"node-resolver-rgjlh\" (UID: \"226f79e5-5702-495b-8ffd-d60cd1e68f19\") " pod="openshift-dns/node-resolver-rgjlh" Jun 11 19:50:02.339499 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.338290 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/98cc5ec8-4790-4b36-a80d-df6d5d1e8bf6-serviceca\") pod \"node-ca-mc6x6\" (UID: \"98cc5ec8-4790-4b36-a80d-df6d5d1e8bf6\") " pod="openshift-image-registry/node-ca-mc6x6" Jun 11 19:50:02.340051 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.339828 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/548d858f-2ed3-4a90-b197-693ef3bfa7e9-tmp\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.340288 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.340271 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/548d858f-2ed3-4a90-b197-693ef3bfa7e9-etc-tuned\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.346486 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:02.346463 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:50:02.346486 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:02.346486 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:50:02.346630 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:02.346501 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fxtl8 for pod openshift-network-diagnostics/network-check-target-2rn74: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:50:02.346630 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:02.346559 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d798bbe1-8647-4ec6-88da-24514bca83d1-kube-api-access-fxtl8 podName:d798bbe1-8647-4ec6-88da-24514bca83d1 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:02.846547609 +0000 UTC m=+3.124308345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fxtl8" (UniqueName: "kubernetes.io/projected/d798bbe1-8647-4ec6-88da-24514bca83d1-kube-api-access-fxtl8") pod "network-check-target-2rn74" (UID: "d798bbe1-8647-4ec6-88da-24514bca83d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:50:02.348858 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.348834 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n79sh\" (UniqueName: \"kubernetes.io/projected/226f79e5-5702-495b-8ffd-d60cd1e68f19-kube-api-access-n79sh\") pod \"node-resolver-rgjlh\" (UID: \"226f79e5-5702-495b-8ffd-d60cd1e68f19\") " pod="openshift-dns/node-resolver-rgjlh" Jun 11 19:50:02.349017 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.348993 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g78vl\" (UniqueName: \"kubernetes.io/projected/ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99-kube-api-access-g78vl\") pod \"network-metrics-daemon-lrgwp\" (UID: \"ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99\") " pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:50:02.350007 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.349979 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmx67\" (UniqueName: \"kubernetes.io/projected/abe83f4b-2288-46d2-8b25-4de9e634ff5b-kube-api-access-kmx67\") pod \"aws-ebs-csi-driver-node-m7r7h\" (UID: \"abe83f4b-2288-46d2-8b25-4de9e634ff5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7r7h" Jun 11 19:50:02.350452 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.350434 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ft9h\" (UniqueName: \"kubernetes.io/projected/98cc5ec8-4790-4b36-a80d-df6d5d1e8bf6-kube-api-access-2ft9h\") pod \"node-ca-mc6x6\" (UID: \"98cc5ec8-4790-4b36-a80d-df6d5d1e8bf6\") " pod="openshift-image-registry/node-ca-mc6x6" Jun 11 19:50:02.350999 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.350923 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ppxz\" (UniqueName: \"kubernetes.io/projected/548d858f-2ed3-4a90-b197-693ef3bfa7e9-kube-api-access-4ppxz\") pod \"tuned-wgbgr\" (UID: \"548d858f-2ed3-4a90-b197-693ef3bfa7e9\") " pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.426819 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.426790 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5d69r" Jun 11 19:50:02.433569 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.433539 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jm7ml" Jun 11 19:50:02.442386 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.442357 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2trvq" Jun 11 19:50:02.450092 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.450074 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dhc6t" Jun 11 19:50:02.456678 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.456660 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:02.463270 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.463255 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" Jun 11 19:50:02.469888 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.469871 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7r7h" Jun 11 19:50:02.476644 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.476625 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mc6x6" Jun 11 19:50:02.481351 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.481330 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rgjlh" Jun 11 19:50:02.584868 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.584838 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:50:02.841266 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.841225 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99-metrics-certs\") pod \"network-metrics-daemon-lrgwp\" (UID: \"ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99\") " pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:50:02.841423 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.841279 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6a5da50-2b05-42de-8aa9-a23e838da830-original-pull-secret\") pod \"global-pull-secret-syncer-jddtw\" (UID: \"f6a5da50-2b05-42de-8aa9-a23e838da830\") " pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:50:02.841423 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:02.841377 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:50:02.841513 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:02.841425 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:50:02.841513 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:02.841446 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99-metrics-certs podName:ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:03.841431508 +0000 UTC m=+4.119192263 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99-metrics-certs") pod "network-metrics-daemon-lrgwp" (UID: "ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:50:02.841513 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:02.841475 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6a5da50-2b05-42de-8aa9-a23e838da830-original-pull-secret podName:f6a5da50-2b05-42de-8aa9-a23e838da830 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:03.841460225 +0000 UTC m=+4.119220968 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f6a5da50-2b05-42de-8aa9-a23e838da830-original-pull-secret") pod "global-pull-secret-syncer-jddtw" (UID: "f6a5da50-2b05-42de-8aa9-a23e838da830") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:50:02.942197 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:02.942165 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxtl8\" (UniqueName: \"kubernetes.io/projected/d798bbe1-8647-4ec6-88da-24514bca83d1-kube-api-access-fxtl8\") pod \"network-check-target-2rn74\" (UID: \"d798bbe1-8647-4ec6-88da-24514bca83d1\") " pod="openshift-network-diagnostics/network-check-target-2rn74" Jun 11 19:50:02.942332 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:02.942318 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:50:02.942368 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:02.942340 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:50:02.942368 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:02.942350 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fxtl8 for pod openshift-network-diagnostics/network-check-target-2rn74: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:50:02.942439 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:02.942401 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d798bbe1-8647-4ec6-88da-24514bca83d1-kube-api-access-fxtl8 podName:d798bbe1-8647-4ec6-88da-24514bca83d1 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:03.942388571 +0000 UTC m=+4.220149306 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxtl8" (UniqueName: "kubernetes.io/projected/d798bbe1-8647-4ec6-88da-24514bca83d1-kube-api-access-fxtl8") pod "network-check-target-2rn74" (UID: "d798bbe1-8647-4ec6-88da-24514bca83d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:50:03.001340 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:03.001315 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod226f79e5_5702_495b_8ffd_d60cd1e68f19.slice/crio-fea345dd86b0dce089b81d79b2154ab7d1feb8d56550e39cd383a686cd31ffae WatchSource:0}: Error finding container fea345dd86b0dce089b81d79b2154ab7d1feb8d56550e39cd383a686cd31ffae: Status 404 returned error can't find the container with id fea345dd86b0dce089b81d79b2154ab7d1feb8d56550e39cd383a686cd31ffae Jun 11 19:50:03.002380 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:03.002343 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bb1879c_50b2_47e1_a3f6_95e8b36ca724.slice/crio-a49f3a8c77d5471b9352ec79f304ea6ed33cea1755a19fde3b97cb2f113c0911 WatchSource:0}: Error finding container a49f3a8c77d5471b9352ec79f304ea6ed33cea1755a19fde3b97cb2f113c0911: Status 404 returned error can't find the container with id a49f3a8c77d5471b9352ec79f304ea6ed33cea1755a19fde3b97cb2f113c0911 Jun 11 19:50:03.003833 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:03.003806 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02067c5b_4d64_4458_ab32_b005f9546ec9.slice/crio-e7391cdc0ce09a19ee79a60a88be48f59f0c7d7a0c9433dee8114e734c3d5e85 WatchSource:0}: Error finding container e7391cdc0ce09a19ee79a60a88be48f59f0c7d7a0c9433dee8114e734c3d5e85: Status 404 returned error can't find the container with id e7391cdc0ce09a19ee79a60a88be48f59f0c7d7a0c9433dee8114e734c3d5e85 Jun 11 19:50:03.006823 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:03.006798 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabe83f4b_2288_46d2_8b25_4de9e634ff5b.slice/crio-65aee16be082e064310e1585c7d27b0e64c2dd0791041d1eb760b65d48b10062 WatchSource:0}: Error finding container 65aee16be082e064310e1585c7d27b0e64c2dd0791041d1eb760b65d48b10062: Status 404 returned error can't find the container with id 65aee16be082e064310e1585c7d27b0e64c2dd0791041d1eb760b65d48b10062 Jun 11 19:50:03.007658 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:03.007627 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod548d858f_2ed3_4a90_b197_693ef3bfa7e9.slice/crio-aea0a219afc712e72efe5f454bf75e8e997f722df59d6fc7561fc6972ad848a0 WatchSource:0}: Error finding container aea0a219afc712e72efe5f454bf75e8e997f722df59d6fc7561fc6972ad848a0: Status 404 returned error can't find the container with id aea0a219afc712e72efe5f454bf75e8e997f722df59d6fc7561fc6972ad848a0 Jun 11 19:50:03.008535 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:03.008370 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod143be408_3d56_48e6_87d3_3e2746001044.slice/crio-d1fb01d19f6b6245f5f15af2fc071e99b8119c76090bd2daead9e72b4931055c WatchSource:0}: Error finding container d1fb01d19f6b6245f5f15af2fc071e99b8119c76090bd2daead9e72b4931055c: Status 404 returned error can't find the container with id d1fb01d19f6b6245f5f15af2fc071e99b8119c76090bd2daead9e72b4931055c Jun 11 19:50:03.009787 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:03.009212 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98cc5ec8_4790_4b36_a80d_df6d5d1e8bf6.slice/crio-9b651f123fea2a7b21bcfb8ba8aa85c8d32c5126bdf44762ce9c6a90fde21bb5 WatchSource:0}: Error finding container 9b651f123fea2a7b21bcfb8ba8aa85c8d32c5126bdf44762ce9c6a90fde21bb5: Status 404 returned error can't find the container with id 9b651f123fea2a7b21bcfb8ba8aa85c8d32c5126bdf44762ce9c6a90fde21bb5 Jun 11 19:50:03.010959 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:03.010936 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1faca528_a502_4643_9533_a66900535be2.slice/crio-17c5124fdb160c27c7d46b59c0af5fe7bcfc98dfa8fdc8ef4053d77c9250e4d2 WatchSource:0}: Error finding container 17c5124fdb160c27c7d46b59c0af5fe7bcfc98dfa8fdc8ef4053d77c9250e4d2: Status 404 returned error can't find the container with id 17c5124fdb160c27c7d46b59c0af5fe7bcfc98dfa8fdc8ef4053d77c9250e4d2 Jun 11 19:50:03.040788 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:03.040772 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:50:03.177766 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:03.177668 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 19:45:02 +0000 UTC" deadline="2028-03-06 18:05:43.134025342 +0000 UTC" Jun 11 19:50:03.177766 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:03.177722 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15214h15m39.956308191s" Jun 11 19:50:03.199080 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:03.199051 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dhc6t" event={"ID":"5bb1879c-50b2-47e1-a3f6-95e8b36ca724","Type":"ContainerStarted","Data":"a49f3a8c77d5471b9352ec79f304ea6ed33cea1755a19fde3b97cb2f113c0911"} Jun 11 19:50:03.201545 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:03.201522 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" event={"ID":"548d858f-2ed3-4a90-b197-693ef3bfa7e9","Type":"ContainerStarted","Data":"aea0a219afc712e72efe5f454bf75e8e997f722df59d6fc7561fc6972ad848a0"} Jun 11 19:50:03.202653 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:03.202633 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5d69r" event={"ID":"02067c5b-4d64-4458-ab32-b005f9546ec9","Type":"ContainerStarted","Data":"e7391cdc0ce09a19ee79a60a88be48f59f0c7d7a0c9433dee8114e734c3d5e85"} Jun 11 19:50:03.205786 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:03.205766 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rgjlh" event={"ID":"226f79e5-5702-495b-8ffd-d60cd1e68f19","Type":"ContainerStarted","Data":"fea345dd86b0dce089b81d79b2154ab7d1feb8d56550e39cd383a686cd31ffae"} Jun 11 19:50:03.207533 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:03.207504 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-247.ec2.internal" event={"ID":"e15e0f7f81589bcd73e7fe66f326b60b","Type":"ContainerStarted","Data":"4704cdfd4d5695c56eac0fcb5e94d5b940586a42df38ec015f6a8b4304a49979"} Jun 11 19:50:03.208603 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:03.208584 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" event={"ID":"85a48db4-30bf-47f2-9668-8b0a67c26fe4","Type":"ContainerStarted","Data":"7af569737b1c889a903522b428216dfb2a779f45ffa93d5ad1fb3d89094dd069"} Jun 11 19:50:03.209635 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:03.209616 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jm7ml" event={"ID":"1faca528-a502-4643-9533-a66900535be2","Type":"ContainerStarted","Data":"17c5124fdb160c27c7d46b59c0af5fe7bcfc98dfa8fdc8ef4053d77c9250e4d2"} Jun 11 19:50:03.210741 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:03.210716 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2trvq" event={"ID":"143be408-3d56-48e6-87d3-3e2746001044","Type":"ContainerStarted","Data":"d1fb01d19f6b6245f5f15af2fc071e99b8119c76090bd2daead9e72b4931055c"} Jun 11 19:50:03.211814 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:03.211791 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mc6x6" event={"ID":"98cc5ec8-4790-4b36-a80d-df6d5d1e8bf6","Type":"ContainerStarted","Data":"9b651f123fea2a7b21bcfb8ba8aa85c8d32c5126bdf44762ce9c6a90fde21bb5"} Jun 11 19:50:03.212788 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:03.212768 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7r7h" event={"ID":"abe83f4b-2288-46d2-8b25-4de9e634ff5b","Type":"ContainerStarted","Data":"65aee16be082e064310e1585c7d27b0e64c2dd0791041d1eb760b65d48b10062"} Jun 11 19:50:03.222965 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:03.222921 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-247.ec2.internal" podStartSLOduration=2.222908564 podStartE2EDuration="2.222908564s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:50:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:50:03.222517461 +0000 UTC m=+3.500278211" watchObservedRunningTime="2026-06-11 19:50:03.222908564 +0000 UTC m=+3.500669322" Jun 11 19:50:03.851858 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:03.851814 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99-metrics-certs\") pod \"network-metrics-daemon-lrgwp\" (UID: \"ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99\") " pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:50:03.852034 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:03.851878 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6a5da50-2b05-42de-8aa9-a23e838da830-original-pull-secret\") pod \"global-pull-secret-syncer-jddtw\" (UID: \"f6a5da50-2b05-42de-8aa9-a23e838da830\") " pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:50:03.852034 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:03.851994 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:50:03.852198 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:03.852068 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6a5da50-2b05-42de-8aa9-a23e838da830-original-pull-secret podName:f6a5da50-2b05-42de-8aa9-a23e838da830 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:05.852041045 +0000 UTC m=+6.129801788 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f6a5da50-2b05-42de-8aa9-a23e838da830-original-pull-secret") pod "global-pull-secret-syncer-jddtw" (UID: "f6a5da50-2b05-42de-8aa9-a23e838da830") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:50:03.852304 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:03.852280 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:50:03.852363 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:03.852351 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99-metrics-certs podName:ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:05.852333543 +0000 UTC m=+6.130094287 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99-metrics-certs") pod "network-metrics-daemon-lrgwp" (UID: "ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:50:03.952302 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:03.952263 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxtl8\" (UniqueName: \"kubernetes.io/projected/d798bbe1-8647-4ec6-88da-24514bca83d1-kube-api-access-fxtl8\") pod \"network-check-target-2rn74\" (UID: \"d798bbe1-8647-4ec6-88da-24514bca83d1\") " pod="openshift-network-diagnostics/network-check-target-2rn74" Jun 11 19:50:03.952482 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:03.952445 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:50:03.952482 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:03.952465 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:50:03.952482 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:03.952477 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fxtl8 for pod openshift-network-diagnostics/network-check-target-2rn74: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:50:03.952645 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:03.952534 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d798bbe1-8647-4ec6-88da-24514bca83d1-kube-api-access-fxtl8 podName:d798bbe1-8647-4ec6-88da-24514bca83d1 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:05.952517347 +0000 UTC m=+6.230278085 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxtl8" (UniqueName: "kubernetes.io/projected/d798bbe1-8647-4ec6-88da-24514bca83d1-kube-api-access-fxtl8") pod "network-check-target-2rn74" (UID: "d798bbe1-8647-4ec6-88da-24514bca83d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:50:04.178471 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:04.178355 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 19:45:02 +0000 UTC" deadline="2027-11-24 16:29:20.678194317 +0000 UTC" Jun 11 19:50:04.178471 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:04.178420 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12740h39m16.499777783s" Jun 11 19:50:04.194175 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:04.194144 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:50:04.194365 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:04.194272 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jddtw" podUID="f6a5da50-2b05-42de-8aa9-a23e838da830" Jun 11 19:50:04.194671 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:04.194651 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:50:04.194783 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:04.194764 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrgwp" podUID="ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99" Jun 11 19:50:04.194872 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:04.194833 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rn74" Jun 11 19:50:04.194929 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:04.194901 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rn74" podUID="d798bbe1-8647-4ec6-88da-24514bca83d1" Jun 11 19:50:04.232605 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:04.232569 2576 generic.go:356] "Generic (PLEG): container finished" podID="fbb096cc08e0623b4ecaeee81385785b" containerID="bbe3cf95ed2e41988977c97e2a7c8dd764ac1e578186e3a99402347b1678e771" exitCode=0 Jun 11 19:50:04.233536 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:04.233509 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal" event={"ID":"fbb096cc08e0623b4ecaeee81385785b","Type":"ContainerDied","Data":"bbe3cf95ed2e41988977c97e2a7c8dd764ac1e578186e3a99402347b1678e771"} Jun 11 19:50:05.255704 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:05.255640 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal" event={"ID":"fbb096cc08e0623b4ecaeee81385785b","Type":"ContainerStarted","Data":"ba0fe0b0d0684bb4581cb7a0251a9771ef8791db400dec9a496c7887d8a3c7b8"} Jun 11 19:50:05.874528 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:05.874456 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99-metrics-certs\") pod \"network-metrics-daemon-lrgwp\" (UID: \"ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99\") " pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:50:05.874528 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:05.874511 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6a5da50-2b05-42de-8aa9-a23e838da830-original-pull-secret\") pod \"global-pull-secret-syncer-jddtw\" (UID: \"f6a5da50-2b05-42de-8aa9-a23e838da830\") " pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:50:05.874818 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:05.874666 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:50:05.874818 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:05.874729 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6a5da50-2b05-42de-8aa9-a23e838da830-original-pull-secret podName:f6a5da50-2b05-42de-8aa9-a23e838da830 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:09.87471174 +0000 UTC m=+10.152472489 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f6a5da50-2b05-42de-8aa9-a23e838da830-original-pull-secret") pod "global-pull-secret-syncer-jddtw" (UID: "f6a5da50-2b05-42de-8aa9-a23e838da830") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:50:05.875153 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:05.875115 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:50:05.875270 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:05.875187 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99-metrics-certs podName:ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:09.875173517 +0000 UTC m=+10.152934266 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99-metrics-certs") pod "network-metrics-daemon-lrgwp" (UID: "ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:50:05.974963 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:05.974898 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxtl8\" (UniqueName: \"kubernetes.io/projected/d798bbe1-8647-4ec6-88da-24514bca83d1-kube-api-access-fxtl8\") pod \"network-check-target-2rn74\" (UID: \"d798bbe1-8647-4ec6-88da-24514bca83d1\") " pod="openshift-network-diagnostics/network-check-target-2rn74" Jun 11 19:50:05.975228 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:05.975087 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:50:05.975228 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:05.975109 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:50:05.975228 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:05.975139 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fxtl8 for pod openshift-network-diagnostics/network-check-target-2rn74: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:50:05.975228 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:05.975213 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d798bbe1-8647-4ec6-88da-24514bca83d1-kube-api-access-fxtl8 podName:d798bbe1-8647-4ec6-88da-24514bca83d1 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:09.975183261 +0000 UTC m=+10.252944020 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxtl8" (UniqueName: "kubernetes.io/projected/d798bbe1-8647-4ec6-88da-24514bca83d1-kube-api-access-fxtl8") pod "network-check-target-2rn74" (UID: "d798bbe1-8647-4ec6-88da-24514bca83d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:50:06.193314 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:06.192325 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:50:06.193314 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:06.192454 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jddtw" podUID="f6a5da50-2b05-42de-8aa9-a23e838da830" Jun 11 19:50:06.193314 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:06.193089 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:50:06.193314 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:06.193209 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrgwp" podUID="ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99" Jun 11 19:50:06.193785 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:06.193648 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rn74" Jun 11 19:50:06.193785 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:06.193734 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rn74" podUID="d798bbe1-8647-4ec6-88da-24514bca83d1" Jun 11 19:50:08.190897 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:08.190862 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:50:08.191376 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:08.190863 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:50:08.191376 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:08.191021 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrgwp" podUID="ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99" Jun 11 19:50:08.191376 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:08.190867 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rn74" Jun 11 19:50:08.194894 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:08.191988 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rn74" podUID="d798bbe1-8647-4ec6-88da-24514bca83d1" Jun 11 19:50:08.194894 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:08.192291 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jddtw" podUID="f6a5da50-2b05-42de-8aa9-a23e838da830" Jun 11 19:50:09.908778 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:09.908727 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6a5da50-2b05-42de-8aa9-a23e838da830-original-pull-secret\") pod \"global-pull-secret-syncer-jddtw\" (UID: \"f6a5da50-2b05-42de-8aa9-a23e838da830\") " pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:50:09.909422 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:09.908830 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99-metrics-certs\") pod \"network-metrics-daemon-lrgwp\" (UID: \"ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99\") " pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:50:09.909422 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:09.908905 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:50:09.909422 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:09.908934 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:50:09.909422 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:09.908986 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99-metrics-certs podName:ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:17.908969228 +0000 UTC m=+18.186729967 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99-metrics-certs") pod "network-metrics-daemon-lrgwp" (UID: "ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:50:09.909422 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:09.909004 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6a5da50-2b05-42de-8aa9-a23e838da830-original-pull-secret podName:f6a5da50-2b05-42de-8aa9-a23e838da830 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:17.908994744 +0000 UTC m=+18.186755480 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f6a5da50-2b05-42de-8aa9-a23e838da830-original-pull-secret") pod "global-pull-secret-syncer-jddtw" (UID: "f6a5da50-2b05-42de-8aa9-a23e838da830") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:50:10.009749 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:10.009259 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxtl8\" (UniqueName: \"kubernetes.io/projected/d798bbe1-8647-4ec6-88da-24514bca83d1-kube-api-access-fxtl8\") pod \"network-check-target-2rn74\" (UID: \"d798bbe1-8647-4ec6-88da-24514bca83d1\") " pod="openshift-network-diagnostics/network-check-target-2rn74" Jun 11 19:50:10.009749 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:10.009452 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:50:10.009749 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:10.009470 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:50:10.009749 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:10.009484 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fxtl8 for pod openshift-network-diagnostics/network-check-target-2rn74: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:50:10.009749 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:10.009541 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d798bbe1-8647-4ec6-88da-24514bca83d1-kube-api-access-fxtl8 podName:d798bbe1-8647-4ec6-88da-24514bca83d1 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:18.009523747 +0000 UTC m=+18.287284485 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxtl8" (UniqueName: "kubernetes.io/projected/d798bbe1-8647-4ec6-88da-24514bca83d1-kube-api-access-fxtl8") pod "network-check-target-2rn74" (UID: "d798bbe1-8647-4ec6-88da-24514bca83d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:50:10.193201 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:10.192383 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:50:10.193201 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:10.192504 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrgwp" podUID="ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99" Jun 11 19:50:10.193201 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:10.192568 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rn74" Jun 11 19:50:10.193201 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:10.192633 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rn74" podUID="d798bbe1-8647-4ec6-88da-24514bca83d1" Jun 11 19:50:10.193201 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:10.193004 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:50:10.193201 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:10.193097 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jddtw" podUID="f6a5da50-2b05-42de-8aa9-a23e838da830" Jun 11 19:50:12.191216 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:12.191092 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rn74" Jun 11 19:50:12.191619 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:12.191261 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rn74" podUID="d798bbe1-8647-4ec6-88da-24514bca83d1" Jun 11 19:50:12.191619 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:12.191578 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:50:12.191715 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:12.191691 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jddtw" podUID="f6a5da50-2b05-42de-8aa9-a23e838da830" Jun 11 19:50:12.191790 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:12.191769 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:50:12.191917 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:12.191894 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrgwp" podUID="ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99" Jun 11 19:50:14.191456 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:14.191418 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:50:14.191908 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:14.191553 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jddtw" podUID="f6a5da50-2b05-42de-8aa9-a23e838da830" Jun 11 19:50:14.191908 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:14.191418 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rn74" Jun 11 19:50:14.191908 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:14.191418 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:50:14.191908 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:14.191688 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rn74" podUID="d798bbe1-8647-4ec6-88da-24514bca83d1" Jun 11 19:50:14.191908 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:14.191724 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrgwp" podUID="ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99" Jun 11 19:50:16.191231 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:16.191196 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:50:16.191664 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:16.191201 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rn74" Jun 11 19:50:16.191664 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:16.191335 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrgwp" podUID="ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99" Jun 11 19:50:16.191664 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:16.191203 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:50:16.191664 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:16.191391 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rn74" podUID="d798bbe1-8647-4ec6-88da-24514bca83d1" Jun 11 19:50:16.191664 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:16.191494 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jddtw" podUID="f6a5da50-2b05-42de-8aa9-a23e838da830" Jun 11 19:50:17.976413 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:17.976378 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99-metrics-certs\") pod \"network-metrics-daemon-lrgwp\" (UID: \"ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99\") " pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:50:17.976413 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:17.976419 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6a5da50-2b05-42de-8aa9-a23e838da830-original-pull-secret\") pod \"global-pull-secret-syncer-jddtw\" (UID: \"f6a5da50-2b05-42de-8aa9-a23e838da830\") " pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:50:17.976869 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:17.976535 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:50:17.976869 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:17.976538 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:50:17.976869 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:17.976601 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6a5da50-2b05-42de-8aa9-a23e838da830-original-pull-secret podName:f6a5da50-2b05-42de-8aa9-a23e838da830 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:33.976582543 +0000 UTC m=+34.254343356 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f6a5da50-2b05-42de-8aa9-a23e838da830-original-pull-secret") pod "global-pull-secret-syncer-jddtw" (UID: "f6a5da50-2b05-42de-8aa9-a23e838da830") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:50:17.976869 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:17.976621 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99-metrics-certs podName:ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:33.976611637 +0000 UTC m=+34.254372375 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99-metrics-certs") pod "network-metrics-daemon-lrgwp" (UID: "ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:50:18.077115 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:18.077081 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxtl8\" (UniqueName: \"kubernetes.io/projected/d798bbe1-8647-4ec6-88da-24514bca83d1-kube-api-access-fxtl8\") pod \"network-check-target-2rn74\" (UID: \"d798bbe1-8647-4ec6-88da-24514bca83d1\") " pod="openshift-network-diagnostics/network-check-target-2rn74" Jun 11 19:50:18.077289 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:18.077248 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:50:18.077289 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:18.077270 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:50:18.077289 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:18.077280 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fxtl8 for pod openshift-network-diagnostics/network-check-target-2rn74: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:50:18.077433 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:18.077353 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d798bbe1-8647-4ec6-88da-24514bca83d1-kube-api-access-fxtl8 podName:d798bbe1-8647-4ec6-88da-24514bca83d1 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:34.077326089 +0000 UTC m=+34.355086844 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxtl8" (UniqueName: "kubernetes.io/projected/d798bbe1-8647-4ec6-88da-24514bca83d1-kube-api-access-fxtl8") pod "network-check-target-2rn74" (UID: "d798bbe1-8647-4ec6-88da-24514bca83d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:50:18.191831 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:18.191793 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:50:18.191984 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:18.191793 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:50:18.191984 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:18.191929 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jddtw" podUID="f6a5da50-2b05-42de-8aa9-a23e838da830" Jun 11 19:50:18.192114 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:18.191982 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrgwp" podUID="ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99" Jun 11 19:50:18.192114 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:18.191793 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rn74" Jun 11 19:50:18.192114 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:18.192057 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rn74" podUID="d798bbe1-8647-4ec6-88da-24514bca83d1" Jun 11 19:50:20.192279 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:20.192044 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:50:20.192704 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:20.192147 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:50:20.192704 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:20.192367 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jddtw" podUID="f6a5da50-2b05-42de-8aa9-a23e838da830" Jun 11 19:50:20.192704 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:20.192174 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rn74" Jun 11 19:50:20.192704 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:20.192432 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrgwp" podUID="ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99" Jun 11 19:50:20.192704 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:20.192462 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rn74" podUID="d798bbe1-8647-4ec6-88da-24514bca83d1" Jun 11 19:50:22.190916 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:22.190886 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rn74" Jun 11 19:50:22.191536 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:22.190887 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:50:22.191536 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:22.190992 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rn74" podUID="d798bbe1-8647-4ec6-88da-24514bca83d1" Jun 11 19:50:22.191536 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:22.191004 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:50:22.191536 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:22.191116 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrgwp" podUID="ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99" Jun 11 19:50:22.191536 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:22.191212 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jddtw" podUID="f6a5da50-2b05-42de-8aa9-a23e838da830" Jun 11 19:50:22.291609 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:22.291588 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hrb9t_85a48db4-30bf-47f2-9668-8b0a67c26fe4/ovn-acl-logging/0.log" Jun 11 19:50:22.292039 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:22.292005 2576 generic.go:356] "Generic (PLEG): container finished" podID="85a48db4-30bf-47f2-9668-8b0a67c26fe4" containerID="9285d86c775aefe934f6e12a1e597fda8d20388379dfd3f9ebfdc86591ff1c6b" exitCode=1 Jun 11 19:50:22.292179 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:22.292143 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" event={"ID":"85a48db4-30bf-47f2-9668-8b0a67c26fe4","Type":"ContainerStarted","Data":"d0fefa277e462bd57cf0f06e0e4fbf1fe4b69ab044d43556e0f77896cf21fd00"} Jun 11 19:50:22.292247 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:22.292226 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" event={"ID":"85a48db4-30bf-47f2-9668-8b0a67c26fe4","Type":"ContainerStarted","Data":"8cd829556066f8a939babe6cad7117110b612ff46da76d5b4d6e2e6e9e97e098"} Jun 11 19:50:22.292302 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:22.292277 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" event={"ID":"85a48db4-30bf-47f2-9668-8b0a67c26fe4","Type":"ContainerDied","Data":"9285d86c775aefe934f6e12a1e597fda8d20388379dfd3f9ebfdc86591ff1c6b"} Jun 11 19:50:22.292358 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:22.292327 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" event={"ID":"85a48db4-30bf-47f2-9668-8b0a67c26fe4","Type":"ContainerStarted","Data":"dd09c57238dd28f86cc131263176f15537cf8bd3da62718a6e386a3ddf2e136a"} Jun 11 19:50:22.293933 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:22.293909 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jm7ml" event={"ID":"1faca528-a502-4643-9533-a66900535be2","Type":"ContainerStarted","Data":"bd9394901938c25f0f8b36d0362ba23a873239f6ee15fec39ea69448ce9f891a"} Jun 11 19:50:22.295295 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:22.295273 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2trvq" event={"ID":"143be408-3d56-48e6-87d3-3e2746001044","Type":"ContainerStarted","Data":"e7d25cc4929c33e6b32c3709fc5971740a654fbf8f69af88565f591cb0cf9d8a"} Jun 11 19:50:22.296515 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:22.296493 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mc6x6" event={"ID":"98cc5ec8-4790-4b36-a80d-df6d5d1e8bf6","Type":"ContainerStarted","Data":"fd71a79597ee236f06b66b33c71981fe16a97fd6ef6f2cf98eeb530219bf7b19"} Jun 11 19:50:22.297706 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:22.297686 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7r7h" event={"ID":"abe83f4b-2288-46d2-8b25-4de9e634ff5b","Type":"ContainerStarted","Data":"de10619f3fff1570b373d501be52a02297a11a4e82126e74971f84ddf66a671f"} Jun 11 19:50:22.298904 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:22.298886 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" event={"ID":"548d858f-2ed3-4a90-b197-693ef3bfa7e9","Type":"ContainerStarted","Data":"e8c692c395ab5dc5db2c91b6a9d236426f07e45986b130591f48cb2659737fae"} Jun 11 19:50:22.300443 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:22.300422 2576 generic.go:356] "Generic (PLEG): container finished" podID="02067c5b-4d64-4458-ab32-b005f9546ec9" containerID="26a29a980e9c8bbeaf5fc07c75e6c75987bc32068e092d81e92065fa9a305756" exitCode=0 Jun 11 19:50:22.300525 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:22.300484 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5d69r" event={"ID":"02067c5b-4d64-4458-ab32-b005f9546ec9","Type":"ContainerDied","Data":"26a29a980e9c8bbeaf5fc07c75e6c75987bc32068e092d81e92065fa9a305756"} Jun 11 19:50:22.301929 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:22.301909 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rgjlh" event={"ID":"226f79e5-5702-495b-8ffd-d60cd1e68f19","Type":"ContainerStarted","Data":"ac3142cc828e5a592d9a93207ec63078e71571bc3acc5d09999415f6ec7893aa"} Jun 11 19:50:22.310397 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:22.310359 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal" podStartSLOduration=21.310333428 podStartE2EDuration="21.310333428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:50:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:50:05.27996725 +0000 UTC m=+5.557728009" watchObservedRunningTime="2026-06-11 19:50:22.310333428 +0000 UTC m=+22.588094177" Jun 11 19:50:22.310666 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:22.310642 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jm7ml" podStartSLOduration=12.257300015 podStartE2EDuration="22.310633558s" totalImagesPullingTime="10.053333543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:50:22.310249141 +0000 UTC m=+22.588009910" watchObservedRunningTime="2026-06-11 19:50:22.310633558 +0000 UTC m=+22.588394313" Jun 11 19:50:22.352664 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:22.352625 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mc6x6" podStartSLOduration=7.96723165 podStartE2EDuration="22.352613473s" totalImagesPullingTime="14.385381823s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:50:22.32747705 +0000 UTC m=+22.605237809" watchObservedRunningTime="2026-06-11 19:50:22.352613473 +0000 UTC m=+22.630374249" Jun 11 19:50:22.370738 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:22.370692 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wgbgr" podStartSLOduration=3.600367615 podStartE2EDuration="22.370678989s" totalImagesPullingTime="18.770311374s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:50:22.370404375 +0000 UTC m=+22.648165133" watchObservedRunningTime="2026-06-11 19:50:22.370678989 +0000 UTC m=+22.648439746" Jun 11 19:50:22.387301 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:22.387264 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rgjlh" podStartSLOduration=3.612064017 podStartE2EDuration="22.387251409s" totalImagesPullingTime="18.775187392s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:50:22.386900292 +0000 UTC m=+22.664661050" watchObservedRunningTime="2026-06-11 19:50:22.387251409 +0000 UTC m=+22.665012168" Jun 11 19:50:22.414026 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:22.413988 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2trvq" podStartSLOduration=3.57693343 podStartE2EDuration="22.413975841s" totalImagesPullingTime="18.837042411s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:50:22.413413954 +0000 UTC m=+22.691174712" watchObservedRunningTime="2026-06-11 19:50:22.413975841 +0000 UTC m=+22.691736598" Jun 11 19:50:22.438299 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:22.438277 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jm7ml" Jun 11 19:50:22.438868 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:22.438851 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jm7ml" Jun 11 19:50:23.305699 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:23.305655 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dhc6t" event={"ID":"5bb1879c-50b2-47e1-a3f6-95e8b36ca724","Type":"ContainerStarted","Data":"48a8ffe26f6450eea4c7839e3d02a6c6661b30990f36b6f02d71443ca4acd39d"} Jun 11 19:50:23.309090 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:23.309038 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hrb9t_85a48db4-30bf-47f2-9668-8b0a67c26fe4/ovn-acl-logging/0.log" Jun 11 19:50:23.309539 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:23.309511 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" event={"ID":"85a48db4-30bf-47f2-9668-8b0a67c26fe4","Type":"ContainerStarted","Data":"e28e819dee5c97f3a65689de29c56e9d4fc6d4fa2813d2073c0a23550155f20d"} Jun 11 19:50:23.309641 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:23.309587 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" event={"ID":"85a48db4-30bf-47f2-9668-8b0a67c26fe4","Type":"ContainerStarted","Data":"35f6fbb40c8d388a591d194a8f7b05c732973ebfadb79efdd3c3f2ae21899633"} Jun 11 19:50:23.310348 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:23.310325 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jm7ml" Jun 11 19:50:23.310823 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:23.310807 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jm7ml" Jun 11 19:50:23.322206 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:23.322173 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dhc6t" podStartSLOduration=4.587794815 podStartE2EDuration="23.322162225s" totalImagesPullingTime="18.73436741s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:50:23.321971606 +0000 UTC m=+23.599732365" watchObservedRunningTime="2026-06-11 19:50:23.322162225 +0000 UTC m=+23.599922983" Jun 11 19:50:23.365622 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:23.365602 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 19:50:24.191413 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:24.191375 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:50:24.191591 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:24.191382 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rn74" Jun 11 19:50:24.191591 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:24.191510 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrgwp" podUID="ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99" Jun 11 19:50:24.191591 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:24.191551 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:50:24.191745 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:24.191618 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rn74" podUID="d798bbe1-8647-4ec6-88da-24514bca83d1" Jun 11 19:50:24.191745 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:24.191719 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jddtw" podUID="f6a5da50-2b05-42de-8aa9-a23e838da830" Jun 11 19:50:24.205755 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:24.205658 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T19:50:23.365618239Z","UUID":"73a5b9ec-85df-44b6-998d-40d3e9ba7ecd","Handler":null,"Name":"","Endpoint":""} Jun 11 19:50:24.207567 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:24.207547 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 19:50:24.207666 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:24.207585 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 19:50:24.313618 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:24.313576 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7r7h" event={"ID":"abe83f4b-2288-46d2-8b25-4de9e634ff5b","Type":"ContainerStarted","Data":"9f0f26739ed6ac56102cf550ecf304456df96e6a6cc9837a64c1c2abd795157e"} Jun 11 19:50:25.321545 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:25.321480 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hrb9t_85a48db4-30bf-47f2-9668-8b0a67c26fe4/ovn-acl-logging/0.log" Jun 11 19:50:25.322078 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:25.321816 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" event={"ID":"85a48db4-30bf-47f2-9668-8b0a67c26fe4","Type":"ContainerStarted","Data":"ba42e2a424daeaea6248e13d7f73f6ed56ee41fbe9265186543ba10ebd9fae1b"} Jun 11 19:50:25.323637 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:25.323610 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7r7h" event={"ID":"abe83f4b-2288-46d2-8b25-4de9e634ff5b","Type":"ContainerStarted","Data":"d06ce0c09a64d548786274d0ece9c7add3e8496b28108a7371c4d6bd182166d5"} Jun 11 19:50:25.342672 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:25.342633 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7r7h" podStartSLOduration=3.731260431 podStartE2EDuration="25.342621473s" totalImagesPullingTime="21.611361042s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:50:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:50:25.342361895 +0000 UTC m=+25.620122652" watchObservedRunningTime="2026-06-11 19:50:25.342621473 +0000 UTC m=+25.620382231" Jun 11 19:50:26.191299 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:26.191262 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:50:26.191299 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:26.191287 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rn74" Jun 11 19:50:26.191528 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:26.191270 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:50:26.191528 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:26.191398 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jddtw" podUID="f6a5da50-2b05-42de-8aa9-a23e838da830" Jun 11 19:50:26.191528 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:26.191520 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrgwp" podUID="ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99" Jun 11 19:50:26.191687 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:26.191583 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rn74" podUID="d798bbe1-8647-4ec6-88da-24514bca83d1" Jun 11 19:50:27.333099 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:27.332900 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hrb9t_85a48db4-30bf-47f2-9668-8b0a67c26fe4/ovn-acl-logging/0.log" Jun 11 19:50:27.333568 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:27.333485 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" event={"ID":"85a48db4-30bf-47f2-9668-8b0a67c26fe4","Type":"ContainerStarted","Data":"1b9b957b9ba56b01e5c259545e3dd4336cf139aa5ed0b11882a7768fd52a1b10"} Jun 11 19:50:27.333858 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:27.333831 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:27.333917 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:27.333898 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:27.334022 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:27.333996 2576 scope.go:117] "RemoveContainer" containerID="9285d86c775aefe934f6e12a1e597fda8d20388379dfd3f9ebfdc86591ff1c6b" Jun 11 19:50:27.350752 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:27.350724 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:27.351019 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:27.351003 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:28.191303 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:28.191267 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:50:28.191303 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:28.191298 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:50:28.191479 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:28.191265 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rn74" Jun 11 19:50:28.191479 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:28.191391 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrgwp" podUID="ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99" Jun 11 19:50:28.191479 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:28.191442 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rn74" podUID="d798bbe1-8647-4ec6-88da-24514bca83d1" Jun 11 19:50:28.191563 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:28.191546 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jddtw" podUID="f6a5da50-2b05-42de-8aa9-a23e838da830" Jun 11 19:50:28.337276 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:28.337242 2576 generic.go:356] "Generic (PLEG): container finished" podID="02067c5b-4d64-4458-ab32-b005f9546ec9" containerID="dc434806196a522ec2b3edaca02f10f842eff30510202abb330ed2fa8a93d026" exitCode=0 Jun 11 19:50:28.337742 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:28.337320 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5d69r" event={"ID":"02067c5b-4d64-4458-ab32-b005f9546ec9","Type":"ContainerDied","Data":"dc434806196a522ec2b3edaca02f10f842eff30510202abb330ed2fa8a93d026"} Jun 11 19:50:28.341197 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:28.341178 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hrb9t_85a48db4-30bf-47f2-9668-8b0a67c26fe4/ovn-acl-logging/0.log" Jun 11 19:50:28.341496 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:28.341478 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" event={"ID":"85a48db4-30bf-47f2-9668-8b0a67c26fe4","Type":"ContainerStarted","Data":"5fe4d9d290e46878f0880ba0072437bb560e8ce17ca58b7a8c68232be739b3b7"} Jun 11 19:50:28.341579 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:28.341566 2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 11 19:50:28.386187 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:28.386113 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" podStartSLOduration=9.578254413 podStartE2EDuration="28.386096775s" totalImagesPullingTime="18.807842362s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:50:28.385458318 +0000 UTC m=+28.663219075" watchObservedRunningTime="2026-06-11 19:50:28.386096775 +0000 UTC m=+28.663857532" Jun 11 19:50:28.661231 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:28.661200 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:50:29.166092 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:29.166057 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jddtw"] Jun 11 19:50:29.166237 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:29.166174 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:50:29.166272 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:29.166255 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jddtw" podUID="f6a5da50-2b05-42de-8aa9-a23e838da830" Jun 11 19:50:29.182846 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:29.182810 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lrgwp"] Jun 11 19:50:29.182961 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:29.182922 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:50:29.183053 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:29.183034 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrgwp" podUID="ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99" Jun 11 19:50:29.198949 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:29.198921 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2rn74"] Jun 11 19:50:29.199062 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:29.199009 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rn74" Jun 11 19:50:29.199149 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:29.199105 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rn74" podUID="d798bbe1-8647-4ec6-88da-24514bca83d1" Jun 11 19:50:30.347837 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:30.347654 2576 generic.go:356] "Generic (PLEG): container finished" podID="02067c5b-4d64-4458-ab32-b005f9546ec9" containerID="9bbad7b8ff5abd30c9597b3e373a7e69e3a7c710034e39d99507cd014f6fa0a8" exitCode=0 Jun 11 19:50:30.347837 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:30.347718 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5d69r" event={"ID":"02067c5b-4d64-4458-ab32-b005f9546ec9","Type":"ContainerDied","Data":"9bbad7b8ff5abd30c9597b3e373a7e69e3a7c710034e39d99507cd014f6fa0a8"} Jun 11 19:50:31.191504 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:31.191464 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:50:31.191635 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:31.191518 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:50:31.191635 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:31.191527 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rn74" Jun 11 19:50:31.191724 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:31.191624 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jddtw" podUID="f6a5da50-2b05-42de-8aa9-a23e838da830" Jun 11 19:50:31.191724 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:31.191700 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrgwp" podUID="ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99" Jun 11 19:50:31.191808 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:31.191765 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rn74" podUID="d798bbe1-8647-4ec6-88da-24514bca83d1" Jun 11 19:50:32.354812 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:32.354779 2576 generic.go:356] "Generic (PLEG): container finished" podID="02067c5b-4d64-4458-ab32-b005f9546ec9" containerID="0ba2855e76719f8e6d11856f7ee40572f51e662bfeda6d9d3bc12c5c18299459" exitCode=0 Jun 11 19:50:32.355485 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:32.354837 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5d69r" event={"ID":"02067c5b-4d64-4458-ab32-b005f9546ec9","Type":"ContainerDied","Data":"0ba2855e76719f8e6d11856f7ee40572f51e662bfeda6d9d3bc12c5c18299459"} Jun 11 19:50:33.191745 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:33.191707 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:50:33.191745 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:33.191741 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rn74" Jun 11 19:50:33.192054 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:33.191742 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:50:33.192054 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:33.191842 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jddtw" podUID="f6a5da50-2b05-42de-8aa9-a23e838da830" Jun 11 19:50:33.192225 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:33.192096 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrgwp" podUID="ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99" Jun 11 19:50:33.192275 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:33.192221 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rn74" podUID="d798bbe1-8647-4ec6-88da-24514bca83d1" Jun 11 19:50:33.997381 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:33.997349 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99-metrics-certs\") pod \"network-metrics-daemon-lrgwp\" (UID: \"ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99\") " pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:50:33.997893 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:33.997390 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6a5da50-2b05-42de-8aa9-a23e838da830-original-pull-secret\") pod \"global-pull-secret-syncer-jddtw\" (UID: \"f6a5da50-2b05-42de-8aa9-a23e838da830\") " pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:50:33.997893 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:33.997507 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:50:33.997893 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:33.997531 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:50:33.997893 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:33.997565 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6a5da50-2b05-42de-8aa9-a23e838da830-original-pull-secret podName:f6a5da50-2b05-42de-8aa9-a23e838da830 nodeName:}" failed. No retries permitted until 2026-06-11 19:51:05.997549129 +0000 UTC m=+66.275309869 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f6a5da50-2b05-42de-8aa9-a23e838da830-original-pull-secret") pod "global-pull-secret-syncer-jddtw" (UID: "f6a5da50-2b05-42de-8aa9-a23e838da830") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:50:33.997893 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:33.997596 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99-metrics-certs podName:ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99 nodeName:}" failed. No retries permitted until 2026-06-11 19:51:05.997578819 +0000 UTC m=+66.275339570 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99-metrics-certs") pod "network-metrics-daemon-lrgwp" (UID: "ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:50:34.098095 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:34.098059 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxtl8\" (UniqueName: \"kubernetes.io/projected/d798bbe1-8647-4ec6-88da-24514bca83d1-kube-api-access-fxtl8\") pod \"network-check-target-2rn74\" (UID: \"d798bbe1-8647-4ec6-88da-24514bca83d1\") " pod="openshift-network-diagnostics/network-check-target-2rn74" Jun 11 19:50:34.098259 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:34.098242 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:50:34.098298 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:34.098264 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:50:34.098298 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:34.098273 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fxtl8 for pod openshift-network-diagnostics/network-check-target-2rn74: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:50:34.098400 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:34.098323 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d798bbe1-8647-4ec6-88da-24514bca83d1-kube-api-access-fxtl8 podName:d798bbe1-8647-4ec6-88da-24514bca83d1 nodeName:}" failed. No retries permitted until 2026-06-11 19:51:06.09831054 +0000 UTC m=+66.376071277 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxtl8" (UniqueName: "kubernetes.io/projected/d798bbe1-8647-4ec6-88da-24514bca83d1-kube-api-access-fxtl8") pod "network-check-target-2rn74" (UID: "d798bbe1-8647-4ec6-88da-24514bca83d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:50:35.191415 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.191377 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rn74" Jun 11 19:50:35.191764 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.191377 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:50:35.191764 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:35.191479 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2rn74" podUID="d798bbe1-8647-4ec6-88da-24514bca83d1" Jun 11 19:50:35.191764 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.191377 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:50:35.191764 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:35.191556 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrgwp" podUID="ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99" Jun 11 19:50:35.191764 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:35.191624 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jddtw" podUID="f6a5da50-2b05-42de-8aa9-a23e838da830" Jun 11 19:50:35.571678 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.571603 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeReady" Jun 11 19:50:35.571816 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.571752 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 19:50:35.623146 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.623098 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-84f479d4df-xxq5c"] Jun 11 19:50:35.654521 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.654443 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nqlv6"] Jun 11 19:50:35.654689 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.654593 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:50:35.657483 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.657460 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 19:50:35.657604 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.657490 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zmxhm\"" Jun 11 19:50:35.659869 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.658382 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 19:50:35.659869 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.658777 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 19:50:35.667175 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.667115 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 19:50:35.668763 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.668028 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-84f479d4df-xxq5c"] Jun 11 19:50:35.668763 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.668076 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-76x6k"] Jun 11 19:50:35.668763 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.668177 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nqlv6" Jun 11 19:50:35.670521 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.670499 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rb2ld\"" Jun 11 19:50:35.673274 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.673090 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 19:50:35.673274 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.673108 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 19:50:35.682411 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.682393 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nqlv6"] Jun 11 19:50:35.682505 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.682420 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-76x6k"] Jun 11 19:50:35.682505 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.682499 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-76x6k" Jun 11 19:50:35.687956 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.687924 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 19:50:35.687956 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.687940 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 19:50:35.688112 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.688009 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fdr4v\"" Jun 11 19:50:35.688597 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.688579 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 19:50:35.810865 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.810827 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-tls\") pod \"image-registry-84f479d4df-xxq5c\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:50:35.810865 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.810860 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/783eb1a7-0a40-4ad8-9705-e9df073f3194-cert\") pod \"ingress-canary-76x6k\" (UID: \"783eb1a7-0a40-4ad8-9705-e9df073f3194\") " pod="openshift-ingress-canary/ingress-canary-76x6k" Jun 11 19:50:35.811089 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.810878 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-trusted-ca\") pod \"image-registry-84f479d4df-xxq5c\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:50:35.811089 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.810899 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-bound-sa-token\") pod \"image-registry-84f479d4df-xxq5c\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:50:35.811089 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.810949 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/783f40b5-7d52-4433-9c0d-3bd61ebe9100-tmp-dir\") pod \"dns-default-nqlv6\" (UID: \"783f40b5-7d52-4433-9c0d-3bd61ebe9100\") " pod="openshift-dns/dns-default-nqlv6" Jun 11 19:50:35.811089 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.811059 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-installation-pull-secrets\") pod \"image-registry-84f479d4df-xxq5c\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:50:35.811275 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.811091 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffk76\" (UniqueName: \"kubernetes.io/projected/783eb1a7-0a40-4ad8-9705-e9df073f3194-kube-api-access-ffk76\") pod \"ingress-canary-76x6k\" (UID: \"783eb1a7-0a40-4ad8-9705-e9df073f3194\") " pod="openshift-ingress-canary/ingress-canary-76x6k" Jun 11 19:50:35.811275 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.811138 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn6d2\" (UniqueName: \"kubernetes.io/projected/783f40b5-7d52-4433-9c0d-3bd61ebe9100-kube-api-access-cn6d2\") pod \"dns-default-nqlv6\" (UID: \"783f40b5-7d52-4433-9c0d-3bd61ebe9100\") " pod="openshift-dns/dns-default-nqlv6" Jun 11 19:50:35.811275 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.811168 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-image-registry-private-configuration\") pod \"image-registry-84f479d4df-xxq5c\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:50:35.811275 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.811210 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/783f40b5-7d52-4433-9c0d-3bd61ebe9100-config-volume\") pod \"dns-default-nqlv6\" (UID: \"783f40b5-7d52-4433-9c0d-3bd61ebe9100\") " pod="openshift-dns/dns-default-nqlv6" Jun 11 19:50:35.811455 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.811282 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/783f40b5-7d52-4433-9c0d-3bd61ebe9100-metrics-tls\") pod \"dns-default-nqlv6\" (UID: \"783f40b5-7d52-4433-9c0d-3bd61ebe9100\") " pod="openshift-dns/dns-default-nqlv6" Jun 11 19:50:35.811455 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.811303 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmth6\" (UniqueName: \"kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-kube-api-access-jmth6\") pod \"image-registry-84f479d4df-xxq5c\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:50:35.811455 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.811340 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-certificates\") pod \"image-registry-84f479d4df-xxq5c\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:50:35.811455 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.811368 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-ca-trust-extracted\") pod \"image-registry-84f479d4df-xxq5c\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:50:35.912168 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.912132 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-tls\") pod \"image-registry-84f479d4df-xxq5c\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:50:35.912168 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.912166 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/783eb1a7-0a40-4ad8-9705-e9df073f3194-cert\") pod \"ingress-canary-76x6k\" (UID: \"783eb1a7-0a40-4ad8-9705-e9df073f3194\") " pod="openshift-ingress-canary/ingress-canary-76x6k" Jun 11 19:50:35.912413 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.912198 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-trusted-ca\") pod \"image-registry-84f479d4df-xxq5c\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:50:35.912413 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.912239 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-bound-sa-token\") pod \"image-registry-84f479d4df-xxq5c\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:50:35.912413 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.912268 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/783f40b5-7d52-4433-9c0d-3bd61ebe9100-tmp-dir\") pod \"dns-default-nqlv6\" (UID: \"783f40b5-7d52-4433-9c0d-3bd61ebe9100\") " pod="openshift-dns/dns-default-nqlv6" Jun 11 19:50:35.912413 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.912314 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-installation-pull-secrets\") pod \"image-registry-84f479d4df-xxq5c\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:50:35.912413 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:35.912320 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 19:50:35.912413 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:35.912341 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84f479d4df-xxq5c: secret "image-registry-tls" not found Jun 11 19:50:35.912413 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.912345 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffk76\" (UniqueName: \"kubernetes.io/projected/783eb1a7-0a40-4ad8-9705-e9df073f3194-kube-api-access-ffk76\") pod \"ingress-canary-76x6k\" (UID: \"783eb1a7-0a40-4ad8-9705-e9df073f3194\") " pod="openshift-ingress-canary/ingress-canary-76x6k" Jun 11 19:50:35.912413 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.912374 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn6d2\" (UniqueName: \"kubernetes.io/projected/783f40b5-7d52-4433-9c0d-3bd61ebe9100-kube-api-access-cn6d2\") pod \"dns-default-nqlv6\" (UID: \"783f40b5-7d52-4433-9c0d-3bd61ebe9100\") " pod="openshift-dns/dns-default-nqlv6" Jun 11 19:50:35.912742 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:35.912429 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-tls podName:d7079aa1-df0b-45cc-9c97-c2ae18aa1520 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:36.412407169 +0000 UTC m=+36.690167918 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-tls") pod "image-registry-84f479d4df-xxq5c" (UID: "d7079aa1-df0b-45cc-9c97-c2ae18aa1520") : secret "image-registry-tls" not found Jun 11 19:50:35.912742 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.912408 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-image-registry-private-configuration\") pod \"image-registry-84f479d4df-xxq5c\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:50:35.912742 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.912461 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/783f40b5-7d52-4433-9c0d-3bd61ebe9100-config-volume\") pod \"dns-default-nqlv6\" (UID: \"783f40b5-7d52-4433-9c0d-3bd61ebe9100\") " pod="openshift-dns/dns-default-nqlv6" Jun 11 19:50:35.912742 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.912537 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/783f40b5-7d52-4433-9c0d-3bd61ebe9100-metrics-tls\") pod \"dns-default-nqlv6\" (UID: \"783f40b5-7d52-4433-9c0d-3bd61ebe9100\") " pod="openshift-dns/dns-default-nqlv6" Jun 11 19:50:35.912742 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.912725 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/783f40b5-7d52-4433-9c0d-3bd61ebe9100-tmp-dir\") pod \"dns-default-nqlv6\" (UID: \"783f40b5-7d52-4433-9c0d-3bd61ebe9100\") " pod="openshift-dns/dns-default-nqlv6" Jun 11 19:50:35.912963 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.912751 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmth6\" (UniqueName: \"kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-kube-api-access-jmth6\") pod \"image-registry-84f479d4df-xxq5c\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:50:35.912963 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.912813 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-certificates\") pod \"image-registry-84f479d4df-xxq5c\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:50:35.912963 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.912846 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-ca-trust-extracted\") pod \"image-registry-84f479d4df-xxq5c\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:50:35.912963 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:35.912902 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:50:35.913187 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:35.912981 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/783f40b5-7d52-4433-9c0d-3bd61ebe9100-metrics-tls podName:783f40b5-7d52-4433-9c0d-3bd61ebe9100 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:36.412959594 +0000 UTC m=+36.690720335 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/783f40b5-7d52-4433-9c0d-3bd61ebe9100-metrics-tls") pod "dns-default-nqlv6" (UID: "783f40b5-7d52-4433-9c0d-3bd61ebe9100") : secret "dns-default-metrics-tls" not found Jun 11 19:50:35.913318 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.913271 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-ca-trust-extracted\") pod \"image-registry-84f479d4df-xxq5c\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:50:35.913373 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.913358 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/783f40b5-7d52-4433-9c0d-3bd61ebe9100-config-volume\") pod \"dns-default-nqlv6\" (UID: \"783f40b5-7d52-4433-9c0d-3bd61ebe9100\") " pod="openshift-dns/dns-default-nqlv6" Jun 11 19:50:35.914009 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.913802 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-certificates\") pod \"image-registry-84f479d4df-xxq5c\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:50:35.914149 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.914007 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-trusted-ca\") pod \"image-registry-84f479d4df-xxq5c\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:50:35.917422 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.917386 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/783eb1a7-0a40-4ad8-9705-e9df073f3194-cert\") pod \"ingress-canary-76x6k\" (UID: \"783eb1a7-0a40-4ad8-9705-e9df073f3194\") " pod="openshift-ingress-canary/ingress-canary-76x6k" Jun 11 19:50:35.917422 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.917405 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-image-registry-private-configuration\") pod \"image-registry-84f479d4df-xxq5c\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:50:35.917793 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.917773 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-installation-pull-secrets\") pod \"image-registry-84f479d4df-xxq5c\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:50:35.940333 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.940312 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn6d2\" (UniqueName: \"kubernetes.io/projected/783f40b5-7d52-4433-9c0d-3bd61ebe9100-kube-api-access-cn6d2\") pod \"dns-default-nqlv6\" (UID: \"783f40b5-7d52-4433-9c0d-3bd61ebe9100\") " pod="openshift-dns/dns-default-nqlv6" Jun 11 19:50:35.940507 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.940484 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-bound-sa-token\") pod \"image-registry-84f479d4df-xxq5c\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:50:35.940603 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.940589 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmth6\" (UniqueName: \"kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-kube-api-access-jmth6\") pod \"image-registry-84f479d4df-xxq5c\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:50:35.941573 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.941549 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffk76\" (UniqueName: \"kubernetes.io/projected/783eb1a7-0a40-4ad8-9705-e9df073f3194-kube-api-access-ffk76\") pod \"ingress-canary-76x6k\" (UID: \"783eb1a7-0a40-4ad8-9705-e9df073f3194\") " pod="openshift-ingress-canary/ingress-canary-76x6k" Jun 11 19:50:35.986615 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.986568 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jm7ml_1faca528-a502-4643-9533-a66900535be2/konnectivity-agent/0.log" limit=1024 Jun 11 19:50:35.992344 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:35.992321 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-76x6k" Jun 11 19:50:36.136577 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:36.136534 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jm7ml_1faca528-a502-4643-9533-a66900535be2/konnectivity-agent/0.log" limit=1024 Jun 11 19:50:36.416459 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:36.416412 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/783f40b5-7d52-4433-9c0d-3bd61ebe9100-metrics-tls\") pod \"dns-default-nqlv6\" (UID: \"783f40b5-7d52-4433-9c0d-3bd61ebe9100\") " pod="openshift-dns/dns-default-nqlv6" Jun 11 19:50:36.416945 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:36.416486 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-tls\") pod \"image-registry-84f479d4df-xxq5c\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:50:36.416945 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:36.416589 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:50:36.416945 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:36.416628 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 19:50:36.416945 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:36.416643 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84f479d4df-xxq5c: secret "image-registry-tls" not found Jun 11 19:50:36.416945 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:36.416670 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/783f40b5-7d52-4433-9c0d-3bd61ebe9100-metrics-tls podName:783f40b5-7d52-4433-9c0d-3bd61ebe9100 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:37.416650237 +0000 UTC m=+37.694410977 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/783f40b5-7d52-4433-9c0d-3bd61ebe9100-metrics-tls") pod "dns-default-nqlv6" (UID: "783f40b5-7d52-4433-9c0d-3bd61ebe9100") : secret "dns-default-metrics-tls" not found Jun 11 19:50:36.416945 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:36.416690 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-tls podName:d7079aa1-df0b-45cc-9c97-c2ae18aa1520 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:37.416680632 +0000 UTC m=+37.694441373 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-tls") pod "image-registry-84f479d4df-xxq5c" (UID: "d7079aa1-df0b-45cc-9c97-c2ae18aa1520") : secret "image-registry-tls" not found Jun 11 19:50:36.896600 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:36.896575 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-76x6k"] Jun 11 19:50:36.899796 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:50:36.899762 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod783eb1a7_0a40_4ad8_9705_e9df073f3194.slice/crio-4a37edc09537c46c426d0bf550f9814a8bfa6425d606718c1c644958d743e3de WatchSource:0}: Error finding container 4a37edc09537c46c426d0bf550f9814a8bfa6425d606718c1c644958d743e3de: Status 404 returned error can't find the container with id 4a37edc09537c46c426d0bf550f9814a8bfa6425d606718c1c644958d743e3de Jun 11 19:50:37.191222 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:37.191191 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:50:37.191392 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:37.191228 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:50:37.191392 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:37.191228 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rn74" Jun 11 19:50:37.195676 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:37.195654 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 19:50:37.196936 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:37.196912 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 19:50:37.196936 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:37.196922 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 19:50:37.196936 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:37.196932 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6rmmv\"" Jun 11 19:50:37.196936 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:37.196935 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 19:50:37.197179 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:37.196950 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mvws7\"" Jun 11 19:50:37.369560 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:37.369528 2576 generic.go:356] "Generic (PLEG): container finished" podID="02067c5b-4d64-4458-ab32-b005f9546ec9" containerID="13ec94fcbcf224a54df0d0ed7d1c84f4c9233d9c4372586c8280b616ec0f33ec" exitCode=0 Jun 11 19:50:37.369749 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:37.369588 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5d69r" event={"ID":"02067c5b-4d64-4458-ab32-b005f9546ec9","Type":"ContainerDied","Data":"13ec94fcbcf224a54df0d0ed7d1c84f4c9233d9c4372586c8280b616ec0f33ec"} Jun 11 19:50:37.370646 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:37.370628 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-76x6k" event={"ID":"783eb1a7-0a40-4ad8-9705-e9df073f3194","Type":"ContainerStarted","Data":"4a37edc09537c46c426d0bf550f9814a8bfa6425d606718c1c644958d743e3de"} Jun 11 19:50:37.424840 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:37.424680 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/783f40b5-7d52-4433-9c0d-3bd61ebe9100-metrics-tls\") pod \"dns-default-nqlv6\" (UID: \"783f40b5-7d52-4433-9c0d-3bd61ebe9100\") " pod="openshift-dns/dns-default-nqlv6" Jun 11 19:50:37.425229 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:37.424865 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:50:37.425229 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:37.424885 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-tls\") pod \"image-registry-84f479d4df-xxq5c\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:50:37.425229 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:37.424941 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/783f40b5-7d52-4433-9c0d-3bd61ebe9100-metrics-tls podName:783f40b5-7d52-4433-9c0d-3bd61ebe9100 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:39.4249176 +0000 UTC m=+39.702678356 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/783f40b5-7d52-4433-9c0d-3bd61ebe9100-metrics-tls") pod "dns-default-nqlv6" (UID: "783f40b5-7d52-4433-9c0d-3bd61ebe9100") : secret "dns-default-metrics-tls" not found Jun 11 19:50:37.425229 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:37.424999 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 19:50:37.425229 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:37.425018 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84f479d4df-xxq5c: secret "image-registry-tls" not found Jun 11 19:50:37.425229 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:37.425082 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-tls podName:d7079aa1-df0b-45cc-9c97-c2ae18aa1520 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:39.425066224 +0000 UTC m=+39.702826979 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-tls") pod "image-registry-84f479d4df-xxq5c" (UID: "d7079aa1-df0b-45cc-9c97-c2ae18aa1520") : secret "image-registry-tls" not found Jun 11 19:50:38.376136 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:38.376090 2576 generic.go:356] "Generic (PLEG): container finished" podID="02067c5b-4d64-4458-ab32-b005f9546ec9" containerID="cfa3df7d281071fbbdfd811e7968c3d741ee16cf7bb8707f0910f087c828ad03" exitCode=0 Jun 11 19:50:38.376314 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:38.376161 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5d69r" event={"ID":"02067c5b-4d64-4458-ab32-b005f9546ec9","Type":"ContainerDied","Data":"cfa3df7d281071fbbdfd811e7968c3d741ee16cf7bb8707f0910f087c828ad03"} Jun 11 19:50:39.381419 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:39.381385 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5d69r" event={"ID":"02067c5b-4d64-4458-ab32-b005f9546ec9","Type":"ContainerStarted","Data":"7e448b192f11aba7f80d279e1f23179ec93908e9b0cb24fef0c14d23f835dbd6"} Jun 11 19:50:39.382740 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:39.382719 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-76x6k" event={"ID":"783eb1a7-0a40-4ad8-9705-e9df073f3194","Type":"ContainerStarted","Data":"f85ca0ebbb4302f9f0c2a279d28c0535287b001f087f6635e6b2f7f0de74088f"} Jun 11 19:50:39.442321 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:39.442292 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/783f40b5-7d52-4433-9c0d-3bd61ebe9100-metrics-tls\") pod \"dns-default-nqlv6\" (UID: \"783f40b5-7d52-4433-9c0d-3bd61ebe9100\") " pod="openshift-dns/dns-default-nqlv6" Jun 11 19:50:39.442489 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:39.442354 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-tls\") pod \"image-registry-84f479d4df-xxq5c\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:50:39.442489 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:39.442441 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:50:39.442628 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:39.442500 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/783f40b5-7d52-4433-9c0d-3bd61ebe9100-metrics-tls podName:783f40b5-7d52-4433-9c0d-3bd61ebe9100 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:43.442485891 +0000 UTC m=+43.720246648 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/783f40b5-7d52-4433-9c0d-3bd61ebe9100-metrics-tls") pod "dns-default-nqlv6" (UID: "783f40b5-7d52-4433-9c0d-3bd61ebe9100") : secret "dns-default-metrics-tls" not found Jun 11 19:50:39.442628 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:39.442545 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 19:50:39.442628 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:39.442560 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84f479d4df-xxq5c: secret "image-registry-tls" not found Jun 11 19:50:39.442628 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:39.442612 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-tls podName:d7079aa1-df0b-45cc-9c97-c2ae18aa1520 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:43.442597047 +0000 UTC m=+43.720357800 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-tls") pod "image-registry-84f479d4df-xxq5c" (UID: "d7079aa1-df0b-45cc-9c97-c2ae18aa1520") : secret "image-registry-tls" not found Jun 11 19:50:39.452146 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:39.451531 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5d69r" podStartSLOduration=9.081003698 podStartE2EDuration="39.451507688s" totalImagesPullingTime="30.37050399s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:50:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:50:39.450500043 +0000 UTC m=+39.728260802" watchObservedRunningTime="2026-06-11 19:50:39.451507688 +0000 UTC m=+39.729268447" Jun 11 19:50:39.494947 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:39.494904 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-76x6k" podStartSLOduration=2.468704232 podStartE2EDuration="4.494890702s" totalImagesPullingTime="2.02618647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:50:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:50:39.494288366 +0000 UTC m=+39.772049138" watchObservedRunningTime="2026-06-11 19:50:39.494890702 +0000 UTC m=+39.772651459" Jun 11 19:50:39.495586 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:39.495562 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jm7ml_1faca528-a502-4643-9533-a66900535be2/konnectivity-agent/0.log" limit=1024 Jun 11 19:50:39.734462 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:39.734382 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jm7ml_1faca528-a502-4643-9533-a66900535be2/konnectivity-agent/0.log" limit=1024 Jun 11 19:50:40.043474 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:40.043383 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jm7ml_1faca528-a502-4643-9533-a66900535be2/konnectivity-agent/0.log" limit=1024 Jun 11 19:50:40.313638 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:40.313550 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jm7ml_1faca528-a502-4643-9533-a66900535be2/konnectivity-agent/0.log" limit=1024 Jun 11 19:50:43.471055 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:43.471021 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-tls\") pod \"image-registry-84f479d4df-xxq5c\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:50:43.471443 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:43.471090 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/783f40b5-7d52-4433-9c0d-3bd61ebe9100-metrics-tls\") pod \"dns-default-nqlv6\" (UID: \"783f40b5-7d52-4433-9c0d-3bd61ebe9100\") " pod="openshift-dns/dns-default-nqlv6" Jun 11 19:50:43.471443 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:43.471184 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:50:43.471443 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:43.471184 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 19:50:43.471443 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:43.471203 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84f479d4df-xxq5c: secret "image-registry-tls" not found Jun 11 19:50:43.471443 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:43.471240 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/783f40b5-7d52-4433-9c0d-3bd61ebe9100-metrics-tls podName:783f40b5-7d52-4433-9c0d-3bd61ebe9100 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:51.47122826 +0000 UTC m=+51.748988999 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/783f40b5-7d52-4433-9c0d-3bd61ebe9100-metrics-tls") pod "dns-default-nqlv6" (UID: "783f40b5-7d52-4433-9c0d-3bd61ebe9100") : secret "dns-default-metrics-tls" not found Jun 11 19:50:43.471443 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:43.471253 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-tls podName:d7079aa1-df0b-45cc-9c97-c2ae18aa1520 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:51.471247233 +0000 UTC m=+51.749007968 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-tls") pod "image-registry-84f479d4df-xxq5c" (UID: "d7079aa1-df0b-45cc-9c97-c2ae18aa1520") : secret "image-registry-tls" not found Jun 11 19:50:51.524603 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:51.524568 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/783f40b5-7d52-4433-9c0d-3bd61ebe9100-metrics-tls\") pod \"dns-default-nqlv6\" (UID: \"783f40b5-7d52-4433-9c0d-3bd61ebe9100\") " pod="openshift-dns/dns-default-nqlv6" Jun 11 19:50:51.525156 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:50:51.524620 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-tls\") pod \"image-registry-84f479d4df-xxq5c\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:50:51.525156 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:51.524724 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 19:50:51.525156 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:51.524734 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84f479d4df-xxq5c: secret "image-registry-tls" not found Jun 11 19:50:51.525156 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:51.524734 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:50:51.525156 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:51.524782 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-tls podName:d7079aa1-df0b-45cc-9c97-c2ae18aa1520 nodeName:}" failed. No retries permitted until 2026-06-11 19:51:07.524768828 +0000 UTC m=+67.802529579 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-tls") pod "image-registry-84f479d4df-xxq5c" (UID: "d7079aa1-df0b-45cc-9c97-c2ae18aa1520") : secret "image-registry-tls" not found Jun 11 19:50:51.525156 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:50:51.524840 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/783f40b5-7d52-4433-9c0d-3bd61ebe9100-metrics-tls podName:783f40b5-7d52-4433-9c0d-3bd61ebe9100 nodeName:}" failed. No retries permitted until 2026-06-11 19:51:07.524821929 +0000 UTC m=+67.802582683 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/783f40b5-7d52-4433-9c0d-3bd61ebe9100-metrics-tls") pod "dns-default-nqlv6" (UID: "783f40b5-7d52-4433-9c0d-3bd61ebe9100") : secret "dns-default-metrics-tls" not found Jun 11 19:51:00.358405 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:00.358377 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hrb9t" Jun 11 19:51:06.020217 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:06.020183 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99-metrics-certs\") pod \"network-metrics-daemon-lrgwp\" (UID: \"ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99\") " pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:51:06.020217 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:06.020218 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6a5da50-2b05-42de-8aa9-a23e838da830-original-pull-secret\") pod \"global-pull-secret-syncer-jddtw\" (UID: \"f6a5da50-2b05-42de-8aa9-a23e838da830\") " pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:51:06.025592 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:06.025574 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 19:51:06.025658 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:06.025579 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 19:51:06.030420 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:51:06.030402 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 19:51:06.030481 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:51:06.030469 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99-metrics-certs podName:ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99 nodeName:}" failed. No retries permitted until 2026-06-11 19:52:10.030448788 +0000 UTC m=+130.308209542 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99-metrics-certs") pod "network-metrics-daemon-lrgwp" (UID: "ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99") : secret "metrics-daemon-secret" not found Jun 11 19:51:06.033915 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:06.033896 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6a5da50-2b05-42de-8aa9-a23e838da830-original-pull-secret\") pod \"global-pull-secret-syncer-jddtw\" (UID: \"f6a5da50-2b05-42de-8aa9-a23e838da830\") " pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:51:06.121550 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:06.121144 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxtl8\" (UniqueName: \"kubernetes.io/projected/d798bbe1-8647-4ec6-88da-24514bca83d1-kube-api-access-fxtl8\") pod \"network-check-target-2rn74\" (UID: \"d798bbe1-8647-4ec6-88da-24514bca83d1\") " pod="openshift-network-diagnostics/network-check-target-2rn74" Jun 11 19:51:06.125042 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:06.125012 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 19:51:06.135117 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:06.135100 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 19:51:06.144723 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:06.144697 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxtl8\" (UniqueName: \"kubernetes.io/projected/d798bbe1-8647-4ec6-88da-24514bca83d1-kube-api-access-fxtl8\") pod \"network-check-target-2rn74\" (UID: \"d798bbe1-8647-4ec6-88da-24514bca83d1\") " pod="openshift-network-diagnostics/network-check-target-2rn74" Jun 11 19:51:06.303240 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:06.303136 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jddtw" Jun 11 19:51:06.316471 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:06.316448 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6rmmv\"" Jun 11 19:51:06.323384 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:06.323364 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2rn74" Jun 11 19:51:06.470379 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:06.470350 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jddtw"] Jun 11 19:51:06.473476 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:51:06.473453 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6a5da50_2b05_42de_8aa9_a23e838da830.slice/crio-b766b15786f5595bc0b4054ee2081956748d8481ebabd145ef0db7b30aae1f0e WatchSource:0}: Error finding container b766b15786f5595bc0b4054ee2081956748d8481ebabd145ef0db7b30aae1f0e: Status 404 returned error can't find the container with id b766b15786f5595bc0b4054ee2081956748d8481ebabd145ef0db7b30aae1f0e Jun 11 19:51:06.490158 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:06.490117 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2rn74"] Jun 11 19:51:06.493615 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:51:06.493584 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd798bbe1_8647_4ec6_88da_24514bca83d1.slice/crio-541ba210bf489c2c71e00173ee50ef20bfcfea9544b855ba6cf3fb0dde23fcb1 WatchSource:0}: Error finding container 541ba210bf489c2c71e00173ee50ef20bfcfea9544b855ba6cf3fb0dde23fcb1: Status 404 returned error can't find the container with id 541ba210bf489c2c71e00173ee50ef20bfcfea9544b855ba6cf3fb0dde23fcb1 Jun 11 19:51:07.449438 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:07.449397 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2rn74" event={"ID":"d798bbe1-8647-4ec6-88da-24514bca83d1","Type":"ContainerStarted","Data":"541ba210bf489c2c71e00173ee50ef20bfcfea9544b855ba6cf3fb0dde23fcb1"} Jun 11 19:51:07.450745 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:07.450709 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jddtw" event={"ID":"f6a5da50-2b05-42de-8aa9-a23e838da830","Type":"ContainerStarted","Data":"b766b15786f5595bc0b4054ee2081956748d8481ebabd145ef0db7b30aae1f0e"} Jun 11 19:51:07.533728 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:07.533695 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/783f40b5-7d52-4433-9c0d-3bd61ebe9100-metrics-tls\") pod \"dns-default-nqlv6\" (UID: \"783f40b5-7d52-4433-9c0d-3bd61ebe9100\") " pod="openshift-dns/dns-default-nqlv6" Jun 11 19:51:07.533917 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:07.533754 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-tls\") pod \"image-registry-84f479d4df-xxq5c\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:51:07.533917 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:51:07.533862 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 19:51:07.533917 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:51:07.533865 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:51:07.534067 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:51:07.533944 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/783f40b5-7d52-4433-9c0d-3bd61ebe9100-metrics-tls podName:783f40b5-7d52-4433-9c0d-3bd61ebe9100 nodeName:}" failed. No retries permitted until 2026-06-11 19:51:39.533925427 +0000 UTC m=+99.811686163 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/783f40b5-7d52-4433-9c0d-3bd61ebe9100-metrics-tls") pod "dns-default-nqlv6" (UID: "783f40b5-7d52-4433-9c0d-3bd61ebe9100") : secret "dns-default-metrics-tls" not found Jun 11 19:51:07.534067 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:51:07.533877 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84f479d4df-xxq5c: secret "image-registry-tls" not found Jun 11 19:51:07.534067 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:51:07.534024 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-tls podName:d7079aa1-df0b-45cc-9c97-c2ae18aa1520 nodeName:}" failed. No retries permitted until 2026-06-11 19:51:39.534007813 +0000 UTC m=+99.811768563 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-tls") pod "image-registry-84f479d4df-xxq5c" (UID: "d7079aa1-df0b-45cc-9c97-c2ae18aa1520") : secret "image-registry-tls" not found Jun 11 19:51:12.465304 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:12.465264 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2rn74" event={"ID":"d798bbe1-8647-4ec6-88da-24514bca83d1","Type":"ContainerStarted","Data":"c146033073a2d4473422c8958d55f7a15ec81d3f6e2af21a5709d0a10c90e812"} Jun 11 19:51:12.465699 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:12.465383 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2rn74" Jun 11 19:51:12.466708 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:12.466691 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jddtw" event={"ID":"f6a5da50-2b05-42de-8aa9-a23e838da830","Type":"ContainerStarted","Data":"b5095c9aa584ce544ffdd5dbf7287d6e8ac4beff21a30c0de11e2c27f7bc319c"} Jun 11 19:51:12.481675 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:12.481530 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2rn74" podStartSLOduration=67.152021853 podStartE2EDuration="1m12.481519259s" totalImagesPullingTime="5.329497406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:51:12.48082975 +0000 UTC m=+72.758590507" watchObservedRunningTime="2026-06-11 19:51:12.481519259 +0000 UTC m=+72.759279994" Jun 11 19:51:12.496509 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:12.496453 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jddtw" podStartSLOduration=67.139513781 podStartE2EDuration="1m12.496436156s" totalImagesPullingTime="5.356922375s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:51:12.496054954 +0000 UTC m=+72.773815703" watchObservedRunningTime="2026-06-11 19:51:12.496436156 +0000 UTC m=+72.774196915" Jun 11 19:51:32.245631 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:32.245595 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f64f58d6c-55df8"] Jun 11 19:51:32.249849 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:32.249833 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f64f58d6c-55df8" Jun 11 19:51:32.253485 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:32.253464 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 11 19:51:32.253684 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:32.253667 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 19:51:32.254716 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:32.254695 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 19:51:32.254831 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:32.254755 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 19:51:32.268739 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:32.268714 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f64f58d6c-55df8"] Jun 11 19:51:32.301555 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:32.301533 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7555597f-55e4-49eb-b2b6-f4335df9d30d-tmp\") pod \"klusterlet-addon-workmgr-f64f58d6c-55df8\" (UID: \"7555597f-55e4-49eb-b2b6-f4335df9d30d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f64f58d6c-55df8" Jun 11 19:51:32.301663 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:32.301587 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4jt5\" (UniqueName: \"kubernetes.io/projected/7555597f-55e4-49eb-b2b6-f4335df9d30d-kube-api-access-k4jt5\") pod \"klusterlet-addon-workmgr-f64f58d6c-55df8\" (UID: \"7555597f-55e4-49eb-b2b6-f4335df9d30d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f64f58d6c-55df8" Jun 11 19:51:32.301663 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:32.301609 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7555597f-55e4-49eb-b2b6-f4335df9d30d-klusterlet-config\") pod \"klusterlet-addon-workmgr-f64f58d6c-55df8\" (UID: \"7555597f-55e4-49eb-b2b6-f4335df9d30d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f64f58d6c-55df8" Jun 11 19:51:32.402087 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:32.402057 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4jt5\" (UniqueName: \"kubernetes.io/projected/7555597f-55e4-49eb-b2b6-f4335df9d30d-kube-api-access-k4jt5\") pod \"klusterlet-addon-workmgr-f64f58d6c-55df8\" (UID: \"7555597f-55e4-49eb-b2b6-f4335df9d30d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f64f58d6c-55df8" Jun 11 19:51:32.402231 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:32.402096 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7555597f-55e4-49eb-b2b6-f4335df9d30d-klusterlet-config\") pod \"klusterlet-addon-workmgr-f64f58d6c-55df8\" (UID: \"7555597f-55e4-49eb-b2b6-f4335df9d30d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f64f58d6c-55df8" Jun 11 19:51:32.402231 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:32.402186 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7555597f-55e4-49eb-b2b6-f4335df9d30d-tmp\") pod \"klusterlet-addon-workmgr-f64f58d6c-55df8\" (UID: \"7555597f-55e4-49eb-b2b6-f4335df9d30d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f64f58d6c-55df8" Jun 11 19:51:32.402568 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:32.402547 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7555597f-55e4-49eb-b2b6-f4335df9d30d-tmp\") pod \"klusterlet-addon-workmgr-f64f58d6c-55df8\" (UID: \"7555597f-55e4-49eb-b2b6-f4335df9d30d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f64f58d6c-55df8" Jun 11 19:51:32.404467 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:32.404437 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7555597f-55e4-49eb-b2b6-f4335df9d30d-klusterlet-config\") pod \"klusterlet-addon-workmgr-f64f58d6c-55df8\" (UID: \"7555597f-55e4-49eb-b2b6-f4335df9d30d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f64f58d6c-55df8" Jun 11 19:51:32.414725 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:32.414701 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4jt5\" (UniqueName: \"kubernetes.io/projected/7555597f-55e4-49eb-b2b6-f4335df9d30d-kube-api-access-k4jt5\") pod \"klusterlet-addon-workmgr-f64f58d6c-55df8\" (UID: \"7555597f-55e4-49eb-b2b6-f4335df9d30d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f64f58d6c-55df8" Jun 11 19:51:32.558314 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:32.558237 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f64f58d6c-55df8" Jun 11 19:51:32.691212 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:32.691186 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f64f58d6c-55df8"] Jun 11 19:51:32.693038 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:51:32.692995 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7555597f_55e4_49eb_b2b6_f4335df9d30d.slice/crio-5d4cfa91857172c85472dbee3feb47a9d7d8afd952fe10b6084b48c22f943881 WatchSource:0}: Error finding container 5d4cfa91857172c85472dbee3feb47a9d7d8afd952fe10b6084b48c22f943881: Status 404 returned error can't find the container with id 5d4cfa91857172c85472dbee3feb47a9d7d8afd952fe10b6084b48c22f943881 Jun 11 19:51:33.518555 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:33.518507 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f64f58d6c-55df8" event={"ID":"7555597f-55e4-49eb-b2b6-f4335df9d30d","Type":"ContainerStarted","Data":"5d4cfa91857172c85472dbee3feb47a9d7d8afd952fe10b6084b48c22f943881"} Jun 11 19:51:36.526939 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:36.526851 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f64f58d6c-55df8" event={"ID":"7555597f-55e4-49eb-b2b6-f4335df9d30d","Type":"ContainerStarted","Data":"270d664ef53b077bd919cc76684336c8353ad08f9d6772519ed4968ad9f7968c"} Jun 11 19:51:36.527318 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:36.527049 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f64f58d6c-55df8" Jun 11 19:51:36.528609 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:36.528581 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f64f58d6c-55df8" Jun 11 19:51:36.543417 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:36.543361 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f64f58d6c-55df8" podStartSLOduration=0.987159129 podStartE2EDuration="4.543345493s" totalImagesPullingTime="3.556186364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:51:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:51:36.542614207 +0000 UTC m=+96.820374964" watchObservedRunningTime="2026-06-11 19:51:36.543345493 +0000 UTC m=+96.821106252" Jun 11 19:51:39.554822 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:39.554792 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-tls\") pod \"image-registry-84f479d4df-xxq5c\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:51:39.555283 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:39.554851 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/783f40b5-7d52-4433-9c0d-3bd61ebe9100-metrics-tls\") pod \"dns-default-nqlv6\" (UID: \"783f40b5-7d52-4433-9c0d-3bd61ebe9100\") " pod="openshift-dns/dns-default-nqlv6" Jun 11 19:51:39.555283 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:51:39.554941 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:51:39.555283 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:51:39.554956 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 19:51:39.555283 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:51:39.554977 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84f479d4df-xxq5c: secret "image-registry-tls" not found Jun 11 19:51:39.555283 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:51:39.555000 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/783f40b5-7d52-4433-9c0d-3bd61ebe9100-metrics-tls podName:783f40b5-7d52-4433-9c0d-3bd61ebe9100 nodeName:}" failed. No retries permitted until 2026-06-11 19:52:43.554988066 +0000 UTC m=+163.832748803 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/783f40b5-7d52-4433-9c0d-3bd61ebe9100-metrics-tls") pod "dns-default-nqlv6" (UID: "783f40b5-7d52-4433-9c0d-3bd61ebe9100") : secret "dns-default-metrics-tls" not found Jun 11 19:51:39.555283 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:51:39.555044 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-tls podName:d7079aa1-df0b-45cc-9c97-c2ae18aa1520 nodeName:}" failed. No retries permitted until 2026-06-11 19:52:43.555028156 +0000 UTC m=+163.832788912 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-tls") pod "image-registry-84f479d4df-xxq5c" (UID: "d7079aa1-df0b-45cc-9c97-c2ae18aa1520") : secret "image-registry-tls" not found Jun 11 19:51:43.472655 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:51:43.472622 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2rn74" Jun 11 19:52:10.056274 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:52:10.056242 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99-metrics-certs\") pod \"network-metrics-daemon-lrgwp\" (UID: \"ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99\") " pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:52:10.056717 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:52:10.056357 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 19:52:10.056717 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:52:10.056418 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99-metrics-certs podName:ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99 nodeName:}" failed. No retries permitted until 2026-06-11 19:54:12.056405061 +0000 UTC m=+252.334165796 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99-metrics-certs") pod "network-metrics-daemon-lrgwp" (UID: "ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99") : secret "metrics-daemon-secret" not found Jun 11 19:52:38.668987 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:52:38.668884 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" podUID="d7079aa1-df0b-45cc-9c97-c2ae18aa1520" Jun 11 19:52:38.673683 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:52:38.673658 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:52:38.678114 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:52:38.678093 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nqlv6" podUID="783f40b5-7d52-4433-9c0d-3bd61ebe9100" Jun 11 19:52:39.676452 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:52:39.676424 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nqlv6" Jun 11 19:52:40.208862 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:52:40.208823 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-lrgwp" podUID="ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99" Jun 11 19:52:43.587859 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:52:43.587796 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/783f40b5-7d52-4433-9c0d-3bd61ebe9100-metrics-tls\") pod \"dns-default-nqlv6\" (UID: \"783f40b5-7d52-4433-9c0d-3bd61ebe9100\") " pod="openshift-dns/dns-default-nqlv6" Jun 11 19:52:43.588298 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:52:43.587867 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-tls\") pod \"image-registry-84f479d4df-xxq5c\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:52:43.588298 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:52:43.587963 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 19:52:43.588298 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:52:43.587963 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:52:43.588298 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:52:43.588040 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/783f40b5-7d52-4433-9c0d-3bd61ebe9100-metrics-tls podName:783f40b5-7d52-4433-9c0d-3bd61ebe9100 nodeName:}" failed. No retries permitted until 2026-06-11 19:54:45.588024576 +0000 UTC m=+285.865785313 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/783f40b5-7d52-4433-9c0d-3bd61ebe9100-metrics-tls") pod "dns-default-nqlv6" (UID: "783f40b5-7d52-4433-9c0d-3bd61ebe9100") : secret "dns-default-metrics-tls" not found Jun 11 19:52:43.588298 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:52:43.587973 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84f479d4df-xxq5c: secret "image-registry-tls" not found Jun 11 19:52:43.588298 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:52:43.588097 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-tls podName:d7079aa1-df0b-45cc-9c97-c2ae18aa1520 nodeName:}" failed. No retries permitted until 2026-06-11 19:54:45.58808655 +0000 UTC m=+285.865847286 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-tls") pod "image-registry-84f479d4df-xxq5c" (UID: "d7079aa1-df0b-45cc-9c97-c2ae18aa1520") : secret "image-registry-tls" not found Jun 11 19:52:51.191589 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:52:51.191543 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:53:36.528196 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:36.528146 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f64f58d6c-55df8" podUID="7555597f-55e4-49eb-b2b6-f4335df9d30d" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/readyz\": dial tcp 10.132.0.9:8000: connect: connection refused" Jun 11 19:53:36.813196 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:36.813163 2576 generic.go:356] "Generic (PLEG): container finished" podID="7555597f-55e4-49eb-b2b6-f4335df9d30d" containerID="270d664ef53b077bd919cc76684336c8353ad08f9d6772519ed4968ad9f7968c" exitCode=1 Jun 11 19:53:36.813358 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:36.813209 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f64f58d6c-55df8" event={"ID":"7555597f-55e4-49eb-b2b6-f4335df9d30d","Type":"ContainerDied","Data":"270d664ef53b077bd919cc76684336c8353ad08f9d6772519ed4968ad9f7968c"} Jun 11 19:53:36.813528 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:36.813514 2576 scope.go:117] "RemoveContainer" containerID="270d664ef53b077bd919cc76684336c8353ad08f9d6772519ed4968ad9f7968c" Jun 11 19:53:37.818288 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:37.818249 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f64f58d6c-55df8" event={"ID":"7555597f-55e4-49eb-b2b6-f4335df9d30d","Type":"ContainerStarted","Data":"c29808766afe41001da1403ade7a35c80db9b5336ab802b6ef2805b317eb186e"} Jun 11 19:53:37.818761 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:37.818518 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f64f58d6c-55df8" Jun 11 19:53:37.819103 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:37.819082 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f64f58d6c-55df8" Jun 11 19:53:46.701994 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:46.701959 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pqkz8"] Jun 11 19:53:46.704864 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:46.704849 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pqkz8" Jun 11 19:53:46.707501 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:46.707479 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 11 19:53:46.707626 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:46.707478 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-29rd7\"" Jun 11 19:53:46.708452 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:46.708437 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 11 19:53:46.708512 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:46.708489 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 11 19:53:46.714186 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:46.714167 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pqkz8"] Jun 11 19:53:46.824956 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:46.824923 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dqbg\" (UniqueName: \"kubernetes.io/projected/1475401e-d13d-43f0-b786-efbd977c3bca-kube-api-access-9dqbg\") pod \"cluster-samples-operator-9547488fd-pqkz8\" (UID: \"1475401e-d13d-43f0-b786-efbd977c3bca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pqkz8" Jun 11 19:53:46.825113 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:46.825041 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1475401e-d13d-43f0-b786-efbd977c3bca-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-pqkz8\" (UID: \"1475401e-d13d-43f0-b786-efbd977c3bca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pqkz8" Jun 11 19:53:46.899359 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:46.899329 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-9pxm2"] Jun 11 19:53:46.902374 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:46.902355 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-9pxm2" Jun 11 19:53:46.904488 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:46.904467 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 11 19:53:46.904616 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:46.904597 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 11 19:53:46.904716 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:46.904696 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 11 19:53:46.905067 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:46.905047 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 11 19:53:46.905188 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:46.905160 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-jl4rz\"" Jun 11 19:53:46.909560 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:46.909541 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 11 19:53:46.912610 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:46.912584 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-9pxm2"] Jun 11 19:53:46.925512 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:46.925473 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1475401e-d13d-43f0-b786-efbd977c3bca-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-pqkz8\" (UID: \"1475401e-d13d-43f0-b786-efbd977c3bca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pqkz8" Jun 11 19:53:46.925601 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:46.925548 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dqbg\" (UniqueName: \"kubernetes.io/projected/1475401e-d13d-43f0-b786-efbd977c3bca-kube-api-access-9dqbg\") pod \"cluster-samples-operator-9547488fd-pqkz8\" (UID: \"1475401e-d13d-43f0-b786-efbd977c3bca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pqkz8" Jun 11 19:53:46.925695 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:53:46.925598 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 19:53:46.925695 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:53:46.925667 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1475401e-d13d-43f0-b786-efbd977c3bca-samples-operator-tls podName:1475401e-d13d-43f0-b786-efbd977c3bca nodeName:}" failed. No retries permitted until 2026-06-11 19:53:47.425649194 +0000 UTC m=+227.703409929 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1475401e-d13d-43f0-b786-efbd977c3bca-samples-operator-tls") pod "cluster-samples-operator-9547488fd-pqkz8" (UID: "1475401e-d13d-43f0-b786-efbd977c3bca") : secret "samples-operator-tls" not found Jun 11 19:53:46.934267 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:46.934248 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dqbg\" (UniqueName: \"kubernetes.io/projected/1475401e-d13d-43f0-b786-efbd977c3bca-kube-api-access-9dqbg\") pod \"cluster-samples-operator-9547488fd-pqkz8\" (UID: \"1475401e-d13d-43f0-b786-efbd977c3bca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pqkz8" Jun 11 19:53:47.026071 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:47.026002 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23de3c36-7fd1-4a71-9bff-dd7782544ca4-trusted-ca\") pod \"console-operator-5dbbb5d744-9pxm2\" (UID: \"23de3c36-7fd1-4a71-9bff-dd7782544ca4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-9pxm2" Jun 11 19:53:47.026071 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:47.026061 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/23de3c36-7fd1-4a71-9bff-dd7782544ca4-config\") pod \"console-operator-5dbbb5d744-9pxm2\" (UID: \"23de3c36-7fd1-4a71-9bff-dd7782544ca4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-9pxm2" Jun 11 19:53:47.026243 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:47.026152 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/23de3c36-7fd1-4a71-9bff-dd7782544ca4-serving-cert\") pod \"console-operator-5dbbb5d744-9pxm2\" (UID: \"23de3c36-7fd1-4a71-9bff-dd7782544ca4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-9pxm2" Jun 11 19:53:47.026243 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:47.026172 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7m8p\" (UniqueName: \"kubernetes.io/projected/23de3c36-7fd1-4a71-9bff-dd7782544ca4-kube-api-access-r7m8p\") pod \"console-operator-5dbbb5d744-9pxm2\" (UID: \"23de3c36-7fd1-4a71-9bff-dd7782544ca4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-9pxm2" Jun 11 19:53:47.126586 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:47.126561 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/23de3c36-7fd1-4a71-9bff-dd7782544ca4-config\") pod \"console-operator-5dbbb5d744-9pxm2\" (UID: \"23de3c36-7fd1-4a71-9bff-dd7782544ca4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-9pxm2" Jun 11 19:53:47.126748 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:47.126630 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/23de3c36-7fd1-4a71-9bff-dd7782544ca4-serving-cert\") pod \"console-operator-5dbbb5d744-9pxm2\" (UID: \"23de3c36-7fd1-4a71-9bff-dd7782544ca4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-9pxm2" Jun 11 19:53:47.126748 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:47.126659 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7m8p\" (UniqueName: \"kubernetes.io/projected/23de3c36-7fd1-4a71-9bff-dd7782544ca4-kube-api-access-r7m8p\") pod \"console-operator-5dbbb5d744-9pxm2\" (UID: \"23de3c36-7fd1-4a71-9bff-dd7782544ca4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-9pxm2" Jun 11 19:53:47.126748 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:47.126686 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23de3c36-7fd1-4a71-9bff-dd7782544ca4-trusted-ca\") pod \"console-operator-5dbbb5d744-9pxm2\" (UID: \"23de3c36-7fd1-4a71-9bff-dd7782544ca4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-9pxm2" Jun 11 19:53:47.127225 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:47.127204 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/23de3c36-7fd1-4a71-9bff-dd7782544ca4-config\") pod \"console-operator-5dbbb5d744-9pxm2\" (UID: \"23de3c36-7fd1-4a71-9bff-dd7782544ca4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-9pxm2" Jun 11 19:53:47.127441 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:47.127421 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23de3c36-7fd1-4a71-9bff-dd7782544ca4-trusted-ca\") pod \"console-operator-5dbbb5d744-9pxm2\" (UID: \"23de3c36-7fd1-4a71-9bff-dd7782544ca4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-9pxm2" Jun 11 19:53:47.128844 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:47.128828 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/23de3c36-7fd1-4a71-9bff-dd7782544ca4-serving-cert\") pod \"console-operator-5dbbb5d744-9pxm2\" (UID: \"23de3c36-7fd1-4a71-9bff-dd7782544ca4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-9pxm2" Jun 11 19:53:47.135701 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:47.135680 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7m8p\" (UniqueName: \"kubernetes.io/projected/23de3c36-7fd1-4a71-9bff-dd7782544ca4-kube-api-access-r7m8p\") pod \"console-operator-5dbbb5d744-9pxm2\" (UID: \"23de3c36-7fd1-4a71-9bff-dd7782544ca4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-9pxm2" Jun 11 19:53:47.211890 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:47.211849 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-9pxm2" Jun 11 19:53:47.331815 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:47.331787 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-9pxm2"] Jun 11 19:53:47.334910 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:53:47.334880 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23de3c36_7fd1_4a71_9bff_dd7782544ca4.slice/crio-6c1491ff8ae81be4dbcde4876139ca23493164bc3bd4ec122289b150ba1ec9aa WatchSource:0}: Error finding container 6c1491ff8ae81be4dbcde4876139ca23493164bc3bd4ec122289b150ba1ec9aa: Status 404 returned error can't find the container with id 6c1491ff8ae81be4dbcde4876139ca23493164bc3bd4ec122289b150ba1ec9aa Jun 11 19:53:47.428379 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:47.428345 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1475401e-d13d-43f0-b786-efbd977c3bca-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-pqkz8\" (UID: \"1475401e-d13d-43f0-b786-efbd977c3bca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pqkz8" Jun 11 19:53:47.428528 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:53:47.428487 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 19:53:47.428576 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:53:47.428546 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1475401e-d13d-43f0-b786-efbd977c3bca-samples-operator-tls podName:1475401e-d13d-43f0-b786-efbd977c3bca nodeName:}" failed. No retries permitted until 2026-06-11 19:53:48.4285317 +0000 UTC m=+228.706292436 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1475401e-d13d-43f0-b786-efbd977c3bca-samples-operator-tls") pod "cluster-samples-operator-9547488fd-pqkz8" (UID: "1475401e-d13d-43f0-b786-efbd977c3bca") : secret "samples-operator-tls" not found Jun 11 19:53:47.848539 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:47.848501 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-9pxm2" event={"ID":"23de3c36-7fd1-4a71-9bff-dd7782544ca4","Type":"ContainerStarted","Data":"6c1491ff8ae81be4dbcde4876139ca23493164bc3bd4ec122289b150ba1ec9aa"} Jun 11 19:53:48.436800 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:48.436766 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1475401e-d13d-43f0-b786-efbd977c3bca-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-pqkz8\" (UID: \"1475401e-d13d-43f0-b786-efbd977c3bca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pqkz8" Jun 11 19:53:48.436941 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:53:48.436915 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 19:53:48.437001 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:53:48.436990 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1475401e-d13d-43f0-b786-efbd977c3bca-samples-operator-tls podName:1475401e-d13d-43f0-b786-efbd977c3bca nodeName:}" failed. No retries permitted until 2026-06-11 19:53:50.436975108 +0000 UTC m=+230.714735853 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1475401e-d13d-43f0-b786-efbd977c3bca-samples-operator-tls") pod "cluster-samples-operator-9547488fd-pqkz8" (UID: "1475401e-d13d-43f0-b786-efbd977c3bca") : secret "samples-operator-tls" not found Jun 11 19:53:49.855562 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:49.855533 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9pxm2_23de3c36-7fd1-4a71-9bff-dd7782544ca4/console-operator/0.log" Jun 11 19:53:49.855931 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:49.855572 2576 generic.go:356] "Generic (PLEG): container finished" podID="23de3c36-7fd1-4a71-9bff-dd7782544ca4" containerID="fd0bcfd21df2f40b1f98ba7dca5020aeeeb7b852b99a8ad8812cf8bd1e739316" exitCode=255 Jun 11 19:53:49.855931 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:49.855618 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-9pxm2" event={"ID":"23de3c36-7fd1-4a71-9bff-dd7782544ca4","Type":"ContainerDied","Data":"fd0bcfd21df2f40b1f98ba7dca5020aeeeb7b852b99a8ad8812cf8bd1e739316"} Jun 11 19:53:49.855931 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:49.855842 2576 scope.go:117] "RemoveContainer" containerID="fd0bcfd21df2f40b1f98ba7dca5020aeeeb7b852b99a8ad8812cf8bd1e739316" Jun 11 19:53:50.456574 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:50.456520 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1475401e-d13d-43f0-b786-efbd977c3bca-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-pqkz8\" (UID: \"1475401e-d13d-43f0-b786-efbd977c3bca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pqkz8" Jun 11 19:53:50.456757 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:53:50.456686 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 19:53:50.456757 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:53:50.456755 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1475401e-d13d-43f0-b786-efbd977c3bca-samples-operator-tls podName:1475401e-d13d-43f0-b786-efbd977c3bca nodeName:}" failed. No retries permitted until 2026-06-11 19:53:54.456739477 +0000 UTC m=+234.734500224 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1475401e-d13d-43f0-b786-efbd977c3bca-samples-operator-tls") pod "cluster-samples-operator-9547488fd-pqkz8" (UID: "1475401e-d13d-43f0-b786-efbd977c3bca") : secret "samples-operator-tls" not found Jun 11 19:53:50.859973 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:50.859943 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9pxm2_23de3c36-7fd1-4a71-9bff-dd7782544ca4/console-operator/1.log" Jun 11 19:53:50.860384 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:50.860340 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9pxm2_23de3c36-7fd1-4a71-9bff-dd7782544ca4/console-operator/0.log" Jun 11 19:53:50.860384 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:50.860372 2576 generic.go:356] "Generic (PLEG): container finished" podID="23de3c36-7fd1-4a71-9bff-dd7782544ca4" containerID="01ad66ff189b94f94bd86dfd84352cd4090cb3b165d19a94a99f07df018005f8" exitCode=255 Jun 11 19:53:50.860508 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:50.860399 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-9pxm2" event={"ID":"23de3c36-7fd1-4a71-9bff-dd7782544ca4","Type":"ContainerDied","Data":"01ad66ff189b94f94bd86dfd84352cd4090cb3b165d19a94a99f07df018005f8"} Jun 11 19:53:50.860508 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:50.860453 2576 scope.go:117] "RemoveContainer" containerID="fd0bcfd21df2f40b1f98ba7dca5020aeeeb7b852b99a8ad8812cf8bd1e739316" Jun 11 19:53:50.860687 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:50.860668 2576 scope.go:117] "RemoveContainer" containerID="01ad66ff189b94f94bd86dfd84352cd4090cb3b165d19a94a99f07df018005f8" Jun 11 19:53:50.860871 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:53:50.860850 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-9pxm2_openshift-console-operator(23de3c36-7fd1-4a71-9bff-dd7782544ca4)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-9pxm2" podUID="23de3c36-7fd1-4a71-9bff-dd7782544ca4" Jun 11 19:53:51.718920 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:51.718891 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-t2ks4"] Jun 11 19:53:51.723003 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:51.722988 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t2ks4" Jun 11 19:53:51.725477 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:51.725455 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kckmb\"" Jun 11 19:53:51.725580 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:51.725537 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 19:53:51.726661 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:51.726640 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 19:53:51.726727 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:51.726644 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 19:53:51.726727 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:51.726694 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 19:53:51.736748 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:51.736727 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t2ks4"] Jun 11 19:53:51.865106 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:51.865085 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9pxm2_23de3c36-7fd1-4a71-9bff-dd7782544ca4/console-operator/1.log" Jun 11 19:53:51.865573 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:51.865480 2576 scope.go:117] "RemoveContainer" containerID="01ad66ff189b94f94bd86dfd84352cd4090cb3b165d19a94a99f07df018005f8" Jun 11 19:53:51.865676 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:53:51.865654 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-9pxm2_openshift-console-operator(23de3c36-7fd1-4a71-9bff-dd7782544ca4)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-9pxm2" podUID="23de3c36-7fd1-4a71-9bff-dd7782544ca4" Jun 11 19:53:51.866035 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:51.866016 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frm2d\" (UniqueName: \"kubernetes.io/projected/006884e0-f73c-4791-8439-a25fcaa21ddd-kube-api-access-frm2d\") pod \"insights-runtime-extractor-t2ks4\" (UID: \"006884e0-f73c-4791-8439-a25fcaa21ddd\") " pod="openshift-insights/insights-runtime-extractor-t2ks4" Jun 11 19:53:51.866145 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:51.866047 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/006884e0-f73c-4791-8439-a25fcaa21ddd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t2ks4\" (UID: \"006884e0-f73c-4791-8439-a25fcaa21ddd\") " pod="openshift-insights/insights-runtime-extractor-t2ks4" Jun 11 19:53:51.866213 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:51.866141 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/006884e0-f73c-4791-8439-a25fcaa21ddd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t2ks4\" (UID: \"006884e0-f73c-4791-8439-a25fcaa21ddd\") " pod="openshift-insights/insights-runtime-extractor-t2ks4" Jun 11 19:53:51.866213 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:51.866182 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/006884e0-f73c-4791-8439-a25fcaa21ddd-data-volume\") pod \"insights-runtime-extractor-t2ks4\" (UID: \"006884e0-f73c-4791-8439-a25fcaa21ddd\") " pod="openshift-insights/insights-runtime-extractor-t2ks4" Jun 11 19:53:51.866297 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:51.866233 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/006884e0-f73c-4791-8439-a25fcaa21ddd-crio-socket\") pod \"insights-runtime-extractor-t2ks4\" (UID: \"006884e0-f73c-4791-8439-a25fcaa21ddd\") " pod="openshift-insights/insights-runtime-extractor-t2ks4" Jun 11 19:53:51.966877 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:51.966840 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/006884e0-f73c-4791-8439-a25fcaa21ddd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t2ks4\" (UID: \"006884e0-f73c-4791-8439-a25fcaa21ddd\") " pod="openshift-insights/insights-runtime-extractor-t2ks4" Jun 11 19:53:51.967060 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:51.966892 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/006884e0-f73c-4791-8439-a25fcaa21ddd-data-volume\") pod \"insights-runtime-extractor-t2ks4\" (UID: \"006884e0-f73c-4791-8439-a25fcaa21ddd\") " pod="openshift-insights/insights-runtime-extractor-t2ks4" Jun 11 19:53:51.967060 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:51.966927 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/006884e0-f73c-4791-8439-a25fcaa21ddd-crio-socket\") pod \"insights-runtime-extractor-t2ks4\" (UID: \"006884e0-f73c-4791-8439-a25fcaa21ddd\") " pod="openshift-insights/insights-runtime-extractor-t2ks4" Jun 11 19:53:51.967060 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:53:51.966971 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 19:53:51.967060 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:51.966981 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frm2d\" (UniqueName: \"kubernetes.io/projected/006884e0-f73c-4791-8439-a25fcaa21ddd-kube-api-access-frm2d\") pod \"insights-runtime-extractor-t2ks4\" (UID: \"006884e0-f73c-4791-8439-a25fcaa21ddd\") " pod="openshift-insights/insights-runtime-extractor-t2ks4" Jun 11 19:53:51.967060 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:53:51.967050 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/006884e0-f73c-4791-8439-a25fcaa21ddd-insights-runtime-extractor-tls podName:006884e0-f73c-4791-8439-a25fcaa21ddd nodeName:}" failed. No retries permitted until 2026-06-11 19:53:52.46702964 +0000 UTC m=+232.744790378 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/006884e0-f73c-4791-8439-a25fcaa21ddd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t2ks4" (UID: "006884e0-f73c-4791-8439-a25fcaa21ddd") : secret "insights-runtime-extractor-tls" not found Jun 11 19:53:51.967335 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:51.967074 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/006884e0-f73c-4791-8439-a25fcaa21ddd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t2ks4\" (UID: \"006884e0-f73c-4791-8439-a25fcaa21ddd\") " pod="openshift-insights/insights-runtime-extractor-t2ks4" Jun 11 19:53:51.967335 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:51.967051 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/006884e0-f73c-4791-8439-a25fcaa21ddd-crio-socket\") pod \"insights-runtime-extractor-t2ks4\" (UID: \"006884e0-f73c-4791-8439-a25fcaa21ddd\") " pod="openshift-insights/insights-runtime-extractor-t2ks4" Jun 11 19:53:51.967335 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:53:51.967159 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 19:53:51.967335 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:53:51.967205 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/006884e0-f73c-4791-8439-a25fcaa21ddd-kube-rbac-proxy-cm podName:006884e0-f73c-4791-8439-a25fcaa21ddd nodeName:}" failed. No retries permitted until 2026-06-11 19:53:52.467192493 +0000 UTC m=+232.744953232 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/006884e0-f73c-4791-8439-a25fcaa21ddd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t2ks4" (UID: "006884e0-f73c-4791-8439-a25fcaa21ddd") : configmap "kube-rbac-proxy" not found Jun 11 19:53:51.967470 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:51.967390 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/006884e0-f73c-4791-8439-a25fcaa21ddd-data-volume\") pod \"insights-runtime-extractor-t2ks4\" (UID: \"006884e0-f73c-4791-8439-a25fcaa21ddd\") " pod="openshift-insights/insights-runtime-extractor-t2ks4" Jun 11 19:53:51.976935 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:51.976887 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frm2d\" (UniqueName: \"kubernetes.io/projected/006884e0-f73c-4791-8439-a25fcaa21ddd-kube-api-access-frm2d\") pod \"insights-runtime-extractor-t2ks4\" (UID: \"006884e0-f73c-4791-8439-a25fcaa21ddd\") " pod="openshift-insights/insights-runtime-extractor-t2ks4" Jun 11 19:53:52.113446 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:52.113411 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-z9pkk"] Jun 11 19:53:52.116362 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:52.116346 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-z9pkk" Jun 11 19:53:52.119011 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:52.118990 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 11 19:53:52.119114 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:52.119033 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 11 19:53:52.119283 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:52.119270 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-cfqjw\"" Jun 11 19:53:52.124379 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:52.124349 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-z9pkk"] Jun 11 19:53:52.270018 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:52.269939 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqtd5\" (UniqueName: \"kubernetes.io/projected/cecb6c30-e660-4a9b-a275-412353c6a5b0-kube-api-access-wqtd5\") pod \"migrator-d4bcd4867-z9pkk\" (UID: \"cecb6c30-e660-4a9b-a275-412353c6a5b0\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-z9pkk" Jun 11 19:53:52.370576 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:52.370540 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqtd5\" (UniqueName: \"kubernetes.io/projected/cecb6c30-e660-4a9b-a275-412353c6a5b0-kube-api-access-wqtd5\") pod \"migrator-d4bcd4867-z9pkk\" (UID: \"cecb6c30-e660-4a9b-a275-412353c6a5b0\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-z9pkk" Jun 11 19:53:52.378996 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:52.378964 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqtd5\" (UniqueName: \"kubernetes.io/projected/cecb6c30-e660-4a9b-a275-412353c6a5b0-kube-api-access-wqtd5\") pod \"migrator-d4bcd4867-z9pkk\" (UID: \"cecb6c30-e660-4a9b-a275-412353c6a5b0\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-z9pkk" Jun 11 19:53:52.426193 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:52.426163 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-z9pkk" Jun 11 19:53:52.471411 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:52.471370 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/006884e0-f73c-4791-8439-a25fcaa21ddd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t2ks4\" (UID: \"006884e0-f73c-4791-8439-a25fcaa21ddd\") " pod="openshift-insights/insights-runtime-extractor-t2ks4" Jun 11 19:53:52.471528 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:52.471513 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/006884e0-f73c-4791-8439-a25fcaa21ddd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t2ks4\" (UID: \"006884e0-f73c-4791-8439-a25fcaa21ddd\") " pod="openshift-insights/insights-runtime-extractor-t2ks4" Jun 11 19:53:52.471588 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:53:52.471529 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 19:53:52.471637 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:53:52.471611 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/006884e0-f73c-4791-8439-a25fcaa21ddd-insights-runtime-extractor-tls podName:006884e0-f73c-4791-8439-a25fcaa21ddd nodeName:}" failed. No retries permitted until 2026-06-11 19:53:53.471588933 +0000 UTC m=+233.749349692 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/006884e0-f73c-4791-8439-a25fcaa21ddd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t2ks4" (UID: "006884e0-f73c-4791-8439-a25fcaa21ddd") : secret "insights-runtime-extractor-tls" not found Jun 11 19:53:52.471682 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:53:52.471645 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 19:53:52.471731 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:53:52.471719 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/006884e0-f73c-4791-8439-a25fcaa21ddd-kube-rbac-proxy-cm podName:006884e0-f73c-4791-8439-a25fcaa21ddd nodeName:}" failed. No retries permitted until 2026-06-11 19:53:53.471700651 +0000 UTC m=+233.749461388 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/006884e0-f73c-4791-8439-a25fcaa21ddd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t2ks4" (UID: "006884e0-f73c-4791-8439-a25fcaa21ddd") : configmap "kube-rbac-proxy" not found Jun 11 19:53:52.542293 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:52.542109 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-z9pkk"] Jun 11 19:53:52.546087 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:53:52.546059 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcecb6c30_e660_4a9b_a275_412353c6a5b0.slice/crio-1e9cb498a51ea5f3319dbdf27bf452e5739a0fb7417c6f619de712082cd34c51 WatchSource:0}: Error finding container 1e9cb498a51ea5f3319dbdf27bf452e5739a0fb7417c6f619de712082cd34c51: Status 404 returned error can't find the container with id 1e9cb498a51ea5f3319dbdf27bf452e5739a0fb7417c6f619de712082cd34c51 Jun 11 19:53:52.869246 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:52.869213 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-z9pkk" event={"ID":"cecb6c30-e660-4a9b-a275-412353c6a5b0","Type":"ContainerStarted","Data":"1e9cb498a51ea5f3319dbdf27bf452e5739a0fb7417c6f619de712082cd34c51"} Jun 11 19:53:53.479945 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:53.479910 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/006884e0-f73c-4791-8439-a25fcaa21ddd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t2ks4\" (UID: \"006884e0-f73c-4791-8439-a25fcaa21ddd\") " pod="openshift-insights/insights-runtime-extractor-t2ks4" Jun 11 19:53:53.480162 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:53.480009 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/006884e0-f73c-4791-8439-a25fcaa21ddd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t2ks4\" (UID: \"006884e0-f73c-4791-8439-a25fcaa21ddd\") " pod="openshift-insights/insights-runtime-extractor-t2ks4" Jun 11 19:53:53.480162 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:53:53.480037 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 19:53:53.480162 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:53:53.480097 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 19:53:53.480162 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:53:53.480108 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/006884e0-f73c-4791-8439-a25fcaa21ddd-insights-runtime-extractor-tls podName:006884e0-f73c-4791-8439-a25fcaa21ddd nodeName:}" failed. No retries permitted until 2026-06-11 19:53:55.480088775 +0000 UTC m=+235.757849530 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/006884e0-f73c-4791-8439-a25fcaa21ddd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t2ks4" (UID: "006884e0-f73c-4791-8439-a25fcaa21ddd") : secret "insights-runtime-extractor-tls" not found Jun 11 19:53:53.480162 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:53:53.480163 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/006884e0-f73c-4791-8439-a25fcaa21ddd-kube-rbac-proxy-cm podName:006884e0-f73c-4791-8439-a25fcaa21ddd nodeName:}" failed. No retries permitted until 2026-06-11 19:53:55.480148718 +0000 UTC m=+235.757909457 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/006884e0-f73c-4791-8439-a25fcaa21ddd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t2ks4" (UID: "006884e0-f73c-4791-8439-a25fcaa21ddd") : configmap "kube-rbac-proxy" not found Jun 11 19:53:53.873414 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:53.873385 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-z9pkk" event={"ID":"cecb6c30-e660-4a9b-a275-412353c6a5b0","Type":"ContainerStarted","Data":"305f178afbca3272e1b7c02814ca649f7ef86dfaf706083ab4681d19dfbcd212"} Jun 11 19:53:53.873735 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:53.873439 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-z9pkk" event={"ID":"cecb6c30-e660-4a9b-a275-412353c6a5b0","Type":"ContainerStarted","Data":"515ea8abfe1781dd659de6755ab90814831596f5a82d56eb3238e9524d50c528"} Jun 11 19:53:53.887855 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:53.887807 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-z9pkk" podStartSLOduration=0.749631532 podStartE2EDuration="1.887793554s" totalImagesPullingTime="1.138162022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:53:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:53:53.887463362 +0000 UTC m=+234.165224130" watchObservedRunningTime="2026-06-11 19:53:53.887793554 +0000 UTC m=+234.165554312" Jun 11 19:53:53.897070 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:53.897050 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rgjlh_226f79e5-5702-495b-8ffd-d60cd1e68f19/dns-node-resolver/0.log" Jun 11 19:53:54.212067 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:54.212038 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-2gbfs"] Jun 11 19:53:54.214993 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:54.214977 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-2gbfs" Jun 11 19:53:54.217557 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:54.217534 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 11 19:53:54.217784 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:54.217582 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 11 19:53:54.217784 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:54.217666 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 11 19:53:54.217784 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:54.217720 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-5h9vc\"" Jun 11 19:53:54.217784 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:54.217752 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 11 19:53:54.224914 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:54.224889 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-2gbfs"] Jun 11 19:53:54.387577 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:54.387542 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/88f7f161-8ca1-400e-a2dc-1a2dfa6876c1-signing-cabundle\") pod \"service-ca-7b994bc59-2gbfs\" (UID: \"88f7f161-8ca1-400e-a2dc-1a2dfa6876c1\") " pod="openshift-service-ca/service-ca-7b994bc59-2gbfs" Jun 11 19:53:54.387747 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:54.387609 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/88f7f161-8ca1-400e-a2dc-1a2dfa6876c1-signing-key\") pod \"service-ca-7b994bc59-2gbfs\" (UID: \"88f7f161-8ca1-400e-a2dc-1a2dfa6876c1\") " pod="openshift-service-ca/service-ca-7b994bc59-2gbfs" Jun 11 19:53:54.387747 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:54.387628 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9ddj\" (UniqueName: \"kubernetes.io/projected/88f7f161-8ca1-400e-a2dc-1a2dfa6876c1-kube-api-access-q9ddj\") pod \"service-ca-7b994bc59-2gbfs\" (UID: \"88f7f161-8ca1-400e-a2dc-1a2dfa6876c1\") " pod="openshift-service-ca/service-ca-7b994bc59-2gbfs" Jun 11 19:53:54.488690 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:54.488626 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/88f7f161-8ca1-400e-a2dc-1a2dfa6876c1-signing-key\") pod \"service-ca-7b994bc59-2gbfs\" (UID: \"88f7f161-8ca1-400e-a2dc-1a2dfa6876c1\") " pod="openshift-service-ca/service-ca-7b994bc59-2gbfs" Jun 11 19:53:54.488690 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:54.488658 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9ddj\" (UniqueName: \"kubernetes.io/projected/88f7f161-8ca1-400e-a2dc-1a2dfa6876c1-kube-api-access-q9ddj\") pod \"service-ca-7b994bc59-2gbfs\" (UID: \"88f7f161-8ca1-400e-a2dc-1a2dfa6876c1\") " pod="openshift-service-ca/service-ca-7b994bc59-2gbfs" Jun 11 19:53:54.488839 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:54.488704 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1475401e-d13d-43f0-b786-efbd977c3bca-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-pqkz8\" (UID: \"1475401e-d13d-43f0-b786-efbd977c3bca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pqkz8" Jun 11 19:53:54.488839 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:54.488741 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/88f7f161-8ca1-400e-a2dc-1a2dfa6876c1-signing-cabundle\") pod \"service-ca-7b994bc59-2gbfs\" (UID: \"88f7f161-8ca1-400e-a2dc-1a2dfa6876c1\") " pod="openshift-service-ca/service-ca-7b994bc59-2gbfs" Jun 11 19:53:54.488925 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:53:54.488877 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 19:53:54.488984 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:53:54.488956 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1475401e-d13d-43f0-b786-efbd977c3bca-samples-operator-tls podName:1475401e-d13d-43f0-b786-efbd977c3bca nodeName:}" failed. No retries permitted until 2026-06-11 19:54:02.488935086 +0000 UTC m=+242.766695842 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1475401e-d13d-43f0-b786-efbd977c3bca-samples-operator-tls") pod "cluster-samples-operator-9547488fd-pqkz8" (UID: "1475401e-d13d-43f0-b786-efbd977c3bca") : secret "samples-operator-tls" not found Jun 11 19:53:54.489380 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:54.489362 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/88f7f161-8ca1-400e-a2dc-1a2dfa6876c1-signing-cabundle\") pod \"service-ca-7b994bc59-2gbfs\" (UID: \"88f7f161-8ca1-400e-a2dc-1a2dfa6876c1\") " pod="openshift-service-ca/service-ca-7b994bc59-2gbfs" Jun 11 19:53:54.490975 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:54.490950 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/88f7f161-8ca1-400e-a2dc-1a2dfa6876c1-signing-key\") pod \"service-ca-7b994bc59-2gbfs\" (UID: \"88f7f161-8ca1-400e-a2dc-1a2dfa6876c1\") " pod="openshift-service-ca/service-ca-7b994bc59-2gbfs" Jun 11 19:53:54.495940 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:54.495923 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mc6x6_98cc5ec8-4790-4b36-a80d-df6d5d1e8bf6/node-ca/0.log" Jun 11 19:53:54.497195 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:54.497180 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9ddj\" (UniqueName: \"kubernetes.io/projected/88f7f161-8ca1-400e-a2dc-1a2dfa6876c1-kube-api-access-q9ddj\") pod \"service-ca-7b994bc59-2gbfs\" (UID: \"88f7f161-8ca1-400e-a2dc-1a2dfa6876c1\") " pod="openshift-service-ca/service-ca-7b994bc59-2gbfs" Jun 11 19:53:54.523194 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:54.523175 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-2gbfs" Jun 11 19:53:54.638816 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:54.638785 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-2gbfs"] Jun 11 19:53:54.642132 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:53:54.642098 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88f7f161_8ca1_400e_a2dc_1a2dfa6876c1.slice/crio-a15c2987f269da386606818587c115d0ed3602dd7b9076ecbdfd1609ef2c0a20 WatchSource:0}: Error finding container a15c2987f269da386606818587c115d0ed3602dd7b9076ecbdfd1609ef2c0a20: Status 404 returned error can't find the container with id a15c2987f269da386606818587c115d0ed3602dd7b9076ecbdfd1609ef2c0a20 Jun 11 19:53:54.876731 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:54.876703 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-2gbfs" event={"ID":"88f7f161-8ca1-400e-a2dc-1a2dfa6876c1","Type":"ContainerStarted","Data":"a15c2987f269da386606818587c115d0ed3602dd7b9076ecbdfd1609ef2c0a20"} Jun 11 19:53:55.496805 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:55.496771 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/006884e0-f73c-4791-8439-a25fcaa21ddd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t2ks4\" (UID: \"006884e0-f73c-4791-8439-a25fcaa21ddd\") " pod="openshift-insights/insights-runtime-extractor-t2ks4" Jun 11 19:53:55.496984 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:55.496858 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/006884e0-f73c-4791-8439-a25fcaa21ddd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t2ks4\" (UID: \"006884e0-f73c-4791-8439-a25fcaa21ddd\") " pod="openshift-insights/insights-runtime-extractor-t2ks4" Jun 11 19:53:55.496984 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:53:55.496913 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 19:53:55.496984 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:53:55.496944 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 19:53:55.496984 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:53:55.496981 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/006884e0-f73c-4791-8439-a25fcaa21ddd-insights-runtime-extractor-tls podName:006884e0-f73c-4791-8439-a25fcaa21ddd nodeName:}" failed. No retries permitted until 2026-06-11 19:53:59.496964338 +0000 UTC m=+239.774725084 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/006884e0-f73c-4791-8439-a25fcaa21ddd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t2ks4" (UID: "006884e0-f73c-4791-8439-a25fcaa21ddd") : secret "insights-runtime-extractor-tls" not found Jun 11 19:53:55.497233 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:53:55.497001 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/006884e0-f73c-4791-8439-a25fcaa21ddd-kube-rbac-proxy-cm podName:006884e0-f73c-4791-8439-a25fcaa21ddd nodeName:}" failed. No retries permitted until 2026-06-11 19:53:59.496992329 +0000 UTC m=+239.774753072 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/006884e0-f73c-4791-8439-a25fcaa21ddd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t2ks4" (UID: "006884e0-f73c-4791-8439-a25fcaa21ddd") : configmap "kube-rbac-proxy" not found Jun 11 19:53:55.497233 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:55.497210 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-76x6k_783eb1a7-0a40-4ad8-9705-e9df073f3194/serve-healthcheck-canary/0.log" Jun 11 19:53:56.885214 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:56.885182 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-2gbfs" event={"ID":"88f7f161-8ca1-400e-a2dc-1a2dfa6876c1","Type":"ContainerStarted","Data":"33da2bfa060271848371cbd74a382460e5fed9906a28f867b5bb82a9b43c5f28"} Jun 11 19:53:56.902793 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:56.902744 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-2gbfs" podStartSLOduration=1.3768704760000001 podStartE2EDuration="2.902730473s" totalImagesPullingTime="1.525859997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:53:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:53:56.901526802 +0000 UTC m=+237.179287561" watchObservedRunningTime="2026-06-11 19:53:56.902730473 +0000 UTC m=+237.180491209" Jun 11 19:53:57.212368 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:57.212331 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-9pxm2" Jun 11 19:53:57.212508 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:57.212425 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-9pxm2" Jun 11 19:53:57.212778 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:57.212765 2576 scope.go:117] "RemoveContainer" containerID="01ad66ff189b94f94bd86dfd84352cd4090cb3b165d19a94a99f07df018005f8" Jun 11 19:53:57.212919 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:53:57.212900 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-9pxm2_openshift-console-operator(23de3c36-7fd1-4a71-9bff-dd7782544ca4)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-9pxm2" podUID="23de3c36-7fd1-4a71-9bff-dd7782544ca4" Jun 11 19:53:59.530862 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:59.530820 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/006884e0-f73c-4791-8439-a25fcaa21ddd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t2ks4\" (UID: \"006884e0-f73c-4791-8439-a25fcaa21ddd\") " pod="openshift-insights/insights-runtime-extractor-t2ks4" Jun 11 19:53:59.531277 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:53:59.530900 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/006884e0-f73c-4791-8439-a25fcaa21ddd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t2ks4\" (UID: \"006884e0-f73c-4791-8439-a25fcaa21ddd\") " pod="openshift-insights/insights-runtime-extractor-t2ks4" Jun 11 19:53:59.531277 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:53:59.530951 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 19:53:59.531277 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:53:59.530997 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 19:53:59.531277 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:53:59.531015 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/006884e0-f73c-4791-8439-a25fcaa21ddd-kube-rbac-proxy-cm podName:006884e0-f73c-4791-8439-a25fcaa21ddd nodeName:}" failed. No retries permitted until 2026-06-11 19:54:07.531001041 +0000 UTC m=+247.808761777 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/006884e0-f73c-4791-8439-a25fcaa21ddd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t2ks4" (UID: "006884e0-f73c-4791-8439-a25fcaa21ddd") : configmap "kube-rbac-proxy" not found Jun 11 19:53:59.531277 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:53:59.531043 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/006884e0-f73c-4791-8439-a25fcaa21ddd-insights-runtime-extractor-tls podName:006884e0-f73c-4791-8439-a25fcaa21ddd nodeName:}" failed. No retries permitted until 2026-06-11 19:54:07.531025193 +0000 UTC m=+247.808785936 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/006884e0-f73c-4791-8439-a25fcaa21ddd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t2ks4" (UID: "006884e0-f73c-4791-8439-a25fcaa21ddd") : secret "insights-runtime-extractor-tls" not found Jun 11 19:54:02.552484 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:02.552453 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1475401e-d13d-43f0-b786-efbd977c3bca-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-pqkz8\" (UID: \"1475401e-d13d-43f0-b786-efbd977c3bca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pqkz8" Jun 11 19:54:02.554863 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:02.554840 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1475401e-d13d-43f0-b786-efbd977c3bca-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-pqkz8\" (UID: \"1475401e-d13d-43f0-b786-efbd977c3bca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pqkz8" Jun 11 19:54:02.616489 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:02.616456 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-29rd7\"" Jun 11 19:54:02.624439 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:02.624422 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pqkz8" Jun 11 19:54:02.751296 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:02.751266 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pqkz8"] Jun 11 19:54:02.905186 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:02.905154 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pqkz8" event={"ID":"1475401e-d13d-43f0-b786-efbd977c3bca","Type":"ContainerStarted","Data":"39667c9413193a2f6670d27df1aaf561ee14bcf0bc3f9072a31a31cecd6ec4a1"} Jun 11 19:54:04.917869 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:04.917826 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pqkz8" event={"ID":"1475401e-d13d-43f0-b786-efbd977c3bca","Type":"ContainerStarted","Data":"b6a01a3e30e8ba8a61619a92c9ca07bb26c650fb80791b4467acfd1b41476f1a"} Jun 11 19:54:04.918343 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:04.917893 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pqkz8" event={"ID":"1475401e-d13d-43f0-b786-efbd977c3bca","Type":"ContainerStarted","Data":"e956ef7980a037fb7244b9e0a77ceb1c0d6a97ae96b9379981c7f4f1124af9e3"} Jun 11 19:54:07.596600 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:07.596563 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/006884e0-f73c-4791-8439-a25fcaa21ddd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t2ks4\" (UID: \"006884e0-f73c-4791-8439-a25fcaa21ddd\") " pod="openshift-insights/insights-runtime-extractor-t2ks4" Jun 11 19:54:07.597094 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:07.596634 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/006884e0-f73c-4791-8439-a25fcaa21ddd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t2ks4\" (UID: \"006884e0-f73c-4791-8439-a25fcaa21ddd\") " pod="openshift-insights/insights-runtime-extractor-t2ks4" Jun 11 19:54:07.597170 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:07.597108 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/006884e0-f73c-4791-8439-a25fcaa21ddd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t2ks4\" (UID: \"006884e0-f73c-4791-8439-a25fcaa21ddd\") " pod="openshift-insights/insights-runtime-extractor-t2ks4" Jun 11 19:54:07.598834 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:07.598818 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/006884e0-f73c-4791-8439-a25fcaa21ddd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t2ks4\" (UID: \"006884e0-f73c-4791-8439-a25fcaa21ddd\") " pod="openshift-insights/insights-runtime-extractor-t2ks4" Jun 11 19:54:07.633472 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:07.633441 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kckmb\"" Jun 11 19:54:07.641559 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:07.641537 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t2ks4" Jun 11 19:54:07.760599 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:07.760551 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pqkz8" podStartSLOduration=20.042007313 podStartE2EDuration="21.760533066s" totalImagesPullingTime="1.718525753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:53:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:04.937319432 +0000 UTC m=+245.215080190" watchObservedRunningTime="2026-06-11 19:54:07.760533066 +0000 UTC m=+248.038293823" Jun 11 19:54:07.760748 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:07.760721 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t2ks4"] Jun 11 19:54:07.763720 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:54:07.763685 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod006884e0_f73c_4791_8439_a25fcaa21ddd.slice/crio-fee2a10063f0ec5bd460cc4304b9c5d22068a9877e0588e7ea1478135ee320cd WatchSource:0}: Error finding container fee2a10063f0ec5bd460cc4304b9c5d22068a9877e0588e7ea1478135ee320cd: Status 404 returned error can't find the container with id fee2a10063f0ec5bd460cc4304b9c5d22068a9877e0588e7ea1478135ee320cd Jun 11 19:54:07.927326 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:07.927245 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t2ks4" event={"ID":"006884e0-f73c-4791-8439-a25fcaa21ddd","Type":"ContainerStarted","Data":"fee2a10063f0ec5bd460cc4304b9c5d22068a9877e0588e7ea1478135ee320cd"} Jun 11 19:54:08.191515 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:08.191435 2576 scope.go:117] "RemoveContainer" containerID="01ad66ff189b94f94bd86dfd84352cd4090cb3b165d19a94a99f07df018005f8" Jun 11 19:54:08.932733 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:08.932700 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9pxm2_23de3c36-7fd1-4a71-9bff-dd7782544ca4/console-operator/1.log" Jun 11 19:54:08.933234 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:08.932795 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-9pxm2" event={"ID":"23de3c36-7fd1-4a71-9bff-dd7782544ca4","Type":"ContainerStarted","Data":"1add3b98a0a52ce91f48bba8f01a26cdde75381f3bf83a36d60f9efe29382b37"} Jun 11 19:54:08.933234 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:08.933105 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-9pxm2" Jun 11 19:54:08.950647 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:08.950569 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5dbbb5d744-9pxm2" podStartSLOduration=21.329170262 podStartE2EDuration="22.950550837s" totalImagesPullingTime="1.621380575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:53:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:08.949496685 +0000 UTC m=+249.227257468" watchObservedRunningTime="2026-06-11 19:54:08.950550837 +0000 UTC m=+249.228311595" Jun 11 19:54:09.138622 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:09.138592 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5dbbb5d744-9pxm2" Jun 11 19:54:11.945581 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:11.945540 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t2ks4" event={"ID":"006884e0-f73c-4791-8439-a25fcaa21ddd","Type":"ContainerStarted","Data":"a2696419c3617a5f1adb83f2f24e64e60270d24fdbc74fd9ebc02f59373096ce"} Jun 11 19:54:12.133713 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:12.133691 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99-metrics-certs\") pod \"network-metrics-daemon-lrgwp\" (UID: \"ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99\") " pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:54:12.135865 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:12.135838 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99-metrics-certs\") pod \"network-metrics-daemon-lrgwp\" (UID: \"ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99\") " pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:54:12.194456 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:12.194435 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mvws7\"" Jun 11 19:54:12.202740 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:12.202695 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrgwp" Jun 11 19:54:12.321703 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:12.321676 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lrgwp"] Jun 11 19:54:12.324875 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:54:12.324851 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddd4c11f_6630_4ed1_9ef0_1d80c81fbb99.slice/crio-6f030ca599427eb741124b877d32c35bc543ef610b8062e2ba8c4eb10c7bfa3f WatchSource:0}: Error finding container 6f030ca599427eb741124b877d32c35bc543ef610b8062e2ba8c4eb10c7bfa3f: Status 404 returned error can't find the container with id 6f030ca599427eb741124b877d32c35bc543ef610b8062e2ba8c4eb10c7bfa3f Jun 11 19:54:12.950640 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:12.950572 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lrgwp" event={"ID":"ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99","Type":"ContainerStarted","Data":"6f030ca599427eb741124b877d32c35bc543ef610b8062e2ba8c4eb10c7bfa3f"} Jun 11 19:54:12.952876 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:12.952845 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t2ks4" event={"ID":"006884e0-f73c-4791-8439-a25fcaa21ddd","Type":"ContainerStarted","Data":"5678dd96cb8bf7f6d5041f3163079c5fe73e5ddce1fbb10f9ee02e9bfe97a643"} Jun 11 19:54:14.961933 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:14.961841 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t2ks4" event={"ID":"006884e0-f73c-4791-8439-a25fcaa21ddd","Type":"ContainerStarted","Data":"9b602c66febc7961d371a7b2b00ab90f1bf85788c0a1f6dea694ad08f4dbb66f"} Jun 11 19:54:14.963597 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:14.963573 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lrgwp" event={"ID":"ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99","Type":"ContainerStarted","Data":"5646e3a6b50bb0f3a8dc6b4d6d38e528868a8164dcb1de2ddf1ace02b08302a7"} Jun 11 19:54:14.963711 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:14.963615 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lrgwp" event={"ID":"ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99","Type":"ContainerStarted","Data":"e900cdd5426aca4a3a3d9d467501b69dc24d8500dfe3246af0464664b85edbe9"} Jun 11 19:54:14.980790 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:14.980746 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-t2ks4" podStartSLOduration=17.407689735 podStartE2EDuration="23.980733841s" totalImagesPullingTime="6.573044106s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:53:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:14.979193948 +0000 UTC m=+255.256954707" watchObservedRunningTime="2026-06-11 19:54:14.980733841 +0000 UTC m=+255.258494598" Jun 11 19:54:14.993871 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:14.993832 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lrgwp" podStartSLOduration=252.871700673 podStartE2EDuration="4m14.993819944s" totalImagesPullingTime="2.122119271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:14.993542866 +0000 UTC m=+255.271303624" watchObservedRunningTime="2026-06-11 19:54:14.993819944 +0000 UTC m=+255.271580702" Jun 11 19:54:29.806691 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.806657 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tl7k7"] Jun 11 19:54:29.811272 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.811248 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-czzc5"] Jun 11 19:54:29.811421 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.811400 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tl7k7" Jun 11 19:54:29.814331 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.814312 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-czzc5" Jun 11 19:54:29.814867 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.814837 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 19:54:29.815057 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.815027 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nrhtz\"" Jun 11 19:54:29.816147 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.816114 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 19:54:29.816291 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.816273 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 19:54:29.816359 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.816287 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 19:54:29.816413 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.816238 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 19:54:29.816471 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.816273 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 19:54:29.817156 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.817135 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-68r8c\"" Jun 11 19:54:29.817252 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.817186 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 11 19:54:29.817252 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.817213 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 11 19:54:29.817620 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.817603 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 11 19:54:29.822004 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.821983 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-czzc5"] Jun 11 19:54:29.859937 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.859905 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qklzz\" (UniqueName: \"kubernetes.io/projected/667b360e-2e24-4d54-bbbc-84722535b390-kube-api-access-qklzz\") pod \"node-exporter-tl7k7\" (UID: \"667b360e-2e24-4d54-bbbc-84722535b390\") " pod="openshift-monitoring/node-exporter-tl7k7" Jun 11 19:54:29.860088 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.859943 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/667b360e-2e24-4d54-bbbc-84722535b390-node-exporter-textfile\") pod \"node-exporter-tl7k7\" (UID: \"667b360e-2e24-4d54-bbbc-84722535b390\") " pod="openshift-monitoring/node-exporter-tl7k7" Jun 11 19:54:29.860088 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.859963 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/667b360e-2e24-4d54-bbbc-84722535b390-root\") pod \"node-exporter-tl7k7\" (UID: \"667b360e-2e24-4d54-bbbc-84722535b390\") " pod="openshift-monitoring/node-exporter-tl7k7" Jun 11 19:54:29.860088 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.859977 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/667b360e-2e24-4d54-bbbc-84722535b390-metrics-client-ca\") pod \"node-exporter-tl7k7\" (UID: \"667b360e-2e24-4d54-bbbc-84722535b390\") " pod="openshift-monitoring/node-exporter-tl7k7" Jun 11 19:54:29.860088 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.860039 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/667b360e-2e24-4d54-bbbc-84722535b390-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tl7k7\" (UID: \"667b360e-2e24-4d54-bbbc-84722535b390\") " pod="openshift-monitoring/node-exporter-tl7k7" Jun 11 19:54:29.860317 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.860164 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/73909124-6142-46b9-af2a-47bf06bf1ef1-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-czzc5\" (UID: \"73909124-6142-46b9-af2a-47bf06bf1ef1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-czzc5" Jun 11 19:54:29.860317 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.860207 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/73909124-6142-46b9-af2a-47bf06bf1ef1-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-czzc5\" (UID: \"73909124-6142-46b9-af2a-47bf06bf1ef1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-czzc5" Jun 11 19:54:29.860317 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.860248 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/667b360e-2e24-4d54-bbbc-84722535b390-node-exporter-wtmp\") pod \"node-exporter-tl7k7\" (UID: \"667b360e-2e24-4d54-bbbc-84722535b390\") " pod="openshift-monitoring/node-exporter-tl7k7" Jun 11 19:54:29.860317 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.860285 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73909124-6142-46b9-af2a-47bf06bf1ef1-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-czzc5\" (UID: \"73909124-6142-46b9-af2a-47bf06bf1ef1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-czzc5" Jun 11 19:54:29.860545 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.860342 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/667b360e-2e24-4d54-bbbc-84722535b390-node-exporter-tls\") pod \"node-exporter-tl7k7\" (UID: \"667b360e-2e24-4d54-bbbc-84722535b390\") " pod="openshift-monitoring/node-exporter-tl7k7" Jun 11 19:54:29.860545 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.860389 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d4hg\" (UniqueName: \"kubernetes.io/projected/73909124-6142-46b9-af2a-47bf06bf1ef1-kube-api-access-8d4hg\") pod \"kube-state-metrics-678bc549d7-czzc5\" (UID: \"73909124-6142-46b9-af2a-47bf06bf1ef1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-czzc5" Jun 11 19:54:29.860545 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.860414 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/667b360e-2e24-4d54-bbbc-84722535b390-sys\") pod \"node-exporter-tl7k7\" (UID: \"667b360e-2e24-4d54-bbbc-84722535b390\") " pod="openshift-monitoring/node-exporter-tl7k7" Jun 11 19:54:29.860545 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.860442 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/667b360e-2e24-4d54-bbbc-84722535b390-node-exporter-accelerators-collector-config\") pod \"node-exporter-tl7k7\" (UID: \"667b360e-2e24-4d54-bbbc-84722535b390\") " pod="openshift-monitoring/node-exporter-tl7k7" Jun 11 19:54:29.860545 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.860502 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73909124-6142-46b9-af2a-47bf06bf1ef1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-czzc5\" (UID: \"73909124-6142-46b9-af2a-47bf06bf1ef1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-czzc5" Jun 11 19:54:29.860545 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.860526 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/73909124-6142-46b9-af2a-47bf06bf1ef1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-czzc5\" (UID: \"73909124-6142-46b9-af2a-47bf06bf1ef1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-czzc5" Jun 11 19:54:29.960795 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.960768 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qklzz\" (UniqueName: \"kubernetes.io/projected/667b360e-2e24-4d54-bbbc-84722535b390-kube-api-access-qklzz\") pod \"node-exporter-tl7k7\" (UID: \"667b360e-2e24-4d54-bbbc-84722535b390\") " pod="openshift-monitoring/node-exporter-tl7k7" Jun 11 19:54:29.960795 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.960800 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/667b360e-2e24-4d54-bbbc-84722535b390-node-exporter-textfile\") pod \"node-exporter-tl7k7\" (UID: \"667b360e-2e24-4d54-bbbc-84722535b390\") " pod="openshift-monitoring/node-exporter-tl7k7" Jun 11 19:54:29.961007 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.960817 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/667b360e-2e24-4d54-bbbc-84722535b390-root\") pod \"node-exporter-tl7k7\" (UID: \"667b360e-2e24-4d54-bbbc-84722535b390\") " pod="openshift-monitoring/node-exporter-tl7k7" Jun 11 19:54:29.961007 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.960833 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/667b360e-2e24-4d54-bbbc-84722535b390-metrics-client-ca\") pod \"node-exporter-tl7k7\" (UID: \"667b360e-2e24-4d54-bbbc-84722535b390\") " pod="openshift-monitoring/node-exporter-tl7k7" Jun 11 19:54:29.961007 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.960850 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/667b360e-2e24-4d54-bbbc-84722535b390-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tl7k7\" (UID: \"667b360e-2e24-4d54-bbbc-84722535b390\") " pod="openshift-monitoring/node-exporter-tl7k7" Jun 11 19:54:29.961007 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.960906 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/667b360e-2e24-4d54-bbbc-84722535b390-root\") pod \"node-exporter-tl7k7\" (UID: \"667b360e-2e24-4d54-bbbc-84722535b390\") " pod="openshift-monitoring/node-exporter-tl7k7" Jun 11 19:54:29.961269 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.961013 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/73909124-6142-46b9-af2a-47bf06bf1ef1-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-czzc5\" (UID: \"73909124-6142-46b9-af2a-47bf06bf1ef1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-czzc5" Jun 11 19:54:29.961269 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.961048 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/73909124-6142-46b9-af2a-47bf06bf1ef1-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-czzc5\" (UID: \"73909124-6142-46b9-af2a-47bf06bf1ef1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-czzc5" Jun 11 19:54:29.961269 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.961068 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/667b360e-2e24-4d54-bbbc-84722535b390-node-exporter-wtmp\") pod \"node-exporter-tl7k7\" (UID: \"667b360e-2e24-4d54-bbbc-84722535b390\") " pod="openshift-monitoring/node-exporter-tl7k7" Jun 11 19:54:29.961269 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.961086 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73909124-6142-46b9-af2a-47bf06bf1ef1-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-czzc5\" (UID: \"73909124-6142-46b9-af2a-47bf06bf1ef1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-czzc5" Jun 11 19:54:29.961269 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.961110 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/667b360e-2e24-4d54-bbbc-84722535b390-node-exporter-tls\") pod \"node-exporter-tl7k7\" (UID: \"667b360e-2e24-4d54-bbbc-84722535b390\") " pod="openshift-monitoring/node-exporter-tl7k7" Jun 11 19:54:29.961269 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.961156 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d4hg\" (UniqueName: \"kubernetes.io/projected/73909124-6142-46b9-af2a-47bf06bf1ef1-kube-api-access-8d4hg\") pod \"kube-state-metrics-678bc549d7-czzc5\" (UID: \"73909124-6142-46b9-af2a-47bf06bf1ef1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-czzc5" Jun 11 19:54:29.961269 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.961174 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/667b360e-2e24-4d54-bbbc-84722535b390-sys\") pod \"node-exporter-tl7k7\" (UID: \"667b360e-2e24-4d54-bbbc-84722535b390\") " pod="openshift-monitoring/node-exporter-tl7k7" Jun 11 19:54:29.961269 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.961180 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/667b360e-2e24-4d54-bbbc-84722535b390-node-exporter-textfile\") pod \"node-exporter-tl7k7\" (UID: \"667b360e-2e24-4d54-bbbc-84722535b390\") " pod="openshift-monitoring/node-exporter-tl7k7" Jun 11 19:54:29.961269 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.961200 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/667b360e-2e24-4d54-bbbc-84722535b390-node-exporter-accelerators-collector-config\") pod \"node-exporter-tl7k7\" (UID: \"667b360e-2e24-4d54-bbbc-84722535b390\") " pod="openshift-monitoring/node-exporter-tl7k7" Jun 11 19:54:29.961269 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.961222 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73909124-6142-46b9-af2a-47bf06bf1ef1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-czzc5\" (UID: \"73909124-6142-46b9-af2a-47bf06bf1ef1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-czzc5" Jun 11 19:54:29.961269 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.961245 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/73909124-6142-46b9-af2a-47bf06bf1ef1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-czzc5\" (UID: \"73909124-6142-46b9-af2a-47bf06bf1ef1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-czzc5" Jun 11 19:54:29.961269 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:54:29.961272 2576 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 11 19:54:29.961837 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:54:29.961328 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73909124-6142-46b9-af2a-47bf06bf1ef1-kube-state-metrics-tls podName:73909124-6142-46b9-af2a-47bf06bf1ef1 nodeName:}" failed. No retries permitted until 2026-06-11 19:54:30.461311194 +0000 UTC m=+270.739071931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/73909124-6142-46b9-af2a-47bf06bf1ef1-kube-state-metrics-tls") pod "kube-state-metrics-678bc549d7-czzc5" (UID: "73909124-6142-46b9-af2a-47bf06bf1ef1") : secret "kube-state-metrics-tls" not found Jun 11 19:54:29.961837 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.961416 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/73909124-6142-46b9-af2a-47bf06bf1ef1-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-czzc5\" (UID: \"73909124-6142-46b9-af2a-47bf06bf1ef1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-czzc5" Jun 11 19:54:29.961837 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.961499 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/667b360e-2e24-4d54-bbbc-84722535b390-metrics-client-ca\") pod \"node-exporter-tl7k7\" (UID: \"667b360e-2e24-4d54-bbbc-84722535b390\") " pod="openshift-monitoring/node-exporter-tl7k7" Jun 11 19:54:29.961837 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.961576 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/667b360e-2e24-4d54-bbbc-84722535b390-sys\") pod \"node-exporter-tl7k7\" (UID: \"667b360e-2e24-4d54-bbbc-84722535b390\") " pod="openshift-monitoring/node-exporter-tl7k7" Jun 11 19:54:29.961837 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.961605 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/667b360e-2e24-4d54-bbbc-84722535b390-node-exporter-wtmp\") pod \"node-exporter-tl7k7\" (UID: \"667b360e-2e24-4d54-bbbc-84722535b390\") " pod="openshift-monitoring/node-exporter-tl7k7" Jun 11 19:54:29.962094 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.961936 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/667b360e-2e24-4d54-bbbc-84722535b390-node-exporter-accelerators-collector-config\") pod \"node-exporter-tl7k7\" (UID: \"667b360e-2e24-4d54-bbbc-84722535b390\") " pod="openshift-monitoring/node-exporter-tl7k7" Jun 11 19:54:29.962094 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.961979 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/73909124-6142-46b9-af2a-47bf06bf1ef1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-czzc5\" (UID: \"73909124-6142-46b9-af2a-47bf06bf1ef1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-czzc5" Jun 11 19:54:29.962094 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.962081 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73909124-6142-46b9-af2a-47bf06bf1ef1-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-czzc5\" (UID: \"73909124-6142-46b9-af2a-47bf06bf1ef1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-czzc5" Jun 11 19:54:29.963817 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.963785 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/667b360e-2e24-4d54-bbbc-84722535b390-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tl7k7\" (UID: \"667b360e-2e24-4d54-bbbc-84722535b390\") " pod="openshift-monitoring/node-exporter-tl7k7" Jun 11 19:54:29.963979 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.963954 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73909124-6142-46b9-af2a-47bf06bf1ef1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-czzc5\" (UID: \"73909124-6142-46b9-af2a-47bf06bf1ef1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-czzc5" Jun 11 19:54:29.964074 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.964060 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/667b360e-2e24-4d54-bbbc-84722535b390-node-exporter-tls\") pod \"node-exporter-tl7k7\" (UID: \"667b360e-2e24-4d54-bbbc-84722535b390\") " pod="openshift-monitoring/node-exporter-tl7k7" Jun 11 19:54:29.968978 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.968950 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qklzz\" (UniqueName: \"kubernetes.io/projected/667b360e-2e24-4d54-bbbc-84722535b390-kube-api-access-qklzz\") pod \"node-exporter-tl7k7\" (UID: \"667b360e-2e24-4d54-bbbc-84722535b390\") " pod="openshift-monitoring/node-exporter-tl7k7" Jun 11 19:54:29.969217 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:29.969198 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d4hg\" (UniqueName: \"kubernetes.io/projected/73909124-6142-46b9-af2a-47bf06bf1ef1-kube-api-access-8d4hg\") pod \"kube-state-metrics-678bc549d7-czzc5\" (UID: \"73909124-6142-46b9-af2a-47bf06bf1ef1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-czzc5" Jun 11 19:54:30.123629 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:30.123598 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tl7k7" Jun 11 19:54:30.134896 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:54:30.134869 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod667b360e_2e24_4d54_bbbc_84722535b390.slice/crio-319a2c26467eada70d19c3c51564831a626b8cb733d423c9bfc2b3716e366a29 WatchSource:0}: Error finding container 319a2c26467eada70d19c3c51564831a626b8cb733d423c9bfc2b3716e366a29: Status 404 returned error can't find the container with id 319a2c26467eada70d19c3c51564831a626b8cb733d423c9bfc2b3716e366a29 Jun 11 19:54:30.465459 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:30.465384 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/73909124-6142-46b9-af2a-47bf06bf1ef1-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-czzc5\" (UID: \"73909124-6142-46b9-af2a-47bf06bf1ef1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-czzc5" Jun 11 19:54:30.467652 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:30.467625 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/73909124-6142-46b9-af2a-47bf06bf1ef1-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-czzc5\" (UID: \"73909124-6142-46b9-af2a-47bf06bf1ef1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-czzc5" Jun 11 19:54:30.729215 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:30.729139 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-czzc5" Jun 11 19:54:30.857187 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:30.857154 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 19:54:30.862397 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:30.862374 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:30.864810 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:30.864789 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 19:54:30.864959 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:30.864789 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 19:54:30.865209 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:30.865185 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 19:54:30.865820 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:30.865318 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 19:54:30.865820 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:30.865246 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tbmsk\"" Jun 11 19:54:30.865820 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:30.865313 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 19:54:30.865820 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:30.865409 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 19:54:30.865820 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:30.865315 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 19:54:30.865820 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:30.865594 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 19:54:30.865820 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:30.865710 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 19:54:30.875937 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:30.875911 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 19:54:30.970093 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:30.969291 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9205e756-671e-472b-92e9-969a60a3f16c-config-out\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:30.970093 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:30.969331 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:30.970093 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:30.969362 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9205e756-671e-472b-92e9-969a60a3f16c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:30.970093 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:30.969412 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9205e756-671e-472b-92e9-969a60a3f16c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:30.970093 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:30.969438 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:30.970093 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:30.969463 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-config-volume\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:30.970093 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:30.969485 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:30.970093 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:30.969510 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:30.970093 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:30.969533 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9205e756-671e-472b-92e9-969a60a3f16c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:30.970093 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:30.969577 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqnml\" (UniqueName: \"kubernetes.io/projected/9205e756-671e-472b-92e9-969a60a3f16c-kube-api-access-vqnml\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:30.970093 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:30.969601 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-web-config\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:30.970093 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:30.969632 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:30.970093 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:30.969653 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9205e756-671e-472b-92e9-969a60a3f16c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:31.020281 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:31.020200 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tl7k7" event={"ID":"667b360e-2e24-4d54-bbbc-84722535b390","Type":"ContainerStarted","Data":"319a2c26467eada70d19c3c51564831a626b8cb733d423c9bfc2b3716e366a29"} Jun 11 19:54:31.069270 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:31.069250 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-czzc5"] Jun 11 19:54:31.070105 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:31.070083 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9205e756-671e-472b-92e9-969a60a3f16c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:31.070273 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:31.070116 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:31.070273 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:31.070151 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-config-volume\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:31.070273 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:31.070168 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:31.070273 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:31.070190 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:31.070273 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:31.070204 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9205e756-671e-472b-92e9-969a60a3f16c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:31.070273 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:31.070252 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqnml\" (UniqueName: \"kubernetes.io/projected/9205e756-671e-472b-92e9-969a60a3f16c-kube-api-access-vqnml\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:31.070273 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:31.070269 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-web-config\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:31.070617 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:31.070293 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:31.070617 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:31.070313 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9205e756-671e-472b-92e9-969a60a3f16c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:31.070617 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:31.070337 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9205e756-671e-472b-92e9-969a60a3f16c-config-out\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:31.070617 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:31.070361 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:31.070617 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:31.070395 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9205e756-671e-472b-92e9-969a60a3f16c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:31.070871 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:31.070803 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9205e756-671e-472b-92e9-969a60a3f16c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:31.074244 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:31.073277 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9205e756-671e-472b-92e9-969a60a3f16c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:31.074244 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:31.073573 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9205e756-671e-472b-92e9-969a60a3f16c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:31.074554 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:31.074474 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:31.075481 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:31.075197 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9205e756-671e-472b-92e9-969a60a3f16c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:31.075481 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:31.075375 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-config-volume\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:31.076153 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:31.075874 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:31.076153 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:31.075999 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9205e756-671e-472b-92e9-969a60a3f16c-config-out\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:31.076153 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:31.076096 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:31.076396 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:31.076249 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-web-config\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:31.077298 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:31.077256 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:31.078277 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:31.078108 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:31.080460 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:31.080429 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqnml\" (UniqueName: \"kubernetes.io/projected/9205e756-671e-472b-92e9-969a60a3f16c-kube-api-access-vqnml\") pod \"alertmanager-main-0\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:31.174222 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:31.174194 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:54:31.304392 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:31.303434 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 19:54:32.026422 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:32.026385 2576 generic.go:356] "Generic (PLEG): container finished" podID="667b360e-2e24-4d54-bbbc-84722535b390" containerID="b75aabf560f98eb8f4457a524f25d696ca29c87150160f69f5c115b379650637" exitCode=0 Jun 11 19:54:32.026996 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:32.026448 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tl7k7" event={"ID":"667b360e-2e24-4d54-bbbc-84722535b390","Type":"ContainerDied","Data":"b75aabf560f98eb8f4457a524f25d696ca29c87150160f69f5c115b379650637"} Jun 11 19:54:32.027933 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:32.027902 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9205e756-671e-472b-92e9-969a60a3f16c","Type":"ContainerStarted","Data":"cb94199b36b011eb0977dc888b4bd6bc79fd65640f381aacaa28c2190bb84b7e"} Jun 11 19:54:32.030189 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:32.030105 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-czzc5" event={"ID":"73909124-6142-46b9-af2a-47bf06bf1ef1","Type":"ContainerStarted","Data":"74c1cb72aa39381827cdeec44ba983997654582445b2ac0c97725b06cf1f6e66"} Jun 11 19:54:33.035425 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:33.035389 2576 generic.go:356] "Generic (PLEG): container finished" podID="9205e756-671e-472b-92e9-969a60a3f16c" containerID="7517c6c0a45ccbcffb50d458357167959069175eb3527cee3f593240b2c16024" exitCode=0 Jun 11 19:54:33.035846 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:33.035483 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9205e756-671e-472b-92e9-969a60a3f16c","Type":"ContainerDied","Data":"7517c6c0a45ccbcffb50d458357167959069175eb3527cee3f593240b2c16024"} Jun 11 19:54:33.038213 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:33.038188 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-czzc5" event={"ID":"73909124-6142-46b9-af2a-47bf06bf1ef1","Type":"ContainerStarted","Data":"3f3959b61aba6b0737b012774232ae412f114ac061569d178236711b7e2fffb3"} Jun 11 19:54:33.038325 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:33.038294 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-czzc5" event={"ID":"73909124-6142-46b9-af2a-47bf06bf1ef1","Type":"ContainerStarted","Data":"8f1f290068e7be73ab984661ddda9d27a4b77b299fe95b0663fd4897e38a052c"} Jun 11 19:54:33.038389 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:33.038346 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-czzc5" event={"ID":"73909124-6142-46b9-af2a-47bf06bf1ef1","Type":"ContainerStarted","Data":"c08bc73aaf374f6ef3422394741cd02a554e715c37a3c4a2d9988c870a62e932"} Jun 11 19:54:33.040585 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:33.040551 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tl7k7" event={"ID":"667b360e-2e24-4d54-bbbc-84722535b390","Type":"ContainerStarted","Data":"e3c6709b91c6236bff2c577acde6c53c036e74a71591ffdcecd1be6f49937217"} Jun 11 19:54:33.040702 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:33.040596 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tl7k7" event={"ID":"667b360e-2e24-4d54-bbbc-84722535b390","Type":"ContainerStarted","Data":"8e6806dedc1acaf9d4f9c5bbe12f3877c890bbd5981f79773f29f748c9c0e018"} Jun 11 19:54:33.080404 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:33.080350 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-czzc5" podStartSLOduration=2.4624456710000002 podStartE2EDuration="4.080330561s" totalImagesPullingTime="1.61788489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:54:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:33.078347944 +0000 UTC m=+273.356108706" watchObservedRunningTime="2026-06-11 19:54:33.080330561 +0000 UTC m=+273.358091323" Jun 11 19:54:33.100562 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:33.100511 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tl7k7" podStartSLOduration=3.204647528 podStartE2EDuration="4.100493934s" totalImagesPullingTime="828.81517ms" totalInitContainerRuntime="67.031236ms" isStatefulPod=true podCreationTimestamp="2026-06-11 19:54:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:33.098939193 +0000 UTC m=+273.376699961" watchObservedRunningTime="2026-06-11 19:54:33.100493934 +0000 UTC m=+273.378254694" Jun 11 19:54:34.100935 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.100903 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-78d4d9cc5c-h8th6"] Jun 11 19:54:34.105254 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.105228 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-78d4d9cc5c-h8th6" Jun 11 19:54:34.108880 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.108856 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 11 19:54:34.109026 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.108885 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-rt2g9\"" Jun 11 19:54:34.109026 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.108937 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 11 19:54:34.109026 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.108893 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 19:54:34.109026 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.108969 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 11 19:54:34.109026 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.108886 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-a3k1kd5mq8obr\"" Jun 11 19:54:34.112920 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.112899 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-78d4d9cc5c-h8th6"] Jun 11 19:54:34.200398 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.200368 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1319ebd0-5707-4873-8f3b-3776de93d36e-secret-metrics-server-client-certs\") pod \"metrics-server-78d4d9cc5c-h8th6\" (UID: \"1319ebd0-5707-4873-8f3b-3776de93d36e\") " pod="openshift-monitoring/metrics-server-78d4d9cc5c-h8th6" Jun 11 19:54:34.200549 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.200423 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5xtv\" (UniqueName: \"kubernetes.io/projected/1319ebd0-5707-4873-8f3b-3776de93d36e-kube-api-access-s5xtv\") pod \"metrics-server-78d4d9cc5c-h8th6\" (UID: \"1319ebd0-5707-4873-8f3b-3776de93d36e\") " pod="openshift-monitoring/metrics-server-78d4d9cc5c-h8th6" Jun 11 19:54:34.200549 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.200447 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1319ebd0-5707-4873-8f3b-3776de93d36e-metrics-server-audit-profiles\") pod \"metrics-server-78d4d9cc5c-h8th6\" (UID: \"1319ebd0-5707-4873-8f3b-3776de93d36e\") " pod="openshift-monitoring/metrics-server-78d4d9cc5c-h8th6" Jun 11 19:54:34.200549 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.200501 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1319ebd0-5707-4873-8f3b-3776de93d36e-client-ca-bundle\") pod \"metrics-server-78d4d9cc5c-h8th6\" (UID: \"1319ebd0-5707-4873-8f3b-3776de93d36e\") " pod="openshift-monitoring/metrics-server-78d4d9cc5c-h8th6" Jun 11 19:54:34.200709 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.200595 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1319ebd0-5707-4873-8f3b-3776de93d36e-audit-log\") pod \"metrics-server-78d4d9cc5c-h8th6\" (UID: \"1319ebd0-5707-4873-8f3b-3776de93d36e\") " pod="openshift-monitoring/metrics-server-78d4d9cc5c-h8th6" Jun 11 19:54:34.200709 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.200665 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1319ebd0-5707-4873-8f3b-3776de93d36e-secret-metrics-server-tls\") pod \"metrics-server-78d4d9cc5c-h8th6\" (UID: \"1319ebd0-5707-4873-8f3b-3776de93d36e\") " pod="openshift-monitoring/metrics-server-78d4d9cc5c-h8th6" Jun 11 19:54:34.200709 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.200692 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1319ebd0-5707-4873-8f3b-3776de93d36e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78d4d9cc5c-h8th6\" (UID: \"1319ebd0-5707-4873-8f3b-3776de93d36e\") " pod="openshift-monitoring/metrics-server-78d4d9cc5c-h8th6" Jun 11 19:54:34.301719 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.301697 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1319ebd0-5707-4873-8f3b-3776de93d36e-client-ca-bundle\") pod \"metrics-server-78d4d9cc5c-h8th6\" (UID: \"1319ebd0-5707-4873-8f3b-3776de93d36e\") " pod="openshift-monitoring/metrics-server-78d4d9cc5c-h8th6" Jun 11 19:54:34.301782 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.301754 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1319ebd0-5707-4873-8f3b-3776de93d36e-audit-log\") pod \"metrics-server-78d4d9cc5c-h8th6\" (UID: \"1319ebd0-5707-4873-8f3b-3776de93d36e\") " pod="openshift-monitoring/metrics-server-78d4d9cc5c-h8th6" Jun 11 19:54:34.301960 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.301940 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1319ebd0-5707-4873-8f3b-3776de93d36e-secret-metrics-server-tls\") pod \"metrics-server-78d4d9cc5c-h8th6\" (UID: \"1319ebd0-5707-4873-8f3b-3776de93d36e\") " pod="openshift-monitoring/metrics-server-78d4d9cc5c-h8th6" Jun 11 19:54:34.302033 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.301968 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1319ebd0-5707-4873-8f3b-3776de93d36e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78d4d9cc5c-h8th6\" (UID: \"1319ebd0-5707-4873-8f3b-3776de93d36e\") " pod="openshift-monitoring/metrics-server-78d4d9cc5c-h8th6" Jun 11 19:54:34.302087 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.302062 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1319ebd0-5707-4873-8f3b-3776de93d36e-audit-log\") pod \"metrics-server-78d4d9cc5c-h8th6\" (UID: \"1319ebd0-5707-4873-8f3b-3776de93d36e\") " pod="openshift-monitoring/metrics-server-78d4d9cc5c-h8th6" Jun 11 19:54:34.302168 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.302081 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1319ebd0-5707-4873-8f3b-3776de93d36e-secret-metrics-server-client-certs\") pod \"metrics-server-78d4d9cc5c-h8th6\" (UID: \"1319ebd0-5707-4873-8f3b-3776de93d36e\") " pod="openshift-monitoring/metrics-server-78d4d9cc5c-h8th6" Jun 11 19:54:34.302217 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.302189 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5xtv\" (UniqueName: \"kubernetes.io/projected/1319ebd0-5707-4873-8f3b-3776de93d36e-kube-api-access-s5xtv\") pod \"metrics-server-78d4d9cc5c-h8th6\" (UID: \"1319ebd0-5707-4873-8f3b-3776de93d36e\") " pod="openshift-monitoring/metrics-server-78d4d9cc5c-h8th6" Jun 11 19:54:34.302276 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.302226 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1319ebd0-5707-4873-8f3b-3776de93d36e-metrics-server-audit-profiles\") pod \"metrics-server-78d4d9cc5c-h8th6\" (UID: \"1319ebd0-5707-4873-8f3b-3776de93d36e\") " pod="openshift-monitoring/metrics-server-78d4d9cc5c-h8th6" Jun 11 19:54:34.302655 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.302607 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1319ebd0-5707-4873-8f3b-3776de93d36e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78d4d9cc5c-h8th6\" (UID: \"1319ebd0-5707-4873-8f3b-3776de93d36e\") " pod="openshift-monitoring/metrics-server-78d4d9cc5c-h8th6" Jun 11 19:54:34.302982 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.302960 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1319ebd0-5707-4873-8f3b-3776de93d36e-metrics-server-audit-profiles\") pod \"metrics-server-78d4d9cc5c-h8th6\" (UID: \"1319ebd0-5707-4873-8f3b-3776de93d36e\") " pod="openshift-monitoring/metrics-server-78d4d9cc5c-h8th6" Jun 11 19:54:34.304046 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.304029 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1319ebd0-5707-4873-8f3b-3776de93d36e-client-ca-bundle\") pod \"metrics-server-78d4d9cc5c-h8th6\" (UID: \"1319ebd0-5707-4873-8f3b-3776de93d36e\") " pod="openshift-monitoring/metrics-server-78d4d9cc5c-h8th6" Jun 11 19:54:34.304599 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.304567 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1319ebd0-5707-4873-8f3b-3776de93d36e-secret-metrics-server-tls\") pod \"metrics-server-78d4d9cc5c-h8th6\" (UID: \"1319ebd0-5707-4873-8f3b-3776de93d36e\") " pod="openshift-monitoring/metrics-server-78d4d9cc5c-h8th6" Jun 11 19:54:34.304687 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.304651 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1319ebd0-5707-4873-8f3b-3776de93d36e-secret-metrics-server-client-certs\") pod \"metrics-server-78d4d9cc5c-h8th6\" (UID: \"1319ebd0-5707-4873-8f3b-3776de93d36e\") " pod="openshift-monitoring/metrics-server-78d4d9cc5c-h8th6" Jun 11 19:54:34.309827 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.309808 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5xtv\" (UniqueName: \"kubernetes.io/projected/1319ebd0-5707-4873-8f3b-3776de93d36e-kube-api-access-s5xtv\") pod \"metrics-server-78d4d9cc5c-h8th6\" (UID: \"1319ebd0-5707-4873-8f3b-3776de93d36e\") " pod="openshift-monitoring/metrics-server-78d4d9cc5c-h8th6" Jun 11 19:54:34.415731 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.415710 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-78d4d9cc5c-h8th6" Jun 11 19:54:34.557182 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.557093 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-78d4d9cc5c-h8th6"] Jun 11 19:54:34.560740 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:54:34.560714 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1319ebd0_5707_4873_8f3b_3776de93d36e.slice/crio-da1792764fdd70088130ed0da8f022f2480015f56d7b596c88be6dc39dafcfbd WatchSource:0}: Error finding container da1792764fdd70088130ed0da8f022f2480015f56d7b596c88be6dc39dafcfbd: Status 404 returned error can't find the container with id da1792764fdd70088130ed0da8f022f2480015f56d7b596c88be6dc39dafcfbd Jun 11 19:54:34.590822 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.590795 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-8jqqm"] Jun 11 19:54:34.594950 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.594930 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-8jqqm" Jun 11 19:54:34.597429 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.597403 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 11 19:54:34.597537 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.597486 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-dp84q\"" Jun 11 19:54:34.603441 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.603417 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-8jqqm"] Jun 11 19:54:34.705739 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.705707 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqhnp\" (UniqueName: \"kubernetes.io/projected/9f429c3c-e5ec-4b11-9b3a-82a66848414e-kube-api-access-gqhnp\") pod \"monitoring-plugin-589576dfc7-8jqqm\" (UID: \"9f429c3c-e5ec-4b11-9b3a-82a66848414e\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-8jqqm" Jun 11 19:54:34.705895 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.705781 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f429c3c-e5ec-4b11-9b3a-82a66848414e-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-8jqqm\" (UID: \"9f429c3c-e5ec-4b11-9b3a-82a66848414e\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-8jqqm" Jun 11 19:54:34.806636 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.806606 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqhnp\" (UniqueName: \"kubernetes.io/projected/9f429c3c-e5ec-4b11-9b3a-82a66848414e-kube-api-access-gqhnp\") pod \"monitoring-plugin-589576dfc7-8jqqm\" (UID: \"9f429c3c-e5ec-4b11-9b3a-82a66848414e\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-8jqqm" Jun 11 19:54:34.806791 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.806649 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f429c3c-e5ec-4b11-9b3a-82a66848414e-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-8jqqm\" (UID: \"9f429c3c-e5ec-4b11-9b3a-82a66848414e\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-8jqqm" Jun 11 19:54:34.808990 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.808970 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f429c3c-e5ec-4b11-9b3a-82a66848414e-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-8jqqm\" (UID: \"9f429c3c-e5ec-4b11-9b3a-82a66848414e\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-8jqqm" Jun 11 19:54:34.814200 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.814181 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqhnp\" (UniqueName: \"kubernetes.io/projected/9f429c3c-e5ec-4b11-9b3a-82a66848414e-kube-api-access-gqhnp\") pod \"monitoring-plugin-589576dfc7-8jqqm\" (UID: \"9f429c3c-e5ec-4b11-9b3a-82a66848414e\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-8jqqm" Jun 11 19:54:34.913622 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:34.913542 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-8jqqm" Jun 11 19:54:35.039495 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:35.039472 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-8jqqm"] Jun 11 19:54:35.041379 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:54:35.041351 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f429c3c_e5ec_4b11_9b3a_82a66848414e.slice/crio-b6dbd86347f1803c09713ad3488aeb15ebf5d197b00a5fb9ae0dabea6c0d7106 WatchSource:0}: Error finding container b6dbd86347f1803c09713ad3488aeb15ebf5d197b00a5fb9ae0dabea6c0d7106: Status 404 returned error can't find the container with id b6dbd86347f1803c09713ad3488aeb15ebf5d197b00a5fb9ae0dabea6c0d7106 Jun 11 19:54:35.051633 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:35.051608 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9205e756-671e-472b-92e9-969a60a3f16c","Type":"ContainerStarted","Data":"f5ebf62a23f6837f0e1ece32efb7ea9210d691de0f2618c71677e5f8e7becce2"} Jun 11 19:54:35.051779 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:35.051670 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9205e756-671e-472b-92e9-969a60a3f16c","Type":"ContainerStarted","Data":"880205388d55ed210446d7d3af8f42380c3b8f6bd43d53cd767952950036b992"} Jun 11 19:54:35.051779 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:35.051707 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9205e756-671e-472b-92e9-969a60a3f16c","Type":"ContainerStarted","Data":"5fb115c2a450e1305d04469edd6f941e7e829f67caed27b2b05e0be8e4555983"} Jun 11 19:54:35.051779 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:35.051737 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9205e756-671e-472b-92e9-969a60a3f16c","Type":"ContainerStarted","Data":"9957c30417d1a866502466c7227e0a6ad920723182b9b92d3b35f6d600777397"} Jun 11 19:54:35.051779 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:35.051761 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9205e756-671e-472b-92e9-969a60a3f16c","Type":"ContainerStarted","Data":"bf8fa8ed6f3877af3b3ac78d8b06b4fc4b8420755affb2b95d106c572c52889b"} Jun 11 19:54:35.052666 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:35.052645 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-8jqqm" event={"ID":"9f429c3c-e5ec-4b11-9b3a-82a66848414e","Type":"ContainerStarted","Data":"b6dbd86347f1803c09713ad3488aeb15ebf5d197b00a5fb9ae0dabea6c0d7106"} Jun 11 19:54:35.053618 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:35.053599 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-78d4d9cc5c-h8th6" event={"ID":"1319ebd0-5707-4873-8f3b-3776de93d36e","Type":"ContainerStarted","Data":"da1792764fdd70088130ed0da8f022f2480015f56d7b596c88be6dc39dafcfbd"} Jun 11 19:54:35.989356 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:35.989280 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 19:54:35.993379 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:35.993356 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:35.996596 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:35.996233 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 19:54:35.996596 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:35.996270 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 19:54:35.996596 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:35.996297 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 19:54:35.996596 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:35.996337 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 19:54:35.996596 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:35.996404 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 19:54:35.996596 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:35.996431 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 19:54:35.996596 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:35.996484 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1k8tbc0n82s0o\"" Jun 11 19:54:35.996596 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:35.996536 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 19:54:35.997275 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:35.997256 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-z9tkq\"" Jun 11 19:54:35.997980 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:35.997903 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 19:54:35.998149 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:35.998113 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 19:54:35.998490 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:35.998344 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 19:54:35.998490 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:35.998358 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 19:54:35.998490 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:35.998411 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 19:54:35.998937 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:35.998578 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 19:54:36.000226 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.000211 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 19:54:36.009198 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.009176 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 19:54:36.118968 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.118932 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.119092 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.118979 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.119092 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.119010 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/28a8495b-f068-448f-8375-bbb5451f911b-config-out\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.119092 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.119033 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.119092 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.119056 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.119325 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.119108 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-config\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.119325 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.119143 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-web-config\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.119325 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.119180 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/28a8495b-f068-448f-8375-bbb5451f911b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.119325 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.119217 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.119325 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.119252 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.119325 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.119292 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqrvl\" (UniqueName: \"kubernetes.io/projected/28a8495b-f068-448f-8375-bbb5451f911b-kube-api-access-bqrvl\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.119621 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.119337 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.119621 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.119389 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.119621 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.119414 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.119621 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.119437 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.119621 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.119485 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.119621 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.119516 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.119621 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.119560 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.119621 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.119587 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.119997 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.119624 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/28a8495b-f068-448f-8375-bbb5451f911b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.220320 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.220286 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.220320 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.220325 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.220525 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.220504 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.220588 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.220545 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.220588 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.220572 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/28a8495b-f068-448f-8375-bbb5451f911b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.220785 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.220760 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.220848 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.220804 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.220848 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.220839 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/28a8495b-f068-448f-8375-bbb5451f911b-config-out\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.220956 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.220867 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.220956 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.220895 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.220956 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.220931 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-config\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.221106 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.220956 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-web-config\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.221106 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.220995 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/28a8495b-f068-448f-8375-bbb5451f911b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.221106 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.221023 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.221106 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.221031 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.221106 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.221049 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.221106 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.221067 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.221106 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.221079 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqrvl\" (UniqueName: \"kubernetes.io/projected/28a8495b-f068-448f-8375-bbb5451f911b-kube-api-access-bqrvl\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.221464 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.221152 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.221464 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.221228 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.221464 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.221255 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.221464 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.221279 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.221464 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.221424 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.221718 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.220892 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/28a8495b-f068-448f-8375-bbb5451f911b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.222437 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.222037 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.224790 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.224468 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.225789 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.225745 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.225966 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.225883 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/28a8495b-f068-448f-8375-bbb5451f911b-config-out\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.226301 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.226277 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.226490 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.226464 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.226595 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.226570 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.226650 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.226627 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.226713 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.226678 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-config\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.226841 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.226818 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-web-config\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.226981 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.226963 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.227069 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.227044 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.227186 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.227079 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.227340 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.227320 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.228312 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.228293 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/28a8495b-f068-448f-8375-bbb5451f911b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.229441 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.229420 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqrvl\" (UniqueName: \"kubernetes.io/projected/28a8495b-f068-448f-8375-bbb5451f911b-kube-api-access-bqrvl\") pod \"prometheus-k8s-0\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.311306 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.305582 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:36.465583 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:36.465549 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 19:54:36.753989 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:54:36.753959 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28a8495b_f068_448f_8375_bbb5451f911b.slice/crio-a496f36b884f2efcc20abac0b3316c5ed1030d272f7e0165d2ad962acabfda13 WatchSource:0}: Error finding container a496f36b884f2efcc20abac0b3316c5ed1030d272f7e0165d2ad962acabfda13: Status 404 returned error can't find the container with id a496f36b884f2efcc20abac0b3316c5ed1030d272f7e0165d2ad962acabfda13 Jun 11 19:54:37.064159 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:37.064043 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9205e756-671e-472b-92e9-969a60a3f16c","Type":"ContainerStarted","Data":"30d77409342abaa04525f4eb4179332c5f13f7451d89e005d91c219842932125"} Jun 11 19:54:37.065668 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:37.065635 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-8jqqm" event={"ID":"9f429c3c-e5ec-4b11-9b3a-82a66848414e","Type":"ContainerStarted","Data":"9f3dc7736d67df88fec2fd3449fdcef062c6aace198719f216db63fcb6afbb2c"} Jun 11 19:54:37.065819 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:37.065799 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-8jqqm" Jun 11 19:54:37.067388 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:37.067354 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-78d4d9cc5c-h8th6" event={"ID":"1319ebd0-5707-4873-8f3b-3776de93d36e","Type":"ContainerStarted","Data":"6e988bfd7f3ecc0aa28a0432d930c6863f035a58374d52782cd19ab301b68fed"} Jun 11 19:54:37.069178 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:37.069155 2576 generic.go:356] "Generic (PLEG): container finished" podID="28a8495b-f068-448f-8375-bbb5451f911b" containerID="29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973" exitCode=0 Jun 11 19:54:37.069278 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:37.069214 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"28a8495b-f068-448f-8375-bbb5451f911b","Type":"ContainerDied","Data":"29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973"} Jun 11 19:54:37.069278 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:37.069275 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"28a8495b-f068-448f-8375-bbb5451f911b","Type":"ContainerStarted","Data":"a496f36b884f2efcc20abac0b3316c5ed1030d272f7e0165d2ad962acabfda13"} Jun 11 19:54:37.070891 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:37.070855 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-8jqqm" Jun 11 19:54:37.089676 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:37.089634 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.050975677 podStartE2EDuration="7.089623035s" totalImagesPullingTime="4.016666306s" totalInitContainerRuntime="21.981052ms" isStatefulPod=false podCreationTimestamp="2026-06-11 19:54:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:37.088027034 +0000 UTC m=+277.365787802" watchObservedRunningTime="2026-06-11 19:54:37.089623035 +0000 UTC m=+277.367383793" Jun 11 19:54:37.106659 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:37.106604 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-78d4d9cc5c-h8th6" podStartSLOduration=1.6487714420000001 podStartE2EDuration="3.10658641s" totalImagesPullingTime="1.457814968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:54:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:37.105224508 +0000 UTC m=+277.382985266" watchObservedRunningTime="2026-06-11 19:54:37.10658641 +0000 UTC m=+277.384347169" Jun 11 19:54:37.124318 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:37.124278 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-8jqqm" podStartSLOduration=1.361173954 podStartE2EDuration="3.124265475s" totalImagesPullingTime="1.763091521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:54:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:37.123573437 +0000 UTC m=+277.401334222" watchObservedRunningTime="2026-06-11 19:54:37.124265475 +0000 UTC m=+277.402026233" Jun 11 19:54:40.089115 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:40.089073 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"28a8495b-f068-448f-8375-bbb5451f911b","Type":"ContainerStarted","Data":"b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8"} Jun 11 19:54:40.089618 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:40.089219 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"28a8495b-f068-448f-8375-bbb5451f911b","Type":"ContainerStarted","Data":"4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5"} Jun 11 19:54:41.674717 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:54:41.674671 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" podUID="d7079aa1-df0b-45cc-9c97-c2ae18aa1520" Jun 11 19:54:42.097628 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:42.097600 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:54:42.677287 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:54:42.677196 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nqlv6" podUID="783f40b5-7d52-4433-9c0d-3bd61ebe9100" Jun 11 19:54:43.104101 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:43.104066 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nqlv6" Jun 11 19:54:43.104281 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:43.104093 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"28a8495b-f068-448f-8375-bbb5451f911b","Type":"ContainerStarted","Data":"d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656"} Jun 11 19:54:43.104281 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:43.104174 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"28a8495b-f068-448f-8375-bbb5451f911b","Type":"ContainerStarted","Data":"10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092"} Jun 11 19:54:43.104281 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:43.104204 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"28a8495b-f068-448f-8375-bbb5451f911b","Type":"ContainerStarted","Data":"bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd"} Jun 11 19:54:43.104281 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:43.104229 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"28a8495b-f068-448f-8375-bbb5451f911b","Type":"ContainerStarted","Data":"fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a"} Jun 11 19:54:43.133797 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:43.133750 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.181391675 podStartE2EDuration="8.133735841s" totalImagesPullingTime="4.930870899s" totalInitContainerRuntime="21.473267ms" isStatefulPod=false podCreationTimestamp="2026-06-11 19:54:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:43.13058602 +0000 UTC m=+283.408346783" watchObservedRunningTime="2026-06-11 19:54:43.133735841 +0000 UTC m=+283.411496596" Jun 11 19:54:45.612485 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:45.612444 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-tls\") pod \"image-registry-84f479d4df-xxq5c\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:54:45.612874 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:45.612535 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/783f40b5-7d52-4433-9c0d-3bd61ebe9100-metrics-tls\") pod \"dns-default-nqlv6\" (UID: \"783f40b5-7d52-4433-9c0d-3bd61ebe9100\") " pod="openshift-dns/dns-default-nqlv6" Jun 11 19:54:45.614988 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:45.614961 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-tls\") pod \"image-registry-84f479d4df-xxq5c\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:54:45.615100 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:45.614961 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/783f40b5-7d52-4433-9c0d-3bd61ebe9100-metrics-tls\") pod \"dns-default-nqlv6\" (UID: \"783f40b5-7d52-4433-9c0d-3bd61ebe9100\") " pod="openshift-dns/dns-default-nqlv6" Jun 11 19:54:45.701222 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:45.701190 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zmxhm\"" Jun 11 19:54:45.709420 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:45.709399 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:54:45.807872 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:45.807847 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rb2ld\"" Jun 11 19:54:45.816078 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:45.816052 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nqlv6" Jun 11 19:54:45.838427 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:45.838391 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-84f479d4df-xxq5c"] Jun 11 19:54:45.841044 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:54:45.841023 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7079aa1_df0b_45cc_9c97_c2ae18aa1520.slice/crio-61be43eebceb3c650a4a63d81419477bcc1291bcea07f4a6c7fdb450fc53f719 WatchSource:0}: Error finding container 61be43eebceb3c650a4a63d81419477bcc1291bcea07f4a6c7fdb450fc53f719: Status 404 returned error can't find the container with id 61be43eebceb3c650a4a63d81419477bcc1291bcea07f4a6c7fdb450fc53f719 Jun 11 19:54:45.947837 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:45.947803 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nqlv6"] Jun 11 19:54:45.950775 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:54:45.950749 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod783f40b5_7d52_4433_9c0d_3bd61ebe9100.slice/crio-90ace39495612615d117bc8459bf88948b0ba7d0794b3eebf7c354e0cf03ba8b WatchSource:0}: Error finding container 90ace39495612615d117bc8459bf88948b0ba7d0794b3eebf7c354e0cf03ba8b: Status 404 returned error can't find the container with id 90ace39495612615d117bc8459bf88948b0ba7d0794b3eebf7c354e0cf03ba8b Jun 11 19:54:46.116601 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:46.116568 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" event={"ID":"d7079aa1-df0b-45cc-9c97-c2ae18aa1520","Type":"ContainerStarted","Data":"1b4977ce9567a738f4ee2e0e893a88f4b0c320f1ae9514d973d9e2802ca6a537"} Jun 11 19:54:46.116788 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:46.116626 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" event={"ID":"d7079aa1-df0b-45cc-9c97-c2ae18aa1520","Type":"ContainerStarted","Data":"61be43eebceb3c650a4a63d81419477bcc1291bcea07f4a6c7fdb450fc53f719"} Jun 11 19:54:46.116788 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:46.116653 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:54:46.117775 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:46.117715 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nqlv6" event={"ID":"783f40b5-7d52-4433-9c0d-3bd61ebe9100","Type":"ContainerStarted","Data":"90ace39495612615d117bc8459bf88948b0ba7d0794b3eebf7c354e0cf03ba8b"} Jun 11 19:54:46.138242 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:46.138193 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" podStartSLOduration=286.138179441 podStartE2EDuration="4m46.138179441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:50:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:46.136537265 +0000 UTC m=+286.414298027" watchObservedRunningTime="2026-06-11 19:54:46.138179441 +0000 UTC m=+286.415940236" Jun 11 19:54:46.306354 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:46.306307 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:54:48.127513 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:48.127479 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nqlv6" event={"ID":"783f40b5-7d52-4433-9c0d-3bd61ebe9100","Type":"ContainerStarted","Data":"bd6b3035f52a1236db4158fc67c1173878657f4c173cbdcba0c60157d98b5c58"} Jun 11 19:54:48.127895 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:48.127566 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nqlv6" event={"ID":"783f40b5-7d52-4433-9c0d-3bd61ebe9100","Type":"ContainerStarted","Data":"2305d266d2aacbe4e0890c756b8e618fa8f352c8b7b9863ca04a8d8a161009bd"} Jun 11 19:54:48.127895 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:48.127600 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nqlv6" Jun 11 19:54:48.146743 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:48.146699 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-nqlv6" podStartSLOduration=251.444414193 podStartE2EDuration="4m13.146684549s" totalImagesPullingTime="1.702270356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:50:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:48.144363506 +0000 UTC m=+288.422124302" watchObservedRunningTime="2026-06-11 19:54:48.146684549 +0000 UTC m=+288.424445307" Jun 11 19:54:54.416705 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:54.416675 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-78d4d9cc5c-h8th6" Jun 11 19:54:54.417094 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:54.416750 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-78d4d9cc5c-h8th6" Jun 11 19:54:58.133834 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:54:58.133803 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nqlv6" Jun 11 19:55:00.150513 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:00.150485 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9pxm2_23de3c36-7fd1-4a71-9bff-dd7782544ca4/console-operator/1.log" Jun 11 19:55:00.150948 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:00.150577 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9pxm2_23de3c36-7fd1-4a71-9bff-dd7782544ca4/console-operator/1.log" Jun 11 19:55:00.154673 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:00.154652 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hrb9t_85a48db4-30bf-47f2-9668-8b0a67c26fe4/ovn-acl-logging/0.log" Jun 11 19:55:00.154783 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:00.154654 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hrb9t_85a48db4-30bf-47f2-9668-8b0a67c26fe4/ovn-acl-logging/0.log" Jun 11 19:55:00.161283 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:00.161266 2576 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 19:55:05.714202 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:05.714165 2576 patch_prober.go:28] interesting pod/image-registry-84f479d4df-xxq5c container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 19:55:05.719778 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:05.714214 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" podUID="d7079aa1-df0b-45cc-9c97-c2ae18aa1520" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 19:55:07.126141 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:07.126093 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:55:07.410575 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:07.410489 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nqlv6_783f40b5-7d52-4433-9c0d-3bd61ebe9100/dns/0.log" Jun 11 19:55:07.610681 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:07.610641 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nqlv6_783f40b5-7d52-4433-9c0d-3bd61ebe9100/kube-rbac-proxy/0.log" Jun 11 19:55:09.009737 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:09.009713 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rgjlh_226f79e5-5702-495b-8ffd-d60cd1e68f19/dns-node-resolver/0.log" Jun 11 19:55:09.409754 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:09.409727 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-84f479d4df-xxq5c_d7079aa1-df0b-45cc-9c97-c2ae18aa1520/registry/0.log" Jun 11 19:55:09.610470 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:09.610434 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mc6x6_98cc5ec8-4790-4b36-a80d-df6d5d1e8bf6/node-ca/0.log" Jun 11 19:55:10.611112 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:10.611084 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-76x6k_783eb1a7-0a40-4ad8-9705-e9df073f3194/serve-healthcheck-canary/0.log" Jun 11 19:55:14.421369 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:14.421333 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-78d4d9cc5c-h8th6" Jun 11 19:55:14.425264 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:14.425239 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-78d4d9cc5c-h8th6" Jun 11 19:55:16.515401 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:16.515366 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-84f479d4df-xxq5c"] Jun 11 19:55:36.305779 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:36.305745 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:36.323792 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:36.323765 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:36.338154 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:36.338113 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:41.535277 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:41.535176 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" podUID="d7079aa1-df0b-45cc-9c97-c2ae18aa1520" containerName="registry" containerID="cri-o://1b4977ce9567a738f4ee2e0e893a88f4b0c320f1ae9514d973d9e2802ca6a537" gracePeriod=30 Jun 11 19:55:42.783181 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:42.783152 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:55:42.884138 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:42.884072 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-tls\") pod \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " Jun 11 19:55:42.884330 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:42.884190 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-image-registry-private-configuration\") pod \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " Jun 11 19:55:42.884330 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:42.884219 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-trusted-ca\") pod \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " Jun 11 19:55:42.884330 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:42.884281 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-ca-trust-extracted\") pod \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " Jun 11 19:55:42.884330 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:42.884316 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmth6\" (UniqueName: \"kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-kube-api-access-jmth6\") pod \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " Jun 11 19:55:42.884538 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:42.884343 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-installation-pull-secrets\") pod \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " Jun 11 19:55:42.884538 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:42.884374 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-certificates\") pod \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " Jun 11 19:55:42.884538 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:42.884444 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-bound-sa-token\") pod \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\" (UID: \"d7079aa1-df0b-45cc-9c97-c2ae18aa1520\") " Jun 11 19:55:42.884776 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:42.884712 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d7079aa1-df0b-45cc-9c97-c2ae18aa1520" (UID: "d7079aa1-df0b-45cc-9c97-c2ae18aa1520"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:55:42.884916 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:42.884843 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d7079aa1-df0b-45cc-9c97-c2ae18aa1520" (UID: "d7079aa1-df0b-45cc-9c97-c2ae18aa1520"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:55:42.886817 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:42.886788 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d7079aa1-df0b-45cc-9c97-c2ae18aa1520" (UID: "d7079aa1-df0b-45cc-9c97-c2ae18aa1520"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:55:42.886937 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:42.886881 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d7079aa1-df0b-45cc-9c97-c2ae18aa1520" (UID: "d7079aa1-df0b-45cc-9c97-c2ae18aa1520"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:55:42.887002 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:42.886939 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-kube-api-access-jmth6" (OuterVolumeSpecName: "kube-api-access-jmth6") pod "d7079aa1-df0b-45cc-9c97-c2ae18aa1520" (UID: "d7079aa1-df0b-45cc-9c97-c2ae18aa1520"). InnerVolumeSpecName "kube-api-access-jmth6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:55:42.887057 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:42.887017 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d7079aa1-df0b-45cc-9c97-c2ae18aa1520" (UID: "d7079aa1-df0b-45cc-9c97-c2ae18aa1520"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:55:42.887191 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:42.887173 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d7079aa1-df0b-45cc-9c97-c2ae18aa1520" (UID: "d7079aa1-df0b-45cc-9c97-c2ae18aa1520"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:55:42.893239 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:42.893214 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d7079aa1-df0b-45cc-9c97-c2ae18aa1520" (UID: "d7079aa1-df0b-45cc-9c97-c2ae18aa1520"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:55:42.985779 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:42.985748 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-bound-sa-token\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:42.985779 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:42.985773 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-tls\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:42.985779 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:42.985783 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-image-registry-private-configuration\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:42.985985 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:42.985792 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-trusted-ca\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:42.985985 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:42.985803 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-ca-trust-extracted\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:42.985985 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:42.985811 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmth6\" (UniqueName: \"kubernetes.io/projected/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-kube-api-access-jmth6\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:42.985985 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:42.985820 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-installation-pull-secrets\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:42.985985 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:42.985828 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d7079aa1-df0b-45cc-9c97-c2ae18aa1520-registry-certificates\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:43.340708 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:43.340624 2576 generic.go:356] "Generic (PLEG): container finished" podID="d7079aa1-df0b-45cc-9c97-c2ae18aa1520" containerID="1b4977ce9567a738f4ee2e0e893a88f4b0c320f1ae9514d973d9e2802ca6a537" exitCode=0 Jun 11 19:55:43.340708 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:43.340670 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" Jun 11 19:55:43.340874 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:43.340710 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" event={"ID":"d7079aa1-df0b-45cc-9c97-c2ae18aa1520","Type":"ContainerDied","Data":"1b4977ce9567a738f4ee2e0e893a88f4b0c320f1ae9514d973d9e2802ca6a537"} Jun 11 19:55:43.340874 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:43.340761 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84f479d4df-xxq5c" event={"ID":"d7079aa1-df0b-45cc-9c97-c2ae18aa1520","Type":"ContainerDied","Data":"61be43eebceb3c650a4a63d81419477bcc1291bcea07f4a6c7fdb450fc53f719"} Jun 11 19:55:43.340874 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:43.340787 2576 scope.go:117] "RemoveContainer" containerID="1b4977ce9567a738f4ee2e0e893a88f4b0c320f1ae9514d973d9e2802ca6a537" Jun 11 19:55:43.349215 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:43.349196 2576 scope.go:117] "RemoveContainer" containerID="1b4977ce9567a738f4ee2e0e893a88f4b0c320f1ae9514d973d9e2802ca6a537" Jun 11 19:55:43.349472 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:55:43.349454 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b4977ce9567a738f4ee2e0e893a88f4b0c320f1ae9514d973d9e2802ca6a537\": container with ID starting with 1b4977ce9567a738f4ee2e0e893a88f4b0c320f1ae9514d973d9e2802ca6a537 not found: ID does not exist" containerID="1b4977ce9567a738f4ee2e0e893a88f4b0c320f1ae9514d973d9e2802ca6a537" Jun 11 19:55:43.349542 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:43.349483 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b4977ce9567a738f4ee2e0e893a88f4b0c320f1ae9514d973d9e2802ca6a537"} err="failed to get container status \"1b4977ce9567a738f4ee2e0e893a88f4b0c320f1ae9514d973d9e2802ca6a537\": rpc error: code = NotFound desc = could not find container \"1b4977ce9567a738f4ee2e0e893a88f4b0c320f1ae9514d973d9e2802ca6a537\": container with ID starting with 1b4977ce9567a738f4ee2e0e893a88f4b0c320f1ae9514d973d9e2802ca6a537 not found: ID does not exist" Jun 11 19:55:43.360684 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:43.360665 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-84f479d4df-xxq5c"] Jun 11 19:55:43.363836 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:43.363815 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-84f479d4df-xxq5c"] Jun 11 19:55:44.195853 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:44.195822 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7079aa1-df0b-45cc-9c97-c2ae18aa1520" path="/var/lib/kubelet/pods/d7079aa1-df0b-45cc-9c97-c2ae18aa1520/volumes" Jun 11 19:55:50.083463 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:50.083427 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 19:55:50.083986 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:50.083729 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9205e756-671e-472b-92e9-969a60a3f16c" containerName="alertmanager" containerID="cri-o://bf8fa8ed6f3877af3b3ac78d8b06b4fc4b8420755affb2b95d106c572c52889b" gracePeriod=120 Jun 11 19:55:50.083986 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:50.083764 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9205e756-671e-472b-92e9-969a60a3f16c" containerName="kube-rbac-proxy-metric" containerID="cri-o://f5ebf62a23f6837f0e1ece32efb7ea9210d691de0f2618c71677e5f8e7becce2" gracePeriod=120 Jun 11 19:55:50.084166 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:50.083836 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9205e756-671e-472b-92e9-969a60a3f16c" containerName="prom-label-proxy" containerID="cri-o://30d77409342abaa04525f4eb4179332c5f13f7451d89e005d91c219842932125" gracePeriod=120 Jun 11 19:55:50.084726 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:50.083860 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9205e756-671e-472b-92e9-969a60a3f16c" containerName="config-reloader" containerID="cri-o://9957c30417d1a866502466c7227e0a6ad920723182b9b92d3b35f6d600777397" gracePeriod=120 Jun 11 19:55:50.084726 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:50.083863 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9205e756-671e-472b-92e9-969a60a3f16c" containerName="kube-rbac-proxy-web" containerID="cri-o://5fb115c2a450e1305d04469edd6f941e7e829f67caed27b2b05e0be8e4555983" gracePeriod=120 Jun 11 19:55:50.084726 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:50.083886 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9205e756-671e-472b-92e9-969a60a3f16c" containerName="kube-rbac-proxy" containerID="cri-o://880205388d55ed210446d7d3af8f42380c3b8f6bd43d53cd767952950036b992" gracePeriod=120 Jun 11 19:55:50.373217 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:50.373185 2576 generic.go:356] "Generic (PLEG): container finished" podID="9205e756-671e-472b-92e9-969a60a3f16c" containerID="30d77409342abaa04525f4eb4179332c5f13f7451d89e005d91c219842932125" exitCode=0 Jun 11 19:55:50.373217 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:50.373209 2576 generic.go:356] "Generic (PLEG): container finished" podID="9205e756-671e-472b-92e9-969a60a3f16c" containerID="880205388d55ed210446d7d3af8f42380c3b8f6bd43d53cd767952950036b992" exitCode=0 Jun 11 19:55:50.373217 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:50.373217 2576 generic.go:356] "Generic (PLEG): container finished" podID="9205e756-671e-472b-92e9-969a60a3f16c" containerID="9957c30417d1a866502466c7227e0a6ad920723182b9b92d3b35f6d600777397" exitCode=0 Jun 11 19:55:50.373217 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:50.373222 2576 generic.go:356] "Generic (PLEG): container finished" podID="9205e756-671e-472b-92e9-969a60a3f16c" containerID="bf8fa8ed6f3877af3b3ac78d8b06b4fc4b8420755affb2b95d106c572c52889b" exitCode=0 Jun 11 19:55:50.373455 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:50.373257 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9205e756-671e-472b-92e9-969a60a3f16c","Type":"ContainerDied","Data":"30d77409342abaa04525f4eb4179332c5f13f7451d89e005d91c219842932125"} Jun 11 19:55:50.373455 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:50.373324 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9205e756-671e-472b-92e9-969a60a3f16c","Type":"ContainerDied","Data":"880205388d55ed210446d7d3af8f42380c3b8f6bd43d53cd767952950036b992"} Jun 11 19:55:50.373455 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:50.373351 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9205e756-671e-472b-92e9-969a60a3f16c","Type":"ContainerDied","Data":"9957c30417d1a866502466c7227e0a6ad920723182b9b92d3b35f6d600777397"} Jun 11 19:55:50.373455 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:50.373376 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9205e756-671e-472b-92e9-969a60a3f16c","Type":"ContainerDied","Data":"bf8fa8ed6f3877af3b3ac78d8b06b4fc4b8420755affb2b95d106c572c52889b"} Jun 11 19:55:51.335155 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.335035 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.357427 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.357403 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-config-volume\") pod \"9205e756-671e-472b-92e9-969a60a3f16c\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " Jun 11 19:55:51.357583 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.357439 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9205e756-671e-472b-92e9-969a60a3f16c-alertmanager-trusted-ca-bundle\") pod \"9205e756-671e-472b-92e9-969a60a3f16c\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " Jun 11 19:55:51.357583 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.357479 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9205e756-671e-472b-92e9-969a60a3f16c-config-out\") pod \"9205e756-671e-472b-92e9-969a60a3f16c\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " Jun 11 19:55:51.357583 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.357511 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-secret-alertmanager-kube-rbac-proxy-web\") pod \"9205e756-671e-472b-92e9-969a60a3f16c\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " Jun 11 19:55:51.357583 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.357530 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-web-config\") pod \"9205e756-671e-472b-92e9-969a60a3f16c\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " Jun 11 19:55:51.357583 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.357562 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqnml\" (UniqueName: \"kubernetes.io/projected/9205e756-671e-472b-92e9-969a60a3f16c-kube-api-access-vqnml\") pod \"9205e756-671e-472b-92e9-969a60a3f16c\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " Jun 11 19:55:51.357901 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.357588 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9205e756-671e-472b-92e9-969a60a3f16c-metrics-client-ca\") pod \"9205e756-671e-472b-92e9-969a60a3f16c\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " Jun 11 19:55:51.357901 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.357612 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"9205e756-671e-472b-92e9-969a60a3f16c\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " Jun 11 19:55:51.357901 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.357657 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9205e756-671e-472b-92e9-969a60a3f16c-alertmanager-main-db\") pod \"9205e756-671e-472b-92e9-969a60a3f16c\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " Jun 11 19:55:51.357901 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.357685 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-secret-alertmanager-kube-rbac-proxy\") pod \"9205e756-671e-472b-92e9-969a60a3f16c\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " Jun 11 19:55:51.357901 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.357719 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-secret-alertmanager-main-tls\") pod \"9205e756-671e-472b-92e9-969a60a3f16c\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " Jun 11 19:55:51.357901 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.357753 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-cluster-tls-config\") pod \"9205e756-671e-472b-92e9-969a60a3f16c\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " Jun 11 19:55:51.357901 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.357789 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9205e756-671e-472b-92e9-969a60a3f16c-tls-assets\") pod \"9205e756-671e-472b-92e9-969a60a3f16c\" (UID: \"9205e756-671e-472b-92e9-969a60a3f16c\") " Jun 11 19:55:51.357901 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.357849 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9205e756-671e-472b-92e9-969a60a3f16c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "9205e756-671e-472b-92e9-969a60a3f16c" (UID: "9205e756-671e-472b-92e9-969a60a3f16c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:55:51.358325 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.358195 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9205e756-671e-472b-92e9-969a60a3f16c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "9205e756-671e-472b-92e9-969a60a3f16c" (UID: "9205e756-671e-472b-92e9-969a60a3f16c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:55:51.358325 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.358224 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9205e756-671e-472b-92e9-969a60a3f16c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:51.358325 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.358265 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9205e756-671e-472b-92e9-969a60a3f16c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "9205e756-671e-472b-92e9-969a60a3f16c" (UID: "9205e756-671e-472b-92e9-969a60a3f16c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:55:51.361438 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.361043 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9205e756-671e-472b-92e9-969a60a3f16c-kube-api-access-vqnml" (OuterVolumeSpecName: "kube-api-access-vqnml") pod "9205e756-671e-472b-92e9-969a60a3f16c" (UID: "9205e756-671e-472b-92e9-969a60a3f16c"). InnerVolumeSpecName "kube-api-access-vqnml". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:55:51.361815 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.361788 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "9205e756-671e-472b-92e9-969a60a3f16c" (UID: "9205e756-671e-472b-92e9-969a60a3f16c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:55:51.362439 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.362371 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "9205e756-671e-472b-92e9-969a60a3f16c" (UID: "9205e756-671e-472b-92e9-969a60a3f16c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:55:51.362747 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.362720 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-config-volume" (OuterVolumeSpecName: "config-volume") pod "9205e756-671e-472b-92e9-969a60a3f16c" (UID: "9205e756-671e-472b-92e9-969a60a3f16c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:55:51.362899 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.362776 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9205e756-671e-472b-92e9-969a60a3f16c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9205e756-671e-472b-92e9-969a60a3f16c" (UID: "9205e756-671e-472b-92e9-969a60a3f16c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:55:51.363204 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.363183 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9205e756-671e-472b-92e9-969a60a3f16c-config-out" (OuterVolumeSpecName: "config-out") pod "9205e756-671e-472b-92e9-969a60a3f16c" (UID: "9205e756-671e-472b-92e9-969a60a3f16c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:55:51.364468 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.364432 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "9205e756-671e-472b-92e9-969a60a3f16c" (UID: "9205e756-671e-472b-92e9-969a60a3f16c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:55:51.364827 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.364786 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "9205e756-671e-472b-92e9-969a60a3f16c" (UID: "9205e756-671e-472b-92e9-969a60a3f16c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:55:51.368282 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.368257 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "9205e756-671e-472b-92e9-969a60a3f16c" (UID: "9205e756-671e-472b-92e9-969a60a3f16c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:55:51.376765 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.376737 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-web-config" (OuterVolumeSpecName: "web-config") pod "9205e756-671e-472b-92e9-969a60a3f16c" (UID: "9205e756-671e-472b-92e9-969a60a3f16c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:55:51.381635 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.381577 2576 generic.go:356] "Generic (PLEG): container finished" podID="9205e756-671e-472b-92e9-969a60a3f16c" containerID="f5ebf62a23f6837f0e1ece32efb7ea9210d691de0f2618c71677e5f8e7becce2" exitCode=0 Jun 11 19:55:51.381635 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.381600 2576 generic.go:356] "Generic (PLEG): container finished" podID="9205e756-671e-472b-92e9-969a60a3f16c" containerID="5fb115c2a450e1305d04469edd6f941e7e829f67caed27b2b05e0be8e4555983" exitCode=0 Jun 11 19:55:51.381784 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.381658 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9205e756-671e-472b-92e9-969a60a3f16c","Type":"ContainerDied","Data":"f5ebf62a23f6837f0e1ece32efb7ea9210d691de0f2618c71677e5f8e7becce2"} Jun 11 19:55:51.381784 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.381674 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.381784 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.381753 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9205e756-671e-472b-92e9-969a60a3f16c","Type":"ContainerDied","Data":"5fb115c2a450e1305d04469edd6f941e7e829f67caed27b2b05e0be8e4555983"} Jun 11 19:55:51.381911 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.381790 2576 scope.go:117] "RemoveContainer" containerID="30d77409342abaa04525f4eb4179332c5f13f7451d89e005d91c219842932125" Jun 11 19:55:51.381911 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.381800 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9205e756-671e-472b-92e9-969a60a3f16c","Type":"ContainerDied","Data":"cb94199b36b011eb0977dc888b4bd6bc79fd65640f381aacaa28c2190bb84b7e"} Jun 11 19:55:51.390278 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.390155 2576 scope.go:117] "RemoveContainer" containerID="f5ebf62a23f6837f0e1ece32efb7ea9210d691de0f2618c71677e5f8e7becce2" Jun 11 19:55:51.397834 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.397813 2576 scope.go:117] "RemoveContainer" containerID="880205388d55ed210446d7d3af8f42380c3b8f6bd43d53cd767952950036b992" Jun 11 19:55:51.404955 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.404930 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 19:55:51.405285 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.405267 2576 scope.go:117] "RemoveContainer" containerID="5fb115c2a450e1305d04469edd6f941e7e829f67caed27b2b05e0be8e4555983" Jun 11 19:55:51.410132 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.410088 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 19:55:51.412605 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.412572 2576 scope.go:117] "RemoveContainer" containerID="9957c30417d1a866502466c7227e0a6ad920723182b9b92d3b35f6d600777397" Jun 11 19:55:51.420534 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.420517 2576 scope.go:117] "RemoveContainer" containerID="bf8fa8ed6f3877af3b3ac78d8b06b4fc4b8420755affb2b95d106c572c52889b" Jun 11 19:55:51.427828 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.427811 2576 scope.go:117] "RemoveContainer" containerID="7517c6c0a45ccbcffb50d458357167959069175eb3527cee3f593240b2c16024" Jun 11 19:55:51.433769 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.433747 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 19:55:51.434022 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.434010 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9205e756-671e-472b-92e9-969a60a3f16c" containerName="alertmanager" Jun 11 19:55:51.434086 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.434024 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9205e756-671e-472b-92e9-969a60a3f16c" containerName="alertmanager" Jun 11 19:55:51.434086 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.434036 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9205e756-671e-472b-92e9-969a60a3f16c" containerName="kube-rbac-proxy-web" Jun 11 19:55:51.434086 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.434041 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9205e756-671e-472b-92e9-969a60a3f16c" containerName="kube-rbac-proxy-web" Jun 11 19:55:51.434086 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.434049 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9205e756-671e-472b-92e9-969a60a3f16c" containerName="kube-rbac-proxy-metric" Jun 11 19:55:51.434086 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.434054 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9205e756-671e-472b-92e9-969a60a3f16c" containerName="kube-rbac-proxy-metric" Jun 11 19:55:51.434086 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.434063 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9205e756-671e-472b-92e9-969a60a3f16c" containerName="config-reloader" Jun 11 19:55:51.434086 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.434068 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9205e756-671e-472b-92e9-969a60a3f16c" containerName="config-reloader" Jun 11 19:55:51.434086 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.434075 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7079aa1-df0b-45cc-9c97-c2ae18aa1520" containerName="registry" Jun 11 19:55:51.434086 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.434081 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7079aa1-df0b-45cc-9c97-c2ae18aa1520" containerName="registry" Jun 11 19:55:51.434086 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.434088 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9205e756-671e-472b-92e9-969a60a3f16c" containerName="init-config-reloader" Jun 11 19:55:51.434379 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.434094 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9205e756-671e-472b-92e9-969a60a3f16c" containerName="init-config-reloader" Jun 11 19:55:51.434379 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.434103 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9205e756-671e-472b-92e9-969a60a3f16c" containerName="kube-rbac-proxy" Jun 11 19:55:51.434379 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.434108 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9205e756-671e-472b-92e9-969a60a3f16c" containerName="kube-rbac-proxy" Jun 11 19:55:51.434379 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.434118 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9205e756-671e-472b-92e9-969a60a3f16c" containerName="prom-label-proxy" Jun 11 19:55:51.434379 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.434149 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9205e756-671e-472b-92e9-969a60a3f16c" containerName="prom-label-proxy" Jun 11 19:55:51.434379 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.434192 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9205e756-671e-472b-92e9-969a60a3f16c" containerName="alertmanager" Jun 11 19:55:51.434379 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.434200 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9205e756-671e-472b-92e9-969a60a3f16c" containerName="kube-rbac-proxy-web" Jun 11 19:55:51.434379 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.434205 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9205e756-671e-472b-92e9-969a60a3f16c" containerName="kube-rbac-proxy-metric" Jun 11 19:55:51.434379 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.434212 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9205e756-671e-472b-92e9-969a60a3f16c" containerName="kube-rbac-proxy" Jun 11 19:55:51.434379 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.434219 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9205e756-671e-472b-92e9-969a60a3f16c" containerName="prom-label-proxy" Jun 11 19:55:51.434379 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.434224 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7079aa1-df0b-45cc-9c97-c2ae18aa1520" containerName="registry" Jun 11 19:55:51.434379 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.434229 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9205e756-671e-472b-92e9-969a60a3f16c" containerName="config-reloader" Jun 11 19:55:51.435413 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.435397 2576 scope.go:117] "RemoveContainer" containerID="30d77409342abaa04525f4eb4179332c5f13f7451d89e005d91c219842932125" Jun 11 19:55:51.435694 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:55:51.435677 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30d77409342abaa04525f4eb4179332c5f13f7451d89e005d91c219842932125\": container with ID starting with 30d77409342abaa04525f4eb4179332c5f13f7451d89e005d91c219842932125 not found: ID does not exist" containerID="30d77409342abaa04525f4eb4179332c5f13f7451d89e005d91c219842932125" Jun 11 19:55:51.435745 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.435703 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30d77409342abaa04525f4eb4179332c5f13f7451d89e005d91c219842932125"} err="failed to get container status \"30d77409342abaa04525f4eb4179332c5f13f7451d89e005d91c219842932125\": rpc error: code = NotFound desc = could not find container \"30d77409342abaa04525f4eb4179332c5f13f7451d89e005d91c219842932125\": container with ID starting with 30d77409342abaa04525f4eb4179332c5f13f7451d89e005d91c219842932125 not found: ID does not exist" Jun 11 19:55:51.435745 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.435719 2576 scope.go:117] "RemoveContainer" containerID="f5ebf62a23f6837f0e1ece32efb7ea9210d691de0f2618c71677e5f8e7becce2" Jun 11 19:55:51.435948 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:55:51.435930 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5ebf62a23f6837f0e1ece32efb7ea9210d691de0f2618c71677e5f8e7becce2\": container with ID starting with f5ebf62a23f6837f0e1ece32efb7ea9210d691de0f2618c71677e5f8e7becce2 not found: ID does not exist" containerID="f5ebf62a23f6837f0e1ece32efb7ea9210d691de0f2618c71677e5f8e7becce2" Jun 11 19:55:51.435987 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.435955 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5ebf62a23f6837f0e1ece32efb7ea9210d691de0f2618c71677e5f8e7becce2"} err="failed to get container status \"f5ebf62a23f6837f0e1ece32efb7ea9210d691de0f2618c71677e5f8e7becce2\": rpc error: code = NotFound desc = could not find container \"f5ebf62a23f6837f0e1ece32efb7ea9210d691de0f2618c71677e5f8e7becce2\": container with ID starting with f5ebf62a23f6837f0e1ece32efb7ea9210d691de0f2618c71677e5f8e7becce2 not found: ID does not exist" Jun 11 19:55:51.435987 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.435971 2576 scope.go:117] "RemoveContainer" containerID="880205388d55ed210446d7d3af8f42380c3b8f6bd43d53cd767952950036b992" Jun 11 19:55:51.436226 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:55:51.436194 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"880205388d55ed210446d7d3af8f42380c3b8f6bd43d53cd767952950036b992\": container with ID starting with 880205388d55ed210446d7d3af8f42380c3b8f6bd43d53cd767952950036b992 not found: ID does not exist" containerID="880205388d55ed210446d7d3af8f42380c3b8f6bd43d53cd767952950036b992" Jun 11 19:55:51.436305 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.436226 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"880205388d55ed210446d7d3af8f42380c3b8f6bd43d53cd767952950036b992"} err="failed to get container status \"880205388d55ed210446d7d3af8f42380c3b8f6bd43d53cd767952950036b992\": rpc error: code = NotFound desc = could not find container \"880205388d55ed210446d7d3af8f42380c3b8f6bd43d53cd767952950036b992\": container with ID starting with 880205388d55ed210446d7d3af8f42380c3b8f6bd43d53cd767952950036b992 not found: ID does not exist" Jun 11 19:55:51.436305 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.436247 2576 scope.go:117] "RemoveContainer" containerID="5fb115c2a450e1305d04469edd6f941e7e829f67caed27b2b05e0be8e4555983" Jun 11 19:55:51.436515 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:55:51.436495 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fb115c2a450e1305d04469edd6f941e7e829f67caed27b2b05e0be8e4555983\": container with ID starting with 5fb115c2a450e1305d04469edd6f941e7e829f67caed27b2b05e0be8e4555983 not found: ID does not exist" containerID="5fb115c2a450e1305d04469edd6f941e7e829f67caed27b2b05e0be8e4555983" Jun 11 19:55:51.436559 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.436522 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fb115c2a450e1305d04469edd6f941e7e829f67caed27b2b05e0be8e4555983"} err="failed to get container status \"5fb115c2a450e1305d04469edd6f941e7e829f67caed27b2b05e0be8e4555983\": rpc error: code = NotFound desc = could not find container \"5fb115c2a450e1305d04469edd6f941e7e829f67caed27b2b05e0be8e4555983\": container with ID starting with 5fb115c2a450e1305d04469edd6f941e7e829f67caed27b2b05e0be8e4555983 not found: ID does not exist" Jun 11 19:55:51.436559 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.436540 2576 scope.go:117] "RemoveContainer" containerID="9957c30417d1a866502466c7227e0a6ad920723182b9b92d3b35f6d600777397" Jun 11 19:55:51.436777 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:55:51.436759 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9957c30417d1a866502466c7227e0a6ad920723182b9b92d3b35f6d600777397\": container with ID starting with 9957c30417d1a866502466c7227e0a6ad920723182b9b92d3b35f6d600777397 not found: ID does not exist" containerID="9957c30417d1a866502466c7227e0a6ad920723182b9b92d3b35f6d600777397" Jun 11 19:55:51.436847 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.436783 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9957c30417d1a866502466c7227e0a6ad920723182b9b92d3b35f6d600777397"} err="failed to get container status \"9957c30417d1a866502466c7227e0a6ad920723182b9b92d3b35f6d600777397\": rpc error: code = NotFound desc = could not find container \"9957c30417d1a866502466c7227e0a6ad920723182b9b92d3b35f6d600777397\": container with ID starting with 9957c30417d1a866502466c7227e0a6ad920723182b9b92d3b35f6d600777397 not found: ID does not exist" Jun 11 19:55:51.436847 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.436801 2576 scope.go:117] "RemoveContainer" containerID="bf8fa8ed6f3877af3b3ac78d8b06b4fc4b8420755affb2b95d106c572c52889b" Jun 11 19:55:51.437025 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:55:51.437007 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf8fa8ed6f3877af3b3ac78d8b06b4fc4b8420755affb2b95d106c572c52889b\": container with ID starting with bf8fa8ed6f3877af3b3ac78d8b06b4fc4b8420755affb2b95d106c572c52889b not found: ID does not exist" containerID="bf8fa8ed6f3877af3b3ac78d8b06b4fc4b8420755affb2b95d106c572c52889b" Jun 11 19:55:51.437060 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.437029 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf8fa8ed6f3877af3b3ac78d8b06b4fc4b8420755affb2b95d106c572c52889b"} err="failed to get container status \"bf8fa8ed6f3877af3b3ac78d8b06b4fc4b8420755affb2b95d106c572c52889b\": rpc error: code = NotFound desc = could not find container \"bf8fa8ed6f3877af3b3ac78d8b06b4fc4b8420755affb2b95d106c572c52889b\": container with ID starting with bf8fa8ed6f3877af3b3ac78d8b06b4fc4b8420755affb2b95d106c572c52889b not found: ID does not exist" Jun 11 19:55:51.437060 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.437043 2576 scope.go:117] "RemoveContainer" containerID="7517c6c0a45ccbcffb50d458357167959069175eb3527cee3f593240b2c16024" Jun 11 19:55:51.437307 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:55:51.437291 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7517c6c0a45ccbcffb50d458357167959069175eb3527cee3f593240b2c16024\": container with ID starting with 7517c6c0a45ccbcffb50d458357167959069175eb3527cee3f593240b2c16024 not found: ID does not exist" containerID="7517c6c0a45ccbcffb50d458357167959069175eb3527cee3f593240b2c16024" Jun 11 19:55:51.437368 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.437308 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7517c6c0a45ccbcffb50d458357167959069175eb3527cee3f593240b2c16024"} err="failed to get container status \"7517c6c0a45ccbcffb50d458357167959069175eb3527cee3f593240b2c16024\": rpc error: code = NotFound desc = could not find container \"7517c6c0a45ccbcffb50d458357167959069175eb3527cee3f593240b2c16024\": container with ID starting with 7517c6c0a45ccbcffb50d458357167959069175eb3527cee3f593240b2c16024 not found: ID does not exist" Jun 11 19:55:51.437368 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.437321 2576 scope.go:117] "RemoveContainer" containerID="30d77409342abaa04525f4eb4179332c5f13f7451d89e005d91c219842932125" Jun 11 19:55:51.437509 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.437494 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30d77409342abaa04525f4eb4179332c5f13f7451d89e005d91c219842932125"} err="failed to get container status \"30d77409342abaa04525f4eb4179332c5f13f7451d89e005d91c219842932125\": rpc error: code = NotFound desc = could not find container \"30d77409342abaa04525f4eb4179332c5f13f7451d89e005d91c219842932125\": container with ID starting with 30d77409342abaa04525f4eb4179332c5f13f7451d89e005d91c219842932125 not found: ID does not exist" Jun 11 19:55:51.437554 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.437510 2576 scope.go:117] "RemoveContainer" containerID="f5ebf62a23f6837f0e1ece32efb7ea9210d691de0f2618c71677e5f8e7becce2" Jun 11 19:55:51.437698 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.437679 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5ebf62a23f6837f0e1ece32efb7ea9210d691de0f2618c71677e5f8e7becce2"} err="failed to get container status \"f5ebf62a23f6837f0e1ece32efb7ea9210d691de0f2618c71677e5f8e7becce2\": rpc error: code = NotFound desc = could not find container \"f5ebf62a23f6837f0e1ece32efb7ea9210d691de0f2618c71677e5f8e7becce2\": container with ID starting with f5ebf62a23f6837f0e1ece32efb7ea9210d691de0f2618c71677e5f8e7becce2 not found: ID does not exist" Jun 11 19:55:51.437698 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.437698 2576 scope.go:117] "RemoveContainer" containerID="880205388d55ed210446d7d3af8f42380c3b8f6bd43d53cd767952950036b992" Jun 11 19:55:51.437883 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.437868 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"880205388d55ed210446d7d3af8f42380c3b8f6bd43d53cd767952950036b992"} err="failed to get container status \"880205388d55ed210446d7d3af8f42380c3b8f6bd43d53cd767952950036b992\": rpc error: code = NotFound desc = could not find container \"880205388d55ed210446d7d3af8f42380c3b8f6bd43d53cd767952950036b992\": container with ID starting with 880205388d55ed210446d7d3af8f42380c3b8f6bd43d53cd767952950036b992 not found: ID does not exist" Jun 11 19:55:51.437883 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.437882 2576 scope.go:117] "RemoveContainer" containerID="5fb115c2a450e1305d04469edd6f941e7e829f67caed27b2b05e0be8e4555983" Jun 11 19:55:51.438106 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.438088 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fb115c2a450e1305d04469edd6f941e7e829f67caed27b2b05e0be8e4555983"} err="failed to get container status \"5fb115c2a450e1305d04469edd6f941e7e829f67caed27b2b05e0be8e4555983\": rpc error: code = NotFound desc = could not find container \"5fb115c2a450e1305d04469edd6f941e7e829f67caed27b2b05e0be8e4555983\": container with ID starting with 5fb115c2a450e1305d04469edd6f941e7e829f67caed27b2b05e0be8e4555983 not found: ID does not exist" Jun 11 19:55:51.438203 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.438108 2576 scope.go:117] "RemoveContainer" containerID="9957c30417d1a866502466c7227e0a6ad920723182b9b92d3b35f6d600777397" Jun 11 19:55:51.438324 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.438309 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9957c30417d1a866502466c7227e0a6ad920723182b9b92d3b35f6d600777397"} err="failed to get container status \"9957c30417d1a866502466c7227e0a6ad920723182b9b92d3b35f6d600777397\": rpc error: code = NotFound desc = could not find container \"9957c30417d1a866502466c7227e0a6ad920723182b9b92d3b35f6d600777397\": container with ID starting with 9957c30417d1a866502466c7227e0a6ad920723182b9b92d3b35f6d600777397 not found: ID does not exist" Jun 11 19:55:51.438369 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.438324 2576 scope.go:117] "RemoveContainer" containerID="bf8fa8ed6f3877af3b3ac78d8b06b4fc4b8420755affb2b95d106c572c52889b" Jun 11 19:55:51.438526 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.438505 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf8fa8ed6f3877af3b3ac78d8b06b4fc4b8420755affb2b95d106c572c52889b"} err="failed to get container status \"bf8fa8ed6f3877af3b3ac78d8b06b4fc4b8420755affb2b95d106c572c52889b\": rpc error: code = NotFound desc = could not find container \"bf8fa8ed6f3877af3b3ac78d8b06b4fc4b8420755affb2b95d106c572c52889b\": container with ID starting with bf8fa8ed6f3877af3b3ac78d8b06b4fc4b8420755affb2b95d106c572c52889b not found: ID does not exist" Jun 11 19:55:51.438578 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.438527 2576 scope.go:117] "RemoveContainer" containerID="7517c6c0a45ccbcffb50d458357167959069175eb3527cee3f593240b2c16024" Jun 11 19:55:51.438748 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.438728 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7517c6c0a45ccbcffb50d458357167959069175eb3527cee3f593240b2c16024"} err="failed to get container status \"7517c6c0a45ccbcffb50d458357167959069175eb3527cee3f593240b2c16024\": rpc error: code = NotFound desc = could not find container \"7517c6c0a45ccbcffb50d458357167959069175eb3527cee3f593240b2c16024\": container with ID starting with 7517c6c0a45ccbcffb50d458357167959069175eb3527cee3f593240b2c16024 not found: ID does not exist" Jun 11 19:55:51.439177 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.439161 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.441720 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.441701 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 19:55:51.441805 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.441702 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 19:55:51.441805 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.441702 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 19:55:51.441805 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.441750 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 19:55:51.442117 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.442101 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 19:55:51.442194 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.442175 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tbmsk\"" Jun 11 19:55:51.442324 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.442310 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 19:55:51.442427 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.442411 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 19:55:51.442490 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.442418 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 19:55:51.446820 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.446799 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 19:55:51.454310 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.452493 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 19:55:51.459251 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.459231 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.459340 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.459262 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.459340 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.459287 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.459340 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.459309 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.459441 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.459387 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.459478 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.459443 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.459513 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.459476 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-web-config\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.459546 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.459514 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.459575 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.459548 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.459608 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.459588 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-config-volume\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.459638 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.459610 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxl9b\" (UniqueName: \"kubernetes.io/projected/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-kube-api-access-gxl9b\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.459638 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.459633 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-config-out\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.459699 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.459656 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.459732 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.459719 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9205e756-671e-472b-92e9-969a60a3f16c-tls-assets\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:51.459764 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.459734 2576 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-config-volume\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:51.459764 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.459749 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9205e756-671e-472b-92e9-969a60a3f16c-config-out\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:51.459821 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.459764 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:51.459821 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.459777 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-web-config\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:51.459821 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.459791 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqnml\" (UniqueName: \"kubernetes.io/projected/9205e756-671e-472b-92e9-969a60a3f16c-kube-api-access-vqnml\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:51.459821 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.459805 2576 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9205e756-671e-472b-92e9-969a60a3f16c-metrics-client-ca\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:51.459932 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.459819 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:51.459932 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.459833 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9205e756-671e-472b-92e9-969a60a3f16c-alertmanager-main-db\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:51.459932 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.459846 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:51.459932 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.459860 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-secret-alertmanager-main-tls\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:51.459932 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.459872 2576 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9205e756-671e-472b-92e9-969a60a3f16c-cluster-tls-config\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:51.560394 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.560353 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.560394 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.560400 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.560627 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.560419 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.560627 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.560439 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.560627 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.560474 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.560627 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.560489 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-web-config\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.560627 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.560511 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.560627 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.560542 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.560627 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.560580 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-config-volume\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.560627 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.560604 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxl9b\" (UniqueName: \"kubernetes.io/projected/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-kube-api-access-gxl9b\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.561000 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.560631 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-config-out\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.561000 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.560653 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.561000 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.560679 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.561296 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.561271 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.561419 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.561393 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.561722 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.561654 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.563642 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.563614 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.563730 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.563707 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.563795 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.563744 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.564010 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.563962 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-config-out\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.564142 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.564005 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-web-config\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.564142 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.564021 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.564247 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.564168 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.564343 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.564326 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.565266 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.565244 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-config-volume\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.568657 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.568638 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxl9b\" (UniqueName: \"kubernetes.io/projected/ca9bab6d-90b7-4cda-acfc-b7baa41ca464-kube-api-access-gxl9b\") pod \"alertmanager-main-0\" (UID: \"ca9bab6d-90b7-4cda-acfc-b7baa41ca464\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.748405 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.748329 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:55:51.884353 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:51.884310 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 19:55:51.887210 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:55:51.887175 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca9bab6d_90b7_4cda_acfc_b7baa41ca464.slice/crio-ab2e5f6b24b9d9059d08456e0ba05a4c73acda0d021c5aaea342071e836e5bac WatchSource:0}: Error finding container ab2e5f6b24b9d9059d08456e0ba05a4c73acda0d021c5aaea342071e836e5bac: Status 404 returned error can't find the container with id ab2e5f6b24b9d9059d08456e0ba05a4c73acda0d021c5aaea342071e836e5bac Jun 11 19:55:52.196225 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:52.196198 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9205e756-671e-472b-92e9-969a60a3f16c" path="/var/lib/kubelet/pods/9205e756-671e-472b-92e9-969a60a3f16c/volumes" Jun 11 19:55:52.387191 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:52.387156 2576 generic.go:356] "Generic (PLEG): container finished" podID="ca9bab6d-90b7-4cda-acfc-b7baa41ca464" containerID="3082e3d65a60186a1581087fb9bc911548c4c7bcd1ab2a84def1ee14ed9ce85b" exitCode=0 Jun 11 19:55:52.387550 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:52.387217 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca9bab6d-90b7-4cda-acfc-b7baa41ca464","Type":"ContainerDied","Data":"3082e3d65a60186a1581087fb9bc911548c4c7bcd1ab2a84def1ee14ed9ce85b"} Jun 11 19:55:52.387550 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:52.387263 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca9bab6d-90b7-4cda-acfc-b7baa41ca464","Type":"ContainerStarted","Data":"ab2e5f6b24b9d9059d08456e0ba05a4c73acda0d021c5aaea342071e836e5bac"} Jun 11 19:55:53.394823 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:53.394792 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca9bab6d-90b7-4cda-acfc-b7baa41ca464","Type":"ContainerStarted","Data":"7a880c70d58f796fbbf007fef327d89a8ae62d8fbabb575c6802cc7f95e600d9"} Jun 11 19:55:53.395292 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:53.394863 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca9bab6d-90b7-4cda-acfc-b7baa41ca464","Type":"ContainerStarted","Data":"f1dedd5d30c013304e38e8a4437bd28da9ae2b27edab20672302784cc4c76afc"} Jun 11 19:55:53.395292 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:53.394905 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca9bab6d-90b7-4cda-acfc-b7baa41ca464","Type":"ContainerStarted","Data":"261ac19443afe00480ed098a0e0beee469d0dbdedf34f762fa27035dcc933b00"} Jun 11 19:55:53.395292 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:53.394953 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca9bab6d-90b7-4cda-acfc-b7baa41ca464","Type":"ContainerStarted","Data":"ee14b9dafcc7be568c950cf32723e316e845070807ef90d1c4a0ddd48e24834d"} Jun 11 19:55:53.395292 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:53.394995 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca9bab6d-90b7-4cda-acfc-b7baa41ca464","Type":"ContainerStarted","Data":"6dd618af5163c812b7c3b70f574b102cb771aed77cae61106e3b47dcc90c2e1d"} Jun 11 19:55:53.395292 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:53.395035 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca9bab6d-90b7-4cda-acfc-b7baa41ca464","Type":"ContainerStarted","Data":"590c97f2da78c1b728765af3526e60fad193189fc9f4281967b8f8a545381638"} Jun 11 19:55:53.423736 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:53.423683 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.407416165 podStartE2EDuration="2.423665976s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.249811ms" isStatefulPod=false podCreationTimestamp="2026-06-11 19:55:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:55:53.420761468 +0000 UTC m=+353.698522240" watchObservedRunningTime="2026-06-11 19:55:53.423665976 +0000 UTC m=+353.701426735" Jun 11 19:55:54.398911 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.398876 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 19:55:54.399288 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.399154 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="28a8495b-f068-448f-8375-bbb5451f911b" containerName="prometheus" containerID="cri-o://4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5" gracePeriod=600 Jun 11 19:55:54.399288 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.399166 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="28a8495b-f068-448f-8375-bbb5451f911b" containerName="kube-rbac-proxy" containerID="cri-o://10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092" gracePeriod=600 Jun 11 19:55:54.399288 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.399195 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="28a8495b-f068-448f-8375-bbb5451f911b" containerName="thanos-sidecar" containerID="cri-o://fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a" gracePeriod=600 Jun 11 19:55:54.399288 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.399224 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="28a8495b-f068-448f-8375-bbb5451f911b" containerName="kube-rbac-proxy-thanos" containerID="cri-o://d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656" gracePeriod=600 Jun 11 19:55:54.399513 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.399200 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="28a8495b-f068-448f-8375-bbb5451f911b" containerName="kube-rbac-proxy-web" containerID="cri-o://bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd" gracePeriod=600 Jun 11 19:55:54.399513 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.399317 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="28a8495b-f068-448f-8375-bbb5451f911b" containerName="config-reloader" containerID="cri-o://b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8" gracePeriod=600 Jun 11 19:55:54.635317 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.635293 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:54.689087 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.689008 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-grpc-tls\") pod \"28a8495b-f068-448f-8375-bbb5451f911b\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " Jun 11 19:55:54.689087 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.689058 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-prometheus-k8s-tls\") pod \"28a8495b-f068-448f-8375-bbb5451f911b\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " Jun 11 19:55:54.689087 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.689083 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-configmap-kubelet-serving-ca-bundle\") pod \"28a8495b-f068-448f-8375-bbb5451f911b\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " Jun 11 19:55:54.689364 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.689137 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/28a8495b-f068-448f-8375-bbb5451f911b-prometheus-k8s-db\") pod \"28a8495b-f068-448f-8375-bbb5451f911b\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " Jun 11 19:55:54.689364 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.689167 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-configmap-metrics-client-ca\") pod \"28a8495b-f068-448f-8375-bbb5451f911b\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " Jun 11 19:55:54.689364 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.689192 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-prometheus-k8s-rulefiles-0\") pod \"28a8495b-f068-448f-8375-bbb5451f911b\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " Jun 11 19:55:54.689364 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.689218 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-configmap-serving-certs-ca-bundle\") pod \"28a8495b-f068-448f-8375-bbb5451f911b\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " Jun 11 19:55:54.689364 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.689246 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/28a8495b-f068-448f-8375-bbb5451f911b-tls-assets\") pod \"28a8495b-f068-448f-8375-bbb5451f911b\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " Jun 11 19:55:54.689364 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.689268 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqrvl\" (UniqueName: \"kubernetes.io/projected/28a8495b-f068-448f-8375-bbb5451f911b-kube-api-access-bqrvl\") pod \"28a8495b-f068-448f-8375-bbb5451f911b\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " Jun 11 19:55:54.689364 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.689295 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"28a8495b-f068-448f-8375-bbb5451f911b\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " Jun 11 19:55:54.689364 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.689320 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-thanos-prometheus-http-client-file\") pod \"28a8495b-f068-448f-8375-bbb5451f911b\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " Jun 11 19:55:54.689364 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.689366 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-config\") pod \"28a8495b-f068-448f-8375-bbb5451f911b\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " Jun 11 19:55:54.689857 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.689391 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-kube-rbac-proxy\") pod \"28a8495b-f068-448f-8375-bbb5451f911b\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " Jun 11 19:55:54.689857 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.689426 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-metrics-client-certs\") pod \"28a8495b-f068-448f-8375-bbb5451f911b\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " Jun 11 19:55:54.689857 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.689470 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-web-config\") pod \"28a8495b-f068-448f-8375-bbb5451f911b\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " Jun 11 19:55:54.689857 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.689505 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-prometheus-k8s-rulefiles-1\") pod \"28a8495b-f068-448f-8375-bbb5451f911b\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " Jun 11 19:55:54.689857 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.689529 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-prometheus-trusted-ca-bundle\") pod \"28a8495b-f068-448f-8375-bbb5451f911b\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " Jun 11 19:55:54.689857 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.689570 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-prometheus-k8s-rulefiles-2\") pod \"28a8495b-f068-448f-8375-bbb5451f911b\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " Jun 11 19:55:54.689857 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.689608 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/28a8495b-f068-448f-8375-bbb5451f911b-config-out\") pod \"28a8495b-f068-448f-8375-bbb5451f911b\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " Jun 11 19:55:54.689857 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.689636 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"28a8495b-f068-448f-8375-bbb5451f911b\" (UID: \"28a8495b-f068-448f-8375-bbb5451f911b\") " Jun 11 19:55:54.689857 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.689783 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "28a8495b-f068-448f-8375-bbb5451f911b" (UID: "28a8495b-f068-448f-8375-bbb5451f911b"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:55:54.690294 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.689916 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-configmap-metrics-client-ca\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:54.690294 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.690114 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "28a8495b-f068-448f-8375-bbb5451f911b" (UID: "28a8495b-f068-448f-8375-bbb5451f911b"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:55:54.692170 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.690485 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28a8495b-f068-448f-8375-bbb5451f911b-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "28a8495b-f068-448f-8375-bbb5451f911b" (UID: "28a8495b-f068-448f-8375-bbb5451f911b"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:55:54.692170 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.690853 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "28a8495b-f068-448f-8375-bbb5451f911b" (UID: "28a8495b-f068-448f-8375-bbb5451f911b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:55:54.692170 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.691229 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "28a8495b-f068-448f-8375-bbb5451f911b" (UID: "28a8495b-f068-448f-8375-bbb5451f911b"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:55:54.692170 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.691241 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "28a8495b-f068-448f-8375-bbb5451f911b" (UID: "28a8495b-f068-448f-8375-bbb5451f911b"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:55:54.692170 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.691471 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "28a8495b-f068-448f-8375-bbb5451f911b" (UID: "28a8495b-f068-448f-8375-bbb5451f911b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:55:54.692170 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.692108 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "28a8495b-f068-448f-8375-bbb5451f911b" (UID: "28a8495b-f068-448f-8375-bbb5451f911b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:55:54.692783 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.692748 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "28a8495b-f068-448f-8375-bbb5451f911b" (UID: "28a8495b-f068-448f-8375-bbb5451f911b"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:55:54.693440 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.692966 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "28a8495b-f068-448f-8375-bbb5451f911b" (UID: "28a8495b-f068-448f-8375-bbb5451f911b"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:55:54.693440 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.693362 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28a8495b-f068-448f-8375-bbb5451f911b-kube-api-access-bqrvl" (OuterVolumeSpecName: "kube-api-access-bqrvl") pod "28a8495b-f068-448f-8375-bbb5451f911b" (UID: "28a8495b-f068-448f-8375-bbb5451f911b"). InnerVolumeSpecName "kube-api-access-bqrvl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:55:54.694591 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.694565 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28a8495b-f068-448f-8375-bbb5451f911b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "28a8495b-f068-448f-8375-bbb5451f911b" (UID: "28a8495b-f068-448f-8375-bbb5451f911b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:55:54.694688 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.694663 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-config" (OuterVolumeSpecName: "config") pod "28a8495b-f068-448f-8375-bbb5451f911b" (UID: "28a8495b-f068-448f-8375-bbb5451f911b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:55:54.694754 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.694678 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28a8495b-f068-448f-8375-bbb5451f911b-config-out" (OuterVolumeSpecName: "config-out") pod "28a8495b-f068-448f-8375-bbb5451f911b" (UID: "28a8495b-f068-448f-8375-bbb5451f911b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:55:54.695331 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.695292 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "28a8495b-f068-448f-8375-bbb5451f911b" (UID: "28a8495b-f068-448f-8375-bbb5451f911b"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:55:54.695466 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.695440 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "28a8495b-f068-448f-8375-bbb5451f911b" (UID: "28a8495b-f068-448f-8375-bbb5451f911b"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:55:54.695551 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.695533 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "28a8495b-f068-448f-8375-bbb5451f911b" (UID: "28a8495b-f068-448f-8375-bbb5451f911b"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:55:54.695708 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.695694 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "28a8495b-f068-448f-8375-bbb5451f911b" (UID: "28a8495b-f068-448f-8375-bbb5451f911b"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:55:54.696034 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.696019 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "28a8495b-f068-448f-8375-bbb5451f911b" (UID: "28a8495b-f068-448f-8375-bbb5451f911b"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:55:54.704442 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.704422 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-web-config" (OuterVolumeSpecName: "web-config") pod "28a8495b-f068-448f-8375-bbb5451f911b" (UID: "28a8495b-f068-448f-8375-bbb5451f911b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:55:54.790941 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.790914 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:54.790941 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.790938 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/28a8495b-f068-448f-8375-bbb5451f911b-config-out\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:54.791075 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.790948 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:54.791075 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.790958 2576 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-grpc-tls\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:54.791075 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.790967 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:54.791075 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.790976 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:54.791075 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.790984 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/28a8495b-f068-448f-8375-bbb5451f911b-prometheus-k8s-db\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:54.791075 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.790993 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:54.791075 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.791000 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:54.791075 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.791008 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/28a8495b-f068-448f-8375-bbb5451f911b-tls-assets\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:54.791075 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.791016 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqrvl\" (UniqueName: \"kubernetes.io/projected/28a8495b-f068-448f-8375-bbb5451f911b-kube-api-access-bqrvl\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:54.791075 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.791025 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:54.791075 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.791033 2576 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:54.791075 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.791041 2576 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-config\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:54.791075 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.791049 2576 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-kube-rbac-proxy\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:54.791075 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.791057 2576 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-secret-metrics-client-certs\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:54.791075 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.791067 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/28a8495b-f068-448f-8375-bbb5451f911b-web-config\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:54.791075 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.791075 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:54.791075 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:54.791083 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28a8495b-f068-448f-8375-bbb5451f911b-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 19:55:55.407140 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.407095 2576 generic.go:356] "Generic (PLEG): container finished" podID="28a8495b-f068-448f-8375-bbb5451f911b" containerID="d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656" exitCode=0 Jun 11 19:55:55.407140 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.407133 2576 generic.go:356] "Generic (PLEG): container finished" podID="28a8495b-f068-448f-8375-bbb5451f911b" containerID="10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092" exitCode=0 Jun 11 19:55:55.407140 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.407143 2576 generic.go:356] "Generic (PLEG): container finished" podID="28a8495b-f068-448f-8375-bbb5451f911b" containerID="bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd" exitCode=0 Jun 11 19:55:55.407634 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.407150 2576 generic.go:356] "Generic (PLEG): container finished" podID="28a8495b-f068-448f-8375-bbb5451f911b" containerID="fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a" exitCode=0 Jun 11 19:55:55.407634 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.407155 2576 generic.go:356] "Generic (PLEG): container finished" podID="28a8495b-f068-448f-8375-bbb5451f911b" containerID="b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8" exitCode=0 Jun 11 19:55:55.407634 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.407161 2576 generic.go:356] "Generic (PLEG): container finished" podID="28a8495b-f068-448f-8375-bbb5451f911b" containerID="4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5" exitCode=0 Jun 11 19:55:55.407634 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.407179 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"28a8495b-f068-448f-8375-bbb5451f911b","Type":"ContainerDied","Data":"d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656"} Jun 11 19:55:55.407634 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.407246 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"28a8495b-f068-448f-8375-bbb5451f911b","Type":"ContainerDied","Data":"10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092"} Jun 11 19:55:55.407634 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.407187 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.407634 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.407288 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"28a8495b-f068-448f-8375-bbb5451f911b","Type":"ContainerDied","Data":"bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd"} Jun 11 19:55:55.407634 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.407314 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"28a8495b-f068-448f-8375-bbb5451f911b","Type":"ContainerDied","Data":"fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a"} Jun 11 19:55:55.407634 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.407343 2576 scope.go:117] "RemoveContainer" containerID="d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656" Jun 11 19:55:55.407634 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.407343 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"28a8495b-f068-448f-8375-bbb5451f911b","Type":"ContainerDied","Data":"b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8"} Jun 11 19:55:55.407634 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.407448 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"28a8495b-f068-448f-8375-bbb5451f911b","Type":"ContainerDied","Data":"4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5"} Jun 11 19:55:55.407634 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.407477 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"28a8495b-f068-448f-8375-bbb5451f911b","Type":"ContainerDied","Data":"a496f36b884f2efcc20abac0b3316c5ed1030d272f7e0165d2ad962acabfda13"} Jun 11 19:55:55.426337 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.426318 2576 scope.go:117] "RemoveContainer" containerID="10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092" Jun 11 19:55:55.433465 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.433448 2576 scope.go:117] "RemoveContainer" containerID="bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd" Jun 11 19:55:55.440227 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.440192 2576 scope.go:117] "RemoveContainer" containerID="fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a" Jun 11 19:55:55.441490 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.441471 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 19:55:55.445426 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.445401 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 19:55:55.447453 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.447439 2576 scope.go:117] "RemoveContainer" containerID="b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8" Jun 11 19:55:55.454338 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.454317 2576 scope.go:117] "RemoveContainer" containerID="4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5" Jun 11 19:55:55.461184 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.461166 2576 scope.go:117] "RemoveContainer" containerID="29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973" Jun 11 19:55:55.467753 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.467735 2576 scope.go:117] "RemoveContainer" containerID="d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656" Jun 11 19:55:55.468037 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:55:55.468021 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656\": container with ID starting with d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656 not found: ID does not exist" containerID="d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656" Jun 11 19:55:55.468099 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.468044 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656"} err="failed to get container status \"d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656\": rpc error: code = NotFound desc = could not find container \"d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656\": container with ID starting with d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656 not found: ID does not exist" Jun 11 19:55:55.468099 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.468066 2576 scope.go:117] "RemoveContainer" containerID="10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092" Jun 11 19:55:55.468321 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:55:55.468304 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092\": container with ID starting with 10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092 not found: ID does not exist" containerID="10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092" Jun 11 19:55:55.468401 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.468332 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092"} err="failed to get container status \"10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092\": rpc error: code = NotFound desc = could not find container \"10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092\": container with ID starting with 10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092 not found: ID does not exist" Jun 11 19:55:55.468401 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.468353 2576 scope.go:117] "RemoveContainer" containerID="bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd" Jun 11 19:55:55.468401 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.468364 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 19:55:55.468588 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:55:55.468569 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd\": container with ID starting with bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd not found: ID does not exist" containerID="bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd" Jun 11 19:55:55.468622 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.468594 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd"} err="failed to get container status \"bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd\": rpc error: code = NotFound desc = could not find container \"bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd\": container with ID starting with bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd not found: ID does not exist" Jun 11 19:55:55.468622 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.468610 2576 scope.go:117] "RemoveContainer" containerID="fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a" Jun 11 19:55:55.468696 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.468659 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28a8495b-f068-448f-8375-bbb5451f911b" containerName="kube-rbac-proxy-web" Jun 11 19:55:55.468696 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.468671 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="28a8495b-f068-448f-8375-bbb5451f911b" containerName="kube-rbac-proxy-web" Jun 11 19:55:55.468696 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.468679 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28a8495b-f068-448f-8375-bbb5451f911b" containerName="init-config-reloader" Jun 11 19:55:55.468696 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.468685 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="28a8495b-f068-448f-8375-bbb5451f911b" containerName="init-config-reloader" Jun 11 19:55:55.468696 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.468692 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28a8495b-f068-448f-8375-bbb5451f911b" containerName="kube-rbac-proxy" Jun 11 19:55:55.468696 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.468697 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="28a8495b-f068-448f-8375-bbb5451f911b" containerName="kube-rbac-proxy" Jun 11 19:55:55.468914 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.468718 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28a8495b-f068-448f-8375-bbb5451f911b" containerName="thanos-sidecar" Jun 11 19:55:55.468914 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.468727 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="28a8495b-f068-448f-8375-bbb5451f911b" containerName="thanos-sidecar" Jun 11 19:55:55.468914 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.468733 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28a8495b-f068-448f-8375-bbb5451f911b" containerName="kube-rbac-proxy-thanos" Jun 11 19:55:55.468914 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.468739 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="28a8495b-f068-448f-8375-bbb5451f911b" containerName="kube-rbac-proxy-thanos" Jun 11 19:55:55.468914 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.468753 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28a8495b-f068-448f-8375-bbb5451f911b" containerName="prometheus" Jun 11 19:55:55.468914 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.468760 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="28a8495b-f068-448f-8375-bbb5451f911b" containerName="prometheus" Jun 11 19:55:55.468914 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.468767 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28a8495b-f068-448f-8375-bbb5451f911b" containerName="config-reloader" Jun 11 19:55:55.468914 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.468772 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="28a8495b-f068-448f-8375-bbb5451f911b" containerName="config-reloader" Jun 11 19:55:55.468914 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:55:55.468784 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a\": container with ID starting with fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a not found: ID does not exist" containerID="fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a" Jun 11 19:55:55.468914 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.468804 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a"} err="failed to get container status \"fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a\": rpc error: code = NotFound desc = could not find container \"fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a\": container with ID starting with fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a not found: ID does not exist" Jun 11 19:55:55.468914 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.468823 2576 scope.go:117] "RemoveContainer" containerID="b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8" Jun 11 19:55:55.468914 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.468814 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="28a8495b-f068-448f-8375-bbb5451f911b" containerName="prometheus" Jun 11 19:55:55.468914 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.468879 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="28a8495b-f068-448f-8375-bbb5451f911b" containerName="config-reloader" Jun 11 19:55:55.468914 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.468888 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="28a8495b-f068-448f-8375-bbb5451f911b" containerName="kube-rbac-proxy-thanos" Jun 11 19:55:55.468914 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.468899 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="28a8495b-f068-448f-8375-bbb5451f911b" containerName="thanos-sidecar" Jun 11 19:55:55.468914 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.468907 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="28a8495b-f068-448f-8375-bbb5451f911b" containerName="kube-rbac-proxy" Jun 11 19:55:55.468914 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.468913 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="28a8495b-f068-448f-8375-bbb5451f911b" containerName="kube-rbac-proxy-web" Jun 11 19:55:55.469495 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:55:55.469043 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8\": container with ID starting with b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8 not found: ID does not exist" containerID="b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8" Jun 11 19:55:55.469495 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.469062 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8"} err="failed to get container status \"b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8\": rpc error: code = NotFound desc = could not find container \"b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8\": container with ID starting with b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8 not found: ID does not exist" Jun 11 19:55:55.469495 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.469073 2576 scope.go:117] "RemoveContainer" containerID="4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5" Jun 11 19:55:55.469495 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:55:55.469320 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5\": container with ID starting with 4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5 not found: ID does not exist" containerID="4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5" Jun 11 19:55:55.469495 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.469339 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5"} err="failed to get container status \"4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5\": rpc error: code = NotFound desc = could not find container \"4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5\": container with ID starting with 4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5 not found: ID does not exist" Jun 11 19:55:55.469495 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.469353 2576 scope.go:117] "RemoveContainer" containerID="29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973" Jun 11 19:55:55.469716 ip-10-0-137-247 kubenswrapper[2576]: E0611 19:55:55.469573 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973\": container with ID starting with 29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973 not found: ID does not exist" containerID="29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973" Jun 11 19:55:55.469716 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.469588 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973"} err="failed to get container status \"29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973\": rpc error: code = NotFound desc = could not find container \"29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973\": container with ID starting with 29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973 not found: ID does not exist" Jun 11 19:55:55.469716 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.469599 2576 scope.go:117] "RemoveContainer" containerID="d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656" Jun 11 19:55:55.469877 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.469854 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656"} err="failed to get container status \"d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656\": rpc error: code = NotFound desc = could not find container \"d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656\": container with ID starting with d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656 not found: ID does not exist" Jun 11 19:55:55.469925 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.469879 2576 scope.go:117] "RemoveContainer" containerID="10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092" Jun 11 19:55:55.470145 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.470111 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092"} err="failed to get container status \"10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092\": rpc error: code = NotFound desc = could not find container \"10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092\": container with ID starting with 10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092 not found: ID does not exist" Jun 11 19:55:55.470197 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.470146 2576 scope.go:117] "RemoveContainer" containerID="bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd" Jun 11 19:55:55.470385 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.470367 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd"} err="failed to get container status \"bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd\": rpc error: code = NotFound desc = could not find container \"bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd\": container with ID starting with bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd not found: ID does not exist" Jun 11 19:55:55.470385 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.470385 2576 scope.go:117] "RemoveContainer" containerID="fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a" Jun 11 19:55:55.470598 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.470580 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a"} err="failed to get container status \"fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a\": rpc error: code = NotFound desc = could not find container \"fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a\": container with ID starting with fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a not found: ID does not exist" Jun 11 19:55:55.470640 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.470599 2576 scope.go:117] "RemoveContainer" containerID="b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8" Jun 11 19:55:55.470784 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.470769 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8"} err="failed to get container status \"b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8\": rpc error: code = NotFound desc = could not find container \"b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8\": container with ID starting with b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8 not found: ID does not exist" Jun 11 19:55:55.470784 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.470783 2576 scope.go:117] "RemoveContainer" containerID="4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5" Jun 11 19:55:55.470968 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.470953 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5"} err="failed to get container status \"4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5\": rpc error: code = NotFound desc = could not find container \"4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5\": container with ID starting with 4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5 not found: ID does not exist" Jun 11 19:55:55.471013 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.470968 2576 scope.go:117] "RemoveContainer" containerID="29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973" Jun 11 19:55:55.471180 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.471164 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973"} err="failed to get container status \"29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973\": rpc error: code = NotFound desc = could not find container \"29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973\": container with ID starting with 29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973 not found: ID does not exist" Jun 11 19:55:55.471180 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.471178 2576 scope.go:117] "RemoveContainer" containerID="d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656" Jun 11 19:55:55.471381 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.471363 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656"} err="failed to get container status \"d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656\": rpc error: code = NotFound desc = could not find container \"d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656\": container with ID starting with d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656 not found: ID does not exist" Jun 11 19:55:55.471430 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.471382 2576 scope.go:117] "RemoveContainer" containerID="10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092" Jun 11 19:55:55.471595 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.471578 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092"} err="failed to get container status \"10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092\": rpc error: code = NotFound desc = could not find container \"10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092\": container with ID starting with 10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092 not found: ID does not exist" Jun 11 19:55:55.471642 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.471596 2576 scope.go:117] "RemoveContainer" containerID="bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd" Jun 11 19:55:55.471810 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.471792 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd"} err="failed to get container status \"bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd\": rpc error: code = NotFound desc = could not find container \"bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd\": container with ID starting with bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd not found: ID does not exist" Jun 11 19:55:55.471894 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.471812 2576 scope.go:117] "RemoveContainer" containerID="fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a" Jun 11 19:55:55.471991 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.471976 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a"} err="failed to get container status \"fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a\": rpc error: code = NotFound desc = could not find container \"fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a\": container with ID starting with fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a not found: ID does not exist" Jun 11 19:55:55.472043 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.471991 2576 scope.go:117] "RemoveContainer" containerID="b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8" Jun 11 19:55:55.472199 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.472173 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8"} err="failed to get container status \"b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8\": rpc error: code = NotFound desc = could not find container \"b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8\": container with ID starting with b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8 not found: ID does not exist" Jun 11 19:55:55.472199 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.472198 2576 scope.go:117] "RemoveContainer" containerID="4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5" Jun 11 19:55:55.472425 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.472403 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5"} err="failed to get container status \"4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5\": rpc error: code = NotFound desc = could not find container \"4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5\": container with ID starting with 4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5 not found: ID does not exist" Jun 11 19:55:55.472491 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.472426 2576 scope.go:117] "RemoveContainer" containerID="29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973" Jun 11 19:55:55.472654 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.472634 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973"} err="failed to get container status \"29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973\": rpc error: code = NotFound desc = could not find container \"29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973\": container with ID starting with 29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973 not found: ID does not exist" Jun 11 19:55:55.472706 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.472656 2576 scope.go:117] "RemoveContainer" containerID="d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656" Jun 11 19:55:55.472864 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.472848 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656"} err="failed to get container status \"d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656\": rpc error: code = NotFound desc = could not find container \"d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656\": container with ID starting with d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656 not found: ID does not exist" Jun 11 19:55:55.472904 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.472864 2576 scope.go:117] "RemoveContainer" containerID="10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092" Jun 11 19:55:55.473076 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.473058 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092"} err="failed to get container status \"10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092\": rpc error: code = NotFound desc = could not find container \"10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092\": container with ID starting with 10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092 not found: ID does not exist" Jun 11 19:55:55.473170 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.473087 2576 scope.go:117] "RemoveContainer" containerID="bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd" Jun 11 19:55:55.473311 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.473293 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd"} err="failed to get container status \"bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd\": rpc error: code = NotFound desc = could not find container \"bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd\": container with ID starting with bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd not found: ID does not exist" Jun 11 19:55:55.473383 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.473312 2576 scope.go:117] "RemoveContainer" containerID="fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a" Jun 11 19:55:55.473548 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.473526 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a"} err="failed to get container status \"fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a\": rpc error: code = NotFound desc = could not find container \"fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a\": container with ID starting with fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a not found: ID does not exist" Jun 11 19:55:55.473591 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.473549 2576 scope.go:117] "RemoveContainer" containerID="b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8" Jun 11 19:55:55.474184 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.474161 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8"} err="failed to get container status \"b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8\": rpc error: code = NotFound desc = could not find container \"b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8\": container with ID starting with b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8 not found: ID does not exist" Jun 11 19:55:55.474241 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.474184 2576 scope.go:117] "RemoveContainer" containerID="4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5" Jun 11 19:55:55.474241 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.474192 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.474363 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.474342 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5"} err="failed to get container status \"4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5\": rpc error: code = NotFound desc = could not find container \"4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5\": container with ID starting with 4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5 not found: ID does not exist" Jun 11 19:55:55.474417 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.474365 2576 scope.go:117] "RemoveContainer" containerID="29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973" Jun 11 19:55:55.474807 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.474782 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973"} err="failed to get container status \"29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973\": rpc error: code = NotFound desc = could not find container \"29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973\": container with ID starting with 29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973 not found: ID does not exist" Jun 11 19:55:55.474881 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.474809 2576 scope.go:117] "RemoveContainer" containerID="d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656" Jun 11 19:55:55.475054 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.475027 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656"} err="failed to get container status \"d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656\": rpc error: code = NotFound desc = could not find container \"d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656\": container with ID starting with d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656 not found: ID does not exist" Jun 11 19:55:55.475054 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.475053 2576 scope.go:117] "RemoveContainer" containerID="10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092" Jun 11 19:55:55.475308 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.475287 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092"} err="failed to get container status \"10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092\": rpc error: code = NotFound desc = could not find container \"10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092\": container with ID starting with 10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092 not found: ID does not exist" Jun 11 19:55:55.475308 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.475308 2576 scope.go:117] "RemoveContainer" containerID="bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd" Jun 11 19:55:55.475552 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.475529 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd"} err="failed to get container status \"bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd\": rpc error: code = NotFound desc = could not find container \"bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd\": container with ID starting with bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd not found: ID does not exist" Jun 11 19:55:55.475601 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.475554 2576 scope.go:117] "RemoveContainer" containerID="fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a" Jun 11 19:55:55.475788 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.475769 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a"} err="failed to get container status \"fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a\": rpc error: code = NotFound desc = could not find container \"fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a\": container with ID starting with fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a not found: ID does not exist" Jun 11 19:55:55.475788 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.475787 2576 scope.go:117] "RemoveContainer" containerID="b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8" Jun 11 19:55:55.475994 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.475978 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8"} err="failed to get container status \"b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8\": rpc error: code = NotFound desc = could not find container \"b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8\": container with ID starting with b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8 not found: ID does not exist" Jun 11 19:55:55.475994 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.475993 2576 scope.go:117] "RemoveContainer" containerID="4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5" Jun 11 19:55:55.476210 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.476193 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5"} err="failed to get container status \"4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5\": rpc error: code = NotFound desc = could not find container \"4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5\": container with ID starting with 4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5 not found: ID does not exist" Jun 11 19:55:55.476277 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.476210 2576 scope.go:117] "RemoveContainer" containerID="29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973" Jun 11 19:55:55.476399 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.476384 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973"} err="failed to get container status \"29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973\": rpc error: code = NotFound desc = could not find container \"29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973\": container with ID starting with 29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973 not found: ID does not exist" Jun 11 19:55:55.476452 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.476397 2576 scope.go:117] "RemoveContainer" containerID="d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656" Jun 11 19:55:55.476621 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.476603 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656"} err="failed to get container status \"d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656\": rpc error: code = NotFound desc = could not find container \"d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656\": container with ID starting with d22ec9d57d386b557fa35f2f1b8bf6c3c11f12e44f36aa79b490df4925ac7656 not found: ID does not exist" Jun 11 19:55:55.476682 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.476623 2576 scope.go:117] "RemoveContainer" containerID="10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092" Jun 11 19:55:55.476822 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.476801 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092"} err="failed to get container status \"10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092\": rpc error: code = NotFound desc = could not find container \"10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092\": container with ID starting with 10e5b94e4298483a2c536ada6812ad3652476fbe075f173e2f0b5dcad9b9a092 not found: ID does not exist" Jun 11 19:55:55.476884 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.476822 2576 scope.go:117] "RemoveContainer" containerID="bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd" Jun 11 19:55:55.476967 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.476948 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 19:55:55.477077 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.477056 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 19:55:55.477077 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.477056 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 19:55:55.477189 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.477092 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd"} err="failed to get container status \"bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd\": rpc error: code = NotFound desc = could not find container \"bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd\": container with ID starting with bab04e7f2e5f36f02940e7d7cf081705ba2b6713a428cb6b84f8c6d6946b96fd not found: ID does not exist" Jun 11 19:55:55.477189 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.477113 2576 scope.go:117] "RemoveContainer" containerID="fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a" Jun 11 19:55:55.477437 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.477418 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 19:55:55.477558 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.477436 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 19:55:55.477558 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.477498 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a"} err="failed to get container status \"fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a\": rpc error: code = NotFound desc = could not find container \"fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a\": container with ID starting with fd98a637a00fc9bd6f3f68f70e3c31cb8c0c9e7632e0086815b390b03825c42a not found: ID does not exist" Jun 11 19:55:55.477558 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.477521 2576 scope.go:117] "RemoveContainer" containerID="b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8" Jun 11 19:55:55.477766 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.477627 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 19:55:55.477766 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.477649 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 19:55:55.477865 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.477789 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8"} err="failed to get container status \"b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8\": rpc error: code = NotFound desc = could not find container \"b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8\": container with ID starting with b4fb5ee5e9f76da58fe8215bf768f9b3dd4ba83ef9fd6c73a053928d9ed0a9a8 not found: ID does not exist" Jun 11 19:55:55.477865 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.477808 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 19:55:55.477865 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.477815 2576 scope.go:117] "RemoveContainer" containerID="4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5" Jun 11 19:55:55.478021 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.478008 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 19:55:55.478110 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.478081 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5"} err="failed to get container status \"4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5\": rpc error: code = NotFound desc = could not find container \"4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5\": container with ID starting with 4e6990299fdc619d28124f61a51e7ad223a47f6116e81512469411b00290cec5 not found: ID does not exist" Jun 11 19:55:55.478110 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.478105 2576 scope.go:117] "RemoveContainer" containerID="29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973" Jun 11 19:55:55.478285 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.478117 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 19:55:55.478384 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.478366 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 19:55:55.478611 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.478591 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973"} err="failed to get container status \"29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973\": rpc error: code = NotFound desc = could not find container \"29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973\": container with ID starting with 29eb8a696479a9e79392acfcb6fd52b58be2a256cf81b061bafc58fa6285e973 not found: ID does not exist" Jun 11 19:55:55.478747 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.478733 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 19:55:55.478857 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.478829 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1k8tbc0n82s0o\"" Jun 11 19:55:55.478951 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.478875 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-z9tkq\"" Jun 11 19:55:55.480516 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.480500 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 19:55:55.482065 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.482047 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 19:55:55.487868 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.487765 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 19:55:55.597802 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.597770 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d07d433f-b7b4-45bf-8ce7-b6459e69312a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.597802 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.597803 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d07d433f-b7b4-45bf-8ce7-b6459e69312a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.597962 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.597822 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d07d433f-b7b4-45bf-8ce7-b6459e69312a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.597962 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.597842 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d07d433f-b7b4-45bf-8ce7-b6459e69312a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.597962 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.597868 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d07d433f-b7b4-45bf-8ce7-b6459e69312a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.597962 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.597885 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d07d433f-b7b4-45bf-8ce7-b6459e69312a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.597962 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.597905 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d07d433f-b7b4-45bf-8ce7-b6459e69312a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.597962 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.597926 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d07d433f-b7b4-45bf-8ce7-b6459e69312a-config\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.598186 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.597966 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d07d433f-b7b4-45bf-8ce7-b6459e69312a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.598186 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.598000 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d07d433f-b7b4-45bf-8ce7-b6459e69312a-web-config\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.598186 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.598020 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d07d433f-b7b4-45bf-8ce7-b6459e69312a-config-out\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.598186 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.598034 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d07d433f-b7b4-45bf-8ce7-b6459e69312a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.598186 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.598050 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d07d433f-b7b4-45bf-8ce7-b6459e69312a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.598186 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.598073 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pbjt\" (UniqueName: \"kubernetes.io/projected/d07d433f-b7b4-45bf-8ce7-b6459e69312a-kube-api-access-5pbjt\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.598186 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.598140 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d07d433f-b7b4-45bf-8ce7-b6459e69312a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.598186 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.598168 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d07d433f-b7b4-45bf-8ce7-b6459e69312a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.598186 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.598186 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d07d433f-b7b4-45bf-8ce7-b6459e69312a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.598445 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.598205 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d07d433f-b7b4-45bf-8ce7-b6459e69312a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.598445 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.598264 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d07d433f-b7b4-45bf-8ce7-b6459e69312a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.598445 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.598301 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d07d433f-b7b4-45bf-8ce7-b6459e69312a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.699202 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.699113 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d07d433f-b7b4-45bf-8ce7-b6459e69312a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.699202 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.699164 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d07d433f-b7b4-45bf-8ce7-b6459e69312a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.699202 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.699187 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d07d433f-b7b4-45bf-8ce7-b6459e69312a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.699423 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.699212 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d07d433f-b7b4-45bf-8ce7-b6459e69312a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.699423 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.699238 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d07d433f-b7b4-45bf-8ce7-b6459e69312a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.699423 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.699271 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d07d433f-b7b4-45bf-8ce7-b6459e69312a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.699423 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.699294 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d07d433f-b7b4-45bf-8ce7-b6459e69312a-config\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.699423 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.699344 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d07d433f-b7b4-45bf-8ce7-b6459e69312a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.699656 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.699371 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d07d433f-b7b4-45bf-8ce7-b6459e69312a-web-config\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.699656 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.699513 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d07d433f-b7b4-45bf-8ce7-b6459e69312a-config-out\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.699656 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.699540 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d07d433f-b7b4-45bf-8ce7-b6459e69312a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.699656 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.699570 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d07d433f-b7b4-45bf-8ce7-b6459e69312a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.699656 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.699598 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pbjt\" (UniqueName: \"kubernetes.io/projected/d07d433f-b7b4-45bf-8ce7-b6459e69312a-kube-api-access-5pbjt\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.699656 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.699634 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d07d433f-b7b4-45bf-8ce7-b6459e69312a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.699946 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.699660 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d07d433f-b7b4-45bf-8ce7-b6459e69312a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.699946 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.699689 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d07d433f-b7b4-45bf-8ce7-b6459e69312a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.699946 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.699719 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d07d433f-b7b4-45bf-8ce7-b6459e69312a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.699946 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.699773 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d07d433f-b7b4-45bf-8ce7-b6459e69312a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.699946 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.699801 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d07d433f-b7b4-45bf-8ce7-b6459e69312a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.699946 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.699842 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d07d433f-b7b4-45bf-8ce7-b6459e69312a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.700498 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.700477 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d07d433f-b7b4-45bf-8ce7-b6459e69312a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.700711 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.700688 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d07d433f-b7b4-45bf-8ce7-b6459e69312a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.701342 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.701313 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d07d433f-b7b4-45bf-8ce7-b6459e69312a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.703589 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.702319 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d07d433f-b7b4-45bf-8ce7-b6459e69312a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.703589 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.702529 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d07d433f-b7b4-45bf-8ce7-b6459e69312a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.703589 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.702560 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d07d433f-b7b4-45bf-8ce7-b6459e69312a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.703589 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.702853 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d07d433f-b7b4-45bf-8ce7-b6459e69312a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.703589 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.703068 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d07d433f-b7b4-45bf-8ce7-b6459e69312a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.703589 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.703280 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d07d433f-b7b4-45bf-8ce7-b6459e69312a-config\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.703589 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.703418 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d07d433f-b7b4-45bf-8ce7-b6459e69312a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.704004 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.703657 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d07d433f-b7b4-45bf-8ce7-b6459e69312a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.704004 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.703656 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d07d433f-b7b4-45bf-8ce7-b6459e69312a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.704116 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.704073 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d07d433f-b7b4-45bf-8ce7-b6459e69312a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.704197 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.704114 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d07d433f-b7b4-45bf-8ce7-b6459e69312a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.704483 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.704461 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d07d433f-b7b4-45bf-8ce7-b6459e69312a-config-out\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.704753 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.704730 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d07d433f-b7b4-45bf-8ce7-b6459e69312a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.705309 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.705282 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d07d433f-b7b4-45bf-8ce7-b6459e69312a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.705786 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.705763 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d07d433f-b7b4-45bf-8ce7-b6459e69312a-web-config\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.705957 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.705939 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d07d433f-b7b4-45bf-8ce7-b6459e69312a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.709039 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.709020 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pbjt\" (UniqueName: \"kubernetes.io/projected/d07d433f-b7b4-45bf-8ce7-b6459e69312a-kube-api-access-5pbjt\") pod \"prometheus-k8s-0\" (UID: \"d07d433f-b7b4-45bf-8ce7-b6459e69312a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.785762 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.785736 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:55:55.923606 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:55.923578 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 19:55:55.925859 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:55:55.925831 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd07d433f_b7b4_45bf_8ce7_b6459e69312a.slice/crio-dbadb967a7a814b6f402d9b3179bc36a19f5a5f438478ccfe7f33e2521ee31d8 WatchSource:0}: Error finding container dbadb967a7a814b6f402d9b3179bc36a19f5a5f438478ccfe7f33e2521ee31d8: Status 404 returned error can't find the container with id dbadb967a7a814b6f402d9b3179bc36a19f5a5f438478ccfe7f33e2521ee31d8 Jun 11 19:55:56.195768 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:56.195737 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28a8495b-f068-448f-8375-bbb5451f911b" path="/var/lib/kubelet/pods/28a8495b-f068-448f-8375-bbb5451f911b/volumes" Jun 11 19:55:56.414008 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:56.413973 2576 generic.go:356] "Generic (PLEG): container finished" podID="d07d433f-b7b4-45bf-8ce7-b6459e69312a" containerID="8ec947af47ebb918bd3d02c8eba48aa24409ff404140978ce23515c5321acb7c" exitCode=0 Jun 11 19:55:56.414389 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:56.414034 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d07d433f-b7b4-45bf-8ce7-b6459e69312a","Type":"ContainerDied","Data":"8ec947af47ebb918bd3d02c8eba48aa24409ff404140978ce23515c5321acb7c"} Jun 11 19:55:56.414389 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:56.414111 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d07d433f-b7b4-45bf-8ce7-b6459e69312a","Type":"ContainerStarted","Data":"dbadb967a7a814b6f402d9b3179bc36a19f5a5f438478ccfe7f33e2521ee31d8"} Jun 11 19:55:57.422404 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:57.422364 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d07d433f-b7b4-45bf-8ce7-b6459e69312a","Type":"ContainerStarted","Data":"e30fd9273203daa6e9d682c80d0a25c325486b89257500b3d4914758255fbbbb"} Jun 11 19:55:57.422742 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:57.422456 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d07d433f-b7b4-45bf-8ce7-b6459e69312a","Type":"ContainerStarted","Data":"0c37e8d2bee13088f382ff5fe7f588e3ee7e043265c0bcb96a87e6b0dda382e5"} Jun 11 19:55:57.422742 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:57.422483 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d07d433f-b7b4-45bf-8ce7-b6459e69312a","Type":"ContainerStarted","Data":"25643f1dddfa536bc8f15f581a183fd0407b17d30789d73440a75b6830f57d5b"} Jun 11 19:55:57.422742 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:57.422507 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d07d433f-b7b4-45bf-8ce7-b6459e69312a","Type":"ContainerStarted","Data":"2dded969acb660afb2c29ef597b7835a6a8a48d8aa0b7cb3ac38cc14e14c85ec"} Jun 11 19:55:57.422742 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:57.422530 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d07d433f-b7b4-45bf-8ce7-b6459e69312a","Type":"ContainerStarted","Data":"3d6872a37e6c36b2330b61298ca4a9ed32d7fd7651d14fca0cb044d3cef58c89"} Jun 11 19:55:57.422742 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:57.422554 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d07d433f-b7b4-45bf-8ce7-b6459e69312a","Type":"ContainerStarted","Data":"2079e44c4161ee20098b60773e59e4bd9b19331f5cdfff5bd49e2ff9fc948091"} Jun 11 19:55:57.450977 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:55:57.450925 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.430854335 podStartE2EDuration="2.450910175s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.05584ms" isStatefulPod=false podCreationTimestamp="2026-06-11 19:55:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:55:57.448577885 +0000 UTC m=+357.726338643" watchObservedRunningTime="2026-06-11 19:55:57.450910175 +0000 UTC m=+357.728670969" Jun 11 19:56:00.786089 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:56:00.786056 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:56:55.786017 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:56:55.785981 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:56:55.801343 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:56:55.801319 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:56:56.658227 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:56:56.658199 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:44.159178 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:58:44.159084 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-z7rhv"] Jun 11 19:58:44.163060 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:58:44.162950 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-z7rhv" Jun 11 19:58:44.166079 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:58:44.166056 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 19:58:44.166240 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:58:44.166153 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-nh8vm\"" Jun 11 19:58:44.166893 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:58:44.166875 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 19:58:44.171622 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:58:44.171598 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-z7rhv"] Jun 11 19:58:44.174036 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:58:44.174012 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7s2f\" (UniqueName: \"kubernetes.io/projected/9d4d9681-aa4b-4e3d-a65f-09a099cc29d0-kube-api-access-v7s2f\") pod \"cert-manager-cainjector-5d99449ffd-z7rhv\" (UID: \"9d4d9681-aa4b-4e3d-a65f-09a099cc29d0\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-z7rhv" Jun 11 19:58:44.174138 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:58:44.174062 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d4d9681-aa4b-4e3d-a65f-09a099cc29d0-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-z7rhv\" (UID: \"9d4d9681-aa4b-4e3d-a65f-09a099cc29d0\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-z7rhv" Jun 11 19:58:44.274942 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:58:44.274905 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7s2f\" (UniqueName: \"kubernetes.io/projected/9d4d9681-aa4b-4e3d-a65f-09a099cc29d0-kube-api-access-v7s2f\") pod \"cert-manager-cainjector-5d99449ffd-z7rhv\" (UID: \"9d4d9681-aa4b-4e3d-a65f-09a099cc29d0\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-z7rhv" Jun 11 19:58:44.274942 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:58:44.274960 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d4d9681-aa4b-4e3d-a65f-09a099cc29d0-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-z7rhv\" (UID: \"9d4d9681-aa4b-4e3d-a65f-09a099cc29d0\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-z7rhv" Jun 11 19:58:44.283195 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:58:44.283161 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7s2f\" (UniqueName: \"kubernetes.io/projected/9d4d9681-aa4b-4e3d-a65f-09a099cc29d0-kube-api-access-v7s2f\") pod \"cert-manager-cainjector-5d99449ffd-z7rhv\" (UID: \"9d4d9681-aa4b-4e3d-a65f-09a099cc29d0\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-z7rhv" Jun 11 19:58:44.283320 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:58:44.283208 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d4d9681-aa4b-4e3d-a65f-09a099cc29d0-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-z7rhv\" (UID: \"9d4d9681-aa4b-4e3d-a65f-09a099cc29d0\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-z7rhv" Jun 11 19:58:44.486907 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:58:44.486821 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-z7rhv" Jun 11 19:58:44.617579 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:58:44.617543 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-z7rhv"] Jun 11 19:58:44.620733 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:58:44.620704 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d4d9681_aa4b_4e3d_a65f_09a099cc29d0.slice/crio-c39a4bcd7d3020e4181be44edfd3ca4ee22422761b2c7f7a3ab4ab08fa9e7574 WatchSource:0}: Error finding container c39a4bcd7d3020e4181be44edfd3ca4ee22422761b2c7f7a3ab4ab08fa9e7574: Status 404 returned error can't find the container with id c39a4bcd7d3020e4181be44edfd3ca4ee22422761b2c7f7a3ab4ab08fa9e7574 Jun 11 19:58:44.622796 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:58:44.622779 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 19:58:45.052685 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:58:45.052649 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-z7rhv" event={"ID":"9d4d9681-aa4b-4e3d-a65f-09a099cc29d0","Type":"ContainerStarted","Data":"c39a4bcd7d3020e4181be44edfd3ca4ee22422761b2c7f7a3ab4ab08fa9e7574"} Jun 11 19:58:48.066089 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:58:48.066050 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-z7rhv" event={"ID":"9d4d9681-aa4b-4e3d-a65f-09a099cc29d0","Type":"ContainerStarted","Data":"8603670fb5c27678c793428e8cc384cb6acf3ea9dfaa3a75232102ea9591e864"} Jun 11 19:58:48.084224 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:58:48.084177 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-z7rhv" podStartSLOduration=1.223983133 podStartE2EDuration="4.084161503s" totalImagesPullingTime="2.86017837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:58:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:58:48.083478355 +0000 UTC m=+528.361239116" watchObservedRunningTime="2026-06-11 19:58:48.084161503 +0000 UTC m=+528.361922261" Jun 11 19:59:12.731840 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:12.731800 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-558786d47d-mcj82"] Jun 11 19:59:12.735115 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:12.735098 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mcj82" Jun 11 19:59:12.738162 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:12.738135 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2hqdj\"" Jun 11 19:59:12.738282 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:12.738248 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 19:59:12.739803 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:12.739782 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 19:59:12.739921 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:12.739836 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 19:59:12.741722 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:12.741700 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 19:59:12.756627 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:12.756605 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-558786d47d-mcj82"] Jun 11 19:59:12.816556 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:12.816524 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv5r6\" (UniqueName: \"kubernetes.io/projected/40a16e2f-7273-41af-8654-2d331161c294-kube-api-access-bv5r6\") pod \"opendatahub-operator-controller-manager-558786d47d-mcj82\" (UID: \"40a16e2f-7273-41af-8654-2d331161c294\") " pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mcj82" Jun 11 19:59:12.816556 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:12.816558 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40a16e2f-7273-41af-8654-2d331161c294-webhook-cert\") pod \"opendatahub-operator-controller-manager-558786d47d-mcj82\" (UID: \"40a16e2f-7273-41af-8654-2d331161c294\") " pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mcj82" Jun 11 19:59:12.816748 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:12.816591 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/40a16e2f-7273-41af-8654-2d331161c294-apiservice-cert\") pod \"opendatahub-operator-controller-manager-558786d47d-mcj82\" (UID: \"40a16e2f-7273-41af-8654-2d331161c294\") " pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mcj82" Jun 11 19:59:12.816748 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:12.816696 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40a16e2f-7273-41af-8654-2d331161c294-tmp\") pod \"opendatahub-operator-controller-manager-558786d47d-mcj82\" (UID: \"40a16e2f-7273-41af-8654-2d331161c294\") " pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mcj82" Jun 11 19:59:12.816817 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:12.816753 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/40a16e2f-7273-41af-8654-2d331161c294-manifests\") pod \"opendatahub-operator-controller-manager-558786d47d-mcj82\" (UID: \"40a16e2f-7273-41af-8654-2d331161c294\") " pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mcj82" Jun 11 19:59:12.917389 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:12.917358 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/40a16e2f-7273-41af-8654-2d331161c294-apiservice-cert\") pod \"opendatahub-operator-controller-manager-558786d47d-mcj82\" (UID: \"40a16e2f-7273-41af-8654-2d331161c294\") " pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mcj82" Jun 11 19:59:12.917557 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:12.917407 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40a16e2f-7273-41af-8654-2d331161c294-tmp\") pod \"opendatahub-operator-controller-manager-558786d47d-mcj82\" (UID: \"40a16e2f-7273-41af-8654-2d331161c294\") " pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mcj82" Jun 11 19:59:12.917557 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:12.917453 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/40a16e2f-7273-41af-8654-2d331161c294-manifests\") pod \"opendatahub-operator-controller-manager-558786d47d-mcj82\" (UID: \"40a16e2f-7273-41af-8654-2d331161c294\") " pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mcj82" Jun 11 19:59:12.917557 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:12.917476 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv5r6\" (UniqueName: \"kubernetes.io/projected/40a16e2f-7273-41af-8654-2d331161c294-kube-api-access-bv5r6\") pod \"opendatahub-operator-controller-manager-558786d47d-mcj82\" (UID: \"40a16e2f-7273-41af-8654-2d331161c294\") " pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mcj82" Jun 11 19:59:12.917557 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:12.917504 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40a16e2f-7273-41af-8654-2d331161c294-webhook-cert\") pod \"opendatahub-operator-controller-manager-558786d47d-mcj82\" (UID: \"40a16e2f-7273-41af-8654-2d331161c294\") " pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mcj82" Jun 11 19:59:12.917921 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:12.917899 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/40a16e2f-7273-41af-8654-2d331161c294-manifests\") pod \"opendatahub-operator-controller-manager-558786d47d-mcj82\" (UID: \"40a16e2f-7273-41af-8654-2d331161c294\") " pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mcj82" Jun 11 19:59:12.919839 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:12.919813 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40a16e2f-7273-41af-8654-2d331161c294-tmp\") pod \"opendatahub-operator-controller-manager-558786d47d-mcj82\" (UID: \"40a16e2f-7273-41af-8654-2d331161c294\") " pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mcj82" Jun 11 19:59:12.920016 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:12.919994 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40a16e2f-7273-41af-8654-2d331161c294-webhook-cert\") pod \"opendatahub-operator-controller-manager-558786d47d-mcj82\" (UID: \"40a16e2f-7273-41af-8654-2d331161c294\") " pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mcj82" Jun 11 19:59:12.920060 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:12.920021 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/40a16e2f-7273-41af-8654-2d331161c294-apiservice-cert\") pod \"opendatahub-operator-controller-manager-558786d47d-mcj82\" (UID: \"40a16e2f-7273-41af-8654-2d331161c294\") " pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mcj82" Jun 11 19:59:12.928784 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:12.928764 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv5r6\" (UniqueName: \"kubernetes.io/projected/40a16e2f-7273-41af-8654-2d331161c294-kube-api-access-bv5r6\") pod \"opendatahub-operator-controller-manager-558786d47d-mcj82\" (UID: \"40a16e2f-7273-41af-8654-2d331161c294\") " pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mcj82" Jun 11 19:59:13.046533 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:13.046452 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mcj82" Jun 11 19:59:13.190814 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:13.190773 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-558786d47d-mcj82"] Jun 11 19:59:13.194925 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:59:13.194898 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40a16e2f_7273_41af_8654_2d331161c294.slice/crio-6b2e0a8c111aa4144431e00601aa51f18b9d04b3a370068878ca11a5b2236746 WatchSource:0}: Error finding container 6b2e0a8c111aa4144431e00601aa51f18b9d04b3a370068878ca11a5b2236746: Status 404 returned error can't find the container with id 6b2e0a8c111aa4144431e00601aa51f18b9d04b3a370068878ca11a5b2236746 Jun 11 19:59:14.174058 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:14.174023 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mcj82" event={"ID":"40a16e2f-7273-41af-8654-2d331161c294","Type":"ContainerStarted","Data":"6b2e0a8c111aa4144431e00601aa51f18b9d04b3a370068878ca11a5b2236746"} Jun 11 19:59:16.184648 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:16.184614 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mcj82" event={"ID":"40a16e2f-7273-41af-8654-2d331161c294","Type":"ContainerStarted","Data":"7149fdf2c1521d751c1403096d8061e79f34f7b09434b443c8173f7c8d979be6"} Jun 11 19:59:17.190400 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:17.190313 2576 generic.go:356] "Generic (PLEG): container finished" podID="40a16e2f-7273-41af-8654-2d331161c294" containerID="7149fdf2c1521d751c1403096d8061e79f34f7b09434b443c8173f7c8d979be6" exitCode=0 Jun 11 19:59:17.190400 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:17.190357 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mcj82" event={"ID":"40a16e2f-7273-41af-8654-2d331161c294","Type":"ContainerDied","Data":"7149fdf2c1521d751c1403096d8061e79f34f7b09434b443c8173f7c8d979be6"} Jun 11 19:59:18.196904 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:18.196873 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mcj82" event={"ID":"40a16e2f-7273-41af-8654-2d331161c294","Type":"ContainerStarted","Data":"576641a9c488d2c3b43763c70d80fc8dc5959cb13e19b0827f9c51dbec026436"} Jun 11 19:59:18.197299 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:18.196994 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mcj82" Jun 11 19:59:18.307368 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:18.307311 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mcj82" podStartSLOduration=2.287415201 podStartE2EDuration="6.307292818s" totalImagesPullingTime="3.104973243s" totalInitContainerRuntime="914.904374ms" isStatefulPod=false podCreationTimestamp="2026-06-11 19:59:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:59:18.30619844 +0000 UTC m=+558.583959197" watchObservedRunningTime="2026-06-11 19:59:18.307292818 +0000 UTC m=+558.585053576" Jun 11 19:59:29.202889 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:29.202857 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mcj82" Jun 11 19:59:40.367868 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:40.367828 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-d5f49777d-hnb6g"] Jun 11 19:59:40.371624 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:40.371602 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d5f49777d-hnb6g" Jun 11 19:59:40.374782 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:40.374761 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 19:59:40.375714 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:40.375696 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 19:59:40.376455 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:40.376426 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 19:59:40.376558 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:40.376542 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 19:59:40.376714 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:40.376700 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-cftmc\"" Jun 11 19:59:40.376802 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:40.376791 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 19:59:40.384163 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:40.384142 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d5f49777d-hnb6g"] Jun 11 19:59:40.461272 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:40.461234 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgghs\" (UniqueName: \"kubernetes.io/projected/8c46bc73-0638-4e32-ac18-227a6b06364e-kube-api-access-qgghs\") pod \"lws-controller-manager-d5f49777d-hnb6g\" (UID: \"8c46bc73-0638-4e32-ac18-227a6b06364e\") " pod="openshift-lws-operator/lws-controller-manager-d5f49777d-hnb6g" Jun 11 19:59:40.461433 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:40.461282 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c46bc73-0638-4e32-ac18-227a6b06364e-cert\") pod \"lws-controller-manager-d5f49777d-hnb6g\" (UID: \"8c46bc73-0638-4e32-ac18-227a6b06364e\") " pod="openshift-lws-operator/lws-controller-manager-d5f49777d-hnb6g" Jun 11 19:59:40.461433 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:40.461348 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8c46bc73-0638-4e32-ac18-227a6b06364e-manager-config\") pod \"lws-controller-manager-d5f49777d-hnb6g\" (UID: \"8c46bc73-0638-4e32-ac18-227a6b06364e\") " pod="openshift-lws-operator/lws-controller-manager-d5f49777d-hnb6g" Jun 11 19:59:40.461433 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:40.461412 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8c46bc73-0638-4e32-ac18-227a6b06364e-metrics-cert\") pod \"lws-controller-manager-d5f49777d-hnb6g\" (UID: \"8c46bc73-0638-4e32-ac18-227a6b06364e\") " pod="openshift-lws-operator/lws-controller-manager-d5f49777d-hnb6g" Jun 11 19:59:40.562506 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:40.562473 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgghs\" (UniqueName: \"kubernetes.io/projected/8c46bc73-0638-4e32-ac18-227a6b06364e-kube-api-access-qgghs\") pod \"lws-controller-manager-d5f49777d-hnb6g\" (UID: \"8c46bc73-0638-4e32-ac18-227a6b06364e\") " pod="openshift-lws-operator/lws-controller-manager-d5f49777d-hnb6g" Jun 11 19:59:40.562677 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:40.562516 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c46bc73-0638-4e32-ac18-227a6b06364e-cert\") pod \"lws-controller-manager-d5f49777d-hnb6g\" (UID: \"8c46bc73-0638-4e32-ac18-227a6b06364e\") " pod="openshift-lws-operator/lws-controller-manager-d5f49777d-hnb6g" Jun 11 19:59:40.562677 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:40.562558 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8c46bc73-0638-4e32-ac18-227a6b06364e-manager-config\") pod \"lws-controller-manager-d5f49777d-hnb6g\" (UID: \"8c46bc73-0638-4e32-ac18-227a6b06364e\") " pod="openshift-lws-operator/lws-controller-manager-d5f49777d-hnb6g" Jun 11 19:59:40.562677 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:40.562604 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8c46bc73-0638-4e32-ac18-227a6b06364e-metrics-cert\") pod \"lws-controller-manager-d5f49777d-hnb6g\" (UID: \"8c46bc73-0638-4e32-ac18-227a6b06364e\") " pod="openshift-lws-operator/lws-controller-manager-d5f49777d-hnb6g" Jun 11 19:59:40.563239 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:40.563213 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8c46bc73-0638-4e32-ac18-227a6b06364e-manager-config\") pod \"lws-controller-manager-d5f49777d-hnb6g\" (UID: \"8c46bc73-0638-4e32-ac18-227a6b06364e\") " pod="openshift-lws-operator/lws-controller-manager-d5f49777d-hnb6g" Jun 11 19:59:40.565066 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:40.565044 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c46bc73-0638-4e32-ac18-227a6b06364e-cert\") pod \"lws-controller-manager-d5f49777d-hnb6g\" (UID: \"8c46bc73-0638-4e32-ac18-227a6b06364e\") " pod="openshift-lws-operator/lws-controller-manager-d5f49777d-hnb6g" Jun 11 19:59:40.565197 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:40.565101 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8c46bc73-0638-4e32-ac18-227a6b06364e-metrics-cert\") pod \"lws-controller-manager-d5f49777d-hnb6g\" (UID: \"8c46bc73-0638-4e32-ac18-227a6b06364e\") " pod="openshift-lws-operator/lws-controller-manager-d5f49777d-hnb6g" Jun 11 19:59:40.571267 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:40.571245 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgghs\" (UniqueName: \"kubernetes.io/projected/8c46bc73-0638-4e32-ac18-227a6b06364e-kube-api-access-qgghs\") pod \"lws-controller-manager-d5f49777d-hnb6g\" (UID: \"8c46bc73-0638-4e32-ac18-227a6b06364e\") " pod="openshift-lws-operator/lws-controller-manager-d5f49777d-hnb6g" Jun 11 19:59:40.680948 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:40.680879 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d5f49777d-hnb6g" Jun 11 19:59:40.816906 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:40.816883 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d5f49777d-hnb6g"] Jun 11 19:59:40.818767 ip-10-0-137-247 kubenswrapper[2576]: W0611 19:59:40.818737 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c46bc73_0638_4e32_ac18_227a6b06364e.slice/crio-6e714a4a7b6ab7627a43fb1d70a46ac02708ca8d21644af1774de2a91718506a WatchSource:0}: Error finding container 6e714a4a7b6ab7627a43fb1d70a46ac02708ca8d21644af1774de2a91718506a: Status 404 returned error can't find the container with id 6e714a4a7b6ab7627a43fb1d70a46ac02708ca8d21644af1774de2a91718506a Jun 11 19:59:41.294736 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:41.294697 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d5f49777d-hnb6g" event={"ID":"8c46bc73-0638-4e32-ac18-227a6b06364e","Type":"ContainerStarted","Data":"6e714a4a7b6ab7627a43fb1d70a46ac02708ca8d21644af1774de2a91718506a"} Jun 11 19:59:43.306006 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:43.305970 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d5f49777d-hnb6g" event={"ID":"8c46bc73-0638-4e32-ac18-227a6b06364e","Type":"ContainerStarted","Data":"c5e0f19665f0b89045d95334e88063d07b53727d0e898fa7fd814a8fe81fd73e"} Jun 11 19:59:43.306439 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:43.306060 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-d5f49777d-hnb6g" Jun 11 19:59:43.350919 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:43.350859 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-d5f49777d-hnb6g" podStartSLOduration=1.05010437 podStartE2EDuration="3.35084305s" totalImagesPullingTime="2.30073868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:59:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:59:43.349989657 +0000 UTC m=+583.627750418" watchObservedRunningTime="2026-06-11 19:59:43.35084305 +0000 UTC m=+583.628603871" Jun 11 19:59:54.312563 ip-10-0-137-247 kubenswrapper[2576]: I0611 19:59:54.312526 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-d5f49777d-hnb6g" Jun 11 20:00:00.180224 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:00.180186 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9pxm2_23de3c36-7fd1-4a71-9bff-dd7782544ca4/console-operator/1.log" Jun 11 20:00:00.180681 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:00.180642 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9pxm2_23de3c36-7fd1-4a71-9bff-dd7782544ca4/console-operator/1.log" Jun 11 20:00:00.183645 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:00.183625 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hrb9t_85a48db4-30bf-47f2-9668-8b0a67c26fe4/ovn-acl-logging/0.log" Jun 11 20:00:00.184039 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:00.184023 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hrb9t_85a48db4-30bf-47f2-9668-8b0a67c26fe4/ovn-acl-logging/0.log" Jun 11 20:00:02.936911 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:02.936874 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq"] Jun 11 20:00:02.948512 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:02.948489 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" Jun 11 20:00:02.953641 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:02.953621 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 20:00:02.954358 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:02.954335 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 20:00:02.954569 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:02.954555 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-nmg52\"" Jun 11 20:00:02.954811 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:02.954795 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 20:00:02.961501 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:02.961477 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq"] Jun 11 20:00:03.070530 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:03.070503 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6458854d-28ed-49a5-981e-87b8743eef12-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97958jlhq\" (UID: \"6458854d-28ed-49a5-981e-87b8743eef12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" Jun 11 20:00:03.070721 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:03.070545 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wqj9\" (UniqueName: \"kubernetes.io/projected/6458854d-28ed-49a5-981e-87b8743eef12-kube-api-access-4wqj9\") pod \"data-science-gateway-data-science-gateway-class-74759f97958jlhq\" (UID: \"6458854d-28ed-49a5-981e-87b8743eef12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" Jun 11 20:00:03.070721 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:03.070610 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6458854d-28ed-49a5-981e-87b8743eef12-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97958jlhq\" (UID: \"6458854d-28ed-49a5-981e-87b8743eef12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" Jun 11 20:00:03.070721 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:03.070627 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6458854d-28ed-49a5-981e-87b8743eef12-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97958jlhq\" (UID: \"6458854d-28ed-49a5-981e-87b8743eef12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" Jun 11 20:00:03.070721 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:03.070648 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6458854d-28ed-49a5-981e-87b8743eef12-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97958jlhq\" (UID: \"6458854d-28ed-49a5-981e-87b8743eef12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" Jun 11 20:00:03.070721 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:03.070675 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6458854d-28ed-49a5-981e-87b8743eef12-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97958jlhq\" (UID: \"6458854d-28ed-49a5-981e-87b8743eef12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" Jun 11 20:00:03.070721 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:03.070690 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6458854d-28ed-49a5-981e-87b8743eef12-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97958jlhq\" (UID: \"6458854d-28ed-49a5-981e-87b8743eef12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" Jun 11 20:00:03.070721 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:03.070706 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6458854d-28ed-49a5-981e-87b8743eef12-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97958jlhq\" (UID: \"6458854d-28ed-49a5-981e-87b8743eef12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" Jun 11 20:00:03.071070 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:03.070768 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6458854d-28ed-49a5-981e-87b8743eef12-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97958jlhq\" (UID: \"6458854d-28ed-49a5-981e-87b8743eef12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" Jun 11 20:00:03.172044 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:03.172012 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wqj9\" (UniqueName: \"kubernetes.io/projected/6458854d-28ed-49a5-981e-87b8743eef12-kube-api-access-4wqj9\") pod \"data-science-gateway-data-science-gateway-class-74759f97958jlhq\" (UID: \"6458854d-28ed-49a5-981e-87b8743eef12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" Jun 11 20:00:03.172235 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:03.172060 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6458854d-28ed-49a5-981e-87b8743eef12-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97958jlhq\" (UID: \"6458854d-28ed-49a5-981e-87b8743eef12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" Jun 11 20:00:03.172235 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:03.172088 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6458854d-28ed-49a5-981e-87b8743eef12-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97958jlhq\" (UID: \"6458854d-28ed-49a5-981e-87b8743eef12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" Jun 11 20:00:03.172235 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:03.172140 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6458854d-28ed-49a5-981e-87b8743eef12-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97958jlhq\" (UID: \"6458854d-28ed-49a5-981e-87b8743eef12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" Jun 11 20:00:03.172379 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:03.172325 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6458854d-28ed-49a5-981e-87b8743eef12-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97958jlhq\" (UID: \"6458854d-28ed-49a5-981e-87b8743eef12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" Jun 11 20:00:03.172379 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:03.172365 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6458854d-28ed-49a5-981e-87b8743eef12-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97958jlhq\" (UID: \"6458854d-28ed-49a5-981e-87b8743eef12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" Jun 11 20:00:03.172482 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:03.172395 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6458854d-28ed-49a5-981e-87b8743eef12-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97958jlhq\" (UID: \"6458854d-28ed-49a5-981e-87b8743eef12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" Jun 11 20:00:03.172482 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:03.172430 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6458854d-28ed-49a5-981e-87b8743eef12-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97958jlhq\" (UID: \"6458854d-28ed-49a5-981e-87b8743eef12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" Jun 11 20:00:03.172583 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:03.172503 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6458854d-28ed-49a5-981e-87b8743eef12-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97958jlhq\" (UID: \"6458854d-28ed-49a5-981e-87b8743eef12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" Jun 11 20:00:03.172637 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:03.172575 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6458854d-28ed-49a5-981e-87b8743eef12-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97958jlhq\" (UID: \"6458854d-28ed-49a5-981e-87b8743eef12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" Jun 11 20:00:03.172687 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:03.172642 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6458854d-28ed-49a5-981e-87b8743eef12-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97958jlhq\" (UID: \"6458854d-28ed-49a5-981e-87b8743eef12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" Jun 11 20:00:03.172844 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:03.172820 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6458854d-28ed-49a5-981e-87b8743eef12-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97958jlhq\" (UID: \"6458854d-28ed-49a5-981e-87b8743eef12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" Jun 11 20:00:03.173023 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:03.172871 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6458854d-28ed-49a5-981e-87b8743eef12-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97958jlhq\" (UID: \"6458854d-28ed-49a5-981e-87b8743eef12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" Jun 11 20:00:03.173151 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:03.173111 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6458854d-28ed-49a5-981e-87b8743eef12-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97958jlhq\" (UID: \"6458854d-28ed-49a5-981e-87b8743eef12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" Jun 11 20:00:03.174416 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:03.174396 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6458854d-28ed-49a5-981e-87b8743eef12-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97958jlhq\" (UID: \"6458854d-28ed-49a5-981e-87b8743eef12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" Jun 11 20:00:03.174552 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:03.174534 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6458854d-28ed-49a5-981e-87b8743eef12-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97958jlhq\" (UID: \"6458854d-28ed-49a5-981e-87b8743eef12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" Jun 11 20:00:03.189163 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:03.189084 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wqj9\" (UniqueName: \"kubernetes.io/projected/6458854d-28ed-49a5-981e-87b8743eef12-kube-api-access-4wqj9\") pod \"data-science-gateway-data-science-gateway-class-74759f97958jlhq\" (UID: \"6458854d-28ed-49a5-981e-87b8743eef12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" Jun 11 20:00:03.191249 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:03.191226 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6458854d-28ed-49a5-981e-87b8743eef12-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97958jlhq\" (UID: \"6458854d-28ed-49a5-981e-87b8743eef12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" Jun 11 20:00:03.259036 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:03.259006 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" Jun 11 20:00:03.402725 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:03.402695 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq"] Jun 11 20:00:03.405678 ip-10-0-137-247 kubenswrapper[2576]: W0611 20:00:03.405652 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6458854d_28ed_49a5_981e_87b8743eef12.slice/crio-f77bb02bbdf544ecbf60e4c87e05b0c532d6f382e9c1d63cd0835439ede407be WatchSource:0}: Error finding container f77bb02bbdf544ecbf60e4c87e05b0c532d6f382e9c1d63cd0835439ede407be: Status 404 returned error can't find the container with id f77bb02bbdf544ecbf60e4c87e05b0c532d6f382e9c1d63cd0835439ede407be Jun 11 20:00:04.393100 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:04.393068 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" event={"ID":"6458854d-28ed-49a5-981e-87b8743eef12","Type":"ContainerStarted","Data":"f77bb02bbdf544ecbf60e4c87e05b0c532d6f382e9c1d63cd0835439ede407be"} Jun 11 20:00:10.888491 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:10.887787 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 20:00:10.888491 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:10.887873 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 20:00:10.888491 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:10.887941 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 20:00:11.426611 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:11.426567 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" event={"ID":"6458854d-28ed-49a5-981e-87b8743eef12","Type":"ContainerStarted","Data":"074c17490e654125b592d21ec04b768ff6d782378d1eebba52a15e1a9dda6b87"} Jun 11 20:00:11.463235 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:11.463181 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" podStartSLOduration=1.983285052 podStartE2EDuration="9.463167448s" totalImagesPullingTime="7.479882396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:00:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:00:11.462474515 +0000 UTC m=+611.740235274" watchObservedRunningTime="2026-06-11 20:00:11.463167448 +0000 UTC m=+611.740928206" Jun 11 20:00:11.915717 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:11.915682 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5f56b79599-tk8cp"] Jun 11 20:00:11.919275 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:11.919254 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5f56b79599-tk8cp" Jun 11 20:00:11.922648 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:11.922622 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-lljjr\"" Jun 11 20:00:11.923110 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:11.923095 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 20:00:11.933298 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:11.933270 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5f56b79599-tk8cp"] Jun 11 20:00:11.957795 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:11.957762 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg2ll\" (UniqueName: \"kubernetes.io/projected/838715e7-2b1d-46cf-9bbe-b3c824ca62c8-kube-api-access-sg2ll\") pod \"dashboard-redirect-5f56b79599-tk8cp\" (UID: \"838715e7-2b1d-46cf-9bbe-b3c824ca62c8\") " pod="opendatahub/dashboard-redirect-5f56b79599-tk8cp" Jun 11 20:00:11.957921 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:11.957822 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/838715e7-2b1d-46cf-9bbe-b3c824ca62c8-redirect-config\") pod \"dashboard-redirect-5f56b79599-tk8cp\" (UID: \"838715e7-2b1d-46cf-9bbe-b3c824ca62c8\") " pod="opendatahub/dashboard-redirect-5f56b79599-tk8cp" Jun 11 20:00:12.058875 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:12.058839 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg2ll\" (UniqueName: \"kubernetes.io/projected/838715e7-2b1d-46cf-9bbe-b3c824ca62c8-kube-api-access-sg2ll\") pod \"dashboard-redirect-5f56b79599-tk8cp\" (UID: \"838715e7-2b1d-46cf-9bbe-b3c824ca62c8\") " pod="opendatahub/dashboard-redirect-5f56b79599-tk8cp" Jun 11 20:00:12.059076 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:12.058911 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/838715e7-2b1d-46cf-9bbe-b3c824ca62c8-redirect-config\") pod \"dashboard-redirect-5f56b79599-tk8cp\" (UID: \"838715e7-2b1d-46cf-9bbe-b3c824ca62c8\") " pod="opendatahub/dashboard-redirect-5f56b79599-tk8cp" Jun 11 20:00:12.059652 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:12.059627 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/838715e7-2b1d-46cf-9bbe-b3c824ca62c8-redirect-config\") pod \"dashboard-redirect-5f56b79599-tk8cp\" (UID: \"838715e7-2b1d-46cf-9bbe-b3c824ca62c8\") " pod="opendatahub/dashboard-redirect-5f56b79599-tk8cp" Jun 11 20:00:12.077802 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:12.077781 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg2ll\" (UniqueName: \"kubernetes.io/projected/838715e7-2b1d-46cf-9bbe-b3c824ca62c8-kube-api-access-sg2ll\") pod \"dashboard-redirect-5f56b79599-tk8cp\" (UID: \"838715e7-2b1d-46cf-9bbe-b3c824ca62c8\") " pod="opendatahub/dashboard-redirect-5f56b79599-tk8cp" Jun 11 20:00:12.230198 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:12.230107 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5f56b79599-tk8cp" Jun 11 20:00:12.260192 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:12.260163 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" Jun 11 20:00:12.265069 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:12.265047 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" Jun 11 20:00:12.363893 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:12.363866 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5f56b79599-tk8cp"] Jun 11 20:00:12.365426 ip-10-0-137-247 kubenswrapper[2576]: W0611 20:00:12.365401 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod838715e7_2b1d_46cf_9bbe_b3c824ca62c8.slice/crio-9eb73ec6d0eb43d5d7b0db91efac4d38279f8cc26ba360932d86fed0d7b6ae51 WatchSource:0}: Error finding container 9eb73ec6d0eb43d5d7b0db91efac4d38279f8cc26ba360932d86fed0d7b6ae51: Status 404 returned error can't find the container with id 9eb73ec6d0eb43d5d7b0db91efac4d38279f8cc26ba360932d86fed0d7b6ae51 Jun 11 20:00:12.431638 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:12.431604 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5f56b79599-tk8cp" event={"ID":"838715e7-2b1d-46cf-9bbe-b3c824ca62c8","Type":"ContainerStarted","Data":"9eb73ec6d0eb43d5d7b0db91efac4d38279f8cc26ba360932d86fed0d7b6ae51"} Jun 11 20:00:12.431826 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:12.431809 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" Jun 11 20:00:12.432694 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:12.432674 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958jlhq" Jun 11 20:00:15.448505 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:15.448466 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5f56b79599-tk8cp" event={"ID":"838715e7-2b1d-46cf-9bbe-b3c824ca62c8","Type":"ContainerStarted","Data":"e21527e2fa7f50a17af9edb4bf473768b6dff765710ec8316d3ea891a9f396db"} Jun 11 20:00:15.471749 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:15.471700 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5f56b79599-tk8cp" podStartSLOduration=1.9817132549999998 podStartE2EDuration="4.471684684s" totalImagesPullingTime="2.489971429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:00:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:00:15.469518835 +0000 UTC m=+615.747279593" watchObservedRunningTime="2026-06-11 20:00:15.471684684 +0000 UTC m=+615.749445468" Jun 11 20:00:33.132380 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:33.132346 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m8klv"] Jun 11 20:00:33.139572 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:33.139553 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-m8klv" Jun 11 20:00:33.142650 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:33.142625 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 20:00:33.142899 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:33.142881 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-9blk6\"" Jun 11 20:00:33.143176 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:33.143157 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 20:00:33.144075 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:33.144049 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m8klv"] Jun 11 20:00:33.245913 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:33.245884 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxk28\" (UniqueName: \"kubernetes.io/projected/1acf9f4b-ae4c-41f6-bbf1-bd6b0403e2bc-kube-api-access-wxk28\") pod \"kuadrant-operator-catalog-m8klv\" (UID: \"1acf9f4b-ae4c-41f6-bbf1-bd6b0403e2bc\") " pod="kuadrant-system/kuadrant-operator-catalog-m8klv" Jun 11 20:00:33.347243 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:33.347209 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxk28\" (UniqueName: \"kubernetes.io/projected/1acf9f4b-ae4c-41f6-bbf1-bd6b0403e2bc-kube-api-access-wxk28\") pod \"kuadrant-operator-catalog-m8klv\" (UID: \"1acf9f4b-ae4c-41f6-bbf1-bd6b0403e2bc\") " pod="kuadrant-system/kuadrant-operator-catalog-m8klv" Jun 11 20:00:33.354989 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:33.354964 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxk28\" (UniqueName: \"kubernetes.io/projected/1acf9f4b-ae4c-41f6-bbf1-bd6b0403e2bc-kube-api-access-wxk28\") pod \"kuadrant-operator-catalog-m8klv\" (UID: \"1acf9f4b-ae4c-41f6-bbf1-bd6b0403e2bc\") " pod="kuadrant-system/kuadrant-operator-catalog-m8klv" Jun 11 20:00:33.450791 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:33.450715 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-m8klv" Jun 11 20:00:33.579161 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:33.579134 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m8klv"] Jun 11 20:00:33.581660 ip-10-0-137-247 kubenswrapper[2576]: W0611 20:00:33.581625 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1acf9f4b_ae4c_41f6_bbf1_bd6b0403e2bc.slice/crio-891aa83b11a1b87978fc0adf379338e6c70658b3a5bc3689f75a7cefa50f749d WatchSource:0}: Error finding container 891aa83b11a1b87978fc0adf379338e6c70658b3a5bc3689f75a7cefa50f749d: Status 404 returned error can't find the container with id 891aa83b11a1b87978fc0adf379338e6c70658b3a5bc3689f75a7cefa50f749d Jun 11 20:00:33.651870 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:33.649423 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m8klv"] Jun 11 20:00:33.706374 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:33.706299 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f8lht"] Jun 11 20:00:33.711010 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:33.710994 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-f8lht" Jun 11 20:00:33.717237 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:33.717212 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f8lht"] Jun 11 20:00:33.852615 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:33.852576 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvpmw\" (UniqueName: \"kubernetes.io/projected/dec8947b-07d3-434b-bb98-bab2e9283aa1-kube-api-access-jvpmw\") pod \"kuadrant-operator-catalog-f8lht\" (UID: \"dec8947b-07d3-434b-bb98-bab2e9283aa1\") " pod="kuadrant-system/kuadrant-operator-catalog-f8lht" Jun 11 20:00:33.953633 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:33.953592 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvpmw\" (UniqueName: \"kubernetes.io/projected/dec8947b-07d3-434b-bb98-bab2e9283aa1-kube-api-access-jvpmw\") pod \"kuadrant-operator-catalog-f8lht\" (UID: \"dec8947b-07d3-434b-bb98-bab2e9283aa1\") " pod="kuadrant-system/kuadrant-operator-catalog-f8lht" Jun 11 20:00:33.962280 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:33.962229 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvpmw\" (UniqueName: \"kubernetes.io/projected/dec8947b-07d3-434b-bb98-bab2e9283aa1-kube-api-access-jvpmw\") pod \"kuadrant-operator-catalog-f8lht\" (UID: \"dec8947b-07d3-434b-bb98-bab2e9283aa1\") " pod="kuadrant-system/kuadrant-operator-catalog-f8lht" Jun 11 20:00:34.021755 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:34.021719 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-f8lht" Jun 11 20:00:34.152158 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:34.152109 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f8lht"] Jun 11 20:00:34.154310 ip-10-0-137-247 kubenswrapper[2576]: W0611 20:00:34.154284 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddec8947b_07d3_434b_bb98_bab2e9283aa1.slice/crio-fcb25f0f96c5946fd8d63656c0021522e979204e9338b29b6cec0aea1980be37 WatchSource:0}: Error finding container fcb25f0f96c5946fd8d63656c0021522e979204e9338b29b6cec0aea1980be37: Status 404 returned error can't find the container with id fcb25f0f96c5946fd8d63656c0021522e979204e9338b29b6cec0aea1980be37 Jun 11 20:00:34.534285 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:34.534254 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-f8lht" event={"ID":"dec8947b-07d3-434b-bb98-bab2e9283aa1","Type":"ContainerStarted","Data":"fcb25f0f96c5946fd8d63656c0021522e979204e9338b29b6cec0aea1980be37"} Jun 11 20:00:34.535546 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:34.535518 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-m8klv" event={"ID":"1acf9f4b-ae4c-41f6-bbf1-bd6b0403e2bc","Type":"ContainerStarted","Data":"891aa83b11a1b87978fc0adf379338e6c70658b3a5bc3689f75a7cefa50f749d"} Jun 11 20:00:36.546871 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:36.546833 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-f8lht" event={"ID":"dec8947b-07d3-434b-bb98-bab2e9283aa1","Type":"ContainerStarted","Data":"1a748d07f798870207ddf8dffecc601c69f8589b7b0f9e1b5188158137690348"} Jun 11 20:00:36.548195 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:36.548170 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-m8klv" event={"ID":"1acf9f4b-ae4c-41f6-bbf1-bd6b0403e2bc","Type":"ContainerStarted","Data":"070329d1e108ec8fb01fff47a991a6ea70d1f5b0245ee2d346643c7146e1a201"} Jun 11 20:00:36.548286 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:36.548239 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-m8klv" podUID="1acf9f4b-ae4c-41f6-bbf1-bd6b0403e2bc" containerName="registry-server" containerID="cri-o://070329d1e108ec8fb01fff47a991a6ea70d1f5b0245ee2d346643c7146e1a201" gracePeriod=2 Jun 11 20:00:36.563468 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:36.562905 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-f8lht" podStartSLOduration=1.984553263 podStartE2EDuration="3.562886198s" totalImagesPullingTime="1.578332935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:00:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:00:36.562806054 +0000 UTC m=+636.840566812" watchObservedRunningTime="2026-06-11 20:00:36.562886198 +0000 UTC m=+636.840646957" Jun 11 20:00:36.580899 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:36.580854 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-m8klv" podStartSLOduration=1.430709002 podStartE2EDuration="3.580838975s" totalImagesPullingTime="2.150129973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:00:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:00:36.578945502 +0000 UTC m=+636.856706260" watchObservedRunningTime="2026-06-11 20:00:36.580838975 +0000 UTC m=+636.858599733" Jun 11 20:00:36.791331 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:36.791308 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-m8klv" Jun 11 20:00:36.882301 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:36.882268 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxk28\" (UniqueName: \"kubernetes.io/projected/1acf9f4b-ae4c-41f6-bbf1-bd6b0403e2bc-kube-api-access-wxk28\") pod \"1acf9f4b-ae4c-41f6-bbf1-bd6b0403e2bc\" (UID: \"1acf9f4b-ae4c-41f6-bbf1-bd6b0403e2bc\") " Jun 11 20:00:36.884568 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:36.884533 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1acf9f4b-ae4c-41f6-bbf1-bd6b0403e2bc-kube-api-access-wxk28" (OuterVolumeSpecName: "kube-api-access-wxk28") pod "1acf9f4b-ae4c-41f6-bbf1-bd6b0403e2bc" (UID: "1acf9f4b-ae4c-41f6-bbf1-bd6b0403e2bc"). InnerVolumeSpecName "kube-api-access-wxk28". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:00:36.983701 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:36.983670 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxk28\" (UniqueName: \"kubernetes.io/projected/1acf9f4b-ae4c-41f6-bbf1-bd6b0403e2bc-kube-api-access-wxk28\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:00:37.553959 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:37.553920 2576 generic.go:356] "Generic (PLEG): container finished" podID="1acf9f4b-ae4c-41f6-bbf1-bd6b0403e2bc" containerID="070329d1e108ec8fb01fff47a991a6ea70d1f5b0245ee2d346643c7146e1a201" exitCode=0 Jun 11 20:00:37.554459 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:37.553971 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-m8klv" Jun 11 20:00:37.554459 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:37.553971 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-m8klv" event={"ID":"1acf9f4b-ae4c-41f6-bbf1-bd6b0403e2bc","Type":"ContainerDied","Data":"070329d1e108ec8fb01fff47a991a6ea70d1f5b0245ee2d346643c7146e1a201"} Jun 11 20:00:37.554459 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:37.554083 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-m8klv" event={"ID":"1acf9f4b-ae4c-41f6-bbf1-bd6b0403e2bc","Type":"ContainerDied","Data":"891aa83b11a1b87978fc0adf379338e6c70658b3a5bc3689f75a7cefa50f749d"} Jun 11 20:00:37.554459 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:37.554104 2576 scope.go:117] "RemoveContainer" containerID="070329d1e108ec8fb01fff47a991a6ea70d1f5b0245ee2d346643c7146e1a201" Jun 11 20:00:37.562972 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:37.562956 2576 scope.go:117] "RemoveContainer" containerID="070329d1e108ec8fb01fff47a991a6ea70d1f5b0245ee2d346643c7146e1a201" Jun 11 20:00:37.563261 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:00:37.563241 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"070329d1e108ec8fb01fff47a991a6ea70d1f5b0245ee2d346643c7146e1a201\": container with ID starting with 070329d1e108ec8fb01fff47a991a6ea70d1f5b0245ee2d346643c7146e1a201 not found: ID does not exist" containerID="070329d1e108ec8fb01fff47a991a6ea70d1f5b0245ee2d346643c7146e1a201" Jun 11 20:00:37.563329 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:37.563273 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"070329d1e108ec8fb01fff47a991a6ea70d1f5b0245ee2d346643c7146e1a201"} err="failed to get container status \"070329d1e108ec8fb01fff47a991a6ea70d1f5b0245ee2d346643c7146e1a201\": rpc error: code = NotFound desc = could not find container \"070329d1e108ec8fb01fff47a991a6ea70d1f5b0245ee2d346643c7146e1a201\": container with ID starting with 070329d1e108ec8fb01fff47a991a6ea70d1f5b0245ee2d346643c7146e1a201 not found: ID does not exist" Jun 11 20:00:37.574073 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:37.574051 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m8klv"] Jun 11 20:00:37.578458 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:37.578436 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m8klv"] Jun 11 20:00:38.200980 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:38.200934 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1acf9f4b-ae4c-41f6-bbf1-bd6b0403e2bc" path="/var/lib/kubelet/pods/1acf9f4b-ae4c-41f6-bbf1-bd6b0403e2bc/volumes" Jun 11 20:00:44.021814 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:44.021779 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-f8lht" Jun 11 20:00:44.022269 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:44.021839 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-f8lht" Jun 11 20:00:44.044153 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:44.044107 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-f8lht" Jun 11 20:00:44.606691 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:00:44.606665 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-f8lht" Jun 11 20:01:03.841995 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:03.841957 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-crwh6"] Jun 11 20:01:03.842434 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:03.842357 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1acf9f4b-ae4c-41f6-bbf1-bd6b0403e2bc" containerName="registry-server" Jun 11 20:01:03.842434 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:03.842370 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1acf9f4b-ae4c-41f6-bbf1-bd6b0403e2bc" containerName="registry-server" Jun 11 20:01:03.842516 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:03.842449 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1acf9f4b-ae4c-41f6-bbf1-bd6b0403e2bc" containerName="registry-server" Jun 11 20:01:03.846990 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:03.846973 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-crwh6" Jun 11 20:01:03.849524 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:03.849494 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 11 20:01:03.849621 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:03.849594 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-68m2g\"" Jun 11 20:01:03.857659 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:03.857635 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-crwh6"] Jun 11 20:01:03.909084 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:03.909054 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htrcj\" (UniqueName: \"kubernetes.io/projected/fe9b4ab9-1ad3-4756-8fdc-1c454a70c997-kube-api-access-htrcj\") pod \"dns-operator-controller-manager-864dd78c4c-crwh6\" (UID: \"fe9b4ab9-1ad3-4756-8fdc-1c454a70c997\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-crwh6" Jun 11 20:01:04.010330 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:04.010289 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htrcj\" (UniqueName: \"kubernetes.io/projected/fe9b4ab9-1ad3-4756-8fdc-1c454a70c997-kube-api-access-htrcj\") pod \"dns-operator-controller-manager-864dd78c4c-crwh6\" (UID: \"fe9b4ab9-1ad3-4756-8fdc-1c454a70c997\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-crwh6" Jun 11 20:01:04.023270 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:04.023242 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htrcj\" (UniqueName: \"kubernetes.io/projected/fe9b4ab9-1ad3-4756-8fdc-1c454a70c997-kube-api-access-htrcj\") pod \"dns-operator-controller-manager-864dd78c4c-crwh6\" (UID: \"fe9b4ab9-1ad3-4756-8fdc-1c454a70c997\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-crwh6" Jun 11 20:01:04.157892 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:04.157798 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-crwh6" Jun 11 20:01:04.285870 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:04.285843 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-crwh6"] Jun 11 20:01:04.288132 ip-10-0-137-247 kubenswrapper[2576]: W0611 20:01:04.288084 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe9b4ab9_1ad3_4756_8fdc_1c454a70c997.slice/crio-7d70682bd9dd9dfbb2b9aca3cb01cccac6f5bae02a9dc82dd7a9ff2fdfc62d7d WatchSource:0}: Error finding container 7d70682bd9dd9dfbb2b9aca3cb01cccac6f5bae02a9dc82dd7a9ff2fdfc62d7d: Status 404 returned error can't find the container with id 7d70682bd9dd9dfbb2b9aca3cb01cccac6f5bae02a9dc82dd7a9ff2fdfc62d7d Jun 11 20:01:04.683790 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:04.683756 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-crwh6" event={"ID":"fe9b4ab9-1ad3-4756-8fdc-1c454a70c997","Type":"ContainerStarted","Data":"7d70682bd9dd9dfbb2b9aca3cb01cccac6f5bae02a9dc82dd7a9ff2fdfc62d7d"} Jun 11 20:01:06.695161 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:06.695113 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-crwh6" event={"ID":"fe9b4ab9-1ad3-4756-8fdc-1c454a70c997","Type":"ContainerStarted","Data":"7eab88620ff04baea0a91e0c487b8bfed8d6bd240b914296a4927baec2ccd26f"} Jun 11 20:01:06.695489 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:06.695239 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-crwh6" Jun 11 20:01:06.712048 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:06.712002 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-crwh6" podStartSLOduration=1.4225889409999999 podStartE2EDuration="3.711988497s" totalImagesPullingTime="2.289399556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:01:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:01:06.711474917 +0000 UTC m=+666.989235688" watchObservedRunningTime="2026-06-11 20:01:06.711988497 +0000 UTC m=+666.989749255" Jun 11 20:01:07.356888 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:07.356856 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4g7d5"] Jun 11 20:01:07.360352 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:07.360336 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4g7d5" Jun 11 20:01:07.363358 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:07.363335 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-5q9fr\"" Jun 11 20:01:07.378886 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:07.378851 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4g7d5"] Jun 11 20:01:07.443651 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:07.443617 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gp5l\" (UniqueName: \"kubernetes.io/projected/2ab842ee-74c8-46d0-a88e-c0ca9dab59ca-kube-api-access-4gp5l\") pod \"limitador-operator-controller-manager-859d7b78bd-4g7d5\" (UID: \"2ab842ee-74c8-46d0-a88e-c0ca9dab59ca\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4g7d5" Jun 11 20:01:07.544979 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:07.544948 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gp5l\" (UniqueName: \"kubernetes.io/projected/2ab842ee-74c8-46d0-a88e-c0ca9dab59ca-kube-api-access-4gp5l\") pod \"limitador-operator-controller-manager-859d7b78bd-4g7d5\" (UID: \"2ab842ee-74c8-46d0-a88e-c0ca9dab59ca\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4g7d5" Jun 11 20:01:07.578143 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:07.578087 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gp5l\" (UniqueName: \"kubernetes.io/projected/2ab842ee-74c8-46d0-a88e-c0ca9dab59ca-kube-api-access-4gp5l\") pod \"limitador-operator-controller-manager-859d7b78bd-4g7d5\" (UID: \"2ab842ee-74c8-46d0-a88e-c0ca9dab59ca\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4g7d5" Jun 11 20:01:07.670672 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:07.670599 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4g7d5" Jun 11 20:01:07.814961 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:07.814936 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4g7d5"] Jun 11 20:01:07.817039 ip-10-0-137-247 kubenswrapper[2576]: W0611 20:01:07.817012 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ab842ee_74c8_46d0_a88e_c0ca9dab59ca.slice/crio-61caeca8825852d6487a209ee86d2e5628fbeb8c6bb2a90f644b842506a8fbf1 WatchSource:0}: Error finding container 61caeca8825852d6487a209ee86d2e5628fbeb8c6bb2a90f644b842506a8fbf1: Status 404 returned error can't find the container with id 61caeca8825852d6487a209ee86d2e5628fbeb8c6bb2a90f644b842506a8fbf1 Jun 11 20:01:08.708835 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:08.708790 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4g7d5" event={"ID":"2ab842ee-74c8-46d0-a88e-c0ca9dab59ca","Type":"ContainerStarted","Data":"61caeca8825852d6487a209ee86d2e5628fbeb8c6bb2a90f644b842506a8fbf1"} Jun 11 20:01:10.720338 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:10.720303 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4g7d5" event={"ID":"2ab842ee-74c8-46d0-a88e-c0ca9dab59ca","Type":"ContainerStarted","Data":"db245f2bcd3f9f5390763f18edd8714470cabe394302950513e20e03e37a2e6a"} Jun 11 20:01:10.720771 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:10.720368 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4g7d5" Jun 11 20:01:10.739780 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:10.739727 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4g7d5" podStartSLOduration=1.662134262 podStartE2EDuration="3.739712583s" totalImagesPullingTime="2.077578321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:01:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:01:10.737748347 +0000 UTC m=+671.015509104" watchObservedRunningTime="2026-06-11 20:01:10.739712583 +0000 UTC m=+671.017473340" Jun 11 20:01:12.489142 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:12.489092 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk"] Jun 11 20:01:12.492503 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:12.492487 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk" Jun 11 20:01:12.496188 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:12.496170 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rwztd\"" Jun 11 20:01:12.510630 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:12.510605 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk"] Jun 11 20:01:12.598943 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:12.598910 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/90ae0230-abb1-4bff-96eb-59cf550f543a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-84rsk\" (UID: \"90ae0230-abb1-4bff-96eb-59cf550f543a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk" Jun 11 20:01:12.599105 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:12.598952 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5rp4\" (UniqueName: \"kubernetes.io/projected/90ae0230-abb1-4bff-96eb-59cf550f543a-kube-api-access-h5rp4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-84rsk\" (UID: \"90ae0230-abb1-4bff-96eb-59cf550f543a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk" Jun 11 20:01:12.699394 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:12.699365 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/90ae0230-abb1-4bff-96eb-59cf550f543a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-84rsk\" (UID: \"90ae0230-abb1-4bff-96eb-59cf550f543a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk" Jun 11 20:01:12.699548 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:12.699405 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5rp4\" (UniqueName: \"kubernetes.io/projected/90ae0230-abb1-4bff-96eb-59cf550f543a-kube-api-access-h5rp4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-84rsk\" (UID: \"90ae0230-abb1-4bff-96eb-59cf550f543a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk" Jun 11 20:01:12.699725 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:12.699697 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/90ae0230-abb1-4bff-96eb-59cf550f543a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-84rsk\" (UID: \"90ae0230-abb1-4bff-96eb-59cf550f543a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk" Jun 11 20:01:12.711441 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:12.711418 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5rp4\" (UniqueName: \"kubernetes.io/projected/90ae0230-abb1-4bff-96eb-59cf550f543a-kube-api-access-h5rp4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-84rsk\" (UID: \"90ae0230-abb1-4bff-96eb-59cf550f543a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk" Jun 11 20:01:12.802498 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:12.802421 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk" Jun 11 20:01:12.962896 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:12.962718 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk"] Jun 11 20:01:12.966115 ip-10-0-137-247 kubenswrapper[2576]: W0611 20:01:12.966080 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90ae0230_abb1_4bff_96eb_59cf550f543a.slice/crio-c3e2f7a2512d2e36fa16c0533178c2c8f3e5a32d3f90576979ef0d79aef28191 WatchSource:0}: Error finding container c3e2f7a2512d2e36fa16c0533178c2c8f3e5a32d3f90576979ef0d79aef28191: Status 404 returned error can't find the container with id c3e2f7a2512d2e36fa16c0533178c2c8f3e5a32d3f90576979ef0d79aef28191 Jun 11 20:01:13.734090 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:13.734046 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk" event={"ID":"90ae0230-abb1-4bff-96eb-59cf550f543a","Type":"ContainerStarted","Data":"c3e2f7a2512d2e36fa16c0533178c2c8f3e5a32d3f90576979ef0d79aef28191"} Jun 11 20:01:17.703152 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:17.703108 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-crwh6" Jun 11 20:01:19.765750 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:19.765720 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk" event={"ID":"90ae0230-abb1-4bff-96eb-59cf550f543a","Type":"ContainerStarted","Data":"16e40ee5159ae2ed43eb2ded037c93ca0ec69b70ca343ccebf41f277c8c8182d"} Jun 11 20:01:19.766088 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:19.765781 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk" Jun 11 20:01:19.788321 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:19.788276 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk" podStartSLOduration=1.079372694 podStartE2EDuration="7.788260715s" totalImagesPullingTime="6.708888021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:01:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:01:19.786583155 +0000 UTC m=+680.064343914" watchObservedRunningTime="2026-06-11 20:01:19.788260715 +0000 UTC m=+680.066021473" Jun 11 20:01:21.726529 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:21.726494 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4g7d5" Jun 11 20:01:30.773032 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:30.773001 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk" Jun 11 20:01:31.828525 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:31.828491 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62c7k"] Jun 11 20:01:31.832720 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:31.832700 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62c7k" Jun 11 20:01:31.846137 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:31.846104 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62c7k"] Jun 11 20:01:31.868418 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:31.868392 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xzws\" (UniqueName: \"kubernetes.io/projected/b7dad353-7dd3-4a90-8e34-7042bbbae243-kube-api-access-9xzws\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-62c7k\" (UID: \"b7dad353-7dd3-4a90-8e34-7042bbbae243\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62c7k" Jun 11 20:01:31.868520 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:31.868435 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7dad353-7dd3-4a90-8e34-7042bbbae243-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-62c7k\" (UID: \"b7dad353-7dd3-4a90-8e34-7042bbbae243\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62c7k" Jun 11 20:01:31.969815 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:31.969780 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xzws\" (UniqueName: \"kubernetes.io/projected/b7dad353-7dd3-4a90-8e34-7042bbbae243-kube-api-access-9xzws\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-62c7k\" (UID: \"b7dad353-7dd3-4a90-8e34-7042bbbae243\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62c7k" Jun 11 20:01:31.969972 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:31.969827 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7dad353-7dd3-4a90-8e34-7042bbbae243-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-62c7k\" (UID: \"b7dad353-7dd3-4a90-8e34-7042bbbae243\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62c7k" Jun 11 20:01:31.970197 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:31.970180 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7dad353-7dd3-4a90-8e34-7042bbbae243-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-62c7k\" (UID: \"b7dad353-7dd3-4a90-8e34-7042bbbae243\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62c7k" Jun 11 20:01:31.996620 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:31.996587 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xzws\" (UniqueName: \"kubernetes.io/projected/b7dad353-7dd3-4a90-8e34-7042bbbae243-kube-api-access-9xzws\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-62c7k\" (UID: \"b7dad353-7dd3-4a90-8e34-7042bbbae243\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62c7k" Jun 11 20:01:32.142496 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.142463 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62c7k" Jun 11 20:01:32.284621 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.284594 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62c7k"] Jun 11 20:01:32.286669 ip-10-0-137-247 kubenswrapper[2576]: W0611 20:01:32.286643 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7dad353_7dd3_4a90_8e34_7042bbbae243.slice/crio-7031508a7a68050b76811efaf00bb64e8c26b80527139a5a595a21b4bdac61c9 WatchSource:0}: Error finding container 7031508a7a68050b76811efaf00bb64e8c26b80527139a5a595a21b4bdac61c9: Status 404 returned error can't find the container with id 7031508a7a68050b76811efaf00bb64e8c26b80527139a5a595a21b4bdac61c9 Jun 11 20:01:32.449931 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.449854 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62c7k"] Jun 11 20:01:32.456984 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.456959 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62c7k"] Jun 11 20:01:32.471909 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.471880 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk"] Jun 11 20:01:32.472072 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.472052 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk" podUID="90ae0230-abb1-4bff-96eb-59cf550f543a" containerName="manager" containerID="cri-o://16e40ee5159ae2ed43eb2ded037c93ca0ec69b70ca343ccebf41f277c8c8182d" gracePeriod=2 Jun 11 20:01:32.492580 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.492554 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk"] Jun 11 20:01:32.516273 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:32.516239 2576 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"90ae0230-abb1-4bff-96eb-59cf550f543a\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-84rsk\": pods \"kuadrant-operator-controller-manager-8684c9ff49-84rsk\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk" Jun 11 20:01:32.519297 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.519267 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mn2p"] Jun 11 20:01:32.519849 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.519823 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90ae0230-abb1-4bff-96eb-59cf550f543a" containerName="manager" Jun 11 20:01:32.519849 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.519851 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="90ae0230-abb1-4bff-96eb-59cf550f543a" containerName="manager" Jun 11 20:01:32.520014 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.519889 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7dad353-7dd3-4a90-8e34-7042bbbae243" containerName="manager" Jun 11 20:01:32.520014 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.519898 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7dad353-7dd3-4a90-8e34-7042bbbae243" containerName="manager" Jun 11 20:01:32.520014 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.519977 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="90ae0230-abb1-4bff-96eb-59cf550f543a" containerName="manager" Jun 11 20:01:32.520014 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.519993 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7dad353-7dd3-4a90-8e34-7042bbbae243" containerName="manager" Jun 11 20:01:32.523626 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.523603 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4g7d5"] Jun 11 20:01:32.523722 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.523704 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mn2p" Jun 11 20:01:32.523829 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.523804 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4g7d5" podUID="2ab842ee-74c8-46d0-a88e-c0ca9dab59ca" containerName="manager" containerID="cri-o://db245f2bcd3f9f5390763f18edd8714470cabe394302950513e20e03e37a2e6a" gracePeriod=2 Jun 11 20:01:32.528083 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:32.528053 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-84rsk\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="90ae0230-abb1-4bff-96eb-59cf550f543a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk" Jun 11 20:01:32.540590 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.540239 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4g7d5"] Jun 11 20:01:32.547259 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.547236 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mn2p"] Jun 11 20:01:32.557495 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.557469 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnx47"] Jun 11 20:01:32.557988 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.557968 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ab842ee-74c8-46d0-a88e-c0ca9dab59ca" containerName="manager" Jun 11 20:01:32.557988 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.557991 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ab842ee-74c8-46d0-a88e-c0ca9dab59ca" containerName="manager" Jun 11 20:01:32.558153 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.558083 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ab842ee-74c8-46d0-a88e-c0ca9dab59ca" containerName="manager" Jun 11 20:01:32.561340 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.561320 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnx47" Jun 11 20:01:32.575023 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.574995 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpmg9\" (UniqueName: \"kubernetes.io/projected/1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5-kube-api-access-cpmg9\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7mn2p\" (UID: \"1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mn2p" Jun 11 20:01:32.575145 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.575043 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77b45f84-5400-4f8a-bd44-0f710220b4b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hnx47\" (UID: \"77b45f84-5400-4f8a-bd44-0f710220b4b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnx47" Jun 11 20:01:32.575145 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.575062 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7mn2p\" (UID: \"1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mn2p" Jun 11 20:01:32.575286 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.575230 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w2l4\" (UniqueName: \"kubernetes.io/projected/77b45f84-5400-4f8a-bd44-0f710220b4b6-kube-api-access-7w2l4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hnx47\" (UID: \"77b45f84-5400-4f8a-bd44-0f710220b4b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnx47" Jun 11 20:01:32.580314 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.580287 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gc9w"] Jun 11 20:01:32.584671 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.584646 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gc9w" Jun 11 20:01:32.587849 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:32.587683 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-84rsk\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="90ae0230-abb1-4bff-96eb-59cf550f543a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk" Jun 11 20:01:32.589743 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.589723 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnx47"] Jun 11 20:01:32.590522 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:32.590496 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4g7d5\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="2ab842ee-74c8-46d0-a88e-c0ca9dab59ca" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4g7d5" Jun 11 20:01:32.595339 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.595316 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gc9w"] Jun 11 20:01:32.621393 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:32.621366 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4g7d5\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="2ab842ee-74c8-46d0-a88e-c0ca9dab59ca" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4g7d5" Jun 11 20:01:32.660028 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:32.659988 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-84rsk\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="90ae0230-abb1-4bff-96eb-59cf550f543a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk" Jun 11 20:01:32.676320 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.676288 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w2l4\" (UniqueName: \"kubernetes.io/projected/77b45f84-5400-4f8a-bd44-0f710220b4b6-kube-api-access-7w2l4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hnx47\" (UID: \"77b45f84-5400-4f8a-bd44-0f710220b4b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnx47" Jun 11 20:01:32.676489 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.676341 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zpxv\" (UniqueName: \"kubernetes.io/projected/ac71096a-0dc1-432a-b3ed-269ad4e79d3a-kube-api-access-8zpxv\") pod \"limitador-operator-controller-manager-859d7b78bd-7gc9w\" (UID: \"ac71096a-0dc1-432a-b3ed-269ad4e79d3a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gc9w" Jun 11 20:01:32.676489 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.676378 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpmg9\" (UniqueName: \"kubernetes.io/projected/1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5-kube-api-access-cpmg9\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7mn2p\" (UID: \"1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mn2p" Jun 11 20:01:32.676489 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.676413 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77b45f84-5400-4f8a-bd44-0f710220b4b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hnx47\" (UID: \"77b45f84-5400-4f8a-bd44-0f710220b4b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnx47" Jun 11 20:01:32.676489 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.676436 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7mn2p\" (UID: \"1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mn2p" Jun 11 20:01:32.676792 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.676770 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7mn2p\" (UID: \"1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mn2p" Jun 11 20:01:32.676860 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.676808 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77b45f84-5400-4f8a-bd44-0f710220b4b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hnx47\" (UID: \"77b45f84-5400-4f8a-bd44-0f710220b4b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnx47" Jun 11 20:01:32.686686 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.686650 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w2l4\" (UniqueName: \"kubernetes.io/projected/77b45f84-5400-4f8a-bd44-0f710220b4b6-kube-api-access-7w2l4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hnx47\" (UID: \"77b45f84-5400-4f8a-bd44-0f710220b4b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnx47" Jun 11 20:01:32.686939 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.686919 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpmg9\" (UniqueName: \"kubernetes.io/projected/1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5-kube-api-access-cpmg9\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7mn2p\" (UID: \"1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mn2p" Jun 11 20:01:32.753526 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.753504 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk" Jun 11 20:01:32.755864 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:32.755839 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-84rsk\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="90ae0230-abb1-4bff-96eb-59cf550f543a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk" Jun 11 20:01:32.758957 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:32.758931 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4g7d5\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="2ab842ee-74c8-46d0-a88e-c0ca9dab59ca" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4g7d5" Jun 11 20:01:32.759669 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.759651 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4g7d5" Jun 11 20:01:32.764936 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:32.764914 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-84rsk\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="90ae0230-abb1-4bff-96eb-59cf550f543a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk" Jun 11 20:01:32.770805 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:32.770783 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4g7d5\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="2ab842ee-74c8-46d0-a88e-c0ca9dab59ca" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4g7d5" Jun 11 20:01:32.777104 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.777082 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gp5l\" (UniqueName: \"kubernetes.io/projected/2ab842ee-74c8-46d0-a88e-c0ca9dab59ca-kube-api-access-4gp5l\") pod \"2ab842ee-74c8-46d0-a88e-c0ca9dab59ca\" (UID: \"2ab842ee-74c8-46d0-a88e-c0ca9dab59ca\") " Jun 11 20:01:32.777223 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.777196 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/90ae0230-abb1-4bff-96eb-59cf550f543a-extensions-socket-volume\") pod \"90ae0230-abb1-4bff-96eb-59cf550f543a\" (UID: \"90ae0230-abb1-4bff-96eb-59cf550f543a\") " Jun 11 20:01:32.777280 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.777223 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5rp4\" (UniqueName: \"kubernetes.io/projected/90ae0230-abb1-4bff-96eb-59cf550f543a-kube-api-access-h5rp4\") pod \"90ae0230-abb1-4bff-96eb-59cf550f543a\" (UID: \"90ae0230-abb1-4bff-96eb-59cf550f543a\") " Jun 11 20:01:32.777491 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.777464 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zpxv\" (UniqueName: \"kubernetes.io/projected/ac71096a-0dc1-432a-b3ed-269ad4e79d3a-kube-api-access-8zpxv\") pod \"limitador-operator-controller-manager-859d7b78bd-7gc9w\" (UID: \"ac71096a-0dc1-432a-b3ed-269ad4e79d3a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gc9w" Jun 11 20:01:32.777627 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.777606 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90ae0230-abb1-4bff-96eb-59cf550f543a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "90ae0230-abb1-4bff-96eb-59cf550f543a" (UID: "90ae0230-abb1-4bff-96eb-59cf550f543a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:01:32.778980 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.778961 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ab842ee-74c8-46d0-a88e-c0ca9dab59ca-kube-api-access-4gp5l" (OuterVolumeSpecName: "kube-api-access-4gp5l") pod "2ab842ee-74c8-46d0-a88e-c0ca9dab59ca" (UID: "2ab842ee-74c8-46d0-a88e-c0ca9dab59ca"). InnerVolumeSpecName "kube-api-access-4gp5l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:01:32.779161 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.779112 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90ae0230-abb1-4bff-96eb-59cf550f543a-kube-api-access-h5rp4" (OuterVolumeSpecName: "kube-api-access-h5rp4") pod "90ae0230-abb1-4bff-96eb-59cf550f543a" (UID: "90ae0230-abb1-4bff-96eb-59cf550f543a"). InnerVolumeSpecName "kube-api-access-h5rp4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:01:32.794568 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.794539 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zpxv\" (UniqueName: \"kubernetes.io/projected/ac71096a-0dc1-432a-b3ed-269ad4e79d3a-kube-api-access-8zpxv\") pod \"limitador-operator-controller-manager-859d7b78bd-7gc9w\" (UID: \"ac71096a-0dc1-432a-b3ed-269ad4e79d3a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gc9w" Jun 11 20:01:32.826821 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.826788 2576 generic.go:356] "Generic (PLEG): container finished" podID="2ab842ee-74c8-46d0-a88e-c0ca9dab59ca" containerID="db245f2bcd3f9f5390763f18edd8714470cabe394302950513e20e03e37a2e6a" exitCode=0 Jun 11 20:01:32.826917 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.826832 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4g7d5" Jun 11 20:01:32.826917 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.826861 2576 scope.go:117] "RemoveContainer" containerID="db245f2bcd3f9f5390763f18edd8714470cabe394302950513e20e03e37a2e6a" Jun 11 20:01:32.828282 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.828259 2576 generic.go:356] "Generic (PLEG): container finished" podID="90ae0230-abb1-4bff-96eb-59cf550f543a" containerID="16e40ee5159ae2ed43eb2ded037c93ca0ec69b70ca343ccebf41f277c8c8182d" exitCode=0 Jun 11 20:01:32.828361 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.828298 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk" Jun 11 20:01:32.829635 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:32.829595 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-84rsk\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="90ae0230-abb1-4bff-96eb-59cf550f543a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk" Jun 11 20:01:32.830304 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:32.830288 2576 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62c7k" container="manager" Jun 11 20:01:32.831754 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:32.831722 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4g7d5\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="2ab842ee-74c8-46d0-a88e-c0ca9dab59ca" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4g7d5" Jun 11 20:01:32.833985 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:32.833955 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-62c7k\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="b7dad353-7dd3-4a90-8e34-7042bbbae243" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62c7k" Jun 11 20:01:32.836036 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.836016 2576 scope.go:117] "RemoveContainer" containerID="db245f2bcd3f9f5390763f18edd8714470cabe394302950513e20e03e37a2e6a" Jun 11 20:01:32.836156 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:32.836073 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-84rsk\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="90ae0230-abb1-4bff-96eb-59cf550f543a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk" Jun 11 20:01:32.836817 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:32.836789 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db245f2bcd3f9f5390763f18edd8714470cabe394302950513e20e03e37a2e6a\": container with ID starting with db245f2bcd3f9f5390763f18edd8714470cabe394302950513e20e03e37a2e6a not found: ID does not exist" containerID="db245f2bcd3f9f5390763f18edd8714470cabe394302950513e20e03e37a2e6a" Jun 11 20:01:32.836915 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.836827 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db245f2bcd3f9f5390763f18edd8714470cabe394302950513e20e03e37a2e6a"} err="failed to get container status \"db245f2bcd3f9f5390763f18edd8714470cabe394302950513e20e03e37a2e6a\": rpc error: code = NotFound desc = could not find container \"db245f2bcd3f9f5390763f18edd8714470cabe394302950513e20e03e37a2e6a\": container with ID starting with db245f2bcd3f9f5390763f18edd8714470cabe394302950513e20e03e37a2e6a not found: ID does not exist" Jun 11 20:01:32.836915 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.836851 2576 scope.go:117] "RemoveContainer" containerID="16e40ee5159ae2ed43eb2ded037c93ca0ec69b70ca343ccebf41f277c8c8182d" Jun 11 20:01:32.838406 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:32.838375 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4g7d5\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="2ab842ee-74c8-46d0-a88e-c0ca9dab59ca" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4g7d5" Jun 11 20:01:32.841580 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:32.841552 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-62c7k\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="b7dad353-7dd3-4a90-8e34-7042bbbae243" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62c7k" Jun 11 20:01:32.843816 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:32.843792 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-84rsk\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="90ae0230-abb1-4bff-96eb-59cf550f543a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk" Jun 11 20:01:32.845561 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.845547 2576 scope.go:117] "RemoveContainer" containerID="16e40ee5159ae2ed43eb2ded037c93ca0ec69b70ca343ccebf41f277c8c8182d" Jun 11 20:01:32.845800 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:32.845777 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16e40ee5159ae2ed43eb2ded037c93ca0ec69b70ca343ccebf41f277c8c8182d\": container with ID starting with 16e40ee5159ae2ed43eb2ded037c93ca0ec69b70ca343ccebf41f277c8c8182d not found: ID does not exist" containerID="16e40ee5159ae2ed43eb2ded037c93ca0ec69b70ca343ccebf41f277c8c8182d" Jun 11 20:01:32.845800 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:32.845792 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4g7d5\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="2ab842ee-74c8-46d0-a88e-c0ca9dab59ca" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4g7d5" Jun 11 20:01:32.845924 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.845804 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16e40ee5159ae2ed43eb2ded037c93ca0ec69b70ca343ccebf41f277c8c8182d"} err="failed to get container status \"16e40ee5159ae2ed43eb2ded037c93ca0ec69b70ca343ccebf41f277c8c8182d\": rpc error: code = NotFound desc = could not find container \"16e40ee5159ae2ed43eb2ded037c93ca0ec69b70ca343ccebf41f277c8c8182d\": container with ID starting with 16e40ee5159ae2ed43eb2ded037c93ca0ec69b70ca343ccebf41f277c8c8182d not found: ID does not exist" Jun 11 20:01:32.847884 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:32.847865 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-84rsk\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="90ae0230-abb1-4bff-96eb-59cf550f543a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk" Jun 11 20:01:32.849799 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:32.849775 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4g7d5\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="2ab842ee-74c8-46d0-a88e-c0ca9dab59ca" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4g7d5" Jun 11 20:01:32.851865 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:32.851842 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-62c7k\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="b7dad353-7dd3-4a90-8e34-7042bbbae243" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62c7k" Jun 11 20:01:32.878517 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.878493 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gp5l\" (UniqueName: \"kubernetes.io/projected/2ab842ee-74c8-46d0-a88e-c0ca9dab59ca-kube-api-access-4gp5l\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:01:32.878517 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.878516 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/90ae0230-abb1-4bff-96eb-59cf550f543a-extensions-socket-volume\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:01:32.878680 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.878526 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5rp4\" (UniqueName: \"kubernetes.io/projected/90ae0230-abb1-4bff-96eb-59cf550f543a-kube-api-access-h5rp4\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:01:32.908085 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.908058 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mn2p" Jun 11 20:01:32.916052 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.916030 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnx47" Jun 11 20:01:32.922216 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:32.922191 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gc9w" Jun 11 20:01:33.096061 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:33.096027 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnx47"] Jun 11 20:01:33.098827 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:33.098801 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mn2p"] Jun 11 20:01:33.101373 ip-10-0-137-247 kubenswrapper[2576]: W0611 20:01:33.101345 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cce2255_4c4a_4b60_b15d_03e2ec0bd8c5.slice/crio-78c3794284f4c079895c1f8b2f8295012bca63a6def6c5c53256da51e8f9572f WatchSource:0}: Error finding container 78c3794284f4c079895c1f8b2f8295012bca63a6def6c5c53256da51e8f9572f: Status 404 returned error can't find the container with id 78c3794284f4c079895c1f8b2f8295012bca63a6def6c5c53256da51e8f9572f Jun 11 20:01:33.101833 ip-10-0-137-247 kubenswrapper[2576]: W0611 20:01:33.101811 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77b45f84_5400_4f8a_bd44_0f710220b4b6.slice/crio-c25eeade740336f9ddd38898e1e334bb0c2176871218b73daf61d9207b55267c WatchSource:0}: Error finding container c25eeade740336f9ddd38898e1e334bb0c2176871218b73daf61d9207b55267c: Status 404 returned error can't find the container with id c25eeade740336f9ddd38898e1e334bb0c2176871218b73daf61d9207b55267c Jun 11 20:01:33.116820 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:33.116796 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gc9w"] Jun 11 20:01:33.119650 ip-10-0-137-247 kubenswrapper[2576]: W0611 20:01:33.119629 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac71096a_0dc1_432a_b3ed_269ad4e79d3a.slice/crio-6d0c0be6a22518ecb600f8cb0a4e02d130a6098212c04f23d82e3547bf2d2d4e WatchSource:0}: Error finding container 6d0c0be6a22518ecb600f8cb0a4e02d130a6098212c04f23d82e3547bf2d2d4e: Status 404 returned error can't find the container with id 6d0c0be6a22518ecb600f8cb0a4e02d130a6098212c04f23d82e3547bf2d2d4e Jun 11 20:01:33.839384 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:33.839335 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62c7k" podUID="b7dad353-7dd3-4a90-8e34-7042bbbae243" containerName="manager" containerID="cri-o://bfac477407fe2fd491fab86c84ed44a097792e231278d5b50d33000f339cf067" gracePeriod=2 Jun 11 20:01:33.840903 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:33.840872 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gc9w" event={"ID":"ac71096a-0dc1-432a-b3ed-269ad4e79d3a","Type":"ContainerStarted","Data":"f8e19fe3524d0eba870388fa59a9646574d0155147bce0d6eb531f9efeb41a20"} Jun 11 20:01:33.841021 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:33.840931 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gc9w" Jun 11 20:01:33.841021 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:33.840951 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gc9w" event={"ID":"ac71096a-0dc1-432a-b3ed-269ad4e79d3a","Type":"ContainerStarted","Data":"6d0c0be6a22518ecb600f8cb0a4e02d130a6098212c04f23d82e3547bf2d2d4e"} Jun 11 20:01:33.842249 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:33.842215 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-62c7k\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="b7dad353-7dd3-4a90-8e34-7042bbbae243" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62c7k" Jun 11 20:01:33.842994 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:33.842968 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mn2p" event={"ID":"1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5","Type":"ContainerStarted","Data":"11cef1ec036a9be2e1e902d3db7b32d71dad7fdd088d3e7fc28450973bd17e77"} Jun 11 20:01:33.843147 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:33.843019 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mn2p" event={"ID":"1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5","Type":"ContainerStarted","Data":"78c3794284f4c079895c1f8b2f8295012bca63a6def6c5c53256da51e8f9572f"} Jun 11 20:01:33.843147 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:33.843053 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mn2p" Jun 11 20:01:33.844654 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:33.844635 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnx47" event={"ID":"77b45f84-5400-4f8a-bd44-0f710220b4b6","Type":"ContainerStarted","Data":"6ec9dc6934068967863e1c01d20184f6806e4ad5993a7ca7e0012fcf996f1454"} Jun 11 20:01:33.844739 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:33.844676 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnx47" event={"ID":"77b45f84-5400-4f8a-bd44-0f710220b4b6","Type":"ContainerStarted","Data":"c25eeade740336f9ddd38898e1e334bb0c2176871218b73daf61d9207b55267c"} Jun 11 20:01:33.844739 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:33.844718 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnx47" Jun 11 20:01:33.845828 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:33.845804 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-84rsk\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="90ae0230-abb1-4bff-96eb-59cf550f543a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk" Jun 11 20:01:33.848767 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:33.848746 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4g7d5\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="2ab842ee-74c8-46d0-a88e-c0ca9dab59ca" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4g7d5" Jun 11 20:01:33.850847 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:33.850824 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-84rsk\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="90ae0230-abb1-4bff-96eb-59cf550f543a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk" Jun 11 20:01:33.854211 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:33.854191 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4g7d5\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="2ab842ee-74c8-46d0-a88e-c0ca9dab59ca" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4g7d5" Jun 11 20:01:33.888017 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:33.887967 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnx47" podStartSLOduration=1.887950205 podStartE2EDuration="1.887950205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:01:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:01:33.885521612 +0000 UTC m=+694.163282369" watchObservedRunningTime="2026-06-11 20:01:33.887950205 +0000 UTC m=+694.165710965" Jun 11 20:01:33.927892 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:33.927840 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mn2p" podStartSLOduration=1.927824546 podStartE2EDuration="1.927824546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:01:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:01:33.925543616 +0000 UTC m=+694.203304376" watchObservedRunningTime="2026-06-11 20:01:33.927824546 +0000 UTC m=+694.205585301" Jun 11 20:01:33.929490 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:33.929444 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-62c7k\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="b7dad353-7dd3-4a90-8e34-7042bbbae243" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62c7k" Jun 11 20:01:33.953962 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:33.953919 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gc9w" podStartSLOduration=1.953905517 podStartE2EDuration="1.953905517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:01:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:01:33.952026785 +0000 UTC m=+694.229787546" watchObservedRunningTime="2026-06-11 20:01:33.953905517 +0000 UTC m=+694.231666274" Jun 11 20:01:34.085402 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:34.085377 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62c7k" Jun 11 20:01:34.097210 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:34.097184 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-62c7k\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="b7dad353-7dd3-4a90-8e34-7042bbbae243" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62c7k" Jun 11 20:01:34.099644 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:34.099617 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-84rsk\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="90ae0230-abb1-4bff-96eb-59cf550f543a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84rsk" Jun 11 20:01:34.104717 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:34.104694 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4g7d5\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="2ab842ee-74c8-46d0-a88e-c0ca9dab59ca" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4g7d5" Jun 11 20:01:34.191325 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:34.191292 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7dad353-7dd3-4a90-8e34-7042bbbae243-extensions-socket-volume\") pod \"b7dad353-7dd3-4a90-8e34-7042bbbae243\" (UID: \"b7dad353-7dd3-4a90-8e34-7042bbbae243\") " Jun 11 20:01:34.191486 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:34.191336 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xzws\" (UniqueName: \"kubernetes.io/projected/b7dad353-7dd3-4a90-8e34-7042bbbae243-kube-api-access-9xzws\") pod \"b7dad353-7dd3-4a90-8e34-7042bbbae243\" (UID: \"b7dad353-7dd3-4a90-8e34-7042bbbae243\") " Jun 11 20:01:34.191618 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:34.191590 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7dad353-7dd3-4a90-8e34-7042bbbae243-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b7dad353-7dd3-4a90-8e34-7042bbbae243" (UID: "b7dad353-7dd3-4a90-8e34-7042bbbae243"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:01:34.193637 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:34.193611 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7dad353-7dd3-4a90-8e34-7042bbbae243-kube-api-access-9xzws" (OuterVolumeSpecName: "kube-api-access-9xzws") pod "b7dad353-7dd3-4a90-8e34-7042bbbae243" (UID: "b7dad353-7dd3-4a90-8e34-7042bbbae243"). InnerVolumeSpecName "kube-api-access-9xzws". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:01:34.203275 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:34.203249 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ab842ee-74c8-46d0-a88e-c0ca9dab59ca" path="/var/lib/kubelet/pods/2ab842ee-74c8-46d0-a88e-c0ca9dab59ca/volumes" Jun 11 20:01:34.203610 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:34.203596 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90ae0230-abb1-4bff-96eb-59cf550f543a" path="/var/lib/kubelet/pods/90ae0230-abb1-4bff-96eb-59cf550f543a/volumes" Jun 11 20:01:34.203908 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:34.203895 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7dad353-7dd3-4a90-8e34-7042bbbae243" path="/var/lib/kubelet/pods/b7dad353-7dd3-4a90-8e34-7042bbbae243/volumes" Jun 11 20:01:34.292541 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:34.292512 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7dad353-7dd3-4a90-8e34-7042bbbae243-extensions-socket-volume\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:01:34.292541 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:34.292539 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xzws\" (UniqueName: \"kubernetes.io/projected/b7dad353-7dd3-4a90-8e34-7042bbbae243-kube-api-access-9xzws\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:01:34.851082 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:34.851048 2576 generic.go:356] "Generic (PLEG): container finished" podID="b7dad353-7dd3-4a90-8e34-7042bbbae243" containerID="bfac477407fe2fd491fab86c84ed44a097792e231278d5b50d33000f339cf067" exitCode=2 Jun 11 20:01:34.851542 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:34.851101 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62c7k" Jun 11 20:01:34.851542 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:34.851160 2576 scope.go:117] "RemoveContainer" containerID="bfac477407fe2fd491fab86c84ed44a097792e231278d5b50d33000f339cf067" Jun 11 20:01:34.855914 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:34.855888 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-62c7k\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="b7dad353-7dd3-4a90-8e34-7042bbbae243" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62c7k" Jun 11 20:01:34.862281 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:34.862266 2576 scope.go:117] "RemoveContainer" containerID="bfac477407fe2fd491fab86c84ed44a097792e231278d5b50d33000f339cf067" Jun 11 20:01:34.862525 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:34.862506 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfac477407fe2fd491fab86c84ed44a097792e231278d5b50d33000f339cf067\": container with ID starting with bfac477407fe2fd491fab86c84ed44a097792e231278d5b50d33000f339cf067 not found: ID does not exist" containerID="bfac477407fe2fd491fab86c84ed44a097792e231278d5b50d33000f339cf067" Jun 11 20:01:34.862607 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:34.862532 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfac477407fe2fd491fab86c84ed44a097792e231278d5b50d33000f339cf067"} err="failed to get container status \"bfac477407fe2fd491fab86c84ed44a097792e231278d5b50d33000f339cf067\": rpc error: code = NotFound desc = could not find container \"bfac477407fe2fd491fab86c84ed44a097792e231278d5b50d33000f339cf067\": container with ID starting with bfac477407fe2fd491fab86c84ed44a097792e231278d5b50d33000f339cf067 not found: ID does not exist" Jun 11 20:01:44.854153 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:44.854054 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnx47" Jun 11 20:01:44.854153 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:44.854147 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gc9w" Jun 11 20:01:44.854752 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:44.854273 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mn2p" Jun 11 20:01:44.955263 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:44.955228 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnx47"] Jun 11 20:01:44.955454 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:44.955432 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnx47" podUID="77b45f84-5400-4f8a-bd44-0f710220b4b6" containerName="manager" containerID="cri-o://6ec9dc6934068967863e1c01d20184f6806e4ad5993a7ca7e0012fcf996f1454" gracePeriod=10 Jun 11 20:01:45.200594 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.200562 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnx47" Jun 11 20:01:45.270106 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.270067 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhb5"] Jun 11 20:01:45.270573 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.270553 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77b45f84-5400-4f8a-bd44-0f710220b4b6" containerName="manager" Jun 11 20:01:45.270573 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.270575 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="77b45f84-5400-4f8a-bd44-0f710220b4b6" containerName="manager" Jun 11 20:01:45.270765 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.270656 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="77b45f84-5400-4f8a-bd44-0f710220b4b6" containerName="manager" Jun 11 20:01:45.273515 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.273495 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhb5" Jun 11 20:01:45.284876 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.284851 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77b45f84-5400-4f8a-bd44-0f710220b4b6-extensions-socket-volume\") pod \"77b45f84-5400-4f8a-bd44-0f710220b4b6\" (UID: \"77b45f84-5400-4f8a-bd44-0f710220b4b6\") " Jun 11 20:01:45.284991 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.284965 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7w2l4\" (UniqueName: \"kubernetes.io/projected/77b45f84-5400-4f8a-bd44-0f710220b4b6-kube-api-access-7w2l4\") pod \"77b45f84-5400-4f8a-bd44-0f710220b4b6\" (UID: \"77b45f84-5400-4f8a-bd44-0f710220b4b6\") " Jun 11 20:01:45.285293 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.285269 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77b45f84-5400-4f8a-bd44-0f710220b4b6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "77b45f84-5400-4f8a-bd44-0f710220b4b6" (UID: "77b45f84-5400-4f8a-bd44-0f710220b4b6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:01:45.286891 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.286870 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77b45f84-5400-4f8a-bd44-0f710220b4b6-kube-api-access-7w2l4" (OuterVolumeSpecName: "kube-api-access-7w2l4") pod "77b45f84-5400-4f8a-bd44-0f710220b4b6" (UID: "77b45f84-5400-4f8a-bd44-0f710220b4b6"). InnerVolumeSpecName "kube-api-access-7w2l4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:01:45.301618 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.301591 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhb5"] Jun 11 20:01:45.386066 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.385971 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfzgj\" (UniqueName: \"kubernetes.io/projected/a0eb9421-2435-4658-864b-5e4dafcd1104-kube-api-access-qfzgj\") pod \"kuadrant-operator-controller-manager-86878c769f-bfhb5\" (UID: \"a0eb9421-2435-4658-864b-5e4dafcd1104\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhb5" Jun 11 20:01:45.386066 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.386020 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0eb9421-2435-4658-864b-5e4dafcd1104-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bfhb5\" (UID: \"a0eb9421-2435-4658-864b-5e4dafcd1104\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhb5" Jun 11 20:01:45.386284 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.386078 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7w2l4\" (UniqueName: \"kubernetes.io/projected/77b45f84-5400-4f8a-bd44-0f710220b4b6-kube-api-access-7w2l4\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:01:45.386284 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.386093 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77b45f84-5400-4f8a-bd44-0f710220b4b6-extensions-socket-volume\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:01:45.487217 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.487181 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfzgj\" (UniqueName: \"kubernetes.io/projected/a0eb9421-2435-4658-864b-5e4dafcd1104-kube-api-access-qfzgj\") pod \"kuadrant-operator-controller-manager-86878c769f-bfhb5\" (UID: \"a0eb9421-2435-4658-864b-5e4dafcd1104\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhb5" Jun 11 20:01:45.487403 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.487224 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0eb9421-2435-4658-864b-5e4dafcd1104-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bfhb5\" (UID: \"a0eb9421-2435-4658-864b-5e4dafcd1104\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhb5" Jun 11 20:01:45.487647 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.487625 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0eb9421-2435-4658-864b-5e4dafcd1104-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bfhb5\" (UID: \"a0eb9421-2435-4658-864b-5e4dafcd1104\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhb5" Jun 11 20:01:45.500503 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.500480 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfzgj\" (UniqueName: \"kubernetes.io/projected/a0eb9421-2435-4658-864b-5e4dafcd1104-kube-api-access-qfzgj\") pod \"kuadrant-operator-controller-manager-86878c769f-bfhb5\" (UID: \"a0eb9421-2435-4658-864b-5e4dafcd1104\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhb5" Jun 11 20:01:45.584391 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.584355 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhb5" Jun 11 20:01:45.722015 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.721985 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhb5"] Jun 11 20:01:45.727995 ip-10-0-137-247 kubenswrapper[2576]: W0611 20:01:45.727968 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0eb9421_2435_4658_864b_5e4dafcd1104.slice/crio-0f1bb45ec3f848a8dc87f6faa4756a67930db1f2171ce6189498e0b6fabdeee3 WatchSource:0}: Error finding container 0f1bb45ec3f848a8dc87f6faa4756a67930db1f2171ce6189498e0b6fabdeee3: Status 404 returned error can't find the container with id 0f1bb45ec3f848a8dc87f6faa4756a67930db1f2171ce6189498e0b6fabdeee3 Jun 11 20:01:45.910510 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.910472 2576 generic.go:356] "Generic (PLEG): container finished" podID="77b45f84-5400-4f8a-bd44-0f710220b4b6" containerID="6ec9dc6934068967863e1c01d20184f6806e4ad5993a7ca7e0012fcf996f1454" exitCode=0 Jun 11 20:01:45.910940 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.910529 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnx47" Jun 11 20:01:45.910940 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.910563 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnx47" event={"ID":"77b45f84-5400-4f8a-bd44-0f710220b4b6","Type":"ContainerDied","Data":"6ec9dc6934068967863e1c01d20184f6806e4ad5993a7ca7e0012fcf996f1454"} Jun 11 20:01:45.910940 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.910617 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnx47" event={"ID":"77b45f84-5400-4f8a-bd44-0f710220b4b6","Type":"ContainerDied","Data":"c25eeade740336f9ddd38898e1e334bb0c2176871218b73daf61d9207b55267c"} Jun 11 20:01:45.910940 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.910644 2576 scope.go:117] "RemoveContainer" containerID="6ec9dc6934068967863e1c01d20184f6806e4ad5993a7ca7e0012fcf996f1454" Jun 11 20:01:45.912343 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.912316 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhb5" event={"ID":"a0eb9421-2435-4658-864b-5e4dafcd1104","Type":"ContainerStarted","Data":"3eaf652e5da0e5193def7779ce7b17786e01f18dfa45cca557297396a18657d2"} Jun 11 20:01:45.912454 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.912368 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhb5" event={"ID":"a0eb9421-2435-4658-864b-5e4dafcd1104","Type":"ContainerStarted","Data":"0f1bb45ec3f848a8dc87f6faa4756a67930db1f2171ce6189498e0b6fabdeee3"} Jun 11 20:01:45.912454 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.912400 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhb5" Jun 11 20:01:45.920162 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.920110 2576 scope.go:117] "RemoveContainer" containerID="6ec9dc6934068967863e1c01d20184f6806e4ad5993a7ca7e0012fcf996f1454" Jun 11 20:01:45.920439 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:45.920410 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ec9dc6934068967863e1c01d20184f6806e4ad5993a7ca7e0012fcf996f1454\": container with ID starting with 6ec9dc6934068967863e1c01d20184f6806e4ad5993a7ca7e0012fcf996f1454 not found: ID does not exist" containerID="6ec9dc6934068967863e1c01d20184f6806e4ad5993a7ca7e0012fcf996f1454" Jun 11 20:01:45.920536 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.920447 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ec9dc6934068967863e1c01d20184f6806e4ad5993a7ca7e0012fcf996f1454"} err="failed to get container status \"6ec9dc6934068967863e1c01d20184f6806e4ad5993a7ca7e0012fcf996f1454\": rpc error: code = NotFound desc = could not find container \"6ec9dc6934068967863e1c01d20184f6806e4ad5993a7ca7e0012fcf996f1454\": container with ID starting with 6ec9dc6934068967863e1c01d20184f6806e4ad5993a7ca7e0012fcf996f1454 not found: ID does not exist" Jun 11 20:01:45.935111 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.935064 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhb5" podStartSLOduration=0.935050653 podStartE2EDuration="935.050653ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:01:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:01:45.933484521 +0000 UTC m=+706.211245279" watchObservedRunningTime="2026-06-11 20:01:45.935050653 +0000 UTC m=+706.212811412" Jun 11 20:01:45.956343 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.956315 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnx47"] Jun 11 20:01:45.960439 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:45.960418 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnx47"] Jun 11 20:01:46.197114 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:46.197034 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77b45f84-5400-4f8a-bd44-0f710220b4b6" path="/var/lib/kubelet/pods/77b45f84-5400-4f8a-bd44-0f710220b4b6/volumes" Jun 11 20:01:56.920620 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:56.920589 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhb5" Jun 11 20:01:57.003065 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:57.002976 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mn2p"] Jun 11 20:01:57.003260 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:57.003232 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mn2p" podUID="1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5" containerName="manager" containerID="cri-o://11cef1ec036a9be2e1e902d3db7b32d71dad7fdd088d3e7fc28450973bd17e77" gracePeriod=10 Jun 11 20:01:57.245607 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:57.245585 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mn2p" Jun 11 20:01:57.387552 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:57.387522 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpmg9\" (UniqueName: \"kubernetes.io/projected/1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5-kube-api-access-cpmg9\") pod \"1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5\" (UID: \"1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5\") " Jun 11 20:01:57.387750 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:57.387610 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5-extensions-socket-volume\") pod \"1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5\" (UID: \"1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5\") " Jun 11 20:01:57.387936 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:57.387910 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5" (UID: "1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:01:57.389495 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:57.389464 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5-kube-api-access-cpmg9" (OuterVolumeSpecName: "kube-api-access-cpmg9") pod "1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5" (UID: "1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5"). InnerVolumeSpecName "kube-api-access-cpmg9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:01:57.488861 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:57.488827 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpmg9\" (UniqueName: \"kubernetes.io/projected/1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5-kube-api-access-cpmg9\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:01:57.488861 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:57.488858 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5-extensions-socket-volume\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:01:57.970903 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:57.970871 2576 generic.go:356] "Generic (PLEG): container finished" podID="1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5" containerID="11cef1ec036a9be2e1e902d3db7b32d71dad7fdd088d3e7fc28450973bd17e77" exitCode=0 Jun 11 20:01:57.971366 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:57.970911 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mn2p" event={"ID":"1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5","Type":"ContainerDied","Data":"11cef1ec036a9be2e1e902d3db7b32d71dad7fdd088d3e7fc28450973bd17e77"} Jun 11 20:01:57.971366 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:57.970913 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mn2p" Jun 11 20:01:57.971366 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:57.970947 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mn2p" event={"ID":"1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5","Type":"ContainerDied","Data":"78c3794284f4c079895c1f8b2f8295012bca63a6def6c5c53256da51e8f9572f"} Jun 11 20:01:57.971366 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:57.970968 2576 scope.go:117] "RemoveContainer" containerID="11cef1ec036a9be2e1e902d3db7b32d71dad7fdd088d3e7fc28450973bd17e77" Jun 11 20:01:57.979959 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:57.979945 2576 scope.go:117] "RemoveContainer" containerID="11cef1ec036a9be2e1e902d3db7b32d71dad7fdd088d3e7fc28450973bd17e77" Jun 11 20:01:57.980251 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:01:57.980231 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11cef1ec036a9be2e1e902d3db7b32d71dad7fdd088d3e7fc28450973bd17e77\": container with ID starting with 11cef1ec036a9be2e1e902d3db7b32d71dad7fdd088d3e7fc28450973bd17e77 not found: ID does not exist" containerID="11cef1ec036a9be2e1e902d3db7b32d71dad7fdd088d3e7fc28450973bd17e77" Jun 11 20:01:57.980332 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:57.980262 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11cef1ec036a9be2e1e902d3db7b32d71dad7fdd088d3e7fc28450973bd17e77"} err="failed to get container status \"11cef1ec036a9be2e1e902d3db7b32d71dad7fdd088d3e7fc28450973bd17e77\": rpc error: code = NotFound desc = could not find container \"11cef1ec036a9be2e1e902d3db7b32d71dad7fdd088d3e7fc28450973bd17e77\": container with ID starting with 11cef1ec036a9be2e1e902d3db7b32d71dad7fdd088d3e7fc28450973bd17e77 not found: ID does not exist" Jun 11 20:01:58.009008 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:58.008985 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mn2p"] Jun 11 20:01:58.020299 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:58.020279 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7mn2p"] Jun 11 20:01:58.196965 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:01:58.196930 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5" path="/var/lib/kubelet/pods/1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5/volumes" Jun 11 20:02:01.319649 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.319612 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2"] Jun 11 20:02:01.320197 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.320182 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5" containerName="manager" Jun 11 20:02:01.320251 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.320201 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5" containerName="manager" Jun 11 20:02:01.320300 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.320288 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cce2255-4c4a-4b60-b15d-03e2ec0bd8c5" containerName="manager" Jun 11 20:02:01.324911 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.324892 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:02:01.327807 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.327789 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-7bkxm\"" Jun 11 20:02:01.336955 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.336927 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2"] Jun 11 20:02:01.426018 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.425977 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b5a2dbd-8029-40aa-aa92-baf0924ba619-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-c6ds2\" (UID: \"4b5a2dbd-8029-40aa-aa92-baf0924ba619\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:02:01.426176 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.426034 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lnxw\" (UniqueName: \"kubernetes.io/projected/4b5a2dbd-8029-40aa-aa92-baf0924ba619-kube-api-access-4lnxw\") pod \"maas-default-gateway-openshift-default-687ff6996-c6ds2\" (UID: \"4b5a2dbd-8029-40aa-aa92-baf0924ba619\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:02:01.426176 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.426103 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b5a2dbd-8029-40aa-aa92-baf0924ba619-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-c6ds2\" (UID: \"4b5a2dbd-8029-40aa-aa92-baf0924ba619\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:02:01.426282 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.426244 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b5a2dbd-8029-40aa-aa92-baf0924ba619-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-c6ds2\" (UID: \"4b5a2dbd-8029-40aa-aa92-baf0924ba619\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:02:01.426321 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.426303 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b5a2dbd-8029-40aa-aa92-baf0924ba619-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-c6ds2\" (UID: \"4b5a2dbd-8029-40aa-aa92-baf0924ba619\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:02:01.426355 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.426343 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b5a2dbd-8029-40aa-aa92-baf0924ba619-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-c6ds2\" (UID: \"4b5a2dbd-8029-40aa-aa92-baf0924ba619\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:02:01.426389 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.426380 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b5a2dbd-8029-40aa-aa92-baf0924ba619-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-c6ds2\" (UID: \"4b5a2dbd-8029-40aa-aa92-baf0924ba619\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:02:01.426429 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.426408 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b5a2dbd-8029-40aa-aa92-baf0924ba619-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-c6ds2\" (UID: \"4b5a2dbd-8029-40aa-aa92-baf0924ba619\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:02:01.426463 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.426430 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b5a2dbd-8029-40aa-aa92-baf0924ba619-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-c6ds2\" (UID: \"4b5a2dbd-8029-40aa-aa92-baf0924ba619\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:02:01.527234 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.527203 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b5a2dbd-8029-40aa-aa92-baf0924ba619-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-c6ds2\" (UID: \"4b5a2dbd-8029-40aa-aa92-baf0924ba619\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:02:01.527446 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.527246 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b5a2dbd-8029-40aa-aa92-baf0924ba619-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-c6ds2\" (UID: \"4b5a2dbd-8029-40aa-aa92-baf0924ba619\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:02:01.527446 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.527273 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b5a2dbd-8029-40aa-aa92-baf0924ba619-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-c6ds2\" (UID: \"4b5a2dbd-8029-40aa-aa92-baf0924ba619\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:02:01.527446 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.527301 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b5a2dbd-8029-40aa-aa92-baf0924ba619-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-c6ds2\" (UID: \"4b5a2dbd-8029-40aa-aa92-baf0924ba619\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:02:01.527446 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.527325 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b5a2dbd-8029-40aa-aa92-baf0924ba619-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-c6ds2\" (UID: \"4b5a2dbd-8029-40aa-aa92-baf0924ba619\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:02:01.527446 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.527361 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b5a2dbd-8029-40aa-aa92-baf0924ba619-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-c6ds2\" (UID: \"4b5a2dbd-8029-40aa-aa92-baf0924ba619\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:02:01.527446 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.527405 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b5a2dbd-8029-40aa-aa92-baf0924ba619-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-c6ds2\" (UID: \"4b5a2dbd-8029-40aa-aa92-baf0924ba619\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:02:01.527786 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.527710 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b5a2dbd-8029-40aa-aa92-baf0924ba619-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-c6ds2\" (UID: \"4b5a2dbd-8029-40aa-aa92-baf0924ba619\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:02:01.527786 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.527727 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lnxw\" (UniqueName: \"kubernetes.io/projected/4b5a2dbd-8029-40aa-aa92-baf0924ba619-kube-api-access-4lnxw\") pod \"maas-default-gateway-openshift-default-687ff6996-c6ds2\" (UID: \"4b5a2dbd-8029-40aa-aa92-baf0924ba619\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:02:01.527900 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.527785 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b5a2dbd-8029-40aa-aa92-baf0924ba619-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-c6ds2\" (UID: \"4b5a2dbd-8029-40aa-aa92-baf0924ba619\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:02:01.527900 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.527788 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b5a2dbd-8029-40aa-aa92-baf0924ba619-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-c6ds2\" (UID: \"4b5a2dbd-8029-40aa-aa92-baf0924ba619\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:02:01.528015 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.527903 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b5a2dbd-8029-40aa-aa92-baf0924ba619-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-c6ds2\" (UID: \"4b5a2dbd-8029-40aa-aa92-baf0924ba619\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:02:01.528015 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.527978 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b5a2dbd-8029-40aa-aa92-baf0924ba619-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-c6ds2\" (UID: \"4b5a2dbd-8029-40aa-aa92-baf0924ba619\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:02:01.528166 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.528100 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b5a2dbd-8029-40aa-aa92-baf0924ba619-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-c6ds2\" (UID: \"4b5a2dbd-8029-40aa-aa92-baf0924ba619\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:02:01.529800 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.529773 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b5a2dbd-8029-40aa-aa92-baf0924ba619-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-c6ds2\" (UID: \"4b5a2dbd-8029-40aa-aa92-baf0924ba619\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:02:01.529973 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.529950 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b5a2dbd-8029-40aa-aa92-baf0924ba619-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-c6ds2\" (UID: \"4b5a2dbd-8029-40aa-aa92-baf0924ba619\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:02:01.536797 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.536776 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lnxw\" (UniqueName: \"kubernetes.io/projected/4b5a2dbd-8029-40aa-aa92-baf0924ba619-kube-api-access-4lnxw\") pod \"maas-default-gateway-openshift-default-687ff6996-c6ds2\" (UID: \"4b5a2dbd-8029-40aa-aa92-baf0924ba619\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:02:01.539371 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.539352 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b5a2dbd-8029-40aa-aa92-baf0924ba619-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-c6ds2\" (UID: \"4b5a2dbd-8029-40aa-aa92-baf0924ba619\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:02:01.638479 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.638454 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:02:01.789687 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.789534 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2"] Jun 11 20:02:01.792206 ip-10-0-137-247 kubenswrapper[2576]: W0611 20:02:01.792176 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b5a2dbd_8029_40aa_aa92_baf0924ba619.slice/crio-c872895d4ff1d09bc0576daee3c42bbf0241fb1cca64ec77d4e0e76216b49293 WatchSource:0}: Error finding container c872895d4ff1d09bc0576daee3c42bbf0241fb1cca64ec77d4e0e76216b49293: Status 404 returned error can't find the container with id c872895d4ff1d09bc0576daee3c42bbf0241fb1cca64ec77d4e0e76216b49293 Jun 11 20:02:01.794276 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.794241 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 20:02:01.794379 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.794311 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 20:02:01.794379 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:01.794340 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 20:02:02.008635 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:02.008545 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" event={"ID":"4b5a2dbd-8029-40aa-aa92-baf0924ba619","Type":"ContainerStarted","Data":"ed262b4f45cc5f9f98e9979468611bfdddf285d14653eb094d4972c1bf9e186a"} Jun 11 20:02:02.008797 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:02.008635 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" event={"ID":"4b5a2dbd-8029-40aa-aa92-baf0924ba619","Type":"ContainerStarted","Data":"c872895d4ff1d09bc0576daee3c42bbf0241fb1cca64ec77d4e0e76216b49293"} Jun 11 20:02:02.033662 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:02.033611 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" podStartSLOduration=1.033595624 podStartE2EDuration="1.033595624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:02:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:02:02.031722036 +0000 UTC m=+722.309482797" watchObservedRunningTime="2026-06-11 20:02:02.033595624 +0000 UTC m=+722.311356382" Jun 11 20:02:02.639530 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:02.639495 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:02:02.644376 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:02.644349 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:02:03.013864 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:03.013784 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:02:03.014612 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:03.014590 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:02:15.388679 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:15.388644 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:02:15.392020 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:15.391999 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-nm4xx" Jun 11 20:02:15.395182 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:15.395159 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vk62p\"" Jun 11 20:02:15.395582 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:15.395566 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 20:02:15.407410 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:15.407386 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:02:15.431253 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:15.431226 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:02:15.549165 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:15.549102 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5d9ad534-fe2f-414e-ae49-eb6eb9251581-config-file\") pod \"limitador-limitador-54d6d988d5-nm4xx\" (UID: \"5d9ad534-fe2f-414e-ae49-eb6eb9251581\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nm4xx" Jun 11 20:02:15.549337 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:15.549189 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kqnc\" (UniqueName: \"kubernetes.io/projected/5d9ad534-fe2f-414e-ae49-eb6eb9251581-kube-api-access-8kqnc\") pod \"limitador-limitador-54d6d988d5-nm4xx\" (UID: \"5d9ad534-fe2f-414e-ae49-eb6eb9251581\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nm4xx" Jun 11 20:02:15.650033 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:15.649946 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5d9ad534-fe2f-414e-ae49-eb6eb9251581-config-file\") pod \"limitador-limitador-54d6d988d5-nm4xx\" (UID: \"5d9ad534-fe2f-414e-ae49-eb6eb9251581\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nm4xx" Jun 11 20:02:15.650033 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:15.649996 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kqnc\" (UniqueName: \"kubernetes.io/projected/5d9ad534-fe2f-414e-ae49-eb6eb9251581-kube-api-access-8kqnc\") pod \"limitador-limitador-54d6d988d5-nm4xx\" (UID: \"5d9ad534-fe2f-414e-ae49-eb6eb9251581\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nm4xx" Jun 11 20:02:15.650565 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:15.650544 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5d9ad534-fe2f-414e-ae49-eb6eb9251581-config-file\") pod \"limitador-limitador-54d6d988d5-nm4xx\" (UID: \"5d9ad534-fe2f-414e-ae49-eb6eb9251581\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nm4xx" Jun 11 20:02:15.659360 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:15.659334 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kqnc\" (UniqueName: \"kubernetes.io/projected/5d9ad534-fe2f-414e-ae49-eb6eb9251581-kube-api-access-8kqnc\") pod \"limitador-limitador-54d6d988d5-nm4xx\" (UID: \"5d9ad534-fe2f-414e-ae49-eb6eb9251581\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nm4xx" Jun 11 20:02:15.703323 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:15.703293 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-nm4xx" Jun 11 20:02:15.838261 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:15.838236 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:02:15.839936 ip-10-0-137-247 kubenswrapper[2576]: W0611 20:02:15.839911 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d9ad534_fe2f_414e_ae49_eb6eb9251581.slice/crio-1cc472280334c773d2745851685c3b10159ad57518241b44335b5155f67be5b1 WatchSource:0}: Error finding container 1cc472280334c773d2745851685c3b10159ad57518241b44335b5155f67be5b1: Status 404 returned error can't find the container with id 1cc472280334c773d2745851685c3b10159ad57518241b44335b5155f67be5b1 Jun 11 20:02:16.073317 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:16.073236 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-nm4xx" event={"ID":"5d9ad534-fe2f-414e-ae49-eb6eb9251581","Type":"ContainerStarted","Data":"1cc472280334c773d2745851685c3b10159ad57518241b44335b5155f67be5b1"} Jun 11 20:02:19.091347 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:19.091310 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-nm4xx" event={"ID":"5d9ad534-fe2f-414e-ae49-eb6eb9251581","Type":"ContainerStarted","Data":"0ef84bd2188eba39a394acf199456a72ccc05119ab504b3db81db17c588ef685"} Jun 11 20:02:19.091733 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:19.091388 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-nm4xx" Jun 11 20:02:19.109003 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:19.108950 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-nm4xx" podStartSLOduration=1.472612832 podStartE2EDuration="4.1089355s" totalImagesPullingTime="2.636322668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:02:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:02:19.108191848 +0000 UTC m=+739.385952600" watchObservedRunningTime="2026-06-11 20:02:19.1089355 +0000 UTC m=+739.386696258" Jun 11 20:02:30.099309 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:02:30.099277 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-nm4xx" Jun 11 20:04:17.752563 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:17.752532 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-rz5mz"] Jun 11 20:04:17.756398 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:17.756374 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-rz5mz" Jun 11 20:04:17.759375 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:17.759352 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-qsxg9\"" Jun 11 20:04:17.759551 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:17.759510 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 11 20:04:17.766230 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:17.766201 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-rz5mz"] Jun 11 20:04:17.822597 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:17.822566 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsbdb\" (UniqueName: \"kubernetes.io/projected/8796ffcd-d396-4632-81ce-8aeb0eaa0d91-kube-api-access-fsbdb\") pod \"payload-processing-699b6cd6c-rz5mz\" (UID: \"8796ffcd-d396-4632-81ce-8aeb0eaa0d91\") " pod="openshift-ingress/payload-processing-699b6cd6c-rz5mz" Jun 11 20:04:17.832603 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:17.832569 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:04:17.924243 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:17.924200 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsbdb\" (UniqueName: \"kubernetes.io/projected/8796ffcd-d396-4632-81ce-8aeb0eaa0d91-kube-api-access-fsbdb\") pod \"payload-processing-699b6cd6c-rz5mz\" (UID: \"8796ffcd-d396-4632-81ce-8aeb0eaa0d91\") " pod="openshift-ingress/payload-processing-699b6cd6c-rz5mz" Jun 11 20:04:17.934792 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:17.934768 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsbdb\" (UniqueName: \"kubernetes.io/projected/8796ffcd-d396-4632-81ce-8aeb0eaa0d91-kube-api-access-fsbdb\") pod \"payload-processing-699b6cd6c-rz5mz\" (UID: \"8796ffcd-d396-4632-81ce-8aeb0eaa0d91\") " pod="openshift-ingress/payload-processing-699b6cd6c-rz5mz" Jun 11 20:04:18.067698 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:18.067624 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-rz5mz" Jun 11 20:04:18.200089 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:18.200064 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-rz5mz"] Jun 11 20:04:18.202441 ip-10-0-137-247 kubenswrapper[2576]: W0611 20:04:18.202414 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8796ffcd_d396_4632_81ce_8aeb0eaa0d91.slice/crio-5b1206f60a016b91a67b9d55521dd04a2a26d697ac4f0d93c1664bfc835f3662 WatchSource:0}: Error finding container 5b1206f60a016b91a67b9d55521dd04a2a26d697ac4f0d93c1664bfc835f3662: Status 404 returned error can't find the container with id 5b1206f60a016b91a67b9d55521dd04a2a26d697ac4f0d93c1664bfc835f3662 Jun 11 20:04:18.204233 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:18.204215 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 20:04:18.651615 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:18.651573 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-rz5mz" event={"ID":"8796ffcd-d396-4632-81ce-8aeb0eaa0d91","Type":"ContainerStarted","Data":"5b1206f60a016b91a67b9d55521dd04a2a26d697ac4f0d93c1664bfc835f3662"} Jun 11 20:04:21.668355 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:21.668316 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-rz5mz" event={"ID":"8796ffcd-d396-4632-81ce-8aeb0eaa0d91","Type":"ContainerStarted","Data":"2b3dc3235ef785f81bd005ffda7e182901325bf998a76d1bbec301271834cab4"} Jun 11 20:04:21.668807 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:21.668479 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-rz5mz" Jun 11 20:04:21.689883 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:21.689821 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-rz5mz" podStartSLOduration=1.8379164829999999 podStartE2EDuration="4.689804601s" totalImagesPullingTime="2.851888118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:04:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:04:21.689390932 +0000 UTC m=+861.967151693" watchObservedRunningTime="2026-06-11 20:04:21.689804601 +0000 UTC m=+861.967565363" Jun 11 20:04:25.689568 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:25.689531 2576 generic.go:356] "Generic (PLEG): container finished" podID="4b5a2dbd-8029-40aa-aa92-baf0924ba619" containerID="ed262b4f45cc5f9f98e9979468611bfdddf285d14653eb094d4972c1bf9e186a" exitCode=0 Jun 11 20:04:25.689965 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:25.689582 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" event={"ID":"4b5a2dbd-8029-40aa-aa92-baf0924ba619","Type":"ContainerDied","Data":"ed262b4f45cc5f9f98e9979468611bfdddf285d14653eb094d4972c1bf9e186a"} Jun 11 20:04:25.689965 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:25.689923 2576 scope.go:117] "RemoveContainer" containerID="ed262b4f45cc5f9f98e9979468611bfdddf285d14653eb094d4972c1bf9e186a" Jun 11 20:04:25.690883 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:25.690852 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 20:04:25.690944 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:25.690927 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 20:04:25.690979 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:25.690959 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 20:04:26.696560 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:26.696525 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" event={"ID":"4b5a2dbd-8029-40aa-aa92-baf0924ba619","Type":"ContainerStarted","Data":"e8c6c6721904a73beb808ce7c6f8f7629b770bb848dad9f20609c9c3405c7ae5"} Jun 11 20:04:27.639154 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:27.639036 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:04:27.639154 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:27.639093 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-c6ds2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jun 11 20:04:27.639560 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:27.639179 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" podUID="4b5a2dbd-8029-40aa-aa92-baf0924ba619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jun 11 20:04:28.639637 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:28.639592 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-c6ds2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jun 11 20:04:28.640109 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:28.639662 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" podUID="4b5a2dbd-8029-40aa-aa92-baf0924ba619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jun 11 20:04:29.639605 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:29.639563 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-c6ds2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jun 11 20:04:29.640363 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:29.639898 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" podUID="4b5a2dbd-8029-40aa-aa92-baf0924ba619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jun 11 20:04:30.639426 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:30.639387 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-c6ds2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jun 11 20:04:30.639623 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:30.639452 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" podUID="4b5a2dbd-8029-40aa-aa92-baf0924ba619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jun 11 20:04:31.642874 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:31.642839 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:04:31.643342 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:31.643117 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:04:31.643978 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:31.643946 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-c6ds2" Jun 11 20:04:32.674931 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:04:32.674900 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-rz5mz" Jun 11 20:05:00.210629 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:05:00.210598 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9pxm2_23de3c36-7fd1-4a71-9bff-dd7782544ca4/console-operator/1.log" Jun 11 20:05:00.212433 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:05:00.212412 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9pxm2_23de3c36-7fd1-4a71-9bff-dd7782544ca4/console-operator/1.log" Jun 11 20:05:00.213840 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:05:00.213819 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hrb9t_85a48db4-30bf-47f2-9668-8b0a67c26fe4/ovn-acl-logging/0.log" Jun 11 20:05:00.215862 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:05:00.215843 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hrb9t_85a48db4-30bf-47f2-9668-8b0a67c26fe4/ovn-acl-logging/0.log" Jun 11 20:07:17.760559 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:17.760530 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw"] Jun 11 20:07:17.764296 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:17.764279 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw" Jun 11 20:07:17.768283 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:17.768256 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 20:07:17.768283 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:17.768257 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 20:07:17.769441 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:17.769422 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 11 20:07:17.769570 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:17.769511 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jml7t\"" Jun 11 20:07:17.776459 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:17.776436 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw"] Jun 11 20:07:17.829187 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:17.829152 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/46e00143-ff83-4338-8fc4-a6853369c3a8-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw\" (UID: \"46e00143-ff83-4338-8fc4-a6853369c3a8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw" Jun 11 20:07:17.829367 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:17.829237 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46e00143-ff83-4338-8fc4-a6853369c3a8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw\" (UID: \"46e00143-ff83-4338-8fc4-a6853369c3a8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw" Jun 11 20:07:17.829367 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:17.829268 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46e00143-ff83-4338-8fc4-a6853369c3a8-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw\" (UID: \"46e00143-ff83-4338-8fc4-a6853369c3a8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw" Jun 11 20:07:17.829367 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:17.829299 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46e00143-ff83-4338-8fc4-a6853369c3a8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw\" (UID: \"46e00143-ff83-4338-8fc4-a6853369c3a8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw" Jun 11 20:07:17.829524 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:17.829373 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46e00143-ff83-4338-8fc4-a6853369c3a8-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw\" (UID: \"46e00143-ff83-4338-8fc4-a6853369c3a8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw" Jun 11 20:07:17.829524 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:17.829397 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vknrx\" (UniqueName: \"kubernetes.io/projected/46e00143-ff83-4338-8fc4-a6853369c3a8-kube-api-access-vknrx\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw\" (UID: \"46e00143-ff83-4338-8fc4-a6853369c3a8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw" Jun 11 20:07:17.930519 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:17.930481 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46e00143-ff83-4338-8fc4-a6853369c3a8-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw\" (UID: \"46e00143-ff83-4338-8fc4-a6853369c3a8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw" Jun 11 20:07:17.930519 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:17.930517 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vknrx\" (UniqueName: \"kubernetes.io/projected/46e00143-ff83-4338-8fc4-a6853369c3a8-kube-api-access-vknrx\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw\" (UID: \"46e00143-ff83-4338-8fc4-a6853369c3a8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw" Jun 11 20:07:17.930730 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:17.930537 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/46e00143-ff83-4338-8fc4-a6853369c3a8-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw\" (UID: \"46e00143-ff83-4338-8fc4-a6853369c3a8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw" Jun 11 20:07:17.930730 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:17.930576 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46e00143-ff83-4338-8fc4-a6853369c3a8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw\" (UID: \"46e00143-ff83-4338-8fc4-a6853369c3a8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw" Jun 11 20:07:17.930730 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:17.930594 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46e00143-ff83-4338-8fc4-a6853369c3a8-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw\" (UID: \"46e00143-ff83-4338-8fc4-a6853369c3a8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw" Jun 11 20:07:17.930730 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:17.930622 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46e00143-ff83-4338-8fc4-a6853369c3a8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw\" (UID: \"46e00143-ff83-4338-8fc4-a6853369c3a8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw" Jun 11 20:07:17.930966 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:17.930948 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46e00143-ff83-4338-8fc4-a6853369c3a8-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw\" (UID: \"46e00143-ff83-4338-8fc4-a6853369c3a8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw" Jun 11 20:07:17.931044 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:17.931014 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/46e00143-ff83-4338-8fc4-a6853369c3a8-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw\" (UID: \"46e00143-ff83-4338-8fc4-a6853369c3a8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw" Jun 11 20:07:17.931176 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:17.931049 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46e00143-ff83-4338-8fc4-a6853369c3a8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw\" (UID: \"46e00143-ff83-4338-8fc4-a6853369c3a8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw" Jun 11 20:07:17.932933 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:17.932916 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46e00143-ff83-4338-8fc4-a6853369c3a8-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw\" (UID: \"46e00143-ff83-4338-8fc4-a6853369c3a8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw" Jun 11 20:07:17.933163 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:17.933145 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46e00143-ff83-4338-8fc4-a6853369c3a8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw\" (UID: \"46e00143-ff83-4338-8fc4-a6853369c3a8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw" Jun 11 20:07:17.939107 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:17.939086 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vknrx\" (UniqueName: \"kubernetes.io/projected/46e00143-ff83-4338-8fc4-a6853369c3a8-kube-api-access-vknrx\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw\" (UID: \"46e00143-ff83-4338-8fc4-a6853369c3a8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw" Jun 11 20:07:18.076466 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:18.076377 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw" Jun 11 20:07:18.099539 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:18.099494 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:07:18.215052 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:18.215027 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw"] Jun 11 20:07:18.217380 ip-10-0-137-247 kubenswrapper[2576]: W0611 20:07:18.217352 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46e00143_ff83_4338_8fc4_a6853369c3a8.slice/crio-3480ad58e09724ce29c7d0180674b9b472807dfe6564a9f876e079068146d5a2 WatchSource:0}: Error finding container 3480ad58e09724ce29c7d0180674b9b472807dfe6564a9f876e079068146d5a2: Status 404 returned error can't find the container with id 3480ad58e09724ce29c7d0180674b9b472807dfe6564a9f876e079068146d5a2 Jun 11 20:07:18.514351 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:18.514298 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw" event={"ID":"46e00143-ff83-4338-8fc4-a6853369c3a8","Type":"ContainerStarted","Data":"3480ad58e09724ce29c7d0180674b9b472807dfe6564a9f876e079068146d5a2"} Jun 11 20:07:22.784445 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:22.784405 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:07:23.542668 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:23.542628 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw" event={"ID":"46e00143-ff83-4338-8fc4-a6853369c3a8","Type":"ContainerStarted","Data":"98e7dc9b8d53573d6c7c818768d5f813316f3f8a3f5f3880670c025dfde0a85a"} Jun 11 20:07:24.548417 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:24.548329 2576 generic.go:356] "Generic (PLEG): container finished" podID="46e00143-ff83-4338-8fc4-a6853369c3a8" containerID="98e7dc9b8d53573d6c7c818768d5f813316f3f8a3f5f3880670c025dfde0a85a" exitCode=0 Jun 11 20:07:24.548777 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:24.548412 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw" event={"ID":"46e00143-ff83-4338-8fc4-a6853369c3a8","Type":"ContainerDied","Data":"98e7dc9b8d53573d6c7c818768d5f813316f3f8a3f5f3880670c025dfde0a85a"} Jun 11 20:07:25.909796 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:25.909718 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:07:26.561384 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:26.561345 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw" event={"ID":"46e00143-ff83-4338-8fc4-a6853369c3a8","Type":"ContainerStarted","Data":"5b0639d9e16ffb49a85088ff056bdbccf8fc13a80870f822c38433fac433fd52"} Jun 11 20:07:26.585067 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:26.585010 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw" podStartSLOduration=2.56613807 podStartE2EDuration="9.584994414s" totalImagesPullingTime="5.738947881s" totalInitContainerRuntime="1.279908463s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:07:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:07:26.582932315 +0000 UTC m=+1046.860693074" watchObservedRunningTime="2026-06-11 20:07:26.584994414 +0000 UTC m=+1046.862755185" Jun 11 20:07:28.076672 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:28.076641 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw" Jun 11 20:07:28.077200 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:28.076695 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw" Jun 11 20:07:28.088900 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:28.088874 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw" Jun 11 20:07:28.582175 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:28.582141 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw" Jun 11 20:07:35.810652 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:35.810619 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:07:51.325191 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:51.325096 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z"] Jun 11 20:07:51.329194 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:51.329176 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z" Jun 11 20:07:51.331981 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:51.331960 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 11 20:07:51.339582 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:51.339552 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z"] Jun 11 20:07:51.342600 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:51.342575 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7660ff0c-820b-46b5-8f78-61b832d24756-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z\" (UID: \"7660ff0c-820b-46b5-8f78-61b832d24756\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z" Jun 11 20:07:51.342710 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:51.342661 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7660ff0c-820b-46b5-8f78-61b832d24756-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z\" (UID: \"7660ff0c-820b-46b5-8f78-61b832d24756\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z" Jun 11 20:07:51.342793 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:51.342767 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqs8n\" (UniqueName: \"kubernetes.io/projected/7660ff0c-820b-46b5-8f78-61b832d24756-kube-api-access-bqs8n\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z\" (UID: \"7660ff0c-820b-46b5-8f78-61b832d24756\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z" Jun 11 20:07:51.342858 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:51.342810 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7660ff0c-820b-46b5-8f78-61b832d24756-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z\" (UID: \"7660ff0c-820b-46b5-8f78-61b832d24756\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z" Jun 11 20:07:51.342858 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:51.342841 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7660ff0c-820b-46b5-8f78-61b832d24756-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z\" (UID: \"7660ff0c-820b-46b5-8f78-61b832d24756\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z" Jun 11 20:07:51.342964 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:51.342909 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7660ff0c-820b-46b5-8f78-61b832d24756-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z\" (UID: \"7660ff0c-820b-46b5-8f78-61b832d24756\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z" Jun 11 20:07:51.443850 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:51.443815 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7660ff0c-820b-46b5-8f78-61b832d24756-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z\" (UID: \"7660ff0c-820b-46b5-8f78-61b832d24756\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z" Jun 11 20:07:51.444037 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:51.443861 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7660ff0c-820b-46b5-8f78-61b832d24756-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z\" (UID: \"7660ff0c-820b-46b5-8f78-61b832d24756\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z" Jun 11 20:07:51.444037 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:51.443904 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7660ff0c-820b-46b5-8f78-61b832d24756-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z\" (UID: \"7660ff0c-820b-46b5-8f78-61b832d24756\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z" Jun 11 20:07:51.444037 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:51.443952 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqs8n\" (UniqueName: \"kubernetes.io/projected/7660ff0c-820b-46b5-8f78-61b832d24756-kube-api-access-bqs8n\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z\" (UID: \"7660ff0c-820b-46b5-8f78-61b832d24756\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z" Jun 11 20:07:51.444037 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:51.443976 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7660ff0c-820b-46b5-8f78-61b832d24756-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z\" (UID: \"7660ff0c-820b-46b5-8f78-61b832d24756\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z" Jun 11 20:07:51.444037 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:51.444011 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7660ff0c-820b-46b5-8f78-61b832d24756-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z\" (UID: \"7660ff0c-820b-46b5-8f78-61b832d24756\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z" Jun 11 20:07:51.444493 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:51.444470 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7660ff0c-820b-46b5-8f78-61b832d24756-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z\" (UID: \"7660ff0c-820b-46b5-8f78-61b832d24756\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z" Jun 11 20:07:51.444566 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:51.444472 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7660ff0c-820b-46b5-8f78-61b832d24756-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z\" (UID: \"7660ff0c-820b-46b5-8f78-61b832d24756\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z" Jun 11 20:07:51.444609 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:51.444588 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7660ff0c-820b-46b5-8f78-61b832d24756-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z\" (UID: \"7660ff0c-820b-46b5-8f78-61b832d24756\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z" Jun 11 20:07:51.446547 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:51.446517 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7660ff0c-820b-46b5-8f78-61b832d24756-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z\" (UID: \"7660ff0c-820b-46b5-8f78-61b832d24756\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z" Jun 11 20:07:51.446759 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:51.446737 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7660ff0c-820b-46b5-8f78-61b832d24756-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z\" (UID: \"7660ff0c-820b-46b5-8f78-61b832d24756\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z" Jun 11 20:07:51.452026 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:51.452004 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqs8n\" (UniqueName: \"kubernetes.io/projected/7660ff0c-820b-46b5-8f78-61b832d24756-kube-api-access-bqs8n\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z\" (UID: \"7660ff0c-820b-46b5-8f78-61b832d24756\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z" Jun 11 20:07:51.641378 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:51.641341 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z" Jun 11 20:07:51.794679 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:51.794651 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z"] Jun 11 20:07:51.796952 ip-10-0-137-247 kubenswrapper[2576]: W0611 20:07:51.796925 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7660ff0c_820b_46b5_8f78_61b832d24756.slice/crio-4a4abfb151bbf9d786108bd71c3cbaca264f232b6d43e360fa607a322ca2b89f WatchSource:0}: Error finding container 4a4abfb151bbf9d786108bd71c3cbaca264f232b6d43e360fa607a322ca2b89f: Status 404 returned error can't find the container with id 4a4abfb151bbf9d786108bd71c3cbaca264f232b6d43e360fa607a322ca2b89f Jun 11 20:07:52.485008 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:52.484975 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:07:52.684670 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:52.684631 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z" event={"ID":"7660ff0c-820b-46b5-8f78-61b832d24756","Type":"ContainerStarted","Data":"8eb5d245a32c4856ec4b137659d12e5bba83b18a83fbae6412c02c2c58d4fcfe"} Jun 11 20:07:52.684870 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:52.684694 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z" event={"ID":"7660ff0c-820b-46b5-8f78-61b832d24756","Type":"ContainerStarted","Data":"4a4abfb151bbf9d786108bd71c3cbaca264f232b6d43e360fa607a322ca2b89f"} Jun 11 20:07:53.691668 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:53.691633 2576 generic.go:356] "Generic (PLEG): container finished" podID="7660ff0c-820b-46b5-8f78-61b832d24756" containerID="8eb5d245a32c4856ec4b137659d12e5bba83b18a83fbae6412c02c2c58d4fcfe" exitCode=0 Jun 11 20:07:53.692069 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:53.691713 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z" event={"ID":"7660ff0c-820b-46b5-8f78-61b832d24756","Type":"ContainerDied","Data":"8eb5d245a32c4856ec4b137659d12e5bba83b18a83fbae6412c02c2c58d4fcfe"} Jun 11 20:07:54.698177 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:54.698142 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z" event={"ID":"7660ff0c-820b-46b5-8f78-61b832d24756","Type":"ContainerStarted","Data":"bb41689b3c1bbc92582b79f46b8701940e7951b03fa88d7f54f54b3131720cc1"} Jun 11 20:07:54.717539 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:07:54.717483 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z" podStartSLOduration=2.261425289 podStartE2EDuration="3.717468729s" totalImagesPullingTime="233.127394ms" totalInitContainerRuntime="1.222916046s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:07:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:07:54.716631502 +0000 UTC m=+1074.994392299" watchObservedRunningTime="2026-06-11 20:07:54.717468729 +0000 UTC m=+1074.995229465" Jun 11 20:08:01.642215 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:08:01.642176 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z" Jun 11 20:08:01.642739 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:08:01.642255 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z" Jun 11 20:08:01.655585 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:08:01.655557 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z" Jun 11 20:08:01.744017 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:08:01.743984 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z" Jun 11 20:08:02.223996 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:08:02.223963 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:09:44.584728 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:09:44.584689 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:09:48.907627 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:09:48.907592 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:09:55.348704 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:09:55.348669 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:10:00.248478 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:10:00.248433 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9pxm2_23de3c36-7fd1-4a71-9bff-dd7782544ca4/console-operator/1.log" Jun 11 20:10:00.250233 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:10:00.250197 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9pxm2_23de3c36-7fd1-4a71-9bff-dd7782544ca4/console-operator/1.log" Jun 11 20:10:00.251777 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:10:00.251760 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hrb9t_85a48db4-30bf-47f2-9668-8b0a67c26fe4/ovn-acl-logging/0.log" Jun 11 20:10:00.253470 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:10:00.253447 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hrb9t_85a48db4-30bf-47f2-9668-8b0a67c26fe4/ovn-acl-logging/0.log" Jun 11 20:10:05.627284 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:10:05.627250 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:10:14.593713 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:10:14.593672 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:10:25.390020 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:10:25.389984 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:10:33.788465 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:10:33.788429 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:10:44.282274 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:10:44.282180 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:11:18.442729 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:11:18.442689 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:11:22.186787 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:11:22.186753 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:12:12.187806 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:12:12.187719 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:12:21.290850 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:12:21.290803 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:12:38.009545 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:12:38.009508 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:12:46.387784 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:12:46.387747 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:13:03.881251 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:13:03.881205 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:13:11.880854 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:13:11.880812 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:13:44.683007 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:13:44.682910 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:13:53.886508 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:13:53.886469 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:14:02.186048 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:14:02.186006 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:14:10.291912 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:14:10.291875 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:14:18.985557 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:14:18.985518 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:14:44.198400 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:14:44.198366 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:14:57.783609 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:14:57.783575 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:15:00.285269 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:15:00.285238 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9pxm2_23de3c36-7fd1-4a71-9bff-dd7782544ca4/console-operator/1.log" Jun 11 20:15:00.288849 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:15:00.288822 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hrb9t_85a48db4-30bf-47f2-9668-8b0a67c26fe4/ovn-acl-logging/0.log" Jun 11 20:15:00.290105 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:15:00.290084 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9pxm2_23de3c36-7fd1-4a71-9bff-dd7782544ca4/console-operator/1.log" Jun 11 20:15:00.293552 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:15:00.293531 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hrb9t_85a48db4-30bf-47f2-9668-8b0a67c26fe4/ovn-acl-logging/0.log" Jun 11 20:15:45.578665 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:15:45.578626 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:15:53.281720 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:15:53.281676 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:16:12.188518 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:16:12.188481 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:16:20.678627 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:16:20.678587 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:16:29.708408 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:16:29.708366 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:16:38.288434 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:16:38.288354 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:16:47.400534 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:16:47.400494 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:16:55.590183 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:16:55.590149 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:17:04.831770 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:17:04.831729 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:17:13.181854 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:17:13.181820 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:17:21.891325 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:17:21.891284 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:17:30.084338 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:17:30.084294 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:18:31.604664 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:18:31.604579 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhb5"] Jun 11 20:18:31.605238 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:18:31.604753 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhb5" podUID="a0eb9421-2435-4658-864b-5e4dafcd1104" containerName="manager" containerID="cri-o://3eaf652e5da0e5193def7779ce7b17786e01f18dfa45cca557297396a18657d2" gracePeriod=10 Jun 11 20:18:31.829534 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:18:31.829497 2576 generic.go:356] "Generic (PLEG): container finished" podID="a0eb9421-2435-4658-864b-5e4dafcd1104" containerID="3eaf652e5da0e5193def7779ce7b17786e01f18dfa45cca557297396a18657d2" exitCode=0 Jun 11 20:18:31.829690 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:18:31.829564 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhb5" event={"ID":"a0eb9421-2435-4658-864b-5e4dafcd1104","Type":"ContainerDied","Data":"3eaf652e5da0e5193def7779ce7b17786e01f18dfa45cca557297396a18657d2"} Jun 11 20:18:31.855094 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:18:31.855034 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhb5" Jun 11 20:18:31.996745 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:18:31.996714 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfzgj\" (UniqueName: \"kubernetes.io/projected/a0eb9421-2435-4658-864b-5e4dafcd1104-kube-api-access-qfzgj\") pod \"a0eb9421-2435-4658-864b-5e4dafcd1104\" (UID: \"a0eb9421-2435-4658-864b-5e4dafcd1104\") " Jun 11 20:18:31.996954 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:18:31.996791 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0eb9421-2435-4658-864b-5e4dafcd1104-extensions-socket-volume\") pod \"a0eb9421-2435-4658-864b-5e4dafcd1104\" (UID: \"a0eb9421-2435-4658-864b-5e4dafcd1104\") " Jun 11 20:18:31.997160 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:18:31.997136 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0eb9421-2435-4658-864b-5e4dafcd1104-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a0eb9421-2435-4658-864b-5e4dafcd1104" (UID: "a0eb9421-2435-4658-864b-5e4dafcd1104"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:18:31.998766 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:18:31.998740 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0eb9421-2435-4658-864b-5e4dafcd1104-kube-api-access-qfzgj" (OuterVolumeSpecName: "kube-api-access-qfzgj") pod "a0eb9421-2435-4658-864b-5e4dafcd1104" (UID: "a0eb9421-2435-4658-864b-5e4dafcd1104"). InnerVolumeSpecName "kube-api-access-qfzgj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:18:32.098149 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:18:32.098099 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfzgj\" (UniqueName: \"kubernetes.io/projected/a0eb9421-2435-4658-864b-5e4dafcd1104-kube-api-access-qfzgj\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:18:32.098149 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:18:32.098148 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0eb9421-2435-4658-864b-5e4dafcd1104-extensions-socket-volume\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:18:32.835252 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:18:32.835215 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhb5" event={"ID":"a0eb9421-2435-4658-864b-5e4dafcd1104","Type":"ContainerDied","Data":"0f1bb45ec3f848a8dc87f6faa4756a67930db1f2171ce6189498e0b6fabdeee3"} Jun 11 20:18:32.835252 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:18:32.835253 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhb5" Jun 11 20:18:32.835779 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:18:32.835279 2576 scope.go:117] "RemoveContainer" containerID="3eaf652e5da0e5193def7779ce7b17786e01f18dfa45cca557297396a18657d2" Jun 11 20:18:32.854906 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:18:32.854878 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhb5"] Jun 11 20:18:32.858411 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:18:32.858390 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhb5"] Jun 11 20:18:34.197006 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:18:34.196974 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0eb9421-2435-4658-864b-5e4dafcd1104" path="/var/lib/kubelet/pods/a0eb9421-2435-4658-864b-5e4dafcd1104/volumes" Jun 11 20:19:37.755117 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:19:37.755074 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5rkr4"] Jun 11 20:19:37.755734 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:19:37.755695 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0eb9421-2435-4658-864b-5e4dafcd1104" containerName="manager" Jun 11 20:19:37.755734 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:19:37.755717 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0eb9421-2435-4658-864b-5e4dafcd1104" containerName="manager" Jun 11 20:19:37.755862 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:19:37.755831 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0eb9421-2435-4658-864b-5e4dafcd1104" containerName="manager" Jun 11 20:19:37.759266 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:19:37.759244 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5rkr4" Jun 11 20:19:37.762560 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:19:37.762542 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rwztd\"" Jun 11 20:19:37.775700 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:19:37.775674 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5rkr4"] Jun 11 20:19:37.783009 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:19:37.782983 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c4931f3-ed1f-467a-b609-80cbb85216b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5rkr4\" (UID: \"2c4931f3-ed1f-467a-b609-80cbb85216b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5rkr4" Jun 11 20:19:37.783172 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:19:37.783150 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7bhr\" (UniqueName: \"kubernetes.io/projected/2c4931f3-ed1f-467a-b609-80cbb85216b4-kube-api-access-n7bhr\") pod \"kuadrant-operator-controller-manager-86878c769f-5rkr4\" (UID: \"2c4931f3-ed1f-467a-b609-80cbb85216b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5rkr4" Jun 11 20:19:37.884308 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:19:37.884273 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7bhr\" (UniqueName: \"kubernetes.io/projected/2c4931f3-ed1f-467a-b609-80cbb85216b4-kube-api-access-n7bhr\") pod \"kuadrant-operator-controller-manager-86878c769f-5rkr4\" (UID: \"2c4931f3-ed1f-467a-b609-80cbb85216b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5rkr4" Jun 11 20:19:37.884527 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:19:37.884351 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c4931f3-ed1f-467a-b609-80cbb85216b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5rkr4\" (UID: \"2c4931f3-ed1f-467a-b609-80cbb85216b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5rkr4" Jun 11 20:19:37.884748 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:19:37.884718 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c4931f3-ed1f-467a-b609-80cbb85216b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5rkr4\" (UID: \"2c4931f3-ed1f-467a-b609-80cbb85216b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5rkr4" Jun 11 20:19:37.897430 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:19:37.897402 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7bhr\" (UniqueName: \"kubernetes.io/projected/2c4931f3-ed1f-467a-b609-80cbb85216b4-kube-api-access-n7bhr\") pod \"kuadrant-operator-controller-manager-86878c769f-5rkr4\" (UID: \"2c4931f3-ed1f-467a-b609-80cbb85216b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5rkr4" Jun 11 20:19:38.069810 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:19:38.069733 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5rkr4" Jun 11 20:19:38.216047 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:19:38.216016 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5rkr4"] Jun 11 20:19:38.218917 ip-10-0-137-247 kubenswrapper[2576]: W0611 20:19:38.218888 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c4931f3_ed1f_467a_b609_80cbb85216b4.slice/crio-d9414a265af45505125d8ff85c5fd99761f4857e0cce229216d8509ecc2f472f WatchSource:0}: Error finding container d9414a265af45505125d8ff85c5fd99761f4857e0cce229216d8509ecc2f472f: Status 404 returned error can't find the container with id d9414a265af45505125d8ff85c5fd99761f4857e0cce229216d8509ecc2f472f Jun 11 20:19:39.158236 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:19:39.158202 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5rkr4" event={"ID":"2c4931f3-ed1f-467a-b609-80cbb85216b4","Type":"ContainerStarted","Data":"20830fc928eda8eb627a277738eb7abad227eb8a018e6e99a8ecb3df837ac3f4"} Jun 11 20:19:39.158655 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:19:39.158253 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5rkr4" event={"ID":"2c4931f3-ed1f-467a-b609-80cbb85216b4","Type":"ContainerStarted","Data":"d9414a265af45505125d8ff85c5fd99761f4857e0cce229216d8509ecc2f472f"} Jun 11 20:19:39.158655 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:19:39.158336 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5rkr4" Jun 11 20:19:39.186452 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:19:39.186398 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5rkr4" podStartSLOduration=2.186383064 podStartE2EDuration="2.186383064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:19:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:19:39.18468936 +0000 UTC m=+1779.462450119" watchObservedRunningTime="2026-06-11 20:19:39.186383064 +0000 UTC m=+1779.464143822" Jun 11 20:19:50.165252 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:19:50.165212 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5rkr4" Jun 11 20:19:58.096813 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:19:58.096779 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:20:00.315521 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:20:00.315494 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9pxm2_23de3c36-7fd1-4a71-9bff-dd7782544ca4/console-operator/1.log" Jun 11 20:20:00.319006 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:20:00.318983 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hrb9t_85a48db4-30bf-47f2-9668-8b0a67c26fe4/ovn-acl-logging/0.log" Jun 11 20:20:00.322465 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:20:00.322444 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9pxm2_23de3c36-7fd1-4a71-9bff-dd7782544ca4/console-operator/1.log" Jun 11 20:20:00.325937 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:20:00.325919 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hrb9t_85a48db4-30bf-47f2-9668-8b0a67c26fe4/ovn-acl-logging/0.log" Jun 11 20:20:02.581094 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:20:02.581056 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:20:29.386423 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:20:29.386387 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:20:33.397693 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:20:33.397656 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:20:43.486585 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:20:43.486545 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:20:52.979407 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:20:52.979369 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:21:02.785228 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:21:02.785186 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:21:12.885887 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:21:12.885803 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:21:22.278143 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:21:22.278086 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:21:31.091524 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:21:31.091486 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:21:41.592887 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:21:41.592847 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:21:50.985509 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:21:50.985474 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:22:00.186027 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:22:00.185990 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:22:05.286596 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:22:05.286559 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:22:33.094805 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:22:33.094754 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:23:16.894164 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:23:16.894115 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:23:24.284284 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:23:24.284247 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:23:34.188252 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:23:34.188213 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:23:41.786483 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:23:41.786451 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:23:50.389662 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:23:50.389625 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:24:02.887729 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:24:02.887691 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:24:12.781005 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:24:12.780916 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:24:17.292940 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:24:17.292899 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:24:27.491554 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:24:27.491516 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:24:35.035678 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:24:35.035639 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:24:42.786165 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:24:42.786116 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:24:53.110971 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:24:53.110932 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:25:00.347414 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:25:00.347385 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9pxm2_23de3c36-7fd1-4a71-9bff-dd7782544ca4/console-operator/1.log" Jun 11 20:25:00.351144 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:25:00.351097 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hrb9t_85a48db4-30bf-47f2-9668-8b0a67c26fe4/ovn-acl-logging/0.log" Jun 11 20:25:00.356963 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:25:00.356944 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9pxm2_23de3c36-7fd1-4a71-9bff-dd7782544ca4/console-operator/1.log" Jun 11 20:25:00.360399 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:25:00.360382 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hrb9t_85a48db4-30bf-47f2-9668-8b0a67c26fe4/ovn-acl-logging/0.log" Jun 11 20:25:12.393953 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:25:12.393919 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:25:19.784050 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:25:19.784012 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:25:29.381825 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:25:29.381786 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:25:36.680601 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:25:36.680566 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:25:54.877161 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:25:54.877055 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:26:02.279520 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:26:02.279483 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:26:11.002780 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:26:11.002738 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:26:19.288864 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:26:19.288828 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:26:29.484602 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:26:29.484567 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:26:37.397111 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:26:37.397076 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:26:46.789370 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:26:46.789325 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:26:58.903612 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:26:58.903573 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:27:09.293182 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:27:09.293081 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:27:21.089607 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:27:21.089574 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:27:31.496976 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:27:31.496935 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:27:35.984133 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:27:35.984079 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:27:45.791371 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:27:45.791335 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:27:50.199486 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:27:50.199443 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:28:06.992494 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:28:06.992456 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:28:15.487334 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:28:15.487299 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:28:24.997826 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:28:24.997783 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:28:30.794327 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:28:30.794290 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:28:52.288754 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:28:52.288656 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:29:04.882000 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:04.881957 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:29:05.575041 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:05.575001 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4"] Jun 11 20:29:05.578823 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:05.578802 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:05.581598 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:05.581575 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-68645d30-openshift-default-dockercfg-258zr\"" Jun 11 20:29:05.601146 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:05.601105 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4"] Jun 11 20:29:05.689098 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:05.689064 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be8bd516-026c-4779-b64d-cc47a2b4e8b6-istio-podinfo\") pod \"e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:05.689292 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:05.689143 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d82h9\" (UniqueName: \"kubernetes.io/projected/be8bd516-026c-4779-b64d-cc47a2b4e8b6-kube-api-access-d82h9\") pod \"e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:05.689292 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:05.689174 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be8bd516-026c-4779-b64d-cc47a2b4e8b6-credential-socket\") pod \"e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:05.689292 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:05.689201 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be8bd516-026c-4779-b64d-cc47a2b4e8b6-workload-certs\") pod \"e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:05.689439 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:05.689311 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be8bd516-026c-4779-b64d-cc47a2b4e8b6-istiod-ca-cert\") pod \"e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:05.689439 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:05.689344 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be8bd516-026c-4779-b64d-cc47a2b4e8b6-istio-envoy\") pod \"e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:05.689439 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:05.689398 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be8bd516-026c-4779-b64d-cc47a2b4e8b6-workload-socket\") pod \"e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:05.689439 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:05.689429 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be8bd516-026c-4779-b64d-cc47a2b4e8b6-istio-data\") pod \"e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:05.689567 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:05.689472 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be8bd516-026c-4779-b64d-cc47a2b4e8b6-istio-token\") pod \"e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:05.790772 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:05.790736 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be8bd516-026c-4779-b64d-cc47a2b4e8b6-workload-socket\") pod \"e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:05.790943 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:05.790783 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be8bd516-026c-4779-b64d-cc47a2b4e8b6-istio-data\") pod \"e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:05.790943 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:05.790810 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be8bd516-026c-4779-b64d-cc47a2b4e8b6-istio-token\") pod \"e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:05.790943 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:05.790917 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be8bd516-026c-4779-b64d-cc47a2b4e8b6-istio-podinfo\") pod \"e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:05.791081 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:05.790977 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d82h9\" (UniqueName: \"kubernetes.io/projected/be8bd516-026c-4779-b64d-cc47a2b4e8b6-kube-api-access-d82h9\") pod \"e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:05.791081 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:05.791006 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be8bd516-026c-4779-b64d-cc47a2b4e8b6-credential-socket\") pod \"e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:05.791081 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:05.791045 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be8bd516-026c-4779-b64d-cc47a2b4e8b6-workload-certs\") pod \"e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:05.791217 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:05.791098 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be8bd516-026c-4779-b64d-cc47a2b4e8b6-istiod-ca-cert\") pod \"e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:05.791217 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:05.791146 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be8bd516-026c-4779-b64d-cc47a2b4e8b6-istio-envoy\") pod \"e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:05.791217 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:05.791190 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be8bd516-026c-4779-b64d-cc47a2b4e8b6-istio-data\") pod \"e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:05.791334 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:05.791231 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be8bd516-026c-4779-b64d-cc47a2b4e8b6-workload-socket\") pod \"e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:05.791455 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:05.791436 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be8bd516-026c-4779-b64d-cc47a2b4e8b6-workload-certs\") pod \"e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:05.791614 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:05.791590 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be8bd516-026c-4779-b64d-cc47a2b4e8b6-credential-socket\") pod \"e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:05.791822 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:05.791799 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be8bd516-026c-4779-b64d-cc47a2b4e8b6-istiod-ca-cert\") pod \"e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:05.793311 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:05.793287 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be8bd516-026c-4779-b64d-cc47a2b4e8b6-istio-envoy\") pod \"e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:05.793509 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:05.793491 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be8bd516-026c-4779-b64d-cc47a2b4e8b6-istio-podinfo\") pod \"e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:05.800324 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:05.800297 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d82h9\" (UniqueName: \"kubernetes.io/projected/be8bd516-026c-4779-b64d-cc47a2b4e8b6-kube-api-access-d82h9\") pod \"e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:05.800414 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:05.800322 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be8bd516-026c-4779-b64d-cc47a2b4e8b6-istio-token\") pod \"e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:05.889966 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:05.889938 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:06.035495 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:06.035468 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4"] Jun 11 20:29:06.037613 ip-10-0-137-247 kubenswrapper[2576]: W0611 20:29:06.037581 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe8bd516_026c_4779_b64d_cc47a2b4e8b6.slice/crio-a215f9f3965c0f8ceeccfdf3b325b9c726ce6a4671879a5503bf68d82dd72942 WatchSource:0}: Error finding container a215f9f3965c0f8ceeccfdf3b325b9c726ce6a4671879a5503bf68d82dd72942: Status 404 returned error can't find the container with id a215f9f3965c0f8ceeccfdf3b325b9c726ce6a4671879a5503bf68d82dd72942 Jun 11 20:29:06.039819 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:06.039784 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 20:29:06.039926 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:06.039852 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 20:29:06.039926 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:06.039884 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 20:29:07.001942 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:07.001900 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" event={"ID":"be8bd516-026c-4779-b64d-cc47a2b4e8b6","Type":"ContainerStarted","Data":"9095463307e1023faf37c1fdea9a276064051b37d1e3b9f1bb5ac7e3892a87e6"} Jun 11 20:29:07.002386 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:07.001960 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" event={"ID":"be8bd516-026c-4779-b64d-cc47a2b4e8b6","Type":"ContainerStarted","Data":"a215f9f3965c0f8ceeccfdf3b325b9c726ce6a4671879a5503bf68d82dd72942"} Jun 11 20:29:07.023493 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:07.023442 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" podStartSLOduration=2.02342759 podStartE2EDuration="2.02342759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:29:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:29:07.020870352 +0000 UTC m=+2347.298631110" watchObservedRunningTime="2026-06-11 20:29:07.02342759 +0000 UTC m=+2347.301188347" Jun 11 20:29:07.891000 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:07.890959 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:07.895389 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:07.895365 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:08.006682 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:08.006653 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:08.007725 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:08.007704 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:11.995265 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:11.995229 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4"] Jun 11 20:29:11.995725 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:11.995403 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" podUID="be8bd516-026c-4779-b64d-cc47a2b4e8b6" containerName="istio-proxy" containerID="cri-o://9095463307e1023faf37c1fdea9a276064051b37d1e3b9f1bb5ac7e3892a87e6" gracePeriod=30 Jun 11 20:29:17.243609 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:17.243583 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:17.406101 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:17.406067 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be8bd516-026c-4779-b64d-cc47a2b4e8b6-istio-podinfo\") pod \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " Jun 11 20:29:17.406101 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:17.406104 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be8bd516-026c-4779-b64d-cc47a2b4e8b6-workload-certs\") pod \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " Jun 11 20:29:17.406368 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:17.406175 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be8bd516-026c-4779-b64d-cc47a2b4e8b6-credential-socket\") pod \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " Jun 11 20:29:17.406368 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:17.406199 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be8bd516-026c-4779-b64d-cc47a2b4e8b6-istio-data\") pod \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " Jun 11 20:29:17.406368 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:17.406246 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d82h9\" (UniqueName: \"kubernetes.io/projected/be8bd516-026c-4779-b64d-cc47a2b4e8b6-kube-api-access-d82h9\") pod \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " Jun 11 20:29:17.406368 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:17.406286 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be8bd516-026c-4779-b64d-cc47a2b4e8b6-workload-socket\") pod \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " Jun 11 20:29:17.406368 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:17.406318 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be8bd516-026c-4779-b64d-cc47a2b4e8b6-istio-token\") pod \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " Jun 11 20:29:17.406605 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:17.406377 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be8bd516-026c-4779-b64d-cc47a2b4e8b6-istio-envoy\") pod \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " Jun 11 20:29:17.406605 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:17.406463 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be8bd516-026c-4779-b64d-cc47a2b4e8b6-istiod-ca-cert\") pod \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\" (UID: \"be8bd516-026c-4779-b64d-cc47a2b4e8b6\") " Jun 11 20:29:17.406697 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:17.406594 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be8bd516-026c-4779-b64d-cc47a2b4e8b6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "be8bd516-026c-4779-b64d-cc47a2b4e8b6" (UID: "be8bd516-026c-4779-b64d-cc47a2b4e8b6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:29:17.406974 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:17.406675 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be8bd516-026c-4779-b64d-cc47a2b4e8b6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "be8bd516-026c-4779-b64d-cc47a2b4e8b6" (UID: "be8bd516-026c-4779-b64d-cc47a2b4e8b6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:29:17.407069 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:17.406778 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be8bd516-026c-4779-b64d-cc47a2b4e8b6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "be8bd516-026c-4779-b64d-cc47a2b4e8b6" (UID: "be8bd516-026c-4779-b64d-cc47a2b4e8b6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:29:17.407069 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:17.406796 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be8bd516-026c-4779-b64d-cc47a2b4e8b6-istio-data" (OuterVolumeSpecName: "istio-data") pod "be8bd516-026c-4779-b64d-cc47a2b4e8b6" (UID: "be8bd516-026c-4779-b64d-cc47a2b4e8b6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:29:17.407206 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:17.407071 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be8bd516-026c-4779-b64d-cc47a2b4e8b6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "be8bd516-026c-4779-b64d-cc47a2b4e8b6" (UID: "be8bd516-026c-4779-b64d-cc47a2b4e8b6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 20:29:17.408545 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:17.408515 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/be8bd516-026c-4779-b64d-cc47a2b4e8b6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "be8bd516-026c-4779-b64d-cc47a2b4e8b6" (UID: "be8bd516-026c-4779-b64d-cc47a2b4e8b6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 20:29:17.408675 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:17.408596 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be8bd516-026c-4779-b64d-cc47a2b4e8b6-kube-api-access-d82h9" (OuterVolumeSpecName: "kube-api-access-d82h9") pod "be8bd516-026c-4779-b64d-cc47a2b4e8b6" (UID: "be8bd516-026c-4779-b64d-cc47a2b4e8b6"). InnerVolumeSpecName "kube-api-access-d82h9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:29:17.408675 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:17.408597 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be8bd516-026c-4779-b64d-cc47a2b4e8b6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "be8bd516-026c-4779-b64d-cc47a2b4e8b6" (UID: "be8bd516-026c-4779-b64d-cc47a2b4e8b6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:29:17.408979 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:17.408952 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be8bd516-026c-4779-b64d-cc47a2b4e8b6-istio-token" (OuterVolumeSpecName: "istio-token") pod "be8bd516-026c-4779-b64d-cc47a2b4e8b6" (UID: "be8bd516-026c-4779-b64d-cc47a2b4e8b6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:29:17.507417 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:17.507382 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be8bd516-026c-4779-b64d-cc47a2b4e8b6-credential-socket\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:29:17.507417 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:17.507408 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be8bd516-026c-4779-b64d-cc47a2b4e8b6-istio-data\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:29:17.507417 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:17.507419 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d82h9\" (UniqueName: \"kubernetes.io/projected/be8bd516-026c-4779-b64d-cc47a2b4e8b6-kube-api-access-d82h9\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:29:17.507417 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:17.507427 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be8bd516-026c-4779-b64d-cc47a2b4e8b6-workload-socket\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:29:17.507759 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:17.507436 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be8bd516-026c-4779-b64d-cc47a2b4e8b6-istio-token\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:29:17.507759 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:17.507444 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be8bd516-026c-4779-b64d-cc47a2b4e8b6-istio-envoy\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:29:17.507759 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:17.507452 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be8bd516-026c-4779-b64d-cc47a2b4e8b6-istiod-ca-cert\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:29:17.507759 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:17.507459 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be8bd516-026c-4779-b64d-cc47a2b4e8b6-istio-podinfo\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:29:17.507759 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:17.507466 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be8bd516-026c-4779-b64d-cc47a2b4e8b6-workload-certs\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:29:18.058182 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.058144 2576 generic.go:356] "Generic (PLEG): container finished" podID="be8bd516-026c-4779-b64d-cc47a2b4e8b6" containerID="9095463307e1023faf37c1fdea9a276064051b37d1e3b9f1bb5ac7e3892a87e6" exitCode=0 Jun 11 20:29:18.058348 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.058195 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" Jun 11 20:29:18.058348 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.058230 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" event={"ID":"be8bd516-026c-4779-b64d-cc47a2b4e8b6","Type":"ContainerDied","Data":"9095463307e1023faf37c1fdea9a276064051b37d1e3b9f1bb5ac7e3892a87e6"} Jun 11 20:29:18.058348 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.058289 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4" event={"ID":"be8bd516-026c-4779-b64d-cc47a2b4e8b6","Type":"ContainerDied","Data":"a215f9f3965c0f8ceeccfdf3b325b9c726ce6a4671879a5503bf68d82dd72942"} Jun 11 20:29:18.058348 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.058311 2576 scope.go:117] "RemoveContainer" containerID="9095463307e1023faf37c1fdea9a276064051b37d1e3b9f1bb5ac7e3892a87e6" Jun 11 20:29:18.067938 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.067918 2576 scope.go:117] "RemoveContainer" containerID="9095463307e1023faf37c1fdea9a276064051b37d1e3b9f1bb5ac7e3892a87e6" Jun 11 20:29:18.068233 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:29:18.068210 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9095463307e1023faf37c1fdea9a276064051b37d1e3b9f1bb5ac7e3892a87e6\": container with ID starting with 9095463307e1023faf37c1fdea9a276064051b37d1e3b9f1bb5ac7e3892a87e6 not found: ID does not exist" containerID="9095463307e1023faf37c1fdea9a276064051b37d1e3b9f1bb5ac7e3892a87e6" Jun 11 20:29:18.068331 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.068239 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9095463307e1023faf37c1fdea9a276064051b37d1e3b9f1bb5ac7e3892a87e6"} err="failed to get container status \"9095463307e1023faf37c1fdea9a276064051b37d1e3b9f1bb5ac7e3892a87e6\": rpc error: code = NotFound desc = could not find container \"9095463307e1023faf37c1fdea9a276064051b37d1e3b9f1bb5ac7e3892a87e6\": container with ID starting with 9095463307e1023faf37c1fdea9a276064051b37d1e3b9f1bb5ac7e3892a87e6 not found: ID does not exist" Jun 11 20:29:18.085621 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.085595 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4"] Jun 11 20:29:18.094928 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.094904 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-68645d30-openshift-default-65f6fbf978-rrjf4"] Jun 11 20:29:18.198016 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.197986 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be8bd516-026c-4779-b64d-cc47a2b4e8b6" path="/var/lib/kubelet/pods/be8bd516-026c-4779-b64d-cc47a2b4e8b6/volumes" Jun 11 20:29:18.219680 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.219651 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2"] Jun 11 20:29:18.220135 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.220104 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be8bd516-026c-4779-b64d-cc47a2b4e8b6" containerName="istio-proxy" Jun 11 20:29:18.220232 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.220137 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="be8bd516-026c-4779-b64d-cc47a2b4e8b6" containerName="istio-proxy" Jun 11 20:29:18.220297 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.220267 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="be8bd516-026c-4779-b64d-cc47a2b4e8b6" containerName="istio-proxy" Jun 11 20:29:18.224949 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.224928 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:18.227871 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.227852 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b3e5ed43-openshift-default-dockercfg-nk2j4\"" Jun 11 20:29:18.242474 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.242450 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2"] Jun 11 20:29:18.416754 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.416719 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-credential-socket\") pod \"e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:18.417223 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.416767 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-workload-socket\") pod \"e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:18.417223 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.416814 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-istiod-ca-cert\") pod \"e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:18.417223 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.416914 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfkpg\" (UniqueName: \"kubernetes.io/projected/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-kube-api-access-qfkpg\") pod \"e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:18.417223 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.416970 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-istio-podinfo\") pod \"e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:18.417223 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.417054 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-istio-data\") pod \"e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:18.417223 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.417090 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-istio-token\") pod \"e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:18.417223 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.417180 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-workload-certs\") pod \"e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:18.417223 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.417201 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-istio-envoy\") pod \"e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:18.518008 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.517975 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-workload-certs\") pod \"e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:18.518203 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.518013 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-istio-envoy\") pod \"e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:18.518203 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.518041 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-credential-socket\") pod \"e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:18.518203 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.518071 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-workload-socket\") pod \"e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:18.518203 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.518087 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-istiod-ca-cert\") pod \"e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:18.518407 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.518256 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfkpg\" (UniqueName: \"kubernetes.io/projected/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-kube-api-access-qfkpg\") pod \"e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:18.518407 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.518315 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-istio-podinfo\") pod \"e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:18.518407 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.518388 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-istio-data\") pod \"e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:18.518581 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.518422 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-istio-token\") pod \"e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:18.518581 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.518531 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-workload-socket\") pod \"e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:18.518581 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.518555 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-workload-certs\") pod \"e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:18.518764 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.518604 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-credential-socket\") pod \"e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:18.518866 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.518837 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-istio-data\") pod \"e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:18.519018 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.518996 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-istiod-ca-cert\") pod \"e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:18.520321 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.520303 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-istio-envoy\") pod \"e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:18.520794 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.520778 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-istio-podinfo\") pod \"e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:18.531424 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.531403 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-istio-token\") pod \"e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:18.536611 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.536583 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfkpg\" (UniqueName: \"kubernetes.io/projected/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-kube-api-access-qfkpg\") pod \"e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:18.836865 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.836756 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:18.987821 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.987651 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2"] Jun 11 20:29:18.990836 ip-10-0-137-247 kubenswrapper[2576]: W0611 20:29:18.990809 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea4dca21_1d69_4fcd_9c9a_4c6b4d1ad2b8.slice/crio-bc93745a643bdc83b4ca4f4781a4179e301c5cad9bfa7175327fcc6d03bfef1d WatchSource:0}: Error finding container bc93745a643bdc83b4ca4f4781a4179e301c5cad9bfa7175327fcc6d03bfef1d: Status 404 returned error can't find the container with id bc93745a643bdc83b4ca4f4781a4179e301c5cad9bfa7175327fcc6d03bfef1d Jun 11 20:29:18.993289 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.993254 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 20:29:18.993587 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.993321 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 20:29:18.993587 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:18.993349 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 20:29:19.068954 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:19.068918 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" event={"ID":"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8","Type":"ContainerStarted","Data":"dd0c5c5d92eb90ac754585121fca9e770b4f61e33e24e679a1950cb392f9e087"} Jun 11 20:29:19.069116 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:19.068978 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" event={"ID":"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8","Type":"ContainerStarted","Data":"bc93745a643bdc83b4ca4f4781a4179e301c5cad9bfa7175327fcc6d03bfef1d"} Jun 11 20:29:19.089715 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:19.089595 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" podStartSLOduration=1.089572493 podStartE2EDuration="1.089572493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:29:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:29:19.088753119 +0000 UTC m=+2359.366513884" watchObservedRunningTime="2026-06-11 20:29:19.089572493 +0000 UTC m=+2359.367333252" Jun 11 20:29:19.837853 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:19.837816 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:20.842344 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:20.842317 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:21.078439 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:21.078412 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:21.079451 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:21.079430 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:25.621436 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:25.621392 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2"] Jun 11 20:29:25.621953 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:25.621690 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" podUID="ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8" containerName="istio-proxy" containerID="cri-o://dd0c5c5d92eb90ac754585121fca9e770b4f61e33e24e679a1950cb392f9e087" gracePeriod=30 Jun 11 20:29:30.879681 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:30.879653 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:30.919273 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:30.919207 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-istiod-ca-cert\") pod \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " Jun 11 20:29:30.919273 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:30.919272 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-workload-certs\") pod \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " Jun 11 20:29:30.919471 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:30.919305 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-istio-podinfo\") pod \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " Jun 11 20:29:30.919471 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:30.919323 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-credential-socket\") pod \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " Jun 11 20:29:30.919471 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:30.919341 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-istio-data\") pod \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " Jun 11 20:29:30.919471 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:30.919441 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfkpg\" (UniqueName: \"kubernetes.io/projected/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-kube-api-access-qfkpg\") pod \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " Jun 11 20:29:30.919711 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:30.919483 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-istio-envoy\") pod \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " Jun 11 20:29:30.919711 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:30.919524 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-workload-socket\") pod \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " Jun 11 20:29:30.919711 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:30.919555 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-istio-token\") pod \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\" (UID: \"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8\") " Jun 11 20:29:30.919711 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:30.919664 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8" (UID: "ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:29:30.919711 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:30.919688 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8" (UID: "ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:29:30.919711 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:30.919696 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8" (UID: "ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 20:29:30.919987 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:30.919778 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-istio-data" (OuterVolumeSpecName: "istio-data") pod "ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8" (UID: "ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:29:30.919987 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:30.919942 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-istiod-ca-cert\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:29:30.919987 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:30.919961 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-workload-certs\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:29:30.919987 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:30.919975 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-credential-socket\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:29:30.920220 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:30.919988 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-istio-data\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:29:30.920220 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:30.920179 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8" (UID: "ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:29:30.921730 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:30.921703 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8" (UID: "ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:29:30.922307 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:30.922277 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8" (UID: "ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 20:29:30.922394 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:30.922303 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-kube-api-access-qfkpg" (OuterVolumeSpecName: "kube-api-access-qfkpg") pod "ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8" (UID: "ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8"). InnerVolumeSpecName "kube-api-access-qfkpg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:29:30.922394 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:30.922232 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-istio-token" (OuterVolumeSpecName: "istio-token") pod "ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8" (UID: "ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:29:31.020599 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.020568 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-workload-socket\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:29:31.020599 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.020593 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-istio-token\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:29:31.020599 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.020603 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-istio-podinfo\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:29:31.020820 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.020612 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfkpg\" (UniqueName: \"kubernetes.io/projected/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-kube-api-access-qfkpg\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:29:31.020820 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.020621 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8-istio-envoy\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:29:31.126500 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.126465 2576 generic.go:356] "Generic (PLEG): container finished" podID="ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8" containerID="dd0c5c5d92eb90ac754585121fca9e770b4f61e33e24e679a1950cb392f9e087" exitCode=0 Jun 11 20:29:31.126644 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.126512 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" Jun 11 20:29:31.126644 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.126553 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" event={"ID":"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8","Type":"ContainerDied","Data":"dd0c5c5d92eb90ac754585121fca9e770b4f61e33e24e679a1950cb392f9e087"} Jun 11 20:29:31.126644 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.126624 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2" event={"ID":"ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8","Type":"ContainerDied","Data":"bc93745a643bdc83b4ca4f4781a4179e301c5cad9bfa7175327fcc6d03bfef1d"} Jun 11 20:29:31.126776 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.126646 2576 scope.go:117] "RemoveContainer" containerID="dd0c5c5d92eb90ac754585121fca9e770b4f61e33e24e679a1950cb392f9e087" Jun 11 20:29:31.136437 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.136419 2576 scope.go:117] "RemoveContainer" containerID="dd0c5c5d92eb90ac754585121fca9e770b4f61e33e24e679a1950cb392f9e087" Jun 11 20:29:31.136680 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:29:31.136663 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd0c5c5d92eb90ac754585121fca9e770b4f61e33e24e679a1950cb392f9e087\": container with ID starting with dd0c5c5d92eb90ac754585121fca9e770b4f61e33e24e679a1950cb392f9e087 not found: ID does not exist" containerID="dd0c5c5d92eb90ac754585121fca9e770b4f61e33e24e679a1950cb392f9e087" Jun 11 20:29:31.136729 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.136690 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd0c5c5d92eb90ac754585121fca9e770b4f61e33e24e679a1950cb392f9e087"} err="failed to get container status \"dd0c5c5d92eb90ac754585121fca9e770b4f61e33e24e679a1950cb392f9e087\": rpc error: code = NotFound desc = could not find container \"dd0c5c5d92eb90ac754585121fca9e770b4f61e33e24e679a1950cb392f9e087\": container with ID starting with dd0c5c5d92eb90ac754585121fca9e770b4f61e33e24e679a1950cb392f9e087 not found: ID does not exist" Jun 11 20:29:31.149823 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.149797 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2"] Jun 11 20:29:31.154972 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.154952 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b3e5ed43-openshift-default-665ccd67d4-m5ft2"] Jun 11 20:29:31.623176 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.623143 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9"] Jun 11 20:29:31.623796 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.623781 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8" containerName="istio-proxy" Jun 11 20:29:31.623850 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.623801 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8" containerName="istio-proxy" Jun 11 20:29:31.623919 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.623908 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8" containerName="istio-proxy" Jun 11 20:29:31.628741 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.628715 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" Jun 11 20:29:31.631358 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.631338 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-invalid-d8cf27af-openshift-default-dockercfg-lgnsb\"" Jun 11 20:29:31.645225 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.645194 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9"] Jun 11 20:29:31.726458 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.726413 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab3227d7-3ded-40f9-a860-1853ba11cef5-workload-certs\") pod \"e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" Jun 11 20:29:31.726458 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.726462 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab3227d7-3ded-40f9-a860-1853ba11cef5-istio-data\") pod \"e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" Jun 11 20:29:31.726692 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.726492 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab3227d7-3ded-40f9-a860-1853ba11cef5-credential-socket\") pod \"e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" Jun 11 20:29:31.726692 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.726525 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab3227d7-3ded-40f9-a860-1853ba11cef5-istio-envoy\") pod \"e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" Jun 11 20:29:31.726692 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.726550 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab3227d7-3ded-40f9-a860-1853ba11cef5-workload-socket\") pod \"e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" Jun 11 20:29:31.726692 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.726618 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzr4t\" (UniqueName: \"kubernetes.io/projected/ab3227d7-3ded-40f9-a860-1853ba11cef5-kube-api-access-wzr4t\") pod \"e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" Jun 11 20:29:31.726692 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.726678 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab3227d7-3ded-40f9-a860-1853ba11cef5-istio-token\") pod \"e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" Jun 11 20:29:31.726952 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.726726 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab3227d7-3ded-40f9-a860-1853ba11cef5-istio-podinfo\") pod \"e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" Jun 11 20:29:31.726952 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.726752 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab3227d7-3ded-40f9-a860-1853ba11cef5-istiod-ca-cert\") pod \"e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" Jun 11 20:29:31.827701 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.827663 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab3227d7-3ded-40f9-a860-1853ba11cef5-workload-certs\") pod \"e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" Jun 11 20:29:31.827701 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.827699 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab3227d7-3ded-40f9-a860-1853ba11cef5-istio-data\") pod \"e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" Jun 11 20:29:31.827957 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.827719 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab3227d7-3ded-40f9-a860-1853ba11cef5-credential-socket\") pod \"e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" Jun 11 20:29:31.827957 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.827747 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab3227d7-3ded-40f9-a860-1853ba11cef5-istio-envoy\") pod \"e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" Jun 11 20:29:31.827957 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.827788 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab3227d7-3ded-40f9-a860-1853ba11cef5-workload-socket\") pod \"e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" Jun 11 20:29:31.827957 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.827830 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzr4t\" (UniqueName: \"kubernetes.io/projected/ab3227d7-3ded-40f9-a860-1853ba11cef5-kube-api-access-wzr4t\") pod \"e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" Jun 11 20:29:31.827957 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.827885 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab3227d7-3ded-40f9-a860-1853ba11cef5-istio-token\") pod \"e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" Jun 11 20:29:31.827957 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.827934 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab3227d7-3ded-40f9-a860-1853ba11cef5-istio-podinfo\") pod \"e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" Jun 11 20:29:31.827957 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.827958 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab3227d7-3ded-40f9-a860-1853ba11cef5-istiod-ca-cert\") pod \"e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" Jun 11 20:29:31.828378 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.828106 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab3227d7-3ded-40f9-a860-1853ba11cef5-workload-certs\") pod \"e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" Jun 11 20:29:31.828378 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.828154 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab3227d7-3ded-40f9-a860-1853ba11cef5-istio-data\") pod \"e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" Jun 11 20:29:31.828378 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.828260 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab3227d7-3ded-40f9-a860-1853ba11cef5-workload-socket\") pod \"e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" Jun 11 20:29:31.828549 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.828482 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab3227d7-3ded-40f9-a860-1853ba11cef5-credential-socket\") pod \"e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" Jun 11 20:29:31.828681 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.828662 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab3227d7-3ded-40f9-a860-1853ba11cef5-istiod-ca-cert\") pod \"e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" Jun 11 20:29:31.830172 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.830154 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab3227d7-3ded-40f9-a860-1853ba11cef5-istio-envoy\") pod \"e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" Jun 11 20:29:31.830464 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.830447 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab3227d7-3ded-40f9-a860-1853ba11cef5-istio-podinfo\") pod \"e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" Jun 11 20:29:31.845764 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.845736 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzr4t\" (UniqueName: \"kubernetes.io/projected/ab3227d7-3ded-40f9-a860-1853ba11cef5-kube-api-access-wzr4t\") pod \"e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" Jun 11 20:29:31.846010 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.845991 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab3227d7-3ded-40f9-a860-1853ba11cef5-istio-token\") pod \"e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" Jun 11 20:29:31.941416 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:31.941342 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" Jun 11 20:29:32.080051 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:32.080025 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9"] Jun 11 20:29:32.082142 ip-10-0-137-247 kubenswrapper[2576]: W0611 20:29:32.082105 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab3227d7_3ded_40f9_a860_1853ba11cef5.slice/crio-a4846d5bfaba700cc8124ded073d450cb3ddeba5b95ed5ac2133fb3498956954 WatchSource:0}: Error finding container a4846d5bfaba700cc8124ded073d450cb3ddeba5b95ed5ac2133fb3498956954: Status 404 returned error can't find the container with id a4846d5bfaba700cc8124ded073d450cb3ddeba5b95ed5ac2133fb3498956954 Jun 11 20:29:32.084265 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:32.084233 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 20:29:32.084357 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:32.084295 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 20:29:32.084357 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:32.084325 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 20:29:32.134987 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:32.134965 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" event={"ID":"ab3227d7-3ded-40f9-a860-1853ba11cef5","Type":"ContainerStarted","Data":"a4846d5bfaba700cc8124ded073d450cb3ddeba5b95ed5ac2133fb3498956954"} Jun 11 20:29:32.189521 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:32.189487 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9"] Jun 11 20:29:32.199639 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:32.199562 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8" path="/var/lib/kubelet/pods/ea4dca21-1d69-4fcd-9c9a-4c6b4d1ad2b8/volumes" Jun 11 20:29:33.141699 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:33.141660 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" event={"ID":"ab3227d7-3ded-40f9-a860-1853ba11cef5","Type":"ContainerStarted","Data":"143ad691a03198b183f41ea18e78b69fbe56dec1d1895deca31cfddc1362b3b0"} Jun 11 20:29:33.142222 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:33.141935 2576 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" secret="" err="secret \"e2e-invalid-d8cf27af-openshift-default-dockercfg-lgnsb\" not found" Jun 11 20:29:33.168448 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:33.168405 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" podStartSLOduration=2.168391924 podStartE2EDuration="2.168391924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:29:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:29:33.16601351 +0000 UTC m=+2373.443774278" watchObservedRunningTime="2026-06-11 20:29:33.168391924 +0000 UTC m=+2373.446152681" Jun 11 20:29:33.942180 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:33.942144 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" Jun 11 20:29:33.943394 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:33.943363 2576 patch_prober.go:28] interesting pod/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jun 11 20:29:33.943524 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:33.943420 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" podUID="ab3227d7-3ded-40f9-a860-1853ba11cef5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jun 11 20:29:34.146482 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:34.146444 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" podUID="ab3227d7-3ded-40f9-a860-1853ba11cef5" containerName="istio-proxy" containerID="cri-o://143ad691a03198b183f41ea18e78b69fbe56dec1d1895deca31cfddc1362b3b0" gracePeriod=30 Jun 11 20:29:39.405521 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:39.405457 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" Jun 11 20:29:39.495179 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:39.495147 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab3227d7-3ded-40f9-a860-1853ba11cef5-workload-certs\") pod \"ab3227d7-3ded-40f9-a860-1853ba11cef5\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " Jun 11 20:29:39.495369 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:39.495202 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab3227d7-3ded-40f9-a860-1853ba11cef5-istio-token\") pod \"ab3227d7-3ded-40f9-a860-1853ba11cef5\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " Jun 11 20:29:39.495369 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:39.495231 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab3227d7-3ded-40f9-a860-1853ba11cef5-istiod-ca-cert\") pod \"ab3227d7-3ded-40f9-a860-1853ba11cef5\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " Jun 11 20:29:39.495369 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:39.495261 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab3227d7-3ded-40f9-a860-1853ba11cef5-credential-socket\") pod \"ab3227d7-3ded-40f9-a860-1853ba11cef5\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " Jun 11 20:29:39.495369 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:39.495289 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzr4t\" (UniqueName: \"kubernetes.io/projected/ab3227d7-3ded-40f9-a860-1853ba11cef5-kube-api-access-wzr4t\") pod \"ab3227d7-3ded-40f9-a860-1853ba11cef5\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " Jun 11 20:29:39.495369 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:39.495336 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab3227d7-3ded-40f9-a860-1853ba11cef5-istio-data\") pod \"ab3227d7-3ded-40f9-a860-1853ba11cef5\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " Jun 11 20:29:39.495369 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:39.495360 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab3227d7-3ded-40f9-a860-1853ba11cef5-workload-socket\") pod \"ab3227d7-3ded-40f9-a860-1853ba11cef5\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " Jun 11 20:29:39.495679 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:39.495408 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab3227d7-3ded-40f9-a860-1853ba11cef5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ab3227d7-3ded-40f9-a860-1853ba11cef5" (UID: "ab3227d7-3ded-40f9-a860-1853ba11cef5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:29:39.495679 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:39.495437 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab3227d7-3ded-40f9-a860-1853ba11cef5-istio-podinfo\") pod \"ab3227d7-3ded-40f9-a860-1853ba11cef5\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " Jun 11 20:29:39.495679 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:39.495469 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab3227d7-3ded-40f9-a860-1853ba11cef5-istio-envoy\") pod \"ab3227d7-3ded-40f9-a860-1853ba11cef5\" (UID: \"ab3227d7-3ded-40f9-a860-1853ba11cef5\") " Jun 11 20:29:39.495679 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:39.495611 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab3227d7-3ded-40f9-a860-1853ba11cef5-istio-data" (OuterVolumeSpecName: "istio-data") pod "ab3227d7-3ded-40f9-a860-1853ba11cef5" (UID: "ab3227d7-3ded-40f9-a860-1853ba11cef5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:29:39.495679 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:39.495640 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab3227d7-3ded-40f9-a860-1853ba11cef5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ab3227d7-3ded-40f9-a860-1853ba11cef5" (UID: "ab3227d7-3ded-40f9-a860-1853ba11cef5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:29:39.495928 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:39.495692 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab3227d7-3ded-40f9-a860-1853ba11cef5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ab3227d7-3ded-40f9-a860-1853ba11cef5" (UID: "ab3227d7-3ded-40f9-a860-1853ba11cef5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 20:29:39.495928 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:39.495839 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab3227d7-3ded-40f9-a860-1853ba11cef5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ab3227d7-3ded-40f9-a860-1853ba11cef5" (UID: "ab3227d7-3ded-40f9-a860-1853ba11cef5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:29:39.495928 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:39.495887 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab3227d7-3ded-40f9-a860-1853ba11cef5-workload-certs\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:29:39.495928 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:39.495905 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab3227d7-3ded-40f9-a860-1853ba11cef5-istiod-ca-cert\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:29:39.495928 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:39.495918 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab3227d7-3ded-40f9-a860-1853ba11cef5-istio-data\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:29:39.496140 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:39.495929 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab3227d7-3ded-40f9-a860-1853ba11cef5-workload-socket\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:29:39.497553 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:39.497525 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab3227d7-3ded-40f9-a860-1853ba11cef5-kube-api-access-wzr4t" (OuterVolumeSpecName: "kube-api-access-wzr4t") pod "ab3227d7-3ded-40f9-a860-1853ba11cef5" (UID: "ab3227d7-3ded-40f9-a860-1853ba11cef5"). InnerVolumeSpecName "kube-api-access-wzr4t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:29:39.497553 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:39.497541 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab3227d7-3ded-40f9-a860-1853ba11cef5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ab3227d7-3ded-40f9-a860-1853ba11cef5" (UID: "ab3227d7-3ded-40f9-a860-1853ba11cef5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:29:39.497933 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:39.497907 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ab3227d7-3ded-40f9-a860-1853ba11cef5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ab3227d7-3ded-40f9-a860-1853ba11cef5" (UID: "ab3227d7-3ded-40f9-a860-1853ba11cef5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 20:29:39.497933 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:39.497910 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab3227d7-3ded-40f9-a860-1853ba11cef5-istio-token" (OuterVolumeSpecName: "istio-token") pod "ab3227d7-3ded-40f9-a860-1853ba11cef5" (UID: "ab3227d7-3ded-40f9-a860-1853ba11cef5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:29:39.596979 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:39.596942 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab3227d7-3ded-40f9-a860-1853ba11cef5-istio-token\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:29:39.596979 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:39.596973 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab3227d7-3ded-40f9-a860-1853ba11cef5-credential-socket\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:29:39.596979 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:39.596985 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzr4t\" (UniqueName: \"kubernetes.io/projected/ab3227d7-3ded-40f9-a860-1853ba11cef5-kube-api-access-wzr4t\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:29:39.597248 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:39.596996 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab3227d7-3ded-40f9-a860-1853ba11cef5-istio-podinfo\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:29:39.597248 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:39.597004 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab3227d7-3ded-40f9-a860-1853ba11cef5-istio-envoy\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:29:40.176282 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:40.176246 2576 generic.go:356] "Generic (PLEG): container finished" podID="ab3227d7-3ded-40f9-a860-1853ba11cef5" containerID="143ad691a03198b183f41ea18e78b69fbe56dec1d1895deca31cfddc1362b3b0" exitCode=0 Jun 11 20:29:40.176452 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:40.176295 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" Jun 11 20:29:40.176452 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:40.176330 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" event={"ID":"ab3227d7-3ded-40f9-a860-1853ba11cef5","Type":"ContainerDied","Data":"143ad691a03198b183f41ea18e78b69fbe56dec1d1895deca31cfddc1362b3b0"} Jun 11 20:29:40.176452 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:40.176381 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9" event={"ID":"ab3227d7-3ded-40f9-a860-1853ba11cef5","Type":"ContainerDied","Data":"a4846d5bfaba700cc8124ded073d450cb3ddeba5b95ed5ac2133fb3498956954"} Jun 11 20:29:40.176452 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:40.176409 2576 scope.go:117] "RemoveContainer" containerID="143ad691a03198b183f41ea18e78b69fbe56dec1d1895deca31cfddc1362b3b0" Jun 11 20:29:40.185746 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:40.185729 2576 scope.go:117] "RemoveContainer" containerID="143ad691a03198b183f41ea18e78b69fbe56dec1d1895deca31cfddc1362b3b0" Jun 11 20:29:40.185999 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:29:40.185977 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"143ad691a03198b183f41ea18e78b69fbe56dec1d1895deca31cfddc1362b3b0\": container with ID starting with 143ad691a03198b183f41ea18e78b69fbe56dec1d1895deca31cfddc1362b3b0 not found: ID does not exist" containerID="143ad691a03198b183f41ea18e78b69fbe56dec1d1895deca31cfddc1362b3b0" Jun 11 20:29:40.186099 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:40.186005 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"143ad691a03198b183f41ea18e78b69fbe56dec1d1895deca31cfddc1362b3b0"} err="failed to get container status \"143ad691a03198b183f41ea18e78b69fbe56dec1d1895deca31cfddc1362b3b0\": rpc error: code = NotFound desc = could not find container \"143ad691a03198b183f41ea18e78b69fbe56dec1d1895deca31cfddc1362b3b0\": container with ID starting with 143ad691a03198b183f41ea18e78b69fbe56dec1d1895deca31cfddc1362b3b0 not found: ID does not exist" Jun 11 20:29:40.197605 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:40.197578 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9"] Jun 11 20:29:40.202095 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:40.202074 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-invalid-d8cf27af-openshift-default-5d6d46d8f8-g5fx9"] Jun 11 20:29:42.197074 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:29:42.197037 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab3227d7-3ded-40f9-a860-1853ba11cef5" path="/var/lib/kubelet/pods/ab3227d7-3ded-40f9-a860-1853ba11cef5/volumes" Jun 11 20:30:00.378681 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:30:00.378574 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9pxm2_23de3c36-7fd1-4a71-9bff-dd7782544ca4/console-operator/1.log" Jun 11 20:30:00.396852 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:30:00.382053 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hrb9t_85a48db4-30bf-47f2-9668-8b0a67c26fe4/ovn-acl-logging/0.log" Jun 11 20:30:00.396852 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:30:00.396793 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9pxm2_23de3c36-7fd1-4a71-9bff-dd7782544ca4/console-operator/1.log" Jun 11 20:30:00.400046 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:30:00.400029 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hrb9t_85a48db4-30bf-47f2-9668-8b0a67c26fe4/ovn-acl-logging/0.log" Jun 11 20:31:01.087858 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:01.087820 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:31:05.384040 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:05.384005 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:31:09.286332 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:09.286296 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:31:14.562566 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.562528 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq"] Jun 11 20:31:14.563218 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.563196 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab3227d7-3ded-40f9-a860-1853ba11cef5" containerName="istio-proxy" Jun 11 20:31:14.563288 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.563221 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab3227d7-3ded-40f9-a860-1853ba11cef5" containerName="istio-proxy" Jun 11 20:31:14.563371 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.563359 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab3227d7-3ded-40f9-a860-1853ba11cef5" containerName="istio-proxy" Jun 11 20:31:14.566587 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.566567 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:14.569465 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.569444 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-6b7655d5-openshift-default-dockercfg-dps7h\"" Jun 11 20:31:14.575215 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.575193 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq"] Jun 11 20:31:14.691773 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.691740 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af887b0e-b83d-4b80-871a-d5aa152530e2-workload-certs\") pod \"e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:14.691773 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.691782 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af887b0e-b83d-4b80-871a-d5aa152530e2-istiod-ca-cert\") pod \"e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:14.692003 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.691807 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af887b0e-b83d-4b80-871a-d5aa152530e2-istio-envoy\") pod \"e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:14.692003 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.691897 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af887b0e-b83d-4b80-871a-d5aa152530e2-istio-podinfo\") pod \"e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:14.692003 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.691962 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af887b0e-b83d-4b80-871a-d5aa152530e2-workload-socket\") pod \"e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:14.692003 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.691985 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af887b0e-b83d-4b80-871a-d5aa152530e2-istio-data\") pod \"e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:14.692198 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.692012 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb8c6\" (UniqueName: \"kubernetes.io/projected/af887b0e-b83d-4b80-871a-d5aa152530e2-kube-api-access-vb8c6\") pod \"e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:14.692198 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.692070 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af887b0e-b83d-4b80-871a-d5aa152530e2-credential-socket\") pod \"e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:14.692198 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.692109 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af887b0e-b83d-4b80-871a-d5aa152530e2-istio-token\") pod \"e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:14.793230 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.793196 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af887b0e-b83d-4b80-871a-d5aa152530e2-istio-token\") pod \"e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:14.793432 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.793252 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af887b0e-b83d-4b80-871a-d5aa152530e2-workload-certs\") pod \"e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:14.793432 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.793275 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af887b0e-b83d-4b80-871a-d5aa152530e2-istiod-ca-cert\") pod \"e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:14.793432 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.793311 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af887b0e-b83d-4b80-871a-d5aa152530e2-istio-envoy\") pod \"e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:14.793432 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.793342 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af887b0e-b83d-4b80-871a-d5aa152530e2-istio-podinfo\") pod \"e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:14.793651 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.793444 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af887b0e-b83d-4b80-871a-d5aa152530e2-workload-socket\") pod \"e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:14.793651 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.793491 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af887b0e-b83d-4b80-871a-d5aa152530e2-istio-data\") pod \"e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:14.793651 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.793526 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb8c6\" (UniqueName: \"kubernetes.io/projected/af887b0e-b83d-4b80-871a-d5aa152530e2-kube-api-access-vb8c6\") pod \"e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:14.793651 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.793587 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af887b0e-b83d-4b80-871a-d5aa152530e2-credential-socket\") pod \"e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:14.793843 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.793702 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af887b0e-b83d-4b80-871a-d5aa152530e2-workload-certs\") pod \"e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:14.793843 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.793833 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af887b0e-b83d-4b80-871a-d5aa152530e2-workload-socket\") pod \"e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:14.793974 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.793870 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af887b0e-b83d-4b80-871a-d5aa152530e2-istio-data\") pod \"e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:14.794157 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.794103 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af887b0e-b83d-4b80-871a-d5aa152530e2-credential-socket\") pod \"e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:14.794283 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.794183 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af887b0e-b83d-4b80-871a-d5aa152530e2-istiod-ca-cert\") pod \"e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:14.796173 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.796156 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af887b0e-b83d-4b80-871a-d5aa152530e2-istio-envoy\") pod \"e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:14.796495 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.796473 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af887b0e-b83d-4b80-871a-d5aa152530e2-istio-podinfo\") pod \"e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:14.803377 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.803353 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb8c6\" (UniqueName: \"kubernetes.io/projected/af887b0e-b83d-4b80-871a-d5aa152530e2-kube-api-access-vb8c6\") pod \"e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:14.803480 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.803461 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af887b0e-b83d-4b80-871a-d5aa152530e2-istio-token\") pod \"e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:14.878350 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:14.878323 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:15.016766 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:15.016739 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq"] Jun 11 20:31:15.019013 ip-10-0-137-247 kubenswrapper[2576]: W0611 20:31:15.018981 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf887b0e_b83d_4b80_871a_d5aa152530e2.slice/crio-1432ac2657848f4ba0ce07fde07b3ba4671361011643bdba16c73739f6174a1c WatchSource:0}: Error finding container 1432ac2657848f4ba0ce07fde07b3ba4671361011643bdba16c73739f6174a1c: Status 404 returned error can't find the container with id 1432ac2657848f4ba0ce07fde07b3ba4671361011643bdba16c73739f6174a1c Jun 11 20:31:15.021224 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:15.021182 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 20:31:15.021316 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:15.021282 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 20:31:15.021368 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:15.021328 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 20:31:15.647014 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:15.646982 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" event={"ID":"af887b0e-b83d-4b80-871a-d5aa152530e2","Type":"ContainerStarted","Data":"8f2b9c3a556447bf10eb775baa02b27b55ffab2f33389d32c1cb7bb2d9c82dc0"} Jun 11 20:31:15.647440 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:15.647031 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" event={"ID":"af887b0e-b83d-4b80-871a-d5aa152530e2","Type":"ContainerStarted","Data":"1432ac2657848f4ba0ce07fde07b3ba4671361011643bdba16c73739f6174a1c"} Jun 11 20:31:15.672312 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:15.672265 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" podStartSLOduration=1.672249981 podStartE2EDuration="1.672249981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:31:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:31:15.669467477 +0000 UTC m=+2475.947228236" watchObservedRunningTime="2026-06-11 20:31:15.672249981 +0000 UTC m=+2475.950010741" Jun 11 20:31:15.878778 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:15.878749 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:16.884271 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:16.884240 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:17.658497 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:17.658465 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:17.659975 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:17.659947 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:34.440171 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:34.440116 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq"] Jun 11 20:31:34.440746 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:34.440337 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" podUID="af887b0e-b83d-4b80-871a-d5aa152530e2" containerName="istio-proxy" containerID="cri-o://8f2b9c3a556447bf10eb775baa02b27b55ffab2f33389d32c1cb7bb2d9c82dc0" gracePeriod=30 Jun 11 20:31:39.691183 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.691153 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:39.733370 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.733289 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af887b0e-b83d-4b80-871a-d5aa152530e2-istio-data\") pod \"af887b0e-b83d-4b80-871a-d5aa152530e2\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " Jun 11 20:31:39.733370 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.733338 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vb8c6\" (UniqueName: \"kubernetes.io/projected/af887b0e-b83d-4b80-871a-d5aa152530e2-kube-api-access-vb8c6\") pod \"af887b0e-b83d-4b80-871a-d5aa152530e2\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " Jun 11 20:31:39.733370 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.733361 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af887b0e-b83d-4b80-871a-d5aa152530e2-istio-podinfo\") pod \"af887b0e-b83d-4b80-871a-d5aa152530e2\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " Jun 11 20:31:39.733638 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.733398 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af887b0e-b83d-4b80-871a-d5aa152530e2-istio-envoy\") pod \"af887b0e-b83d-4b80-871a-d5aa152530e2\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " Jun 11 20:31:39.733638 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.733444 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af887b0e-b83d-4b80-871a-d5aa152530e2-workload-certs\") pod \"af887b0e-b83d-4b80-871a-d5aa152530e2\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " Jun 11 20:31:39.733638 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.733486 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af887b0e-b83d-4b80-871a-d5aa152530e2-istiod-ca-cert\") pod \"af887b0e-b83d-4b80-871a-d5aa152530e2\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " Jun 11 20:31:39.733638 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.733525 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af887b0e-b83d-4b80-871a-d5aa152530e2-credential-socket\") pod \"af887b0e-b83d-4b80-871a-d5aa152530e2\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " Jun 11 20:31:39.733638 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.733584 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af887b0e-b83d-4b80-871a-d5aa152530e2-istio-token\") pod \"af887b0e-b83d-4b80-871a-d5aa152530e2\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " Jun 11 20:31:39.733638 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.733615 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af887b0e-b83d-4b80-871a-d5aa152530e2-workload-socket\") pod \"af887b0e-b83d-4b80-871a-d5aa152530e2\" (UID: \"af887b0e-b83d-4b80-871a-d5aa152530e2\") " Jun 11 20:31:39.733974 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.733848 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af887b0e-b83d-4b80-871a-d5aa152530e2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "af887b0e-b83d-4b80-871a-d5aa152530e2" (UID: "af887b0e-b83d-4b80-871a-d5aa152530e2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:31:39.734033 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.733986 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af887b0e-b83d-4b80-871a-d5aa152530e2-workload-certs\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:31:39.734109 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.734083 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af887b0e-b83d-4b80-871a-d5aa152530e2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "af887b0e-b83d-4b80-871a-d5aa152530e2" (UID: "af887b0e-b83d-4b80-871a-d5aa152530e2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:31:39.734340 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.734221 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af887b0e-b83d-4b80-871a-d5aa152530e2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "af887b0e-b83d-4b80-871a-d5aa152530e2" (UID: "af887b0e-b83d-4b80-871a-d5aa152530e2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:31:39.734340 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.734268 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af887b0e-b83d-4b80-871a-d5aa152530e2-istio-data" (OuterVolumeSpecName: "istio-data") pod "af887b0e-b83d-4b80-871a-d5aa152530e2" (UID: "af887b0e-b83d-4b80-871a-d5aa152530e2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:31:39.734541 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.734458 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af887b0e-b83d-4b80-871a-d5aa152530e2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "af887b0e-b83d-4b80-871a-d5aa152530e2" (UID: "af887b0e-b83d-4b80-871a-d5aa152530e2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 20:31:39.736340 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.736312 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/af887b0e-b83d-4b80-871a-d5aa152530e2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "af887b0e-b83d-4b80-871a-d5aa152530e2" (UID: "af887b0e-b83d-4b80-871a-d5aa152530e2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 20:31:39.736443 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.736356 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af887b0e-b83d-4b80-871a-d5aa152530e2-kube-api-access-vb8c6" (OuterVolumeSpecName: "kube-api-access-vb8c6") pod "af887b0e-b83d-4b80-871a-d5aa152530e2" (UID: "af887b0e-b83d-4b80-871a-d5aa152530e2"). InnerVolumeSpecName "kube-api-access-vb8c6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:31:39.736498 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.736446 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af887b0e-b83d-4b80-871a-d5aa152530e2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "af887b0e-b83d-4b80-871a-d5aa152530e2" (UID: "af887b0e-b83d-4b80-871a-d5aa152530e2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:31:39.736876 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.736845 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af887b0e-b83d-4b80-871a-d5aa152530e2-istio-token" (OuterVolumeSpecName: "istio-token") pod "af887b0e-b83d-4b80-871a-d5aa152530e2" (UID: "af887b0e-b83d-4b80-871a-d5aa152530e2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:31:39.777929 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.777898 2576 generic.go:356] "Generic (PLEG): container finished" podID="af887b0e-b83d-4b80-871a-d5aa152530e2" containerID="8f2b9c3a556447bf10eb775baa02b27b55ffab2f33389d32c1cb7bb2d9c82dc0" exitCode=0 Jun 11 20:31:39.778066 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.777947 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" Jun 11 20:31:39.778066 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.777980 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" event={"ID":"af887b0e-b83d-4b80-871a-d5aa152530e2","Type":"ContainerDied","Data":"8f2b9c3a556447bf10eb775baa02b27b55ffab2f33389d32c1cb7bb2d9c82dc0"} Jun 11 20:31:39.778066 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.778047 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq" event={"ID":"af887b0e-b83d-4b80-871a-d5aa152530e2","Type":"ContainerDied","Data":"1432ac2657848f4ba0ce07fde07b3ba4671361011643bdba16c73739f6174a1c"} Jun 11 20:31:39.778262 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.778076 2576 scope.go:117] "RemoveContainer" containerID="8f2b9c3a556447bf10eb775baa02b27b55ffab2f33389d32c1cb7bb2d9c82dc0" Jun 11 20:31:39.787977 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.787959 2576 scope.go:117] "RemoveContainer" containerID="8f2b9c3a556447bf10eb775baa02b27b55ffab2f33389d32c1cb7bb2d9c82dc0" Jun 11 20:31:39.788274 ip-10-0-137-247 kubenswrapper[2576]: E0611 20:31:39.788255 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f2b9c3a556447bf10eb775baa02b27b55ffab2f33389d32c1cb7bb2d9c82dc0\": container with ID starting with 8f2b9c3a556447bf10eb775baa02b27b55ffab2f33389d32c1cb7bb2d9c82dc0 not found: ID does not exist" containerID="8f2b9c3a556447bf10eb775baa02b27b55ffab2f33389d32c1cb7bb2d9c82dc0" Jun 11 20:31:39.788334 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.788280 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f2b9c3a556447bf10eb775baa02b27b55ffab2f33389d32c1cb7bb2d9c82dc0"} err="failed to get container status \"8f2b9c3a556447bf10eb775baa02b27b55ffab2f33389d32c1cb7bb2d9c82dc0\": rpc error: code = NotFound desc = could not find container \"8f2b9c3a556447bf10eb775baa02b27b55ffab2f33389d32c1cb7bb2d9c82dc0\": container with ID starting with 8f2b9c3a556447bf10eb775baa02b27b55ffab2f33389d32c1cb7bb2d9c82dc0 not found: ID does not exist" Jun 11 20:31:39.805506 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.805482 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq"] Jun 11 20:31:39.807169 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.807157 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-6b7655d5-openshift-default-587fd7cc8b-4dmdq"] Jun 11 20:31:39.835375 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.835345 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af887b0e-b83d-4b80-871a-d5aa152530e2-credential-socket\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:31:39.835375 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.835372 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af887b0e-b83d-4b80-871a-d5aa152530e2-istio-token\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:31:39.835523 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.835388 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af887b0e-b83d-4b80-871a-d5aa152530e2-workload-socket\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:31:39.835523 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.835401 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af887b0e-b83d-4b80-871a-d5aa152530e2-istio-data\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:31:39.835523 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.835414 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vb8c6\" (UniqueName: \"kubernetes.io/projected/af887b0e-b83d-4b80-871a-d5aa152530e2-kube-api-access-vb8c6\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:31:39.835523 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.835427 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af887b0e-b83d-4b80-871a-d5aa152530e2-istio-podinfo\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:31:39.835523 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.835439 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af887b0e-b83d-4b80-871a-d5aa152530e2-istio-envoy\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:31:39.835523 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:39.835453 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af887b0e-b83d-4b80-871a-d5aa152530e2-istiod-ca-cert\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:31:40.198054 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:40.198022 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af887b0e-b83d-4b80-871a-d5aa152530e2" path="/var/lib/kubelet/pods/af887b0e-b83d-4b80-871a-d5aa152530e2/volumes" Jun 11 20:31:58.010023 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.009989 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66"] Jun 11 20:31:58.010469 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.010442 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af887b0e-b83d-4b80-871a-d5aa152530e2" containerName="istio-proxy" Jun 11 20:31:58.010469 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.010456 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="af887b0e-b83d-4b80-871a-d5aa152530e2" containerName="istio-proxy" Jun 11 20:31:58.010550 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.010525 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="af887b0e-b83d-4b80-871a-d5aa152530e2" containerName="istio-proxy" Jun 11 20:31:58.013869 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.013848 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:31:58.018279 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.018254 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-fc9a85bf-openshift-default-dockercfg-fqxpv\"" Jun 11 20:31:58.031622 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.031593 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66"] Jun 11 20:31:58.108449 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.108407 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87b19731-0107-4486-8e64-17cc22be8f81-istio-envoy\") pod \"e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:31:58.108601 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.108466 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-298p4\" (UniqueName: \"kubernetes.io/projected/87b19731-0107-4486-8e64-17cc22be8f81-kube-api-access-298p4\") pod \"e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:31:58.108601 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.108528 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87b19731-0107-4486-8e64-17cc22be8f81-istiod-ca-cert\") pod \"e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:31:58.108601 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.108570 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87b19731-0107-4486-8e64-17cc22be8f81-workload-socket\") pod \"e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:31:58.109000 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.108656 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87b19731-0107-4486-8e64-17cc22be8f81-credential-socket\") pod \"e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:31:58.109000 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.108674 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87b19731-0107-4486-8e64-17cc22be8f81-workload-certs\") pod \"e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:31:58.109000 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.108691 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87b19731-0107-4486-8e64-17cc22be8f81-istio-data\") pod \"e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:31:58.109000 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.108709 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87b19731-0107-4486-8e64-17cc22be8f81-istio-token\") pod \"e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:31:58.109000 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.108788 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87b19731-0107-4486-8e64-17cc22be8f81-istio-podinfo\") pod \"e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:31:58.210286 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.210254 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87b19731-0107-4486-8e64-17cc22be8f81-istiod-ca-cert\") pod \"e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:31:58.210286 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.210292 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87b19731-0107-4486-8e64-17cc22be8f81-workload-socket\") pod \"e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:31:58.210524 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.210341 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87b19731-0107-4486-8e64-17cc22be8f81-credential-socket\") pod \"e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:31:58.210524 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.210359 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87b19731-0107-4486-8e64-17cc22be8f81-workload-certs\") pod \"e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:31:58.210524 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.210376 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87b19731-0107-4486-8e64-17cc22be8f81-istio-data\") pod \"e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:31:58.210524 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.210391 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87b19731-0107-4486-8e64-17cc22be8f81-istio-token\") pod \"e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:31:58.210524 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.210422 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87b19731-0107-4486-8e64-17cc22be8f81-istio-podinfo\") pod \"e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:31:58.210524 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.210444 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87b19731-0107-4486-8e64-17cc22be8f81-istio-envoy\") pod \"e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:31:58.210524 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.210482 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-298p4\" (UniqueName: \"kubernetes.io/projected/87b19731-0107-4486-8e64-17cc22be8f81-kube-api-access-298p4\") pod \"e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:31:58.210887 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.210842 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87b19731-0107-4486-8e64-17cc22be8f81-workload-certs\") pod \"e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:31:58.210962 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.210936 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87b19731-0107-4486-8e64-17cc22be8f81-workload-socket\") pod \"e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:31:58.211007 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.210960 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87b19731-0107-4486-8e64-17cc22be8f81-istio-data\") pod \"e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:31:58.211048 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.211010 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87b19731-0107-4486-8e64-17cc22be8f81-credential-socket\") pod \"e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:31:58.211100 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.211076 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87b19731-0107-4486-8e64-17cc22be8f81-istiod-ca-cert\") pod \"e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:31:58.212886 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.212862 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87b19731-0107-4486-8e64-17cc22be8f81-istio-envoy\") pod \"e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:31:58.213062 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.213043 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87b19731-0107-4486-8e64-17cc22be8f81-istio-podinfo\") pod \"e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:31:58.219696 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.219674 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87b19731-0107-4486-8e64-17cc22be8f81-istio-token\") pod \"e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:31:58.220228 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.220212 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-298p4\" (UniqueName: \"kubernetes.io/projected/87b19731-0107-4486-8e64-17cc22be8f81-kube-api-access-298p4\") pod \"e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:31:58.326361 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.326275 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:31:58.470581 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.470553 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66"] Jun 11 20:31:58.472900 ip-10-0-137-247 kubenswrapper[2576]: W0611 20:31:58.472868 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87b19731_0107_4486_8e64_17cc22be8f81.slice/crio-84da9ad96bc270d8656e57b8cd70cb90355b242513e5b55381aca15157f372c1 WatchSource:0}: Error finding container 84da9ad96bc270d8656e57b8cd70cb90355b242513e5b55381aca15157f372c1: Status 404 returned error can't find the container with id 84da9ad96bc270d8656e57b8cd70cb90355b242513e5b55381aca15157f372c1 Jun 11 20:31:58.475017 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.474984 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 20:31:58.475102 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.475048 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 20:31:58.475102 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.475076 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 20:31:58.874790 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.874760 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" event={"ID":"87b19731-0107-4486-8e64-17cc22be8f81","Type":"ContainerStarted","Data":"d6cdd9c488414ca16f212c37e4363bcaff54aa2eb2cc085e894bf149792fc2d6"} Jun 11 20:31:58.874976 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.874813 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" event={"ID":"87b19731-0107-4486-8e64-17cc22be8f81","Type":"ContainerStarted","Data":"84da9ad96bc270d8656e57b8cd70cb90355b242513e5b55381aca15157f372c1"} Jun 11 20:31:58.905690 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:58.899093 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" podStartSLOduration=1.89907112 podStartE2EDuration="1.89907112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:31:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:31:58.897225913 +0000 UTC m=+2519.174986676" watchObservedRunningTime="2026-06-11 20:31:58.89907112 +0000 UTC m=+2519.176831881" Jun 11 20:31:59.327300 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:59.327210 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:31:59.332153 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:59.332112 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:31:59.880116 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:59.880079 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:31:59.881184 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:31:59.881164 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:34:14.428558 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:14.428526 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66"] Jun 11 20:34:14.429106 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:14.428768 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" podUID="87b19731-0107-4486-8e64-17cc22be8f81" containerName="istio-proxy" containerID="cri-o://d6cdd9c488414ca16f212c37e4363bcaff54aa2eb2cc085e894bf149792fc2d6" gracePeriod=30 Jun 11 20:34:14.883015 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:14.882978 2576 patch_prober.go:28] interesting pod/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 11 20:34:14.883201 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:14.883043 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" podUID="87b19731-0107-4486-8e64-17cc22be8f81" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 20:34:19.566851 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:19.566806 2576 generic.go:356] "Generic (PLEG): container finished" podID="87b19731-0107-4486-8e64-17cc22be8f81" containerID="d6cdd9c488414ca16f212c37e4363bcaff54aa2eb2cc085e894bf149792fc2d6" exitCode=0 Jun 11 20:34:19.567227 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:19.566878 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" event={"ID":"87b19731-0107-4486-8e64-17cc22be8f81","Type":"ContainerDied","Data":"d6cdd9c488414ca16f212c37e4363bcaff54aa2eb2cc085e894bf149792fc2d6"} Jun 11 20:34:19.686295 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:19.686231 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:34:19.694955 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:19.694933 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87b19731-0107-4486-8e64-17cc22be8f81-istio-podinfo\") pod \"87b19731-0107-4486-8e64-17cc22be8f81\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " Jun 11 20:34:19.695090 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:19.694962 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87b19731-0107-4486-8e64-17cc22be8f81-istio-envoy\") pod \"87b19731-0107-4486-8e64-17cc22be8f81\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " Jun 11 20:34:19.695090 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:19.694990 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87b19731-0107-4486-8e64-17cc22be8f81-istio-token\") pod \"87b19731-0107-4486-8e64-17cc22be8f81\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " Jun 11 20:34:19.695090 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:19.695008 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87b19731-0107-4486-8e64-17cc22be8f81-workload-certs\") pod \"87b19731-0107-4486-8e64-17cc22be8f81\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " Jun 11 20:34:19.695090 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:19.695045 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87b19731-0107-4486-8e64-17cc22be8f81-istiod-ca-cert\") pod \"87b19731-0107-4486-8e64-17cc22be8f81\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " Jun 11 20:34:19.695090 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:19.695060 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87b19731-0107-4486-8e64-17cc22be8f81-istio-data\") pod \"87b19731-0107-4486-8e64-17cc22be8f81\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " Jun 11 20:34:19.695418 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:19.695132 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-298p4\" (UniqueName: \"kubernetes.io/projected/87b19731-0107-4486-8e64-17cc22be8f81-kube-api-access-298p4\") pod \"87b19731-0107-4486-8e64-17cc22be8f81\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " Jun 11 20:34:19.695418 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:19.695165 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87b19731-0107-4486-8e64-17cc22be8f81-workload-socket\") pod \"87b19731-0107-4486-8e64-17cc22be8f81\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " Jun 11 20:34:19.695418 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:19.695215 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87b19731-0107-4486-8e64-17cc22be8f81-credential-socket\") pod \"87b19731-0107-4486-8e64-17cc22be8f81\" (UID: \"87b19731-0107-4486-8e64-17cc22be8f81\") " Jun 11 20:34:19.695418 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:19.695396 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87b19731-0107-4486-8e64-17cc22be8f81-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "87b19731-0107-4486-8e64-17cc22be8f81" (UID: "87b19731-0107-4486-8e64-17cc22be8f81"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:34:19.695626 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:19.695473 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87b19731-0107-4486-8e64-17cc22be8f81-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "87b19731-0107-4486-8e64-17cc22be8f81" (UID: "87b19731-0107-4486-8e64-17cc22be8f81"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 20:34:19.695626 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:19.695598 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87b19731-0107-4486-8e64-17cc22be8f81-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "87b19731-0107-4486-8e64-17cc22be8f81" (UID: "87b19731-0107-4486-8e64-17cc22be8f81"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:34:19.695736 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:19.695651 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87b19731-0107-4486-8e64-17cc22be8f81-istio-data" (OuterVolumeSpecName: "istio-data") pod "87b19731-0107-4486-8e64-17cc22be8f81" (UID: "87b19731-0107-4486-8e64-17cc22be8f81"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:34:19.695736 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:19.695677 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87b19731-0107-4486-8e64-17cc22be8f81-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "87b19731-0107-4486-8e64-17cc22be8f81" (UID: "87b19731-0107-4486-8e64-17cc22be8f81"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:34:19.695846 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:19.695761 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87b19731-0107-4486-8e64-17cc22be8f81-credential-socket\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:34:19.695846 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:19.695778 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87b19731-0107-4486-8e64-17cc22be8f81-workload-certs\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:34:19.695846 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:19.695792 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87b19731-0107-4486-8e64-17cc22be8f81-istiod-ca-cert\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:34:19.695846 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:19.695804 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87b19731-0107-4486-8e64-17cc22be8f81-istio-data\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:34:19.697277 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:19.697252 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87b19731-0107-4486-8e64-17cc22be8f81-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "87b19731-0107-4486-8e64-17cc22be8f81" (UID: "87b19731-0107-4486-8e64-17cc22be8f81"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:34:19.697373 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:19.697334 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87b19731-0107-4486-8e64-17cc22be8f81-kube-api-access-298p4" (OuterVolumeSpecName: "kube-api-access-298p4") pod "87b19731-0107-4486-8e64-17cc22be8f81" (UID: "87b19731-0107-4486-8e64-17cc22be8f81"). InnerVolumeSpecName "kube-api-access-298p4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:34:19.697550 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:19.697533 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87b19731-0107-4486-8e64-17cc22be8f81-istio-token" (OuterVolumeSpecName: "istio-token") pod "87b19731-0107-4486-8e64-17cc22be8f81" (UID: "87b19731-0107-4486-8e64-17cc22be8f81"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:34:19.697632 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:19.697616 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/87b19731-0107-4486-8e64-17cc22be8f81-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "87b19731-0107-4486-8e64-17cc22be8f81" (UID: "87b19731-0107-4486-8e64-17cc22be8f81"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 20:34:19.796659 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:19.796623 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87b19731-0107-4486-8e64-17cc22be8f81-istio-token\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:34:19.796659 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:19.796653 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-298p4\" (UniqueName: \"kubernetes.io/projected/87b19731-0107-4486-8e64-17cc22be8f81-kube-api-access-298p4\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:34:19.796834 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:19.796670 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87b19731-0107-4486-8e64-17cc22be8f81-workload-socket\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:34:19.796834 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:19.796683 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87b19731-0107-4486-8e64-17cc22be8f81-istio-podinfo\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:34:19.796834 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:19.796696 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87b19731-0107-4486-8e64-17cc22be8f81-istio-envoy\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\"" Jun 11 20:34:19.797518 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:19.797490 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:34:20.573377 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:20.573298 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" Jun 11 20:34:20.573377 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:20.573310 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66" event={"ID":"87b19731-0107-4486-8e64-17cc22be8f81","Type":"ContainerDied","Data":"84da9ad96bc270d8656e57b8cd70cb90355b242513e5b55381aca15157f372c1"} Jun 11 20:34:20.573377 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:20.573366 2576 scope.go:117] "RemoveContainer" containerID="d6cdd9c488414ca16f212c37e4363bcaff54aa2eb2cc085e894bf149792fc2d6" Jun 11 20:34:20.600251 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:20.600225 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66"] Jun 11 20:34:20.603736 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:20.603715 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-fc9a85bf-openshift-default-7986bc8ff4-4tc66"] Jun 11 20:34:22.197194 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:22.197158 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87b19731-0107-4486-8e64-17cc22be8f81" path="/var/lib/kubelet/pods/87b19731-0107-4486-8e64-17cc22be8f81/volumes" Jun 11 20:34:26.293794 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:34:26.293756 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nm4xx"] Jun 11 20:35:00.419270 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:35:00.419164 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9pxm2_23de3c36-7fd1-4a71-9bff-dd7782544ca4/console-operator/1.log" Jun 11 20:35:00.423314 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:35:00.422918 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hrb9t_85a48db4-30bf-47f2-9668-8b0a67c26fe4/ovn-acl-logging/0.log" Jun 11 20:35:00.429879 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:35:00.429862 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9pxm2_23de3c36-7fd1-4a71-9bff-dd7782544ca4/console-operator/1.log" Jun 11 20:35:00.433231 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:35:00.433213 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hrb9t_85a48db4-30bf-47f2-9668-8b0a67c26fe4/ovn-acl-logging/0.log" Jun 11 20:38:57.679179 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:38:57.679114 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5f56b79599-tk8cp_838715e7-2b1d-46cf-9bbe-b3c824ca62c8/nginx/0.log" Jun 11 20:38:58.818792 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:38:58.818761 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-558786d47d-mcj82_40a16e2f-7273-41af-8654-2d331161c294/copy-manifests/0.log" Jun 11 20:38:58.825186 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:38:58.825165 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-558786d47d-mcj82_40a16e2f-7273-41af-8654-2d331161c294/manager/0.log" Jun 11 20:39:00.494321 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:00.494293 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-crwh6_fe9b4ab9-1ad3-4756-8fdc-1c454a70c997/manager/0.log" Jun 11 20:39:00.720087 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:00.720054 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-f8lht_dec8947b-07d3-434b-bb98-bab2e9283aa1/registry-server/0.log" Jun 11 20:39:00.835597 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:00.835519 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-5rkr4_2c4931f3-ed1f-467a-b609-80cbb85216b4/manager/0.log" Jun 11 20:39:00.945150 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:00.945091 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-nm4xx_5d9ad534-fe2f-414e-ae49-eb6eb9251581/limitador/0.log" Jun 11 20:39:01.062459 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:01.062426 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7gc9w_ac71096a-0dc1-432a-b3ed-269ad4e79d3a/manager/0.log" Jun 11 20:39:01.398909 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:01.398881 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97958jlhq_6458854d-28ed-49a5-981e-87b8743eef12/istio-proxy/0.log" Jun 11 20:39:01.833892 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:01.833803 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-c6ds2_4b5a2dbd-8029-40aa-aa92-baf0924ba619/istio-proxy/1.log" Jun 11 20:39:02.071067 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:02.071036 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-rz5mz_8796ffcd-d396-4632-81ce-8aeb0eaa0d91/payload-processing/0.log" Jun 11 20:39:02.511229 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:02.511198 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw_46e00143-ff83-4338-8fc4-a6853369c3a8/storage-initializer/0.log" Jun 11 20:39:02.518309 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:02.518287 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-lxcnw_46e00143-ff83-4338-8fc4-a6853369c3a8/main/0.log" Jun 11 20:39:02.984887 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:02.984860 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z_7660ff0c-820b-46b5-8f78-61b832d24756/storage-initializer/0.log" Jun 11 20:39:02.992359 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:02.992337 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-jqd7z_7660ff0c-820b-46b5-8f78-61b832d24756/main/0.log" Jun 11 20:39:10.084548 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:10.084459 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jddtw_f6a5da50-2b05-42de-8aa9-a23e838da830/global-pull-secret-syncer/0.log" Jun 11 20:39:10.248692 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:10.248660 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jm7ml_1faca528-a502-4643-9533-a66900535be2/konnectivity-agent/0.log" Jun 11 20:39:10.310806 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:10.310777 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-247.ec2.internal_e15e0f7f81589bcd73e7fe66f326b60b/haproxy/0.log" Jun 11 20:39:15.345606 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:15.345576 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-crwh6_fe9b4ab9-1ad3-4756-8fdc-1c454a70c997/manager/0.log" Jun 11 20:39:15.418360 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:15.418334 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-f8lht_dec8947b-07d3-434b-bb98-bab2e9283aa1/registry-server/0.log" Jun 11 20:39:15.505916 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:15.505885 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-5rkr4_2c4931f3-ed1f-467a-b609-80cbb85216b4/manager/0.log" Jun 11 20:39:15.528464 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:15.528439 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-nm4xx_5d9ad534-fe2f-414e-ae49-eb6eb9251581/limitador/0.log" Jun 11 20:39:15.582680 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:15.582654 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7gc9w_ac71096a-0dc1-432a-b3ed-269ad4e79d3a/manager/0.log" Jun 11 20:39:17.068673 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:17.068641 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ca9bab6d-90b7-4cda-acfc-b7baa41ca464/alertmanager/0.log" Jun 11 20:39:17.096008 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:17.095985 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ca9bab6d-90b7-4cda-acfc-b7baa41ca464/config-reloader/0.log" Jun 11 20:39:17.117271 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:17.117239 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ca9bab6d-90b7-4cda-acfc-b7baa41ca464/kube-rbac-proxy-web/0.log" Jun 11 20:39:17.140470 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:17.140452 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ca9bab6d-90b7-4cda-acfc-b7baa41ca464/kube-rbac-proxy/0.log" Jun 11 20:39:17.162357 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:17.162317 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ca9bab6d-90b7-4cda-acfc-b7baa41ca464/kube-rbac-proxy-metric/0.log" Jun 11 20:39:17.183255 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:17.183237 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ca9bab6d-90b7-4cda-acfc-b7baa41ca464/prom-label-proxy/0.log" Jun 11 20:39:17.204818 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:17.204800 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ca9bab6d-90b7-4cda-acfc-b7baa41ca464/init-config-reloader/0.log" Jun 11 20:39:17.290758 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:17.290687 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-czzc5_73909124-6142-46b9-af2a-47bf06bf1ef1/kube-state-metrics/0.log" Jun 11 20:39:17.310249 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:17.310226 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-czzc5_73909124-6142-46b9-af2a-47bf06bf1ef1/kube-rbac-proxy-main/0.log" Jun 11 20:39:17.331610 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:17.331589 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-czzc5_73909124-6142-46b9-af2a-47bf06bf1ef1/kube-rbac-proxy-self/0.log" Jun 11 20:39:17.362828 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:17.362804 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-78d4d9cc5c-h8th6_1319ebd0-5707-4873-8f3b-3776de93d36e/metrics-server/0.log" Jun 11 20:39:17.395396 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:17.395370 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-8jqqm_9f429c3c-e5ec-4b11-9b3a-82a66848414e/monitoring-plugin/0.log" Jun 11 20:39:17.567811 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:17.567736 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tl7k7_667b360e-2e24-4d54-bbbc-84722535b390/node-exporter/0.log" Jun 11 20:39:17.589465 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:17.589443 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tl7k7_667b360e-2e24-4d54-bbbc-84722535b390/kube-rbac-proxy/0.log" Jun 11 20:39:17.612027 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:17.612008 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tl7k7_667b360e-2e24-4d54-bbbc-84722535b390/init-textfile/0.log" Jun 11 20:39:17.726828 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:17.726799 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d07d433f-b7b4-45bf-8ce7-b6459e69312a/prometheus/0.log" Jun 11 20:39:17.747350 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:17.747323 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d07d433f-b7b4-45bf-8ce7-b6459e69312a/config-reloader/0.log" Jun 11 20:39:17.767604 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:17.767584 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d07d433f-b7b4-45bf-8ce7-b6459e69312a/thanos-sidecar/0.log" Jun 11 20:39:17.788612 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:17.788592 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d07d433f-b7b4-45bf-8ce7-b6459e69312a/kube-rbac-proxy-web/0.log" Jun 11 20:39:17.812647 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:17.812629 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d07d433f-b7b4-45bf-8ce7-b6459e69312a/kube-rbac-proxy/0.log" Jun 11 20:39:17.833354 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:17.833292 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d07d433f-b7b4-45bf-8ce7-b6459e69312a/kube-rbac-proxy-thanos/0.log" Jun 11 20:39:17.856357 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:17.856339 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d07d433f-b7b4-45bf-8ce7-b6459e69312a/init-config-reloader/0.log" Jun 11 20:39:20.536022 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:20.535990 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9pxm2_23de3c36-7fd1-4a71-9bff-dd7782544ca4/console-operator/1.log" Jun 11 20:39:20.541371 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:20.541348 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-9pxm2_23de3c36-7fd1-4a71-9bff-dd7782544ca4/console-operator/2.log" Jun 11 20:39:22.037910 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:22.037872 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q7ncr/perf-node-gather-daemonset-2t26k"] Jun 11 20:39:22.038372 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:22.038354 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87b19731-0107-4486-8e64-17cc22be8f81" containerName="istio-proxy" Jun 11 20:39:22.038372 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:22.038373 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="87b19731-0107-4486-8e64-17cc22be8f81" containerName="istio-proxy" Jun 11 20:39:22.038494 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:22.038481 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="87b19731-0107-4486-8e64-17cc22be8f81" containerName="istio-proxy" Jun 11 20:39:22.041917 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:22.041898 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-2t26k" Jun 11 20:39:22.044288 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:22.044265 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q7ncr\"/\"openshift-service-ca.crt\"" Jun 11 20:39:22.044415 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:22.044322 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q7ncr\"/\"kube-root-ca.crt\"" Jun 11 20:39:22.045361 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:22.045345 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-q7ncr\"/\"default-dockercfg-st6b8\"" Jun 11 20:39:22.051034 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:22.051007 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q7ncr/perf-node-gather-daemonset-2t26k"] Jun 11 20:39:22.094877 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:22.094837 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sdxw\" (UniqueName: \"kubernetes.io/projected/8bf47411-fe3b-4aaf-a653-0c0ff315eecc-kube-api-access-2sdxw\") pod \"perf-node-gather-daemonset-2t26k\" (UID: \"8bf47411-fe3b-4aaf-a653-0c0ff315eecc\") " pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-2t26k" Jun 11 20:39:22.095021 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:22.094895 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8bf47411-fe3b-4aaf-a653-0c0ff315eecc-lib-modules\") pod \"perf-node-gather-daemonset-2t26k\" (UID: \"8bf47411-fe3b-4aaf-a653-0c0ff315eecc\") " pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-2t26k" Jun 11 20:39:22.095021 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:22.094985 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bf47411-fe3b-4aaf-a653-0c0ff315eecc-sys\") pod \"perf-node-gather-daemonset-2t26k\" (UID: \"8bf47411-fe3b-4aaf-a653-0c0ff315eecc\") " pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-2t26k" Jun 11 20:39:22.095105 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:22.095039 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8bf47411-fe3b-4aaf-a653-0c0ff315eecc-proc\") pod \"perf-node-gather-daemonset-2t26k\" (UID: \"8bf47411-fe3b-4aaf-a653-0c0ff315eecc\") " pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-2t26k" Jun 11 20:39:22.095105 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:22.095085 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8bf47411-fe3b-4aaf-a653-0c0ff315eecc-podres\") pod \"perf-node-gather-daemonset-2t26k\" (UID: \"8bf47411-fe3b-4aaf-a653-0c0ff315eecc\") " pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-2t26k" Jun 11 20:39:22.195622 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:22.195593 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sdxw\" (UniqueName: \"kubernetes.io/projected/8bf47411-fe3b-4aaf-a653-0c0ff315eecc-kube-api-access-2sdxw\") pod \"perf-node-gather-daemonset-2t26k\" (UID: \"8bf47411-fe3b-4aaf-a653-0c0ff315eecc\") " pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-2t26k" Jun 11 20:39:22.195784 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:22.195633 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8bf47411-fe3b-4aaf-a653-0c0ff315eecc-lib-modules\") pod \"perf-node-gather-daemonset-2t26k\" (UID: \"8bf47411-fe3b-4aaf-a653-0c0ff315eecc\") " pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-2t26k" Jun 11 20:39:22.195784 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:22.195664 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bf47411-fe3b-4aaf-a653-0c0ff315eecc-sys\") pod \"perf-node-gather-daemonset-2t26k\" (UID: \"8bf47411-fe3b-4aaf-a653-0c0ff315eecc\") " pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-2t26k" Jun 11 20:39:22.195784 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:22.195715 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8bf47411-fe3b-4aaf-a653-0c0ff315eecc-proc\") pod \"perf-node-gather-daemonset-2t26k\" (UID: \"8bf47411-fe3b-4aaf-a653-0c0ff315eecc\") " pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-2t26k" Jun 11 20:39:22.195784 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:22.195740 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bf47411-fe3b-4aaf-a653-0c0ff315eecc-sys\") pod \"perf-node-gather-daemonset-2t26k\" (UID: \"8bf47411-fe3b-4aaf-a653-0c0ff315eecc\") " pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-2t26k" Jun 11 20:39:22.195784 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:22.195756 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8bf47411-fe3b-4aaf-a653-0c0ff315eecc-podres\") pod \"perf-node-gather-daemonset-2t26k\" (UID: \"8bf47411-fe3b-4aaf-a653-0c0ff315eecc\") " pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-2t26k" Jun 11 20:39:22.195974 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:22.195789 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8bf47411-fe3b-4aaf-a653-0c0ff315eecc-lib-modules\") pod \"perf-node-gather-daemonset-2t26k\" (UID: \"8bf47411-fe3b-4aaf-a653-0c0ff315eecc\") " pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-2t26k" Jun 11 20:39:22.195974 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:22.195810 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8bf47411-fe3b-4aaf-a653-0c0ff315eecc-proc\") pod \"perf-node-gather-daemonset-2t26k\" (UID: \"8bf47411-fe3b-4aaf-a653-0c0ff315eecc\") " pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-2t26k" Jun 11 20:39:22.195974 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:22.195902 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8bf47411-fe3b-4aaf-a653-0c0ff315eecc-podres\") pod \"perf-node-gather-daemonset-2t26k\" (UID: \"8bf47411-fe3b-4aaf-a653-0c0ff315eecc\") " pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-2t26k" Jun 11 20:39:22.203660 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:22.203634 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sdxw\" (UniqueName: \"kubernetes.io/projected/8bf47411-fe3b-4aaf-a653-0c0ff315eecc-kube-api-access-2sdxw\") pod \"perf-node-gather-daemonset-2t26k\" (UID: \"8bf47411-fe3b-4aaf-a653-0c0ff315eecc\") " pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-2t26k" Jun 11 20:39:22.352696 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:22.352668 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-2t26k" Jun 11 20:39:22.487639 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:22.487614 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q7ncr/perf-node-gather-daemonset-2t26k"] Jun 11 20:39:22.489596 ip-10-0-137-247 kubenswrapper[2576]: W0611 20:39:22.489571 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8bf47411_fe3b_4aaf_a653_0c0ff315eecc.slice/crio-24abd0227c99b18c31be4e9f44debed686ec019e3677102265c9e68afd569c29 WatchSource:0}: Error finding container 24abd0227c99b18c31be4e9f44debed686ec019e3677102265c9e68afd569c29: Status 404 returned error can't find the container with id 24abd0227c99b18c31be4e9f44debed686ec019e3677102265c9e68afd569c29 Jun 11 20:39:23.061897 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:23.061783 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-2t26k" event={"ID":"8bf47411-fe3b-4aaf-a653-0c0ff315eecc","Type":"ContainerStarted","Data":"781a5d1cd4c06f3f6c4e8e22eff5e82081bb07f50c8431c2ee7bc8ab58babd07"} Jun 11 20:39:23.061897 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:23.061868 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nqlv6_783f40b5-7d52-4433-9c0d-3bd61ebe9100/dns/0.log" Jun 11 20:39:23.061897 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:23.061879 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-2t26k" event={"ID":"8bf47411-fe3b-4aaf-a653-0c0ff315eecc","Type":"ContainerStarted","Data":"24abd0227c99b18c31be4e9f44debed686ec019e3677102265c9e68afd569c29"} Jun 11 20:39:23.062391 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:23.061914 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-2t26k" Jun 11 20:39:23.077972 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:23.077924 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-2t26k" podStartSLOduration=1.077909382 podStartE2EDuration="1.077909382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 20:39:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:39:23.076231677 +0000 UTC m=+2963.353992438" watchObservedRunningTime="2026-06-11 20:39:23.077909382 +0000 UTC m=+2963.355670139" Jun 11 20:39:23.082974 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:23.082954 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nqlv6_783f40b5-7d52-4433-9c0d-3bd61ebe9100/kube-rbac-proxy/0.log" Jun 11 20:39:23.244550 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:23.244522 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rgjlh_226f79e5-5702-495b-8ffd-d60cd1e68f19/dns-node-resolver/0.log" Jun 11 20:39:23.819951 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:23.819924 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mc6x6_98cc5ec8-4790-4b36-a80d-df6d5d1e8bf6/node-ca/0.log" Jun 11 20:39:24.796383 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:24.796345 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97958jlhq_6458854d-28ed-49a5-981e-87b8743eef12/istio-proxy/0.log" Jun 11 20:39:24.948490 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:24.948459 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-c6ds2_4b5a2dbd-8029-40aa-aa92-baf0924ba619/istio-proxy/0.log" Jun 11 20:39:24.979933 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:24.979905 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-c6ds2_4b5a2dbd-8029-40aa-aa92-baf0924ba619/istio-proxy/1.log" Jun 11 20:39:25.075084 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:25.074999 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-rz5mz_8796ffcd-d396-4632-81ce-8aeb0eaa0d91/payload-processing/0.log" Jun 11 20:39:25.755491 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:25.755451 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-76x6k_783eb1a7-0a40-4ad8-9705-e9df073f3194/serve-healthcheck-canary/0.log" Jun 11 20:39:26.469832 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:26.469800 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t2ks4_006884e0-f73c-4791-8439-a25fcaa21ddd/kube-rbac-proxy/0.log" Jun 11 20:39:26.489689 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:26.489663 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t2ks4_006884e0-f73c-4791-8439-a25fcaa21ddd/exporter/0.log" Jun 11 20:39:26.510603 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:26.510576 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t2ks4_006884e0-f73c-4791-8439-a25fcaa21ddd/extractor/0.log" Jun 11 20:39:28.760598 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:28.760565 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5f56b79599-tk8cp_838715e7-2b1d-46cf-9bbe-b3c824ca62c8/nginx/0.log" Jun 11 20:39:29.076573 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:29.076498 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-2t26k" Jun 11 20:39:29.328384 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:29.328306 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-558786d47d-mcj82_40a16e2f-7273-41af-8654-2d331161c294/manager/0.log" Jun 11 20:39:29.348019 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:29.347994 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-558786d47d-mcj82_40a16e2f-7273-41af-8654-2d331161c294/copy-manifests/0.log" Jun 11 20:39:31.033375 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:31.033325 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-d5f49777d-hnb6g_8c46bc73-0638-4e32-ac18-227a6b06364e/manager/0.log" Jun 11 20:39:35.394244 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:35.394209 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97958jlhq_6458854d-28ed-49a5-981e-87b8743eef12/istio-proxy/0.log" Jun 11 20:39:35.530391 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:35.530355 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-c6ds2_4b5a2dbd-8029-40aa-aa92-baf0924ba619/istio-proxy/0.log" Jun 11 20:39:35.564597 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:35.564553 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-c6ds2_4b5a2dbd-8029-40aa-aa92-baf0924ba619/istio-proxy/1.log" Jun 11 20:39:35.640264 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:35.640228 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-rz5mz_8796ffcd-d396-4632-81ce-8aeb0eaa0d91/payload-processing/0.log" Jun 11 20:39:36.281686 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:36.281637 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-z9pkk_cecb6c30-e660-4a9b-a275-412353c6a5b0/migrator/0.log" Jun 11 20:39:36.301478 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:36.301453 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-z9pkk_cecb6c30-e660-4a9b-a275-412353c6a5b0/graceful-termination/0.log" Jun 11 20:39:36.826275 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:36.826246 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97958jlhq_6458854d-28ed-49a5-981e-87b8743eef12/istio-proxy/0.log" Jun 11 20:39:36.944752 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:36.944721 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-c6ds2_4b5a2dbd-8029-40aa-aa92-baf0924ba619/istio-proxy/0.log" Jun 11 20:39:36.974102 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:36.974074 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-c6ds2_4b5a2dbd-8029-40aa-aa92-baf0924ba619/istio-proxy/1.log" Jun 11 20:39:37.051571 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:37.051535 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-rz5mz_8796ffcd-d396-4632-81ce-8aeb0eaa0d91/payload-processing/0.log" Jun 11 20:39:37.819399 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:37.819369 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2trvq_143be408-3d56-48e6-87d3-3e2746001044/kube-multus/0.log" Jun 11 20:39:37.878646 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:37.878619 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5d69r_02067c5b-4d64-4458-ab32-b005f9546ec9/kube-multus-additional-cni-plugins/0.log" Jun 11 20:39:37.898888 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:37.898859 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5d69r_02067c5b-4d64-4458-ab32-b005f9546ec9/egress-router-binary-copy/0.log" Jun 11 20:39:37.920597 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:37.920575 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5d69r_02067c5b-4d64-4458-ab32-b005f9546ec9/cni-plugins/0.log" Jun 11 20:39:37.941566 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:37.941547 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5d69r_02067c5b-4d64-4458-ab32-b005f9546ec9/bond-cni-plugin/0.log" Jun 11 20:39:37.962838 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:37.962821 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5d69r_02067c5b-4d64-4458-ab32-b005f9546ec9/routeoverride-cni/0.log" Jun 11 20:39:37.984675 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:37.984651 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5d69r_02067c5b-4d64-4458-ab32-b005f9546ec9/whereabouts-cni-bincopy/0.log" Jun 11 20:39:38.006409 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:38.006390 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5d69r_02067c5b-4d64-4458-ab32-b005f9546ec9/whereabouts-cni/0.log" Jun 11 20:39:38.447193 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:38.447160 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lrgwp_ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99/network-metrics-daemon/0.log" Jun 11 20:39:38.466584 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:38.466559 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lrgwp_ddd4c11f-6630-4ed1-9ef0-1d80c81fbb99/kube-rbac-proxy/0.log" Jun 11 20:39:38.721341 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:38.721250 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97958jlhq_6458854d-28ed-49a5-981e-87b8743eef12/istio-proxy/0.log" Jun 11 20:39:38.839450 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:38.839410 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-c6ds2_4b5a2dbd-8029-40aa-aa92-baf0924ba619/istio-proxy/0.log" Jun 11 20:39:38.869532 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:38.869507 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-c6ds2_4b5a2dbd-8029-40aa-aa92-baf0924ba619/istio-proxy/1.log" Jun 11 20:39:38.943442 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:38.943414 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-rz5mz_8796ffcd-d396-4632-81ce-8aeb0eaa0d91/payload-processing/0.log" Jun 11 20:39:39.411147 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:39.411106 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hrb9t_85a48db4-30bf-47f2-9668-8b0a67c26fe4/ovn-controller/0.log" Jun 11 20:39:39.428083 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:39.428059 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hrb9t_85a48db4-30bf-47f2-9668-8b0a67c26fe4/ovn-acl-logging/1.log" Jun 11 20:39:39.428221 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:39.428089 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hrb9t_85a48db4-30bf-47f2-9668-8b0a67c26fe4/ovn-acl-logging/0.log" Jun 11 20:39:39.446994 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:39.446973 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hrb9t_85a48db4-30bf-47f2-9668-8b0a67c26fe4/kube-rbac-proxy-node/0.log" Jun 11 20:39:39.467409 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:39.467383 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hrb9t_85a48db4-30bf-47f2-9668-8b0a67c26fe4/kube-rbac-proxy-ovn-metrics/0.log" Jun 11 20:39:39.484205 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:39.484183 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hrb9t_85a48db4-30bf-47f2-9668-8b0a67c26fe4/northd/0.log" Jun 11 20:39:39.502997 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:39.502977 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hrb9t_85a48db4-30bf-47f2-9668-8b0a67c26fe4/nbdb/0.log" Jun 11 20:39:39.522938 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:39.522916 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hrb9t_85a48db4-30bf-47f2-9668-8b0a67c26fe4/sbdb/0.log" Jun 11 20:39:39.568833 ip-10-0-137-247 kubenswrapper[2576]: I0611 20:39:39.568813 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hrb9t_85a48db4-30bf-47f2-9668-8b0a67c26fe4/ovnkube-controller/0.log"